00000100:00100000:1.0:1651532015.297502:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532015.297515:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467912832
00000100:00100000:1.0:1651532015.297531:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2719
00000100:00100000:1.0:1651532015.297533:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467912832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532015.297542:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.297549:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532015.297550:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532015.297551:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.297556:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.398897:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a18c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [192512->9093119] (req 192512->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.398902:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a18c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [192512->9093119] (req 192512->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532015.399348:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532015.490475:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a18c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->9093119] (req 192512->9093119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.490480:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a18c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->9093119] (req 192512->9093119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532015.490498:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467911744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 1195071us (1195109us total) trans 158913792566 rc 0/0
00000100:00100000:1.0:1651532015.490512:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2713
00010000:00010000:1.0:1651532015.490520:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a18c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->9093119] (req 192512->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.490524:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532015.490525:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a18c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->9093119] (req 192512->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.490528:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a18c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->9093119] (req 192512->9093119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.490533:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532015.490534:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532015.490535:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a193 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4452352->9924607] (req 4452352->9924607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.490538:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a193 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4452352->9924607] (req 4452352->9924607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.490550:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a18c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->9093119] (req 192512->9093119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.490553:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a18c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->9093119] (req 192512->9093119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532015.491008:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532015.491017:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467913152
00000100:00100000:1.0:1651532015.491032:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2721
00000100:00100000:1.0:1651532015.491034:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467913152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532015.491050:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.491054:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532015.491055:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a1bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.491058:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532015.491059:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.491063:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a1bd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.491067:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.615551:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a19a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->10280959] (req 282624->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.615556:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a19a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->10280959] (req 282624->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532015.615960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532015.723884:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a19a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10280959] (req 282624->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.723889:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a19a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10280959] (req 282624->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532015.723924:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467912128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 1151013us (1151036us total) trans 158913792568 rc 0/0
00000100:00100000:1.0:1651532015.723928:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2715
00010000:00010000:1.0:1651532015.723973:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [184320->10444799] (req 184320->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.723977:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [184320->10444799] (req 184320->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532015.724495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532015.724504:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467913536
00000100:00100000:1.0:1651532015.724519:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2723
00000100:00100000:1.0:1651532015.724521:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467913536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532015.724528:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a1d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.724533:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532015.724534:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a1cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->8687615] (req 397312->8687615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.724537:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532015.724538:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a1d2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->10354687] (req 2793472->10354687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.724542:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a1cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->8687615] (req 397312->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.724565:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a1d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->10354687] (req 2793472->10354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807205:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->10444799] (req 184320->10444799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807210:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->10444799] (req 184320->10444799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532015.807228:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467912320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 1174105us (1174127us total) trans 158913792569 rc 0/0
00000100:00100000:1.0:1651532015.807232:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2716
00010000:00010000:1.0:1651532015.807239:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->10444799] (req 184320->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807261:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532015.807263:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->10444799] (req 184320->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807266:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1a1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->10444799] (req 184320->10444799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807271:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532015.807272:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532015.807273:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1511424->1515519] (req 1511424->1515519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807286:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1a8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1511424->1515519] (req 1511424->1515519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807298:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1a1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->10444799] (req 184320->10444799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807301:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1a1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->10444799] (req 184320->10444799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532015.807908:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467913728
00000100:00100000:1.0:1651532015.807925:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2724
00000100:00100000:1.0:1651532015.807928:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467913728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532015.807935:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807939:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532015.807940:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a1d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->10354687] (req 2793472->10354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807943:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532015.807944:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807948:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a1d2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->10354687] (req 2793472->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.807952:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.923964:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532015.923968:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532015.924221:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532016.023919:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.023923:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.023940:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467912832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 726407us (726439us total) trans 158913792571 rc 0/0
00000100:00100000:1.0:1651532016.023944:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2719
00010000:00010000:1.0:1651532016.023952:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.023955:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532016.023956:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.023959:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.023965:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.023977:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a1b6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->1110015] (req 1105920->1110015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.024362:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532016.024398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532016.024417:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532016.024432:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467914112
00000100:00100000:1.0:1651532016.024468:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2727
00000100:00100000:1.0:1651532016.024472:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467914240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532016.024484:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.024491:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532016.024493:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532016.024494:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7946240->7950335] (req 7946240->7950335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.024497:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7946240->7950335] (req 7946240->7950335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.090733:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.090738:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.091255:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532016.223963:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.223968:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.223987:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467913152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 732952us (732979us total) trans 158913792574 rc 0/0
00000100:00100000:1.0:1651532016.223990:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2721
00010000:00010000:1.0:1651532016.223997:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224000:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532016.224002:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224005:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224010:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.224010:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.224011:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a1cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->8687615] (req 397312->8687615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224014:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a1cb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->8687615] (req 397312->8687615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224026:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224040:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a1c4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10096639] (req 1466368->10096639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.224324:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532016.224332:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467914624
00000100:00100000:1.0:1651532016.224348:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2730
00000100:00100000:1.0:1651532016.224350:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467914624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532016.224367:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a203 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224374:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532016.224376:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a1e0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7016448->7020543] (req 7016448->7020543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224381:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224386:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7946240->7950335] (req 7946240->7950335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224391:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a1f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7909376->7913471] (req 7909376->7913471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224396:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a1fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9592832->9596927] (req 9592832->9596927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224400:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532016.224409:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a203 lrc: 8/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->9850879] (req 417792->9850879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224415:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a1fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9592832->9596927] (req 9592832->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224432:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a1f5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7909376->7913471] (req 7909376->7913471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224435:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7946240->7950335] (req 7946240->7950335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224438:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224440:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a1e0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7016448->7020543] (req 7016448->7020543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.224444:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a203 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->9850879] (req 417792->9850879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.324051:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a1d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->10354687] (req 2793472->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.324056:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a1d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->10354687] (req 2793472->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.324215:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532016.440648:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a1d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2793472->10354687] (req 2793472->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.440661:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a1d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2793472->10354687] (req 2793472->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.440685:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467913536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716163us (716190us total) trans 158913792576 rc 0/0
00000100:00100000:1.0:1651532016.440689:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2723
00010000:00010000:1.0:1651532016.440735:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.440739:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.441234:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532016.441254:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467915008
00000100:00100000:1.0:1651532016.441269:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2732
00000100:00100000:1.0:1651532016.441271:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467915008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532016.441279:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.441283:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532016.441290:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a20a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->9854975] (req 815104->9854975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.441294:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532016.441294:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.441315:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a20a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->9854975] (req 815104->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.441318:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507374:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507378:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.507397:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467913728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699469us (699509us total) trans 158913792577 rc 0/0
00000100:00100000:1.0:1651532016.507401:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2724
00010000:00010000:1.0:1651532016.507408:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507411:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532016.507412:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507415:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507420:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.507421:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.507431:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a1e0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7016448->7020543] (req 7016448->7020543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507434:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a1e0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7016448->7020543] (req 7016448->7020543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507438:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.507438:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.507439:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507441:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507444:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.507444:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.507445:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7946240->7950335] (req 7946240->7950335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507448:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7946240->7950335] (req 7946240->7950335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507450:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.507451:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.507451:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a1f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7909376->7913471] (req 7909376->7913471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507454:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a1f5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7909376->7913471] (req 7909376->7913471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507457:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.507462:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.507463:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a1fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9592832->9596927] (req 9592832->9596927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507466:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a1fc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9592832->9596927] (req 9592832->9596927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507480:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507483:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a1d9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10170367] (req 835584->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507489:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7946240->7950335] (req 7946240->7950335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507492:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7946240->7950335] (req 7946240->7950335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507611:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507616:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.507829:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532016.507866:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467915200
00000100:00100000:1.0:1651532016.507884:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2733
00000100:00100000:1.0:1651532016.507886:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754467915200:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532016.507906:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507911:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532016.507912:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507915:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532016.507916:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->10469375] (req 1654784->10469375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507920:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.507923:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->10469375] (req 1654784->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640721:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7946240->7950335] (req 7946240->7950335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640725:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a1ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7946240->7950335] (req 7946240->7950335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.640749:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467914240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616277us (616331us total) trans 158913792579 rc 0/0
00000100:00100000:1.0:1651532016.640752:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2727
00010000:00010000:1.0:1651532016.640761:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a1f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7909376->7913471] (req 7909376->7913471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640776:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532016.640777:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a1f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7909376->7913471] (req 7909376->7913471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640781:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a1f5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7909376->7913471] (req 7909376->7913471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640786:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a1f5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7909376->7913471] (req 7909376->7913471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640789:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a1f5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7909376->7913471] (req 7909376->7913471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640793:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a1e0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7016448->7020543] (req 7016448->7020543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640798:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532016.640799:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a1e0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7016448->7020543] (req 7016448->7020543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640802:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a1e0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7016448->7020543] (req 7016448->7020543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640823:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a1e0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7016448->7020543] (req 7016448->7020543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640826:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a1e0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [7016448->7020543] (req 7016448->7020543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640846:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640849:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.640864:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467914048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616415us (616502us total) trans 158913792582 rc 0/0
00000100:00100000:1.0:1651532016.640867:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2726
00010000:00010000:1.0:1651532016.640874:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640877:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532016.640878:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640881:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640885:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.640886:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.640887:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a203 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [417792->9850879] (req 417792->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640889:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a203 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [417792->9850879] (req 417792->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640896:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640907:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a1e7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [585728->4476927] (req 585728->4476927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640913:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a203 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [417792->9850879] (req 417792->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.640916:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a203 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [417792->9850879] (req 417792->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.641405:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532016.641435:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467915392
00000100:00100000:1.0:1651532016.641477:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467915520
00000100:00100000:1.0:1651532016.641486:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467915904
00000100:00100000:1.0:1651532016.641493:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2734
00000100:00100000:1.0:1651532016.641500:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467915392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532016.641508:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a21f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.641513:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532016.641514:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1654784->10469375] (req 1654784->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.641516:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532016.641517:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a21f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [475136->9457663] (req 475136->9457663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.641530:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1654784->10469375] (req 1654784->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.641544:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a21f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [475136->9457663] (req 475136->9457663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.641553:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2737
00000100:00100000:1.0:1651532016.641554:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467915712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532016.641561:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.641565:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532016.641565:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532016.641566:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.641570:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.641579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532016.774013:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a203 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->9850879] (req 417792->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.774018:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a203 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->9850879] (req 417792->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.774041:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467914624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549690us (549718us total) trans 158913792583 rc 0/0
00000100:00100000:1.0:1651532016.774045:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2730
00010000:00010000:1.0:1651532016.774090:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a20a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [815104->9854975] (req 815104->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.774102:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a20a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [815104->9854975] (req 815104->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.774639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532016.774656:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467916032
00000100:00100000:1.0:1651532016.774667:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2739
00000100:00100000:1.0:1651532016.774669:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467916032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532016.774676:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a242 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.774681:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532016.774682:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a226 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->1474559] (req 1470464->1474559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.774685:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a23b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2146304->8691711] (req 2146304->8691711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.774687:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532016.774688:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a242 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9715711] (req 172032->9715711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.774692:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a23b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2146304->8691711] (req 2146304->8691711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.774695:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a226 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->1474559] (req 1470464->1474559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.774711:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a242 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9715711] (req 172032->9715711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.882629:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a20a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->9854975] (req 815104->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.882634:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a20a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->9854975] (req 815104->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.882657:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467914816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 558366us (558442us total) trans 158913792584 rc 0/0
00000100:00100000:1.0:1651532016.882660:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2731
00010000:00010000:1.0:1651532016.882694:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.882699:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.883120:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532016.883137:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467916224
00000100:00100000:1.0:1651532016.883148:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2740
00000100:00100000:1.0:1651532016.883149:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467916224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532016.883157:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a249 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.883161:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532016.883171:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a242 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9715711] (req 172032->9715711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.883174:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532016.883175:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a249 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [716800->9523199] (req 716800->9523199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.883180:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a242 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9715711] (req 172032->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.883183:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a249 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [716800->9523199] (req 716800->9523199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.940765:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.940769:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.940787:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467915008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499515us (499553us total) trans 158913792585 rc 0/0
00000100:00100000:1.0:1651532016.940790:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2732
00010000:00010000:1.0:1651532016.940797:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.940801:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532016.940816:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.940830:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.940835:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.940836:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532016.940837:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->10469375] (req 1654784->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.940840:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->10469375] (req 1654784->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.940848:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.940851:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a211 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->6529023] (req 2338816->6529023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.940856:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1654784->10469375] (req 1654784->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.940860:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1654784->10469375] (req 1654784->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532016.941281:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532016.941289:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467916416
00000100:00100000:1.0:1651532016.941300:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2741
00000100:00100000:1.0:1651532016.941303:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467916416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532016.941326:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a250 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.941333:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532016.941334:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a249 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [716800->9523199] (req 716800->9523199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.941339:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532016.941341:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a250 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1630208->9805823] (req 1630208->9805823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.941348:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a249 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [716800->9523199] (req 716800->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532016.941353:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a250 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1630208->9805823] (req 1630208->9805823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.067884:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->10469375] (req 1654784->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.067888:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a218 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->10469375] (req 1654784->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.067911:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467915200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 560024us (560083us total) trans 158913792586 rc 0/0
00000100:00100000:1.0:1651532017.067914:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2733
00010000:00010000:1.0:1651532017.067955:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a21f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->9457663] (req 475136->9457663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.067970:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a21f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [475136->9457663] (req 475136->9457663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.068503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532017.068512:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467916608
00000100:00100000:1.0:1651532017.068533:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2742
00000100:00100000:1.0:1651532017.068535:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467916608:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532017.068547:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.068552:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532017.068553:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a250 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1630208->9805823] (req 1630208->9805823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.068555:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532017.068556:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.068568:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a250 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1630208->9805823] (req 1630208->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.068571:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.254950:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a21f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9457663] (req 475136->9457663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.254965:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a21f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9457663] (req 475136->9457663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.254989:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467915392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 613488us (613587us total) trans 158913792587 rc 0/0
00000100:00100000:1.0:1651532017.254992:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2734
00010000:00010000:1.0:1651532017.255054:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.255058:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.255567:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532017.255575:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467916800
00000100:00100000:1.0:1651532017.255586:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2743
00000100:00100000:1.0:1651532017.255588:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754467916800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532017.255596:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a25e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.255600:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532017.255601:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.255604:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532017.255605:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a25e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->10137599] (req 8192->10137599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.255621:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.255625:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a25e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->10137599] (req 8192->10137599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339055:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339065:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.339088:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467915712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 697533us (697643us total) trans 158913792589 rc 0/0
00000100:00100000:1.0:1651532017.339092:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2737
00010000:00010000:1.0:1651532017.339101:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339104:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532017.339106:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339109:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339115:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339129:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a234 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4173824->4177919] (req 4173824->4177919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339133:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a22d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5357568->5361663] (req 5357568->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339135:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532017.339136:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a22d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5357568->5361663] (req 5357568->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339139:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a22d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5357568->5361663] (req 5357568->5361663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339142:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532017.339143:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532017.339144:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a23b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2146304->8691711] (req 2146304->8691711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339147:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a23b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2146304->8691711] (req 2146304->8691711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339156:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a22d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5357568->5361663] (req 5357568->5361663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.339160:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a22d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5357568->5361663] (req 5357568->5361663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.339529:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532017.390924:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a242 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->9715711] (req 172032->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.390929:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a242 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [172032->9715711] (req 172032->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.391298:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532017.499168:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a242 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [172032->9715711] (req 172032->9715711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.499173:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a242 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [172032->9715711] (req 172032->9715711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.499196:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467916032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724527us (724557us total) trans 158913792592 rc 0/0
00000100:00100000:1.0:1651532017.499200:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2739
00010000:00010000:1.0:1651532017.499243:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a249 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [716800->9523199] (req 716800->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.499257:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a249 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [716800->9523199] (req 716800->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.499719:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532017.499728:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467917376
00000100:00100000:1.0:1651532017.499740:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2746
00000100:00100000:1.0:1651532017.499742:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467917376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532017.499749:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.499764:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532017.499765:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a26c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [233472->10108927] (req 233472->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.499768:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532017.499769:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [131072->9895935] (req 131072->9895935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.499774:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a26c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [233472->10108927] (req 233472->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.499777:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [131072->9895935] (req 131072->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.607518:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a249 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [716800->9523199] (req 716800->9523199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.607523:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a249 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [716800->9523199] (req 716800->9523199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.607546:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467916224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724395us (724426us total) trans 158913792593 rc 0/0
00000100:00100000:1.0:1651532017.607549:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2740
00010000:00010000:1.0:1651532017.607598:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a250 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1630208->9805823] (req 1630208->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.607603:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a250 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1630208->9805823] (req 1630208->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.607975:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532017.608020:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467917568
00000100:00100000:1.0:1651532017.608031:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2747
00000100:00100000:1.0:1651532017.608033:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467917568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532017.608039:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a27a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.608044:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532017.608045:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [131072->9895935] (req 131072->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.608048:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532017.608049:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a27a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [258048->8101887] (req 258048->8101887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.608053:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [131072->9895935] (req 131072->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.608056:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a27a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [258048->8101887] (req 258048->8101887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.740845:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a250 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1630208->9805823] (req 1630208->9805823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.740850:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a250 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1630208->9805823] (req 1630208->9805823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.740883:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467916416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799579us (799603us total) trans 158913792594 rc 0/0
00000100:00100000:1.0:1651532017.740887:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2741
00010000:00010000:1.0:1651532017.740936:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.740940:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.741365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532017.741387:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467917760
00000100:00100000:1.0:1651532017.741401:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2748
00000100:00100000:1.0:1651532017.741402:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467917760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532017.741412:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.741418:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532017.741420:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a27a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [258048->8101887] (req 258048->8101887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.741422:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532017.741423:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.741428:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a27a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [258048->8101887] (req 258048->8101887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.741449:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532017.824267:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532016 -> 1651532017
00002000:00010000:1.0:1651532017.824269:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532016 -> 1651532017
00010000:00010000:1.0:1651532017.824272:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.824276:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.824294:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467916608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 755759us (755792us total) trans 158913792595 rc 0/0
00000100:00100000:1.0:1651532017.824298:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2742
00010000:00010000:1.0:1651532017.824305:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.824308:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532017.824309:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.824312:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.824317:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532017.824318:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532017.824319:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a25e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8192->10137599] (req 8192->10137599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.824331:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a25e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8192->10137599] (req 8192->10137599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.824339:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.824342:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a257 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.824347:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a25e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8192->10137599] (req 8192->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.824350:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a25e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8192->10137599] (req 8192->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.824985:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532017.824993:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467917952
00000100:00100000:1.0:1651532017.825005:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2749
00000100:00100000:1.0:1651532017.825007:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467917952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532017.825014:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.825019:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532017.825020:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.825023:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532017.825033:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1056768->9867263] (req 1056768->9867263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.825038:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.825042:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1056768->9867263] (req 1056768->9867263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.888122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00010000:00010000:1.0:1651532017.941462:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a25e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8192->10137599] (req 8192->10137599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.941467:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a25e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8192->10137599] (req 8192->10137599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532017.941489:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467916800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 685900us (685923us total) trans 158913792596 rc 0/0
00000100:00100000:1.0:1651532017.941493:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2743
00000100:00100000:1.0:1651532017.942109:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532017.942119:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467918144
00000100:00100000:1.0:1651532017.942132:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2750
00000100:00100000:1.0:1651532017.942134:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467918144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532017.942142:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.942148:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532017.942149:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1056768->9867263] (req 1056768->9867263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.942165:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532017.942166:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.942171:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1056768->9867263] (req 1056768->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532017.942174:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.033566:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532018.133180:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a26c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [233472->10108927] (req 233472->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.133185:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532018.133186:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a26c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [233472->10108927] (req 233472->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.133190:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a26c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [233472->10108927] (req 233472->10108927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.133196:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532018.133197:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532018.133198:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [131072->9895935] (req 131072->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.133201:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [131072->9895935] (req 131072->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.133229:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a26c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [233472->10108927] (req 233472->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.133233:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a26c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [233472->10108927] (req 233472->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.133239:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [131072->9895935] (req 131072->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.133242:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [131072->9895935] (req 131072->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.199870:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [131072->9895935] (req 131072->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.199876:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a273 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [131072->9895935] (req 131072->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.199900:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467917376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 700157us (700181us total) trans 158913792599 rc 0/0
00000100:00100000:1.0:1651532018.199904:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2746
00000100:00100000:1.0:1651532018.200478:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532018.200487:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467918720
00000100:00100000:1.0:1651532018.200499:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2753
00000100:00100000:1.0:1651532018.200501:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467918720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532018.200508:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.200521:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532018.200523:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a29d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1302528->8511487] (req 1302528->8511487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.200526:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532018.200527:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.200531:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a29d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1302528->8511487] (req 1302528->8511487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.200535:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.308310:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.308315:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.308653:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532018.416581:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.416587:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.416606:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467917760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 675202us (675242us total) trans 158913792601 rc 0/0
00000100:00100000:1.0:1651532018.416619:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2748
00010000:00010000:1.0:1651532018.416627:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.416631:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532018.416632:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.416635:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.416640:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532018.416641:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532018.416642:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1056768->9867263] (req 1056768->9867263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.416645:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1056768->9867263] (req 1056768->9867263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.416652:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.416655:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a281 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->9043967] (req 2252800->9043967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.416660:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1056768->9867263] (req 1056768->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.416663:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1056768->9867263] (req 1056768->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.417100:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532018.417118:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467919104
00000100:00100000:1.0:1651532018.417130:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2755
00000100:00100000:1.0:1651532018.417132:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467919104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532018.417140:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a2b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.417144:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532018.417145:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a2ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2215936->7806975] (req 2215936->7806975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.417148:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532018.417149:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a2b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1593344->9338879] (req 1593344->9338879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.417153:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a2ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2215936->7806975] (req 2215936->7806975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.417157:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a2b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1593344->9338879] (req 1593344->9338879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.499954:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1056768->9867263] (req 1056768->9867263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.499958:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a288 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1056768->9867263] (req 1056768->9867263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.499992:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467917952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674984us (675007us total) trans 158913792602 rc 0/0
00000100:00100000:1.0:1651532018.499995:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2749
00010000:00010000:1.0:1651532018.500037:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.500042:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.500579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532018.500587:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467919296
00000100:00100000:1.0:1651532018.500598:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2756
00000100:00100000:1.0:1651532018.500600:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467919296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532018.500607:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.500611:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532018.500627:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a2b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1593344->9338879] (req 1593344->9338879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.500630:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532018.500631:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.500636:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a2b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1593344->9338879] (req 1593344->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.500650:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.624949:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.624954:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.624973:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467918144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 682838us (682865us total) trans 158913792603 rc 0/0
00000100:00100000:1.0:1651532018.624976:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2750
00010000:00010000:1.0:1651532018.624984:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.624987:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532018.624988:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.624991:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.624996:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532018.624997:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532018.624998:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a296 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [602112->8499199] (req 602112->8499199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.625012:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a296 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [602112->8499199] (req 602112->8499199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.625024:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.625027:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a28f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->9744383] (req 176128->9744383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.625605:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532018.625613:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467919488
00000100:00100000:1.0:1651532018.625624:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2757
00000100:00100000:1.0:1651532018.625626:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467919488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532018.625633:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a2c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.625638:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532018.625639:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.625642:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532018.625642:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a2c0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [163840->9039871] (req 163840->9039871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.625655:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.625662:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a2c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [163840->9039871] (req 163840->9039871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.717007:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532018.816732:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.816737:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.817000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532018.925037:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925042:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.925061:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467918720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724560us (724584us total) trans 158913792606 rc 0/0
00000100:00100000:1.0:1651532018.925065:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2753
00010000:00010000:1.0:1651532018.925072:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925076:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532018.925077:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925080:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925097:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532018.925098:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532018.925099:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a2ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2215936->7806975] (req 2215936->7806975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925102:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a2ab lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2215936->7806975] (req 2215936->7806975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925114:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925117:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2a4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [757760->10186751] (req 757760->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532018.925679:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532018.925689:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467920064
00000100:00100000:1.0:1651532018.925700:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2760
00000100:00100000:1.0:1651532018.925702:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467920064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532018.925709:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a2d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925714:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532018.925715:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a2ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5017600->9711615] (req 5017600->9711615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925718:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532018.925718:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a2d5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1409024->10264575] (req 1409024->10264575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925733:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a2ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5017600->9711615] (req 5017600->9711615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532018.925737:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a2d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1409024->10264575] (req 1409024->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.041760:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a2b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1593344->9338879] (req 1593344->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.041764:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a2b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1593344->9338879] (req 1593344->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.042148:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532019.170829:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a2b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1593344->9338879] (req 1593344->9338879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.170833:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a2b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1593344->9338879] (req 1593344->9338879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.170856:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467919104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 753723us (753757us total) trans 158913792608 rc 0/0
00000100:00100000:1.0:1651532019.170860:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2755
00010000:00010000:1.0:1651532019.170907:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.170911:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.171216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532019.171226:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467920448
00000100:00100000:1.0:1651532019.171237:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2762
00000100:00100000:1.0:1651532019.171239:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467920448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532019.171262:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.171267:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532019.171268:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a2dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2322432->9809919] (req 2322432->9809919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.171271:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532019.171272:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1744896->9490431] (req 1744896->9490431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.171276:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a2dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2322432->9809919] (req 2322432->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.171280:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1744896->9490431] (req 1744896->9490431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.295763:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.295768:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.295797:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467919296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 795196us (795218us total) trans 158913792609 rc 0/0
00000100:00100000:1.0:1651532019.295800:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2756
00010000:00010000:1.0:1651532019.295825:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.295829:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532019.295830:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.295833:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.295838:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532019.295839:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532019.295840:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a2c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [163840->9039871] (req 163840->9039871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.295843:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a2c0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [163840->9039871] (req 163840->9039871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.295850:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.295853:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2b9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9818111] (req 929792->9818111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.295858:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a2c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [163840->9039871] (req 163840->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.295880:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a2c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [163840->9039871] (req 163840->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.296420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532019.296429:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467920640
00000100:00100000:1.0:1651532019.296440:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2763
00000100:00100000:1.0:1651532019.296442:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467920640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532019.296449:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a2ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.296453:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532019.296454:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1744896->9490431] (req 1744896->9490431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.296480:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532019.296481:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a2ea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [602112->9658367] (req 602112->9658367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.296486:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1744896->9490431] (req 1744896->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.296490:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a2ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [602112->9658367] (req 602112->9658367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.370845:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a2c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [163840->9039871] (req 163840->9039871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.370859:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a2c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [163840->9039871] (req 163840->9039871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.370881:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467919488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 745254us (745276us total) trans 158913792610 rc 0/0
00000100:00100000:1.0:1651532019.370884:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2757
00010000:00010000:1.0:1651532019.370921:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a2c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2121728->6991871] (req 2121728->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.370933:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a2c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2121728->6991871] (req 2121728->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.371518:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532019.371526:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467920832
00000100:00100000:1.0:1651532019.371537:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2764
00000100:00100000:1.0:1651532019.371539:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467920832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532019.371546:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.371550:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532019.371551:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a2ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [602112->9658367] (req 602112->9658367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.371554:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532019.371555:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.371571:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a2ea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [602112->9658367] (req 602112->9658367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.371575:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.529112:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a2c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2121728->6991871] (req 2121728->6991871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.529117:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a2c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2121728->6991871] (req 2121728->6991871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.529141:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467919680:12345-10.240.43.64@tcp:4:fio.0 Request processed in 812093us (812134us total) trans 158913792611 rc 0/0
00000100:00100000:1.0:1651532019.529145:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2758
00000100:00100000:1.0:1651532019.529546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532019.529583:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532019.529592:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467921024
00000100:00100000:1.0:1651532019.529608:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467921216
00000100:00100000:1.0:1651532019.529615:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2765
00000100:00100000:1.0:1651532019.529617:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467921024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532019.529624:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a2f8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.529629:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532019.529630:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.529644:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532019.529645:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a2f8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->10055679] (req 385024->10055679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.529657:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.529661:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a2f8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->10055679] (req 385024->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.662535:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a2d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1409024->10264575] (req 1409024->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.662539:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a2d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1409024->10264575] (req 1409024->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.662907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532019.779457:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a2d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1409024->10264575] (req 1409024->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.779461:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a2d5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1409024->10264575] (req 1409024->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.779483:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467920064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 853780us (853804us total) trans 158913792613 rc 0/0
00000100:00100000:1.0:1651532019.779487:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2760
00000100:00100000:1.0:1651532019.780044:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532019.780093:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467921536
00000100:00100000:1.0:1651532019.780104:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2768
00000100:00100000:1.0:1651532019.780106:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467921536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532019.780113:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a30d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.780118:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532019.780119:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a2ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2736128->2740223] (req 2736128->2740223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.780122:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a306 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2768896->8933375] (req 2768896->8933375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.780124:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532019.780125:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a30d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [897024->10215423] (req 897024->10215423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.780129:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a306 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2768896->8933375] (req 2768896->8933375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.780132:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a2ff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2736128->2740223] (req 2736128->2740223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.780135:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a30d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [897024->10215423] (req 897024->10215423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.829222:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a2dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2322432->9809919] (req 2322432->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.829238:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532019.829239:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a2dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2322432->9809919] (req 2322432->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.829242:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a2dc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2322432->9809919] (req 2322432->9809919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.829258:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532019.829259:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532019.829260:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1744896->9490431] (req 1744896->9490431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.829263:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1744896->9490431] (req 1744896->9490431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.829271:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a2dc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2322432->9809919] (req 2322432->9809919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.829274:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a2dc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2322432->9809919] (req 2322432->9809919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.829280:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1744896->9490431] (req 1744896->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.829283:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1744896->9490431] (req 1744896->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.829680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532019.929302:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1744896->9490431] (req 1744896->9490431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.929307:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a2e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1744896->9490431] (req 1744896->9490431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.929328:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467920448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 758089us (758118us total) trans 158913792615 rc 0/0
00000100:00100000:1.0:1651532019.929332:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2762
00010000:00010000:1.0:1651532019.929390:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a2ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [602112->9658367] (req 602112->9658367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.929395:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a2ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [602112->9658367] (req 602112->9658367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.929734:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532019.929751:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467921920
00000100:00100000:1.0:1651532019.929762:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2770
00000100:00100000:1.0:1651532019.929764:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467921920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532019.929771:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.929776:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532019.929777:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a314 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2011136->9019391] (req 2011136->9019391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.929779:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532019.929780:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1785856->8957951] (req 1785856->8957951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.929797:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a314 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2011136->9019391] (req 2011136->9019391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.929801:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1785856->8957951] (req 1785856->8957951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.995967:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a2ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [602112->9658367] (req 602112->9658367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.995971:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a2ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [602112->9658367] (req 602112->9658367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.995993:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467920640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699550us (699573us total) trans 158913792616 rc 0/0
00000100:00100000:1.0:1651532019.995996:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2763
00010000:00010000:1.0:1651532019.996042:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.996046:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532019.996611:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532019.996619:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467922112
00000100:00100000:1.0:1651532019.996630:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2771
00000100:00100000:1.0:1651532019.996632:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467922112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532019.996639:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a322 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.996653:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532019.996654:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1785856->8957951] (req 1785856->8957951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.996657:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532019.996658:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a322 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->10465279] (req 1495040->10465279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.996662:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1785856->8957951] (req 1785856->8957951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532019.996666:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a322 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->10465279] (req 1495040->10465279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.062675:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.062680:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.062697:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467920832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691157us (691180us total) trans 158913792617 rc 0/0
00000100:00100000:1.0:1651532020.062700:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2764
00010000:00010000:1.0:1651532020.062707:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.062711:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532020.062720:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.062724:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.062729:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.062730:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.062731:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a2f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->10055679] (req 385024->10055679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.062734:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a2f8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->10055679] (req 385024->10055679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.062741:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.062744:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a2f1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->10301439] (req 880640->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.062749:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a2f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [385024->10055679] (req 385024->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.062752:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a2f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [385024->10055679] (req 385024->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.063330:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532020.063338:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467922304
00000100:00100000:1.0:1651532020.063348:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2772
00000100:00100000:1.0:1651532020.063350:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467922304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532020.063368:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.063372:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532020.063373:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a322 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->10465279] (req 1495040->10465279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.063376:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532020.063377:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.063381:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a322 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->10465279] (req 1495040->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.063384:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.146045:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a2f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->10055679] (req 385024->10055679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.146049:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a2f8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->10055679] (req 385024->10055679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.146071:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467921024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616453us (616525us total) trans 158913792618 rc 0/0
00000100:00100000:1.0:1651532020.146074:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2765
00000100:00100000:1.0:1651532020.146420:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532020.146436:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532020.146464:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467922496
00000100:00100000:1.0:1651532020.146473:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467922560
00000100:00100000:1.0:1651532020.146483:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2773
00000100:00100000:1.0:1651532020.146484:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467922496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532020.146492:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.146497:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532020.146497:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.146500:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532020.146501:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.146505:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.146509:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.146516:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2774
00000100:00100000:1.0:1651532020.146518:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467922560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532020.146522:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a337 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.146525:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532020.146526:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532020.146527:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a337 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->2969599] (req 2965504->2969599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.146537:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a337 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->2969599] (req 2965504->2969599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287044:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a306 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->8933375] (req 2768896->8933375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287054:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532020.287055:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a306 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->8933375] (req 2768896->8933375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287059:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a306 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->8933375] (req 2768896->8933375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287064:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.287065:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.287066:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a30d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [897024->10215423] (req 897024->10215423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287069:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a30d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [897024->10215423] (req 897024->10215423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287076:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a306 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2768896->8933375] (req 2768896->8933375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287079:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a306 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2768896->8933375] (req 2768896->8933375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287085:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a30d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [897024->10215423] (req 897024->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287097:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a30d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [897024->10215423] (req 897024->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.287354:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532020.287374:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532020.287412:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2776
00000100:00100000:1.0:1651532020.287414:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467922816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532020.287422:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a345 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287426:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532020.287427:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532020.287428:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a345 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9887744->9891839] (req 9887744->9891839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.287431:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a345 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9887744->9891839] (req 9887744->9891839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.354427:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a30d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10215423] (req 897024->10215423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.354432:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a30d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10215423] (req 897024->10215423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.354454:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467921536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574347us (574410us total) trans 158913792621 rc 0/0
00000100:00100000:1.0:1651532020.354457:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2768
00000100:00100000:1.0:1651532020.355036:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532020.355071:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467923008
00000100:00100000:1.0:1651532020.355085:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2777
00000100:00100000:1.0:1651532020.355087:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467923008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532020.355094:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a34c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.355098:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.355099:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a33e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->3784703] (req 655360->3784703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.355102:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532020.355103:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a34c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.355107:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a33e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->3784703] (req 655360->3784703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.355110:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a34c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.490832:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a314 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2011136->9019391] (req 2011136->9019391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.490837:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532020.490838:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a314 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2011136->9019391] (req 2011136->9019391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.490841:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a314 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2011136->9019391] (req 2011136->9019391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.490855:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.490856:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.490857:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->8957951] (req 1785856->8957951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.490860:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->8957951] (req 1785856->8957951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.490867:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a314 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2011136->9019391] (req 2011136->9019391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.490878:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a314 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2011136->9019391] (req 2011136->9019391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.490884:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1785856->8957951] (req 1785856->8957951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.490887:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1785856->8957951] (req 1785856->8957951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.621086:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->8957951] (req 1785856->8957951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.621090:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a31b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->8957951] (req 1785856->8957951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.621114:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467921920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691349us (691381us total) trans 158913792623 rc 0/0
00000100:00100000:1.0:1651532020.621127:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2770
00000100:00100000:1.0:1651532020.621453:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532020.621462:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467923392
00000100:00100000:1.0:1651532020.621477:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2779
00000100:00100000:1.0:1651532020.621479:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467923392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532020.621486:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a35a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.621491:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532020.621492:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a353 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8974335] (req 1159168->8974335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.621495:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532020.621496:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a35a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->8916991] (req 1069056->8916991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.621500:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a353 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8974335] (req 1159168->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.621503:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a35a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->8916991] (req 1069056->8916991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.784820:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a322 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10465279] (req 1495040->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.784825:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532020.784836:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a322 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10465279] (req 1495040->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.784848:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a322 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10465279] (req 1495040->10465279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.784853:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.784854:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.784854:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.784858:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.784865:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a322 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10465279] (req 1495040->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.784868:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a322 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->10465279] (req 1495040->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.785466:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532020.896057:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896062:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532020.896063:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896066:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896082:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.896083:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.896084:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896087:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896090:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.896090:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532020.896091:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a337 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->2969599] (req 2965504->2969599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896094:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a337 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->2969599] (req 2965504->2969599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896110:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896113:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a329 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10481663] (req 843776->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896119:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a337 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2965504->2969599] (req 2965504->2969599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896122:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a337 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2965504->2969599] (req 2965504->2969599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896183:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.896194:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.896352:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532020.987790:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a337 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->2969599] (req 2965504->2969599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.987794:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a337 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->2969599] (req 2965504->2969599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.987830:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467922560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841311us (841393us total) trans 158913792626 rc 0/0
00000100:00100000:1.0:1651532020.987834:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2774
00010000:00010000:1.0:1651532020.987849:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.987852:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.987863:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467922496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841378us (841444us total) trans 158913792627 rc 0/0
00000100:00100000:1.0:1651532020.987866:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2773
00010000:00010000:1.0:1651532020.987871:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.987879:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532020.987891:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.987894:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.987901:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.987904:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a330 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.987910:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a345 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9887744->9891839] (req 9887744->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.987913:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a345 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9887744->9891839] (req 9887744->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532020.988244:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467923968
00000100:00100000:1.0:1651532020.988267:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2782
00000100:00100000:1.0:1651532020.988269:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467923968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532020.988281:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a36f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.988286:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532020.988287:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a368 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [520192->10416127] (req 520192->10416127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.988290:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532020.988299:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a36f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->9879551] (req 987136->9879551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.988304:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a368 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10416127] (req 520192->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532020.988325:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a36f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->9879551] (req 987136->9879551) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079494:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a33e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->3784703] (req 655360->3784703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079499:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532021.079500:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a33e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->3784703] (req 655360->3784703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079503:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a33e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->3784703] (req 655360->3784703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079509:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.079510:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.079511:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a34c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079514:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a34c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079517:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.079518:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.079518:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a353 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8974335] (req 1159168->8974335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079530:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a353 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8974335] (req 1159168->8974335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079553:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a33e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->3784703] (req 655360->3784703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079556:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a33e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->3784703] (req 655360->3784703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079560:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a345 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9887744->9891839] (req 9887744->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079567:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532021.079568:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a345 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9887744->9891839] (req 9887744->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079571:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a345 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9887744->9891839] (req 9887744->9891839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079576:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a345 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9887744->9891839] (req 9887744->9891839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079579:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a345 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9887744->9891839] (req 9887744->9891839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079584:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a34c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.079597:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a34c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.197481:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a34c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.197491:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a34c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532021.197507:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467923008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 842419us (842472us total) trans 158913792630 rc 0/0
00000100:00100000:1.0:1651532021.197511:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2777
00010000:00010000:1.0:1651532021.197518:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a353 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8974335] (req 1159168->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.197522:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532021.197523:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a353 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8974335] (req 1159168->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.197526:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a353 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8974335] (req 1159168->8974335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.197531:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.197532:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.197532:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a35a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->8916991] (req 1069056->8916991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.197535:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a35a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->8916991] (req 1069056->8916991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.197558:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a353 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1159168->8974335] (req 1159168->8974335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.197561:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a353 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1159168->8974335] (req 1159168->8974335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.197567:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a35a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->8916991] (req 1069056->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.197570:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a35a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->8916991] (req 1069056->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532021.198113:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467924672
00000100:00100000:1.0:1651532021.198133:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467924544
00000100:00100000:1.0:1651532021.198141:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2787
00000100:00100000:1.0:1651532021.198143:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467924544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532021.198149:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.198175:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.198176:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a38b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->4276223] (req 57344->4276223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.198179:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532021.198180:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.198184:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a38b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->4276223] (req 57344->4276223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.198195:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.396208:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a361 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4526080->10215423] (req 4526080->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.396214:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532021.396215:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a361 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4526080->10215423] (req 4526080->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.396218:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a361 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4526080->10215423] (req 4526080->10215423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.396224:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.396225:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.396226:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a368 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10416127] (req 520192->10416127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.396229:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a368 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10416127] (req 520192->10416127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.396239:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a361 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4526080->10215423] (req 4526080->10215423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.396242:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a361 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4526080->10215423] (req 4526080->10215423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.487986:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a36f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->9879551] (req 987136->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.488000:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a36f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->9879551] (req 987136->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.605855:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a36f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->9879551] (req 987136->9879551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.605860:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a36f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->9879551] (req 987136->9879551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532021.605883:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467923968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 617613us (617655us total) trans 158913792635 rc 0/0
00000100:00100000:1.0:1651532021.605887:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2782
00000100:00100000:1.0:1651532021.606170:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467925568
00000100:00100000:1.0:1651532021.606191:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2791
00000100:00100000:1.0:1651532021.606193:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467925568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532021.606201:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.606207:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532021.606208:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a3a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->7512063] (req 212992->7512063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.606211:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532021.606211:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.606216:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a3a7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->7512063] (req 212992->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.606229:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697706:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a37d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->1277951] (req 1273856->1277951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697711:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532021.697712:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a37d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->1277951] (req 1273856->1277951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697715:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a37d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->1277951] (req 1273856->1277951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697721:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a37d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->1277951] (req 1273856->1277951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697724:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a37d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->1277951] (req 1273856->1277951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697728:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a376 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2306048->2310143] (req 2306048->2310143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697730:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532021.697731:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a376 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2306048->2310143] (req 2306048->2310143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697734:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a376 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2306048->2310143] (req 2306048->2310143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697747:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.697748:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.697749:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697752:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697762:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a376 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2306048->2310143] (req 2306048->2310143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697765:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a376 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2306048->2310143] (req 2306048->2310143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697776:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.697779:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532021.697991:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532021.698013:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00010000:1.0:1651532021.756041:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532020 -> 1651532021
00010000:00010000:1.0:1651532021.756045:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756049:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532021.756079:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467924416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 676020us (676113us total) trans 158913792638 rc 0/0
00000100:00100000:1.0:1651532021.756082:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2785
00010000:00010000:1.0:1651532021.756090:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756093:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532021.756094:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756097:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756102:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.756103:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.756104:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a38b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->4276223] (req 57344->4276223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756107:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a38b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->4276223] (req 57344->4276223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756119:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756122:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a384 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->6311935] (req 90112->6311935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532021.756497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532021.756511:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467926016
00000100:00100000:1.0:1651532021.756525:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2794
00000100:00100000:1.0:1651532021.756528:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467926016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532021.756535:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756539:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.756540:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a3b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->9551871] (req 307200->9551871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756543:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532021.756544:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756549:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a3b5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->9551871] (req 307200->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.756552:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.864375:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a38b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->4276223] (req 57344->4276223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.864379:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532021.864380:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a38b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->4276223] (req 57344->4276223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.864383:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a38b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->4276223] (req 57344->4276223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.864400:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.864400:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.864401:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.864404:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.864412:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a38b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->4276223] (req 57344->4276223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.864415:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a38b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->4276223] (req 57344->4276223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.864429:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.864432:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532021.864659:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532021.931094:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931099:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532021.931121:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467924544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 732977us (733018us total) trans 158913792640 rc 0/0
00000100:00100000:1.0:1651532021.931136:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2787
00010000:00010000:1.0:1651532021.931145:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931148:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532021.931149:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931152:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931166:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.931166:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532021.931167:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a399 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10027007] (req 212992->10027007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931170:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a399 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10027007] (req 212992->10027007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931182:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931185:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a392 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532021.931340:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467926400
00000100:00100000:1.0:1651532021.931355:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2796
00000100:00100000:1.0:1651532021.931357:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467926400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532021.931373:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931377:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532021.931378:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931381:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532021.931382:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931392:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532021.931396:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.047784:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a399 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10027007] (req 212992->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.047789:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532022.047790:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a399 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10027007] (req 212992->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.047793:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a399 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10027007] (req 212992->10027007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.047799:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.047799:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.047818:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a3a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->10219519] (req 2494464->10219519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.047822:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a3a0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->10219519] (req 2494464->10219519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.047831:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a399 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10027007] (req 212992->10027007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.047842:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a399 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10027007] (req 212992->10027007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.114528:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a3a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->10219519] (req 2494464->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.114533:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532022.114534:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a3a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->10219519] (req 2494464->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.114538:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a3a0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->10219519] (req 2494464->10219519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.114543:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.114544:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.114545:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a3a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->7512063] (req 212992->7512063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.114548:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a3a7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->7512063] (req 212992->7512063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.114568:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a3a0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->10219519] (req 2494464->10219519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.114579:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a3a0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->10219519] (req 2494464->10219519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.206196:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a3a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->7512063] (req 212992->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.206201:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532022.206202:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a3a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->7512063] (req 212992->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.206205:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a3a7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->7512063] (req 212992->7512063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.206210:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.206211:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.206212:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.206215:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3ae lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.206222:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a3a7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->7512063] (req 212992->7512063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.206225:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a3a7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->7512063] (req 212992->7512063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.272937:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.272942:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532022.272943:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.272946:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3ae lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.272951:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.272952:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.272953:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a3b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->9551871] (req 307200->9551871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.272956:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a3b5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->9551871] (req 307200->9551871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.272959:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.272960:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.272960:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a3bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10035200->10039295] (req 10035200->10039295) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.272963:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a3bc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10035200->10039295] (req 10035200->10039295) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.272972:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3ae lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.272992:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3ae lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.273003:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a3bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10035200->10039295] (req 10035200->10039295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.273006:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a3bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10035200->10039295] (req 10035200->10039295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532022.273521:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2800
00000100:00100000:1.0:1651532022.273524:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467927104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532022.273533:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.273543:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532022.273544:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a3e6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->9793535] (req 1712128->9793535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.273553:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532022.273554:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.273559:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a3e6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->9793535] (req 1712128->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.273562:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339644:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a3bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10035200->10039295] (req 10035200->10039295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339650:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a3bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10035200->10039295] (req 10035200->10039295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532022.339669:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467925888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 641574us (641655us total) trans 158913792645 rc 0/0
00000100:00100000:1.0:1651532022.339673:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2793
00010000:00010000:1.0:1651532022.339681:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a3b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->9551871] (req 307200->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339685:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532022.339709:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a3b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->9551871] (req 307200->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339718:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a3b5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->9551871] (req 307200->9551871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339724:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.339725:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.339726:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339729:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339745:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.339745:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.339746:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a3ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8417280->9732095] (req 8417280->9732095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339752:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a3ca lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8417280->9732095] (req 8417280->9732095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339764:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a3b5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->9551871] (req 307200->9551871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339767:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a3b5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->9551871] (req 307200->9551871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339774:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.339777:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532022.340332:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467927296
00000100:00100000:1.0:1651532022.340358:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467927424
00000100:00100000:1.0:1651532022.340369:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2802
00000100:00100000:1.0:1651532022.340371:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467927424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532022.340379:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.340425:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532022.340434:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.340437:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532022.340438:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.340443:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.340447:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431385:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431390:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532022.431414:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467926016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674885us (674917us total) trans 158913792647 rc 0/0
00000100:00100000:1.0:1651532022.431417:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2794
00010000:00010000:1.0:1651532022.431426:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431430:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532022.431431:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431445:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431451:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.431451:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.431452:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431455:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431458:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.431459:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.431459:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a3d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6922240->6926335] (req 6922240->6926335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431462:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a3d8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6922240->6926335] (req 6922240->6926335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431473:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431476:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a3c3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5279744->5283839] (req 5279744->5283839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431490:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431493:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532022.431797:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467927616
00000100:00100000:1.0:1651532022.431831:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2803
00000100:00100000:1.0:1651532022.431833:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467927616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532022.431847:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431851:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532022.431852:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431855:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532022.431856:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431860:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.431863:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673358:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673362:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532022.673380:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467926400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 742022us (742059us total) trans 158913792650 rc 0/0
00000100:00100000:1.0:1651532022.673392:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2796
00010000:00010000:1.0:1651532022.673400:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673404:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532022.673407:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673410:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673415:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.673416:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.673416:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673420:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673429:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673432:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a3d1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2744320->5283839] (req 2744320->5283839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673443:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673446:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532022.673755:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467927808
00000100:00100000:1.0:1651532022.673770:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2804
00000100:00100000:1.0:1651532022.673772:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467927808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532022.673779:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673783:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532022.673784:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673787:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532022.673787:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673792:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673814:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532022.673826:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467927872
00000100:00100000:1.0:1651532022.673843:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2805
00000100:00100000:1.0:1651532022.673845:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467927872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532022.673851:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673855:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532022.673863:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673866:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532022.673866:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673870:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.673873:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532022.835172:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532021 -> 1651532022
00010000:00010000:1.0:1651532022.835176:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835180:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532022.835203:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467926720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 720377us (720456us total) trans 158913792651 rc 0/0
00000100:00100000:1.0:1651532022.835207:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2798
00010000:00010000:1.0:1651532022.835215:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835218:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532022.835219:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835233:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835238:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.835239:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532022.835239:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a3e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->9793535] (req 1712128->9793535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835262:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a3e6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->9793535] (req 1712128->9793535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835274:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835277:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a3df lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->9388031] (req 647168->9388031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532022.835787:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467928064
00000100:00100000:1.0:1651532022.835801:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2806
00000100:00100000:1.0:1651532022.835818:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467928064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532022.835825:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835829:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532022.835830:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835832:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532022.835841:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835845:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.835849:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.939686:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532022.939690:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.022949:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.022953:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532023.022976:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467927104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749452us (749490us total) trans 158913792653 rc 0/0
00000100:00100000:1.0:1651532023.022980:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2800
00010000:00010000:1.0:1651532023.022988:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.022991:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532023.022992:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.023004:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.023009:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.023018:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.023019:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.023022:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.023035:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.023038:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a3ed lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->8818687] (req 512000->8818687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.023042:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.023058:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.023353:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532023.023370:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467928448
00000100:00100000:1.0:1651532023.023382:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2808
00000100:00100000:1.0:1651532023.023383:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467928448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532023.023390:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.023394:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532023.023395:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.023398:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532023.023407:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.023412:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.023421:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532023.139569:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792654 is committed
00010000:00010000:0.0:1651532023.139586:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.139590:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.139611:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.139613:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467927296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799247us (799295us total) trans 158913792654 rc 0/0
00010000:00010000:1.0:1651532023.139616:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532023.139616:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2801
00010000:00010000:1.0:1651532023.139617:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.139621:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.139626:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.139627:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.139628:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.139631:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.139639:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.139649:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.139653:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.139660:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a3f4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->10309631] (req 1282048->10309631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.140167:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532023.140175:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467928640
00000100:00100000:1.0:1651532023.140200:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2809
00000100:00100000:1.0:1651532023.140202:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467928640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532023.140211:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.140215:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532023.140222:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.140225:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532023.140226:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.140236:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.140239:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532023.206326:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792655 is committed
00002000:00010000:0.0:1651532023.206341:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532021 -> 1651532022
00010000:00010000:0.0:1651532023.206344:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206358:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.206376:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467927424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866005us (866031us total) trans 158913792655 rc 0/0
00000100:00100000:0.0:1651532023.206380:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2802
00010000:00010000:0.0:1651532023.206387:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206390:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532023.206391:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206394:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206399:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532023.206400:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532023.206401:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206404:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206416:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206419:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a3fb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->10010623] (req 159744->10010623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.206429:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.206434:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.206762:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532023.206771:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532023.206778:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467928896
00000100:00100000:0.0:1651532023.206791:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467928832
00000100:00100000:0.0:1651532023.206798:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2810
00000100:00100000:0.0:1651532023.206800:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467928896:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532023.206802:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2811
00000100:00100000:1.0:1651532023.206815:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467928832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532023.206817:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206821:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532023.206822:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.206824:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206825:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532023.206826:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.206830:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.206831:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.206834:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532023.206834:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206838:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.206839:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.206842:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.206842:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532023.322977:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792656 is committed
00010000:00010000:1.0:1651532023.323007:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323012:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532023.323035:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467927616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 891201us (891250us total) trans 158913792656 rc 0/0
00000100:00100000:1.0:1651532023.323047:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2803
00010000:00010000:1.0:1651532023.323056:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323059:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532023.323060:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323063:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323068:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.323069:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.323070:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323082:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323090:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323093:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a402 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6242304->8658943] (req 6242304->8658943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323098:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323101:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.323356:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532023.323378:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467929216
00000100:00100000:1.0:1651532023.323392:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2812
00000100:00100000:1.0:1651532023.323394:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467929216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532023.323401:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323405:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532023.323406:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323409:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532023.323410:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323414:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.323417:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532023.431315:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792657 is committed
00010000:00010000:1.0:1651532023.431344:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431349:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532023.431372:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467927808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 757599us (757651us total) trans 158913792657 rc 0/0
00000100:00100000:1.0:1651532023.431383:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2804
00010000:00010000:1.0:1651532023.431391:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431394:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532023.431396:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431399:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431404:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.431405:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.431406:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431417:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431425:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431428:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a409 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9863167] (req 1118208->9863167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431434:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431436:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.431639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532023.431665:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467929472
00000100:00100000:1.0:1651532023.431680:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2813
00000100:00100000:1.0:1651532023.431682:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467929472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532023.431689:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431694:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532023.431694:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431697:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532023.431698:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431702:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.431705:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532023.524320:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792658 is committed
00010000:00010000:1.0:1651532023.524349:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.524353:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.524371:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532023.524375:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467927872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 850529us (850582us total) trans 158913792658 rc 0/0
00010000:00010000:0.0:1651532023.524381:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532023.524382:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532023.524386:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2805
00010000:00010000:0.0:1651532023.524386:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.524391:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532023.524392:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532023.524393:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.524396:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.524406:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.524409:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a410 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2633727] (req 2629632->2633727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.524419:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.524422:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532023.524625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532023.524639:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467929664
00000100:00100000:1.0:1651532023.524660:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2814
00000100:00100000:1.0:1651532023.524662:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467929664:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532023.524669:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.524673:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532023.524674:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.524677:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532023.524678:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.524682:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.524685:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532023.599378:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792659 is committed
00010000:00010000:0.0:1651532023.599393:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.599397:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.599418:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467928064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 763599us (763643us total) trans 158913792659 rc 0/0
00010000:00010000:1.0:1651532023.599420:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.599421:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2806
00010000:00010000:1.0:1651532023.599424:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532023.599425:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.599436:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.599441:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.599442:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.599442:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.599445:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.599455:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.599464:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.599465:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a417 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->10346495] (req 1064960->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.599468:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.599981:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532023.600062:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467929792
00000100:00100000:0.0:1651532023.600073:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2815
00000100:00100000:0.0:1651532023.600075:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467929792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532023.600082:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.600087:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532023.600088:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.600102:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532023.600103:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.600108:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.600112:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532023.741067:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792660 is committed
00010000:00010000:0.0:1651532023.741084:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741089:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.741108:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467928256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 800968us (800994us total) trans 158913792660 rc 0/0
00000100:00100000:0.0:1651532023.741112:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2807
00010000:00010000:0.0:1651532023.741119:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741123:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532023.741124:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741139:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741145:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532023.741146:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532023.741146:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741150:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741162:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741165:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a41e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->9203711] (req 163840->9203711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.741174:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.741179:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.741451:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532023.741460:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467929984
00000100:00100000:0.0:1651532023.741471:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2816
00000100:00100000:0.0:1651532023.741473:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467929984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532023.741481:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741486:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532023.741487:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741501:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532023.741502:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741506:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.741510:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532023.849370:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792661 is committed
00002000:00010000:1.0:1651532023.849398:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532022 -> 1651532023
00002000:00010000:1.0:1651532023.849401:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532022 -> 1651532023
00010000:00010000:1.0:1651532023.849403:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849417:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532023.849441:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467928448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 826057us (826088us total) trans 158913792661 rc 0/0
00000100:00100000:1.0:1651532023.849445:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2808
00010000:00010000:1.0:1651532023.849453:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849456:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532023.849457:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849460:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849466:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.849466:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.849467:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849470:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849487:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849490:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a425 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->7602175] (req 204800->7602175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849504:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849507:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.849675:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532023.849688:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467930176
00000100:00100000:1.0:1651532023.849703:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2817
00000100:00100000:1.0:1651532023.849705:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467930176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532023.849712:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849716:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532023.849717:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849727:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532023.849728:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849733:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.849736:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532023.924453:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792662 is committed
00010000:00010000:1.0:1651532023.924482:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.924494:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532023.924517:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467928640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 784314us (784350us total) trans 158913792662 rc 0/0
00000100:00100000:1.0:1651532023.924521:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2809
00010000:00010000:1.0:1651532023.924528:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.924532:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532023.924533:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.924536:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.924540:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.924541:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532023.924542:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.924545:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.924562:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.924565:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a42c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9785343] (req 880640->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.924569:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.924575:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.925079:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532023.925096:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467930368
00000100:00100000:1.0:1651532023.925112:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2818
00000100:00100000:1.0:1651532023.925114:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467930368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532023.925121:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.925125:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532023.925126:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.925129:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532023.925129:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.925133:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.925137:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532023.999698:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792663 is committed
00010000:00010000:0.0:1651532023.999713:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.999718:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532023.999735:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467928896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 792934us (792973us total) trans 158913792663 rc 0/0
00000100:00100000:0.0:1651532023.999750:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2810
00010000:00010000:0.0:1651532023.999758:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.999761:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532023.999762:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.999766:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.999771:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532023.999772:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532023.999773:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.999776:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.999788:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532023.999791:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a433 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->4927487] (req 4923392->4927487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.999800:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532023.999813:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.000026:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532024.000056:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467930560
00000100:00100000:0.0:1651532024.000068:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2819
00000100:00100000:0.0:1651532024.000070:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467930560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532024.000085:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.000090:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532024.000091:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.000094:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532024.000095:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.000099:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.000103:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532024.116170:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792664 is committed
00010000:00010000:1.0:1651532024.116202:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116214:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532024.116238:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467928832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 909422us (909466us total) trans 158913792664 rc 0/0
00000100:00100000:1.0:1651532024.116242:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2811
00010000:00010000:1.0:1651532024.116259:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116263:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532024.116264:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116267:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116272:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.116273:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.116274:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116277:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116294:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.116296:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116297:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a43a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->5640191] (req 86016->5640191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.116304:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.116514:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532024.116530:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467930688
00000100:00100000:1.0:1651532024.116541:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2820
00000100:00100000:1.0:1651532024.116543:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467930688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532024.116550:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116554:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532024.116555:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116558:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532024.116559:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116563:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.116566:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532024.249513:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792665 is committed
00010000:00010000:0.0:1651532024.249530:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.249546:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.249570:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467929216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 926175us (926215us total) trans 158913792665 rc 0/0
00010000:00010000:1.0:1651532024.249572:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.249574:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2812
00010000:00010000:1.0:1651532024.249577:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532024.249578:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.249591:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.249597:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.249597:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.249598:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.249601:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.249617:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.249620:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a441 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9326591] (req 978944->9326591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.249626:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.249629:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.249853:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532024.249873:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467930880
00000100:00100000:0.0:1651532024.249888:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2821
00000100:00100000:0.0:1651532024.249890:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467930880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532024.249897:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.249902:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532024.249903:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.249906:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532024.249907:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.249912:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.249915:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532024.349504:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792666 is committed
00010000:00010000:1.0:1651532024.349535:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.349539:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532024.349571:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467929472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 917887us (917932us total) trans 158913792666 rc 0/0
00000100:00100000:1.0:1651532024.349574:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2813
00010000:00010000:0.0:1651532024.349574:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.349578:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532024.349579:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.349583:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.349589:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532024.349589:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532024.349590:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.349593:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.349602:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.349606:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a448 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->7380991] (req 1531904->7380991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.349616:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.349629:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532024.349919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532024.349928:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467931072
00000100:00100000:1.0:1651532024.349939:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2822
00000100:00100000:1.0:1651532024.349941:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467931072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532024.349948:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.349952:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532024.349953:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.349956:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532024.349957:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.349961:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.349964:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532024.457826:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792667 is committed
00010000:00010000:0.0:1651532024.457841:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.457845:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.457869:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467929664:12345-10.240.43.64@tcp:4:fio.0 Request processed in 933206us (933244us total) trans 158913792667 rc 0/0
00010000:00010000:1.0:1651532024.457870:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.457872:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2814
00010000:00010000:1.0:1651532024.457884:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532024.457885:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.457888:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.457894:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.457895:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.457895:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.457898:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.457918:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.457921:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a44f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->8425471] (req 3047424->8425471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.457931:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.457935:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532024.458156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532024.458173:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467931328
00000100:00100000:0.0:1651532024.458187:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2823
00000100:00100000:0.0:1651532024.458189:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467931328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532024.458197:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.458202:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532024.458211:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.458214:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532024.458215:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.458219:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.458223:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.508865:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1651532024.508874:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006dabb25f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966863040:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651532024.509136:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006dabb25f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966863040:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:0.0:1651532024.544476:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792668 is committed
00010000:00010000:0.0:1651532024.544492:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.544496:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.544518:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467929792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 944442us (944537us total) trans 158913792668 rc 0/0
00010000:00010000:1.0:1651532024.544520:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.544522:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2815
00010000:00010000:1.0:1651532024.544524:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532024.544526:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.544539:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.544545:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.544545:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.544546:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.544549:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.544568:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.544571:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a456 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->4022271] (req 4018176->4022271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.544583:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.544598:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.544744:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532024.544753:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467931520
00000100:00100000:0.0:1651532024.544784:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2824
00000100:00100000:0.0:1651532024.544786:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467931520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532024.544793:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.544798:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532024.544799:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532024.544800:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.544814:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532024.636181:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792669 is committed
00010000:00010000:0.0:1651532024.636197:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636201:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.636218:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467929984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 894743us (894767us total) trans 158913792669 rc 0/0
00000100:00100000:0.0:1651532024.636232:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2816
00010000:00010000:0.0:1651532024.636240:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636243:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532024.636245:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636248:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636263:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532024.636263:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532024.636264:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636267:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636279:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636282:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a45d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->10412031] (req 1220608->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.636293:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.636297:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532024.636580:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532024.636592:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467931648
00000100:00100000:0.0:1651532024.636604:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2825
00000100:00100000:0.0:1651532024.636606:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467931648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532024.636622:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636626:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532024.636627:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636630:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532024.636631:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636635:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.636639:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532024.740043:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792670 is committed
00010000:00010000:1.0:1651532024.740074:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740079:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532024.740110:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467930176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 890405us (890437us total) trans 158913792670 rc 0/0
00000100:00100000:1.0:1651532024.740114:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2817
00010000:00010000:1.0:1651532024.740122:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740126:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532024.740127:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740129:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740134:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.740135:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.740136:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740139:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740156:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740160:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a464 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->8703999] (req 147456->8703999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740166:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740176:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.740381:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532024.740478:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467931840
00000100:00100000:1.0:1651532024.740495:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2826
00000100:00100000:1.0:1651532024.740497:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467931840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532024.740504:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740509:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532024.740510:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740513:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740515:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532024.740516:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740520:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740523:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.740526:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532024.794680:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792671 is committed
00010000:00010000:1.0:1651532024.794710:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.794714:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532024.794735:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467930368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 869620us (869657us total) trans 158913792671 rc 0/0
00000100:00100000:1.0:1651532024.794738:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2818
00010000:00010000:0.0:1651532024.794738:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.794744:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532024.794745:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.794749:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.794766:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532024.794767:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532024.794768:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.794771:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.794779:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.794782:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a46b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4362240->9654271] (req 4362240->9654271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.794788:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.794791:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532024.795001:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532024.795011:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467932032
00000100:00100000:1.0:1651532024.795031:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2827
00000100:00100000:1.0:1651532024.795038:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467932032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532024.795045:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.795050:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532024.795051:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.795053:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532024.795054:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.795058:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.795073:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532024.911309:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792672 is committed
00010000:00010000:0.0:1651532024.911325:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.911330:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.911355:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467930560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 911284us (911329us total) trans 158913792672 rc 0/0
00010000:00010000:1.0:1651532024.911356:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.911361:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532024.911362:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.911365:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.911367:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2819
00010000:00010000:1.0:1651532024.911371:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.911372:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.911372:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.911375:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.911383:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.911386:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a472 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10174463] (req 372736->10174463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.911391:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.911403:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532024.911960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532024.911985:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467932224
00000100:00100000:0.0:1651532024.911997:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2828
00000100:00100000:0.0:1651532024.911999:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467932224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532024.912006:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.912011:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532024.912012:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.912015:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532024.912016:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.912020:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.912024:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532024.994673:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792673 is committed
00010000:00010000:1.0:1651532024.994707:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.994711:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532024.994733:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467930688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 878188us (878220us total) trans 158913792673 rc 0/0
00000100:00100000:1.0:1651532024.994736:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2820
00010000:00010000:1.0:1651532024.994744:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.994747:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532024.994749:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.994751:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.994756:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.994757:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532024.994758:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.994777:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.994789:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532024.994792:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a479 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5976064->5980159] (req 5976064->5980159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.994798:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.994814:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532024.994940:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532024.994962:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467932416
00000100:00100000:0.0:1651532024.994985:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2829
00000100:00100000:0.0:1651532024.994988:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467932416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532024.994997:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.995002:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532024.995009:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.995012:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532024.995013:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.995018:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532024.995021:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.086351:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792674 is committed
00002000:00010000:0.0:1651532025.086365:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532023 -> 1651532024
00010000:00010000:0.0:1651532025.086368:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086372:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532025.086403:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467930880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 836512us (836550us total) trans 158913792674 rc 0/0
00000100:00100000:0.0:1651532025.086407:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2821
00010000:00010000:0.0:1651532025.086414:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086418:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532025.086419:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086422:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086427:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.086428:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.086429:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086432:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086444:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086447:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a480 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3981312->8634367] (req 3981312->8634367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.086455:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.086460:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532025.086724:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532025.086733:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467932544
00000100:00100000:0.0:1651532025.086748:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2830
00000100:00100000:0.0:1651532025.086750:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467932544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532025.086758:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086762:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532025.086763:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086766:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532025.086767:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086771:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.086774:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.169760:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792675 is committed
00010000:00010000:1.0:1651532025.169791:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169796:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.169828:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467931072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 819886us (819909us total) trans 158913792675 rc 0/0
00000100:00100000:1.0:1651532025.169832:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2822
00010000:00010000:1.0:1651532025.169839:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169854:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532025.169855:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169858:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169864:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.169864:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.169865:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169868:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169872:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.169872:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.169873:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169875:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169887:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169890:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a487 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->10305535] (req 1077248->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.169895:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.169900:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169936:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.169940:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.170224:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532025.170241:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467932736
00000100:00100000:1.0:1651532025.170281:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2831
00000100:00100000:1.0:1651532025.170283:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754467932736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.170292:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.170296:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532025.170297:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532025.170298:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.170301:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.340219:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792677 is committed
00010000:00010000:0.0:1651532025.340240:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340245:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340260:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340264:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532025.340284:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467931328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 882093us (882135us total) trans 158913792676 rc 0/0
00000100:00100000:0.0:1651532025.340297:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2823
00000100:00100000:1.0:1651532025.340300:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467931520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 795513us (795556us total) trans 158913792677 rc 0/0
00000100:00100000:1.0:1651532025.340304:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2824
00010000:00010000:0.0:1651532025.340307:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340312:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340313:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532025.340315:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340316:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532025.340317:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340320:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340320:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340325:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340328:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a495 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7794688->10481663] (req 7794688->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340328:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.340329:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.340331:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340335:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340362:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340365:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a48e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [643072->6492159] (req 643072->6492159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340366:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340378:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.340631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532025.340653:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532025.340671:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467932928
00000100:00100000:0.0:1651532025.340676:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467933056
00000100:00100000:1.0:1651532025.340685:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2832
00000100:00100000:1.0:1651532025.340687:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467932928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.340694:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532025.340695:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2833
00000100:00100000:0.0:1651532025.340697:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467933056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.340698:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532025.340699:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340702:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340704:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340705:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532025.340705:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340709:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.340710:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340713:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532025.340714:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340718:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340718:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340721:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.340722:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.340724:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.411648:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792678 is committed
00010000:00010000:1.0:1651532025.411687:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.411701:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.411719:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467931648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 775112us (775140us total) trans 158913792678 rc 0/0
00000100:00100000:1.0:1651532025.411722:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2825
00010000:00010000:1.0:1651532025.411730:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.411733:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532025.411734:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.411737:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.411742:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.411743:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.411744:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.411747:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.411753:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.411756:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a49c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3510272->3514367] (req 3510272->3514367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.411770:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.411773:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.412071:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532025.412089:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467933312
00000100:00100000:1.0:1651532025.412105:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2834
00000100:00100000:1.0:1651532025.412107:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467933312:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.412114:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.412119:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532025.412120:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.412123:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532025.412123:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.412128:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.412131:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.526715:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792679 is committed
00010000:00010000:1.0:1651532025.526746:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.526750:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.526768:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467931840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 786270us (786387us total) trans 158913792679 rc 0/0
00000100:00100000:1.0:1651532025.526771:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2826
00010000:00010000:1.0:1651532025.526778:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.526782:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532025.526783:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.526786:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.526790:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.526791:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.526792:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.526794:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.526830:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.526833:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4a3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->9539583] (req 741376->9539583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.526839:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.526842:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.527133:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532025.527142:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467933440
00000100:00100000:1.0:1651532025.527158:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2835
00000100:00100000:1.0:1651532025.527160:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467933440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.527167:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.527171:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532025.527172:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.527175:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532025.527176:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.527180:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.527192:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.610850:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792680 is committed
00010000:00010000:1.0:1651532025.610880:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.610885:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.610905:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467932032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 815871us (815904us total) trans 158913792680 rc 0/0
00000100:00100000:1.0:1651532025.610908:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2827
00010000:00010000:0.0:1651532025.610908:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.610914:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532025.610915:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.610919:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.610925:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.610926:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.610927:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.610930:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.610938:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.610941:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a4aa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->8499199] (req 1277952->8499199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.610944:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.610956:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.611171:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532025.611272:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467933632
00000100:00100000:1.0:1651532025.611289:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2836
00000100:00100000:1.0:1651532025.611291:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467933632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.611298:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.611303:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532025.611311:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.611314:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532025.611315:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.611319:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.611323:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.653305:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792681 is committed
00010000:00010000:1.0:1651532025.653340:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653344:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.653361:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467932224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 741362us (741402us total) trans 158913792681 rc 0/0
00000100:00100000:1.0:1651532025.653364:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2828
00010000:00010000:1.0:1651532025.653371:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653375:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532025.653376:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653390:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653395:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.653396:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.653396:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653399:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653411:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653414:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a4b1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9379839] (req 1433600->9379839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.653421:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.653437:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.653646:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532025.653663:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467933824
00000100:00100000:1.0:1651532025.653677:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2837
00000100:00100000:1.0:1651532025.653679:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467933824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.653687:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653691:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532025.653692:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653710:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532025.653711:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653716:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.653719:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.754015:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792682 is committed
00010000:00010000:0.0:1651532025.754031:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754035:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532025.754059:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467932416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 759070us (759118us total) trans 158913792682 rc 0/0
00000100:00100000:0.0:1651532025.754062:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2829
00010000:00010000:0.0:1651532025.754071:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754074:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532025.754075:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754078:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754083:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.754084:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.754085:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754100:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754103:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.754104:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.754105:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754107:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754118:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754121:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a4b8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10145791] (req 262144->10145791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.754123:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754126:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.754128:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754129:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.754700:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532025.754719:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467934016
00000100:00100000:0.0:1651532025.754732:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2838
00000100:00100000:0.0:1651532025.754734:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467934016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532025.754742:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754756:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532025.754757:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754760:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532025.754761:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754765:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.754769:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.829707:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792684 is committed
00002000:00010000:0.0:1651532025.829726:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532024 -> 1651532025
00002000:00010000:0.0:1651532025.829727:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532023 -> 1651532025
00010000:00010000:0.0:1651532025.829730:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.829733:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829738:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829748:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532025.829755:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467932544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 743004us (743031us total) trans 158913792683 rc 0/0
00000100:00100000:0.0:1651532025.829758:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2830
00000100:00100000:1.0:1651532025.829768:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467932736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 659483us (659544us total) trans 158913792684 rc 0/0
00000100:00100000:1.0:1651532025.829771:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2831
00010000:00010000:0.0:1651532025.829771:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829779:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.829783:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532025.829784:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.829787:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829792:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532025.829793:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829794:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.829796:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a4bf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->3665919] (req 3661824->3665919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829797:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829802:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.829813:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.829814:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829817:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829825:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829828:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a4c6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8110080->9175039] (req 8110080->9175039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829834:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.829837:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.830149:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532025.830173:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467934208
00000100:00100000:1.0:1651532025.830189:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2839
00000100:00100000:1.0:1651532025.830191:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467934208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.830198:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532025.830202:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532025.830214:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467934336
00010000:00010000:1.0:1651532025.830218:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532025.830219:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.830222:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532025.830223:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532025.830225:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2840
00010000:00010000:1.0:1651532025.830227:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532025.830227:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467934336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.830231:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.830242:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.830246:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532025.830247:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.830261:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532025.830263:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.830282:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.830288:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.886740:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792685 is committed
00010000:00010000:1.0:1651532025.886771:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.886776:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.886799:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467932928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 546111us (546174us total) trans 158913792685 rc 0/0
00010000:00010000:0.0:1651532025.886799:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.886812:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532025.886813:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2832
00010000:00010000:0.0:1651532025.886813:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.886816:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.886822:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.886823:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.886824:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.886827:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.886834:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.886848:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a4cd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->9752575] (req 118784->9752575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.886861:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.886865:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532025.887052:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532025.887066:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467934464
00000100:00100000:1.0:1651532025.887078:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2841
00000100:00100000:1.0:1651532025.887080:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467934464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.887087:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.887092:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532025.887093:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.887096:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532025.887096:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.887101:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.887104:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532025.995058:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792686 is committed
00010000:00010000:1.0:1651532025.995090:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.995105:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.995124:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.995128:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467933056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 654431us (654475us total) trans 158913792686 rc 0/0
00010000:00010000:0.0:1651532025.995129:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532025.995130:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.995132:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2833
00010000:00010000:0.0:1651532025.995134:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.995139:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.995140:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532025.995141:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.995144:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.995154:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532025.995157:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a4d4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->5156863] (req 5152768->5156863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.995172:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.995177:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532025.995385:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532025.995409:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467934656
00000100:00100000:1.0:1651532025.995420:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2842
00000100:00100000:1.0:1651532025.995422:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467934656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532025.995429:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.995433:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532025.995434:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.995437:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532025.995438:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.995454:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532025.995458:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.103401:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792687 is committed
00010000:00010000:1.0:1651532026.103435:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103440:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.103470:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467933312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691362us (691399us total) trans 158913792687 rc 0/0
00000100:00100000:1.0:1651532026.103474:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2834
00010000:00010000:1.0:1651532026.103481:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103485:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532026.103486:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103489:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103494:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.103502:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.103503:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103506:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103523:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103527:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a4db lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->10190847] (req 1454080->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103532:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103535:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.103689:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532026.103698:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467934784
00000100:00100000:1.0:1651532026.103709:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2843
00000100:00100000:1.0:1651532026.103711:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467934784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532026.103718:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103722:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.103723:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103737:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532026.103738:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103742:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.103746:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.170363:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792688 is committed
00010000:00010000:1.0:1651532026.170393:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.170398:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.170417:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467933440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 643257us (643285us total) trans 158913792688 rc 0/0
00000100:00100000:1.0:1651532026.170420:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2835
00010000:00010000:0.0:1651532026.170421:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.170426:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532026.170427:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.170431:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.170437:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.170437:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.170438:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.170441:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.170451:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.170454:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a4e2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7262208->7266303] (req 7262208->7266303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.170464:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.170478:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.170648:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532026.170657:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467935040
00000100:00100000:1.0:1651532026.170679:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2844
00000100:00100000:1.0:1651532026.170681:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467935040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532026.170688:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.170692:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532026.170702:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.170705:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532026.170705:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.170710:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.170713:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.283977:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792689 is committed
00010000:00010000:0.0:1651532026.283993:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.283997:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532026.284021:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467933632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 672728us (672856us total) trans 158913792689 rc 0/0
00000100:00100000:0.0:1651532026.284024:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2836
00010000:00010000:0.0:1651532026.284032:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.284036:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532026.284037:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.284040:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.284046:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.284046:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.284047:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.284062:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.284069:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.284072:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a4e9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9756671] (req 761856->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.284078:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.284082:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.284313:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532026.284339:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467935168
00000100:00100000:0.0:1651532026.284358:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2845
00000100:00100000:0.0:1651532026.284360:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467935168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532026.284368:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.284373:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532026.284374:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.284377:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532026.284377:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.284382:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.284385:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.336871:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792690 is committed
00010000:00010000:1.0:1651532026.336900:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.336905:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.336922:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467933824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 683242us (683276us total) trans 158913792690 rc 0/0
00000100:00100000:1.0:1651532026.336925:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2837
00010000:00010000:1.0:1651532026.336941:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.336945:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532026.336946:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.336949:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.336954:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.336954:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.336955:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.336958:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.336970:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.336973:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a4f0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10268671] (req 217088->10268671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.336983:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.336987:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.337221:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532026.337236:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467935360
00000100:00100000:1.0:1651532026.337259:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2846
00000100:00100000:1.0:1651532026.337261:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467935360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532026.337269:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.337281:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532026.337282:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.337285:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532026.337285:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.337290:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.337293:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.436925:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792691 is committed
00010000:00010000:0.0:1651532026.436940:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.436944:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532026.436968:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467934016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 682232us (682268us total) trans 158913792691 rc 0/0
00000100:00100000:0.0:1651532026.436971:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2838
00010000:00010000:0.0:1651532026.436979:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.436982:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532026.436983:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.436986:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.437003:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.437004:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.437005:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.437008:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.437014:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.437017:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a4f7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->6402047] (req 2031616->6402047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.437020:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.437024:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.437190:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532026.437229:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467935552
00000100:00100000:0.0:1651532026.437241:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2847
00000100:00100000:0.0:1651532026.437243:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467935552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532026.437261:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.437269:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532026.437270:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.437275:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532026.437276:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.437296:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.437302:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.543733:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792692 is committed
00010000:00010000:1.0:1651532026.543766:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.543770:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.543793:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467934208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 713601us (713645us total) trans 158913792692 rc 0/0
00010000:00010000:0.0:1651532026.543793:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.543798:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532026.543799:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.543810:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.543816:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532026.543817:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2839
00010000:00010000:0.0:1651532026.543817:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.543818:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.543821:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.543829:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.543842:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a4fe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10301439] (req 65536->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.543848:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.543852:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.544370:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532026.544393:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467935744
00000100:00100000:1.0:1651532026.544407:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2848
00000100:00100000:1.0:1651532026.544409:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467935744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532026.544416:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.544420:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532026.544421:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.544424:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532026.544425:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.544429:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.544433:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.595312:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792693 is committed
00010000:00010000:0.0:1651532026.595326:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.595330:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532026.595351:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467934336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 765123us (765150us total) trans 158913792693 rc 0/0
00010000:00010000:1.0:1651532026.595353:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532026.595355:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2840
00010000:00010000:1.0:1651532026.595357:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532026.595359:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.595369:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.595375:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.595375:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.595376:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.595379:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.595387:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.595392:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.595396:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.595397:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a505 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->7733247] (req 516096->7733247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.595612:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532026.595640:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467935936
00000100:00100000:0.0:1651532026.595654:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2849
00000100:00100000:0.0:1651532026.595664:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467935936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532026.595672:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.595676:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532026.595677:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.595680:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532026.595681:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.595686:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.595689:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.678706:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792694 is committed
00010000:00010000:0.0:1651532026.678720:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.678723:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532026.678739:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467934464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791658us (791688us total) trans 158913792694 rc 0/0
00000100:00100000:0.0:1651532026.678743:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2841
00010000:00010000:0.0:1651532026.678749:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.678762:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532026.678763:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.678766:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.678771:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.678772:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.678773:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.678776:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.678787:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.678790:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a50c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6774784->6778879] (req 6774784->6778879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.678799:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.678811:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.679054:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532026.679071:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467936128
00000100:00100000:0.0:1651532026.679086:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2850
00000100:00100000:0.0:1651532026.679088:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467936128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532026.679095:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.679110:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532026.679111:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.679114:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532026.679114:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.679119:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.679122:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.795080:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792695 is committed
00010000:00010000:1.0:1651532026.795110:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795125:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.795149:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467934656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799726us (799764us total) trans 158913792695 rc 0/0
00000100:00100000:1.0:1651532026.795152:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2842
00010000:00010000:1.0:1651532026.795160:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795163:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532026.795164:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795167:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795172:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.795173:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.795174:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795177:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795193:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795206:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a513 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->10346495] (req 1290240->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795212:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795215:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.795393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532026.795402:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467936256
00000100:00100000:1.0:1651532026.795418:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2851
00000100:00100000:1.0:1651532026.795420:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467936256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532026.795427:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795431:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.795432:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795435:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532026.795436:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795440:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.795454:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.845460:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792696 is committed
00010000:00010000:1.0:1651532026.845486:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.845491:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.845510:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467934784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 741798us (741821us total) trans 158913792696 rc 0/0
00000100:00100000:1.0:1651532026.845513:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2843
00010000:00010000:0.0:1651532026.845514:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.845519:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532026.845520:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.845523:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.845529:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.845530:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.845539:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.845542:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.845552:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.845555:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a51a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->3371007] (req 3366912->3371007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.845562:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.845566:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.845745:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532026.845784:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467936448
00000100:00100000:1.0:1651532026.845800:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2852
00000100:00100000:1.0:1651532026.845814:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467936448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532026.845821:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.845825:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532026.845834:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.845837:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532026.845838:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.845843:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.845846:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532026.945498:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792697 is committed
00002000:00010000:1.0:1651532026.945530:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532025 -> 1651532026
00010000:00010000:1.0:1651532026.945533:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.945537:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.945560:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467935040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774879us (774912us total) trans 158913792697 rc 0/0
00010000:00010000:0.0:1651532026.945560:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.945564:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2844
00010000:00010000:0.0:1651532026.945565:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532026.945566:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.945569:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.945574:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.945575:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532026.945576:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.945579:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.945597:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532026.945600:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a521 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->7184383] (req 684032->7184383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.945608:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.945612:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532026.945786:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532026.945795:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467936576
00000100:00100000:1.0:1651532026.945822:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2853
00000100:00100000:1.0:1651532026.945825:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467936576:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532026.945832:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.945836:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532026.945837:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.945840:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532026.945841:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.945845:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532026.945849:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532027.062152:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792698 is committed
00010000:00010000:1.0:1651532027.062181:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062186:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.062215:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467935168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 777855us (777903us total) trans 158913792698 rc 0/0
00000100:00100000:1.0:1651532027.062219:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2845
00010000:00010000:1.0:1651532027.062226:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062229:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532027.062230:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062233:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062238:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532027.062239:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532027.062240:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062243:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062250:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062263:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40a528 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4022272->4026367] (req 4022272->4026367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062269:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062279:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.062522:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532027.062602:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467936832
00000100:00100000:1.0:1651532027.062619:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2854
00000100:00100000:1.0:1651532027.062621:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467936832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532027.062628:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062632:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532027.062633:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532027.062634:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.062637:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532027.170498:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792699 is committed
00010000:00010000:1.0:1651532027.170531:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.170535:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.170558:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467935360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 833295us (833337us total) trans 158913792699 rc 0/0
00010000:00010000:0.0:1651532027.170558:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.170561:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2846
00010000:00010000:0.0:1651532027.170564:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532027.170565:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.170569:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.170575:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.170576:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.170577:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.170580:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.170588:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.170609:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a52f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->9900031] (req 819200->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.170613:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.170617:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.170856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532027.170946:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467936960
00000100:00100000:1.0:1651532027.170963:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2855
00000100:00100000:1.0:1651532027.170965:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467936960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532027.170972:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.170977:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532027.170978:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532027.170978:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.170982:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532027.319044:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792700 is committed
00010000:00010000:1.0:1651532027.319077:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319081:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.319104:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467935552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 881860us (881915us total) trans 158913792700 rc 0/0
00010000:00010000:0.0:1651532027.319104:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.319109:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532027.319110:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.319114:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.319118:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2847
00010000:00010000:0.0:1651532027.319119:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.319120:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.319121:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.319124:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.319134:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.319137:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a536 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9285631] (req 757760->9285631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319154:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319165:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.319382:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532027.319403:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467937152
00000100:00100000:1.0:1651532027.319419:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2856
00000100:00100000:1.0:1651532027.319421:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467937152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532027.319428:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319433:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532027.319434:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319437:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319439:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319442:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532027.319442:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319457:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319460:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319463:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.319466:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532027.445466:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792701 is committed
00010000:00010000:1.0:1651532027.445498:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445503:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.445521:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467935744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 901111us (901151us total) trans 158913792701 rc 0/0
00000100:00100000:1.0:1651532027.445524:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2848
00010000:00010000:1.0:1651532027.445531:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445534:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532027.445536:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445547:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445553:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532027.445554:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532027.445555:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445558:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445569:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445572:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a53d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3063808->9768959] (req 3063808->9768959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.445582:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.445587:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.445839:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532027.445848:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467937344
00000100:00100000:1.0:1651532027.445862:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2857
00000100:00100000:1.0:1651532027.445864:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467937344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532027.445871:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445875:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532027.445876:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445889:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532027.445890:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445895:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.445898:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532027.570473:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792702 is committed
00010000:00010000:0.0:1651532027.570490:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.570494:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532027.570518:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467935936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 974853us (974906us total) trans 158913792702 rc 0/0
00000100:00100000:0.0:1651532027.570522:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2849
00010000:00010000:0.0:1651532027.570530:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.570533:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532027.570534:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.570537:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.570554:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.570555:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.570556:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.570559:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.570567:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.570570:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a544 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.570575:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.570578:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.571087:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532027.571111:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467937536
00000100:00100000:0.0:1651532027.571129:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2858
00000100:00100000:0.0:1651532027.571131:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467937536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532027.571138:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.571143:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532027.571152:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.571155:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532027.571155:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.571160:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.571164:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532027.612444:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792703 is committed
00010000:00010000:0.0:1651532027.612459:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612462:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532027.612485:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467936128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 933396us (933431us total) trans 158913792703 rc 0/0
00000100:00100000:0.0:1651532027.612489:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2850
00010000:00010000:0.0:1651532027.612496:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612500:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532027.612501:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612515:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612521:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.612521:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.612522:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612525:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612532:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612535:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a54b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->5873663] (req 1830912->5873663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.612538:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.612543:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.612695:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532027.612715:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467937728
00000100:00100000:0.0:1651532027.612730:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2859
00000100:00100000:0.0:1651532027.612732:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467937728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532027.612739:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612743:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532027.612744:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612747:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532027.612755:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612760:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.612764:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532027.728928:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792704 is committed
00010000:00010000:1.0:1651532027.728959:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.728964:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.728980:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467936256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 933560us (933588us total) trans 158913792704 rc 0/0
00000100:00100000:1.0:1651532027.728983:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2851
00010000:00010000:1.0:1651532027.729000:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729003:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532027.729004:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729007:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729012:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532027.729013:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532027.729014:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729016:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729023:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729026:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a552 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->4464639] (req 4460544->4464639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729031:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729034:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.729308:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532027.729316:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467937920
00000100:00100000:1.0:1651532027.729327:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2860
00000100:00100000:1.0:1651532027.729329:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467937920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532027.729336:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729340:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532027.729341:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729344:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532027.729345:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729349:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.729353:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532027.795646:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792705 is committed
00010000:00010000:1.0:1651532027.795678:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.795683:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.795716:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467936448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 949913us (949971us total) trans 158913792705 rc 0/0
00010000:00010000:0.0:1651532027.795716:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.795720:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2852
00010000:00010000:0.0:1651532027.795721:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532027.795723:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795726:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795732:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.795732:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.795733:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795736:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795740:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.795748:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.795749:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795752:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795755:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.795756:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532027.795756:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795759:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795769:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795772:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a559 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->10256383] (req 819200->10256383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.795776:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.795780:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795782:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.795785:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.795848:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.795852:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.795955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532027.795964:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467938048
00000100:00100000:1.0:1651532027.795974:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2861
00000100:00100000:1.0:1651532027.795976:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467938048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532027.795983:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.795994:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532027.795996:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532027.795996:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.796009:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532027.924037:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792708 is committed
00010000:00010000:0.0:1651532027.924059:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924074:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924079:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924089:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532027.924096:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467936576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 978271us (978311us total) trans 158913792706 rc 0/0
00000100:00100000:0.0:1651532027.924106:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2853
00000100:00100000:1.0:1651532027.924113:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467936960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 753147us (753257us total) trans 158913792707 rc 0/0
00010000:00010000:0.0:1651532027.924114:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.924116:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2855
00010000:00010000:0.0:1651532027.924118:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532027.924119:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924122:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924128:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924129:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924131:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a560 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2355200->2359295] (req 2355200->2359295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924133:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924134:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924137:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532027.924138:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532027.924147:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467936832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 861526us (861626us total) trans 158913792708 rc 0/0
00000100:00100000:1.0:1651532027.924150:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2854
00010000:00010000:0.0:1651532027.924152:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924156:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924157:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924159:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a56e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924160:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532027.924161:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924172:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924178:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532027.924179:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532027.924180:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924183:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924190:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924193:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a567 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3256320->6684671] (req 3256320->6684671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924207:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924210:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532027.924452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532027.924522:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467938240
00000100:00100000:1.0:1651532027.924534:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2862
00000100:00100000:1.0:1651532027.924536:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467938240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532027.924543:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924556:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532027.924557:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924560:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924562:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532027.924563:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924568:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924570:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924574:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532027.924651:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532027.924665:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532027.924671:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467938368
00000100:00100000:0.0:1651532027.924673:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467938560
00000100:00100000:1.0:1651532027.924681:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2863
00000100:00100000:1.0:1651532027.924682:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467938368:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532027.924689:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2864
00000100:00100000:0.0:1651532027.924691:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467938560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532027.924714:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924715:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924718:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532027.924727:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924730:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532027.924731:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924735:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532027.924736:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924739:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532027.924740:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924743:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924744:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532027.924747:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532027.924755:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532028.040775:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792709 is committed
00002000:00010000:1.0:1651532028.040816:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532026 -> 1651532027
00010000:00010000:1.0:1651532028.040820:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.040824:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.040846:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.040847:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467937152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 721424us (721465us total) trans 158913792709 rc 0/0
00000100:00100000:1.0:1651532028.040850:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2856
00010000:00010000:0.0:1651532028.040851:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532028.040852:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.040856:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.040862:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.040862:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.040863:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.040866:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.040876:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.040879:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a575 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->10457087] (req 258048->10457087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.040893:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.040897:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.041359:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532028.041386:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467938752
00000100:00100000:0.0:1651532028.041402:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2865
00000100:00100000:0.0:1651532028.041404:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467938752:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532028.041412:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.041416:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532028.041417:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.041420:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532028.041421:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.041425:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.041429:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532028.128107:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532028.128118:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229056
00000100:00100000:0.0:1651532028.128127:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 42
00000100:00100000:0.0:1651532028.128129:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c39d25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951229056:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532028.128135:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1490944 granted 358146624 pending 200704 free 81138851840 avail 76966649856
00000100:00100000:0.0:1651532028.128153:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c39d25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951229056:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (46us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532028.128164:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 42
00000001:00080000:0.0:1651532028.182374:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792710 is committed
00010000:00010000:1.0:1651532028.182406:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.182411:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.182432:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467937344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 736567us (736594us total) trans 158913792710 rc 0/0
00010000:00010000:0.0:1651532028.182435:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.182436:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2857
00010000:00010000:0.0:1651532028.182440:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532028.182441:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.182444:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.182450:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.182451:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.182452:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.182455:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.182462:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.182466:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a57c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3698688->8622079] (req 3698688->8622079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.182471:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.182485:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.182880:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532028.182898:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467938944
00000100:00100000:1.0:1651532028.182912:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2866
00000100:00100000:1.0:1651532028.182914:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467938944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532028.182921:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.182926:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532028.182927:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.182929:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532028.182930:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.182934:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.182950:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532028.249102:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792711 is committed
00010000:00010000:0.0:1651532028.249116:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.249120:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532028.249141:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467937536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 678009us (678055us total) trans 158913792711 rc 0/0
00010000:00010000:1.0:1651532028.249144:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532028.249145:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2858
00010000:00010000:1.0:1651532028.249148:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532028.249149:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.249153:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.249158:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532028.249159:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532028.249159:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.249163:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.249171:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.249175:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40a583 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1998848->9789439] (req 1998848->9789439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.249182:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.249187:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.249555:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532028.249587:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467939136
00000100:00100000:0.0:1651532028.249600:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2867
00000100:00100000:0.0:1651532028.249602:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467939136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532028.249609:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.249614:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532028.249623:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.249627:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532028.249627:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.249632:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.249636:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532028.391202:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792712 is committed
00010000:00010000:0.0:1651532028.391219:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391224:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532028.391242:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467937728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 778509us (778547us total) trans 158913792712 rc 0/0
00000100:00100000:0.0:1651532028.391245:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2859
00010000:00010000:0.0:1651532028.391269:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391275:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532028.391276:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391291:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391297:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.391298:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.391299:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391302:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391306:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.391306:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.391307:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391309:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391322:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391325:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a58a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->10170367] (req 397312->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.391334:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.391339:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391358:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391362:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.391932:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532028.391957:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467939328
00000100:00100000:0.0:1651532028.391969:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2868
00000100:00100000:0.0:1651532028.391971:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467939328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532028.391979:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391984:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532028.391985:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391988:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532028.391988:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391993:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.391996:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532028.501844:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792714 is committed
00010000:00010000:0.0:1651532028.501865:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.501870:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.501886:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.501891:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532028.501899:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467938048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 705922us (705944us total) trans 158913792713 rc 0/0
00000100:00100000:0.0:1651532028.501903:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2861
00000100:00100000:1.0:1651532028.501908:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467937920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 772578us (772600us total) trans 158913792714 rc 0/0
00000100:00100000:1.0:1651532028.501911:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2860
00010000:00010000:0.0:1651532028.501911:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.501914:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532028.501915:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.501918:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.501919:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.501924:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532028.501924:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.501925:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.501927:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a598 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5885952->5890047] (req 5885952->5890047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.501928:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.501933:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532028.501934:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532028.501934:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.501946:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.501954:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.501962:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.501966:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a591 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4415488->5885951] (req 4415488->5885951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.501966:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.502310:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532028.502325:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467939520
00000100:00100000:1.0:1651532028.502343:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2869
00000100:00100000:1.0:1651532028.502345:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467939520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532028.502352:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.502356:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532028.502357:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.502360:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532028.502361:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.502365:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.502368:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532028.624070:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792715 is committed
00010000:00010000:0.0:1651532028.624086:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624099:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532028.624117:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467938240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699580us (699665us total) trans 158913792715 rc 0/0
00000100:00100000:0.0:1651532028.624121:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2862
00010000:00010000:0.0:1651532028.624128:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624132:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532028.624133:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624136:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624141:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.624142:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.624143:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624146:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624158:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624161:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a59f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9605119] (req 217088->9605119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.624169:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.624174:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532028.624747:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532028.624757:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467939712
00000100:00100000:0.0:1651532028.624768:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2870
00000100:00100000:0.0:1651532028.624770:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467939712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532028.624777:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624781:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532028.624782:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624785:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532028.624786:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624790:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.624794:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532028.715782:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792716 is committed
00002000:00010000:1.0:1651532028.715820:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532025 -> 1651532027
00010000:00010000:1.0:1651532028.715824:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.715827:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.715849:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467938368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791166us (791198us total) trans 158913792716 rc 0/0
00010000:00010000:0.0:1651532028.715850:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.715853:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2863
00010000:00010000:0.0:1651532028.715855:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532028.715856:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.715867:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.715873:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.715874:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.715875:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.715878:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.715886:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.715889:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5a6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6725631] (req 421888->6725631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.715896:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.715900:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532028.716189:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532028.716221:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467939904
00000100:00100000:1.0:1651532028.716236:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2871
00000100:00100000:1.0:1651532028.716237:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467939904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532028.716245:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.716268:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532028.716269:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.716272:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532028.716273:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.716278:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.716281:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532028.832457:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792717 is committed
00010000:00010000:1.0:1651532028.832485:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.832490:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.832511:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467938560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 907819us (907846us total) trans 158913792717 rc 0/0
00010000:00010000:0.0:1651532028.832512:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.832515:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2864
00010000:00010000:0.0:1651532028.832517:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532028.832519:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.832522:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.832539:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.832539:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.832540:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.832543:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.832551:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.832554:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ad lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9732095] (req 2793472->9732095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.832560:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.832563:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.832827:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532028.832836:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467940096
00000100:00100000:1.0:1651532028.832850:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2872
00000100:00100000:1.0:1651532028.832852:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467940096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532028.832868:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.832872:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532028.832882:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532028.832883:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.832887:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532028.924178:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792718 is committed
00002000:00010000:0.0:1651532028.924192:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532027 -> 1651532028
00002000:00010000:0.0:1651532028.924194:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532027 -> 1651532028
00010000:00010000:0.0:1651532028.924197:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924200:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532028.924236:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467938752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 882830us (882877us total) trans 158913792718 rc 0/0
00000100:00100000:0.0:1651532028.924240:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2865
00010000:00010000:0.0:1651532028.924248:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924251:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532028.924265:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924270:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924279:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.924280:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532028.924281:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924286:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924299:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.924303:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924304:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5b4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->8781823] (req 1622016->8781823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532028.924308:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532028.924724:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532028.924763:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467940288
00000100:00100000:0.0:1651532028.924785:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2873
00000100:00100000:0.0:1651532028.924787:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467940288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532028.924794:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924799:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532028.924800:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924821:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924824:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532028.924825:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924830:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924833:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532028.924836:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532029.025552:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792719 is committed
00010000:00010000:1.0:1651532029.025580:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.025585:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.025602:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467938944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 842687us (842722us total) trans 158913792719 rc 0/0
00000100:00100000:1.0:1651532029.025606:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2866
00010000:00010000:1.0:1651532029.025613:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.025628:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532029.025629:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.025632:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.025637:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532029.025638:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532029.025639:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.025642:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.025653:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.025657:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a5bb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2244608->8540159] (req 2244608->8540159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.025673:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.025694:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532029.026115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532029.026126:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467940480
00000100:00100000:1.0:1651532029.026138:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2874
00000100:00100000:1.0:1651532029.026140:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467940480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532029.026147:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.026151:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532029.026161:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.026164:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532029.026165:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.026170:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.026173:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532029.150510:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792720 is committed
00010000:00010000:0.0:1651532029.150526:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.150531:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532029.150555:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467939136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 900952us (901000us total) trans 158913792720 rc 0/0
00000100:00100000:0.0:1651532029.150559:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2867
00010000:00010000:0.0:1651532029.150567:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.150571:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532029.150572:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.150576:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.150581:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.150581:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.150582:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.150594:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.150603:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.150606:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a5c2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->8204287] (req 69632->8204287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.150611:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.150614:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532029.150992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532029.151002:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467940672
00000100:00100000:0.0:1651532029.151017:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2875
00000100:00100000:0.0:1651532029.151019:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467940672:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532029.151027:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.151032:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532029.151033:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.151036:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532029.151045:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.151050:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.151053:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532029.242216:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792721 is committed
00010000:00010000:0.0:1651532029.242233:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.242237:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532029.242270:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467939328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 850297us (850338us total) trans 158913792721 rc 0/0
00000100:00100000:0.0:1651532029.242273:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2868
00010000:00010000:0.0:1651532029.242281:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.242285:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532029.242286:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.242289:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.242305:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.242306:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.242307:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.242310:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.242320:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.242323:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a5c9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->9895935] (req 1064960->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.242329:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.242335:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.242864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532029.242896:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467940864
00000100:00100000:1.0:1651532029.242909:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2876
00000100:00100000:1.0:1651532029.242911:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467940864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532029.242927:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.242932:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532029.242934:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.242949:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532029.242949:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.242954:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.242958:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532029.333902:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792722 is committed
00010000:00010000:1.0:1651532029.333933:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.333938:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.333958:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467939520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 831612us (831648us total) trans 158913792722 rc 0/0
00000100:00100000:1.0:1651532029.333961:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2869
00010000:00010000:1.0:1651532029.333969:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.333972:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532029.333973:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.333976:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.333991:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532029.333992:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532029.333993:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.333996:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.334008:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.334011:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a5d0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2277376->9056255] (req 2277376->9056255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.334021:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.334026:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.334383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532029.334403:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532029.334422:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467941120
00000100:00100000:1.0:1651532029.334442:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467941056
00000100:00100000:0.0:1651532029.334449:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2877
00000100:00100000:0.0:1651532029.334452:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467941120:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532029.334458:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2878
00000100:00100000:1.0:1651532029.334461:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467941056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532029.334461:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.334466:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532029.334473:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.334475:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.334478:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532029.334479:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.334484:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532029.334485:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532029.334486:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.334504:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.334504:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.334508:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532029.400613:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792723 is committed
00010000:00010000:0.0:1651532029.400628:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400632:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532029.400649:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467939712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 775878us (775903us total) trans 158913792723 rc 0/0
00000100:00100000:0.0:1651532029.400653:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2870
00010000:00010000:0.0:1651532029.400659:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400663:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532029.400664:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400679:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400684:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.400685:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.400686:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400689:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400692:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.400693:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.400693:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400696:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400708:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400711:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a5d7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.400721:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.400726:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400743:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.400747:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.401277:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532029.401293:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467941312
00000100:00100000:0.0:1651532029.401313:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2879
00000100:00100000:0.0:1651532029.401316:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754467941312:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532029.401326:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.401333:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532029.401334:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.401339:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.401344:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532029.401345:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.401351:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.401354:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.401357:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532029.508986:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792725 is committed
00010000:00010000:0.0:1651532029.509015:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.509020:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509028:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509033:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532029.509038:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467940096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 676185us (676211us total) trans 158913792725 rc 0/0
00000100:00100000:0.0:1651532029.509041:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2872
00010000:00010000:0.0:1651532029.509049:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.509052:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467939904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 792814us (792864us total) trans 158913792724 rc 0/0
00010000:00010000:0.0:1651532029.509052:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532029.509054:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.509056:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2871
00010000:00010000:0.0:1651532029.509056:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.509062:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509064:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.509065:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a5e5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3043328->6615039] (req 3043328->6615039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509068:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532029.509069:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509072:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509088:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532029.509088:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532029.509089:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509093:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.509110:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.509114:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509116:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509119:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a5de lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->2887679] (req 1822720->2887679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.509521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532029.509538:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532029.509540:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467941504
00000100:00100000:0.0:1651532029.509547:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467941696
00000100:00100000:1.0:1651532029.509552:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2880
00000100:00100000:1.0:1651532029.509554:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467941504:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532029.509562:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2881
00000100:00100000:0.0:1651532029.509565:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467941696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532029.509573:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.509573:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.509577:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532029.509578:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.509581:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532029.509582:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509586:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532029.509587:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509602:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532029.509603:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.509618:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509619:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.509622:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.509623:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532029.608996:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792726 is committed
00010000:00010000:0.0:1651532029.609012:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609016:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532029.609058:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467940288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 684270us (684333us total) trans 158913792726 rc 0/0
00000100:00100000:0.0:1651532029.609061:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2873
00010000:00010000:0.0:1651532029.609069:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609073:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532029.609074:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609077:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609082:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.609083:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.609083:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609086:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609096:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609099:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a5ec lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10436607] (req 24576->10436607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.609110:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.609115:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.609647:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532029.609654:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467941824
00000100:00100000:0.0:1651532029.609675:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2882
00000100:00100000:0.0:1651532029.609677:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467941824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532029.609684:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609689:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532029.609690:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609692:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532029.609693:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609697:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.609701:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532029.750609:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792727 is committed
00002000:00010000:1.0:1651532029.750640:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532028 -> 1651532029
00002000:00010000:1.0:1651532029.750642:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532028 -> 1651532029
00010000:00010000:1.0:1651532029.750645:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.750650:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.750678:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.750682:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532029.750683:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467940480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724542us (724569us total) trans 158913792727 rc 0/0
00010000:00010000:0.0:1651532029.750683:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.750687:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2874
00010000:00010000:0.0:1651532029.750687:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.750703:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.750704:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.750705:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.750708:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.750715:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.750718:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a5f3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10440703] (req 2019328->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.750733:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.750752:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.751163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532029.751182:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467942016
00000100:00100000:1.0:1651532029.751199:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2883
00000100:00100000:1.0:1651532029.751201:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467942016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532029.751209:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.751214:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532029.751215:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.751218:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532029.751219:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.751224:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.751227:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532029.817387:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792728 is committed
00010000:00010000:1.0:1651532029.817420:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.817435:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.817455:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467940672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 666436us (666463us total) trans 158913792728 rc 0/0
00000100:00100000:1.0:1651532029.817459:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2875
00010000:00010000:1.0:1651532029.817467:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.817470:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532029.817471:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.817474:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.817479:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532029.817480:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532029.817481:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.817484:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.817491:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.817504:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40a5fa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4599808->10211327] (req 4599808->10211327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.817510:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.817513:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.817971:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532029.817989:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467942208
00000100:00100000:1.0:1651532029.818006:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2884
00000100:00100000:1.0:1651532029.818008:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467942208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532029.818016:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.818021:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532029.818022:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.818025:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532029.818025:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.818030:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.818044:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532029.925697:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792729 is committed
00010000:00010000:1.0:1651532029.925729:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.925734:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.925757:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467940864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 682845us (682893us total) trans 158913792729 rc 0/0
00010000:00010000:0.0:1651532029.925757:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.925761:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2876
00010000:00010000:0.0:1651532029.925762:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532029.925763:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.925767:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.925773:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.925773:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.925782:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.925785:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.925789:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.925789:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532029.925790:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.925793:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.925814:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.925815:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.925818:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.925818:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a601 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->9195519] (req 692224->9195519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.925823:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532029.925826:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532029.926330:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532029.926406:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467942400
00000100:00100000:1.0:1651532029.926423:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2885
00000100:00100000:1.0:1651532029.926425:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467942400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532029.926432:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.926448:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532029.926458:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.926461:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532029.926462:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.926467:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532029.926470:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532030.042407:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792731 is committed
00010000:00010000:0.0:1651532030.042429:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.042434:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042448:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042457:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.042464:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467941120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 708011us (708081us total) trans 158913792730 rc 0/0
00000100:00100000:0.0:1651532030.042468:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2877
00000100:00100000:1.0:1651532030.042482:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467941056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 708020us (708078us total) trans 158913792731 rc 0/0
00010000:00010000:0.0:1651532030.042482:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.042486:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2878
00010000:00010000:0.0:1651532030.042486:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532030.042487:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.042490:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042494:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.042495:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042498:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532030.042498:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a608 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3592192->3596287] (req 3592192->3596287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042499:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042514:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042519:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532030.042520:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532030.042521:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042524:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042533:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.042539:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.042543:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042544:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a60f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6942720->9850879] (req 6942720->9850879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.042775:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532030.042819:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467942592
00000100:00100000:1.0:1651532030.042834:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2886
00000100:00100000:1.0:1651532030.042836:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467942592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532030.042842:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042847:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532030.042848:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042850:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532030.042858:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042863:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.042867:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.042874:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532030.042910:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467942656
00000100:00100000:0.0:1651532030.042922:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2887
00000100:00100000:0.0:1651532030.042924:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467942656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532030.042931:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.042935:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.042937:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532030.042937:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.042941:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532030.150792:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792732 is committed
00010000:00010000:0.0:1651532030.150819:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.150824:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.150842:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467941312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749526us (749565us total) trans 158913792732 rc 0/0
00000100:00100000:0.0:1651532030.150845:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2879
00010000:00010000:0.0:1651532030.150852:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.150856:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532030.150857:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.150869:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.150874:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.150875:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.150876:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.150879:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.150886:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.150889:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a616 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10461183] (req 659456->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.150894:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.150897:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.151453:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532030.151463:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467942848
00000100:00100000:0.0:1651532030.151474:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2888
00000100:00100000:0.0:1651532030.151476:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467942848:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532030.151493:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.151498:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532030.151499:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.151501:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532030.151502:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.151507:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.151510:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532030.267423:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792733 is committed
00010000:00010000:0.0:1651532030.267438:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267442:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.267458:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467941696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 757893us (757921us total) trans 158913792733 rc 0/0
00000100:00100000:0.0:1651532030.267462:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2881
00010000:00010000:0.0:1651532030.267468:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267481:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532030.267482:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267485:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267490:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.267491:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.267492:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267495:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267507:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267510:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a624 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.267522:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.267527:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.267792:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532030.267834:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467943040
00000100:00100000:0.0:1651532030.267845:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2889
00000100:00100000:0.0:1651532030.267847:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467943040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532030.267854:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267869:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532030.267870:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267873:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532030.267874:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267878:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.267881:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532030.384072:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792734 is committed
00010000:00010000:1.0:1651532030.384102:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.384107:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.384131:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467941504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 874576us (874610us total) trans 158913792734 rc 0/0
00000100:00100000:1.0:1651532030.384135:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2880
00010000:00010000:1.0:1651532030.384143:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.384146:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532030.384147:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.384159:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.384165:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532030.384166:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532030.384167:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.384170:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.384190:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.384193:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a61d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.384203:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.384208:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.384521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532030.384533:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467943168
00000100:00100000:1.0:1651532030.384547:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2890
00000100:00100000:1.0:1651532030.384549:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467943168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532030.384556:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.384560:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532030.384561:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532030.384562:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.384575:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532030.450866:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792735 is committed
00010000:00010000:0.0:1651532030.450882:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.450887:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.450917:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467941824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841239us (841284us total) trans 158913792735 rc 0/0
00000100:00100000:0.0:1651532030.450920:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2882
00010000:00010000:0.0:1651532030.450928:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.450931:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532030.450933:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.450936:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.450941:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.450941:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.450942:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.450945:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.450958:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.450961:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a62b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9662463] (req 1191936->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.450971:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.450976:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.451565:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532030.451574:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467943360
00000100:00100000:0.0:1651532030.451590:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2891
00000100:00100000:0.0:1651532030.451592:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467943360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532030.451600:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.451604:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532030.451605:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.451608:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.451611:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532030.451611:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.451616:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.451618:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.451622:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532030.592434:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792736 is committed
00010000:00010000:1.0:1651532030.592467:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.592472:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.592494:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467942016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841292us (841331us total) trans 158913792736 rc 0/0
00010000:00010000:0.0:1651532030.592495:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.592497:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2883
00010000:00010000:0.0:1651532030.592500:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532030.592501:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.592505:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.592510:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.592511:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.592512:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.592515:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.592524:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.592527:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a632 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9797631] (req 1015808->9797631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.592543:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.592547:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.592989:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532030.593003:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467943552
00000100:00100000:1.0:1651532030.593016:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2892
00000100:00100000:1.0:1651532030.593018:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467943552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532030.593035:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.593039:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532030.593040:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.593043:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532030.593044:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.593048:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.593052:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532030.707044:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792737 is committed
00010000:00010000:1.0:1651532030.707074:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707078:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.707095:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467942208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 889086us (889125us total) trans 158913792737 rc 0/0
00000100:00100000:1.0:1651532030.707099:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2884
00010000:00010000:1.0:1651532030.707105:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707120:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532030.707121:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707124:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707129:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532030.707130:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532030.707131:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707134:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707141:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707144:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a639 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->6135807] (req 925696->6135807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707149:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707152:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.707572:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532030.707590:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467943744
00000100:00100000:1.0:1651532030.707601:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2893
00000100:00100000:1.0:1651532030.707603:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467943744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532030.707610:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707615:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532030.707616:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707619:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707621:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532030.707622:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707626:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707629:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.707632:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532030.767583:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792738 is committed
00010000:00010000:1.0:1651532030.767624:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.767639:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.767661:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467942400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841235us (841331us total) trans 158913792738 rc 0/0
00010000:00010000:0.0:1651532030.767663:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.767664:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2885
00010000:00010000:0.0:1651532030.767668:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532030.767670:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.767673:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.767679:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.767680:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.767680:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.767683:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.767687:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.767687:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.767688:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.767691:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.767702:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.767705:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a640 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->8523775] (req 1802240->8523775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.767717:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.767720:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.767725:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.767729:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.768240:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532030.768339:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467943936
00000100:00100000:1.0:1651532030.768350:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2894
00000100:00100000:1.0:1651532030.768352:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467943936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532030.768359:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.768364:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532030.768365:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.768368:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532030.768369:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.768396:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.768400:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532030.892488:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792740 is committed
00002000:00010000:0.0:1651532030.892509:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532029 -> 1651532030
00002000:00010000:0.0:1651532030.892510:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532029 -> 1651532030
00010000:00010000:0.0:1651532030.892513:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.892517:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892522:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892531:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.892538:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467942656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849613us (849665us total) trans 158913792739 rc 0/0
00000100:00100000:0.0:1651532030.892548:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2887
00000100:00100000:1.0:1651532030.892556:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467942592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849719us (849782us total) trans 158913792740 rc 0/0
00010000:00010000:0.0:1651532030.892556:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.892559:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2886
00010000:00010000:0.0:1651532030.892559:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532030.892560:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.892564:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892568:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892571:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532030.892572:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892575:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.892579:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892581:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532030.892582:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532030.892582:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a64e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892591:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892594:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892604:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892607:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a647 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3256320->10199039] (req 3256320->10199039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892617:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.892620:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532030.892971:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532030.892981:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467944128
00000100:00100000:0.0:1651532030.892981:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532030.892990:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467944320
00000100:00100000:1.0:1651532030.892991:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2895
00000100:00100000:1.0:1651532030.892993:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467944128:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532030.893005:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2896
00010000:00010000:1.0:1651532030.893007:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532030.893007:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467944320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532030.893012:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532030.893013:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.893014:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.893015:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532030.893024:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.893029:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532030.893030:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.893033:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532030.893034:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.893037:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.893038:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532030.893041:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532030.893042:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.017564:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792741 is committed
00010000:00010000:1.0:1651532031.017603:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.017607:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.017630:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467942848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866153us (866177us total) trans 158913792741 rc 0/0
00010000:00010000:0.0:1651532031.017630:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.017633:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2888
00010000:00010000:0.0:1651532031.017635:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532031.017636:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.017639:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.017645:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.017646:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.017646:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.017649:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.017653:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.017653:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.017654:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.017657:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.017668:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.017679:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a655 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9756671] (req 729088->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.017680:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.017684:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.017685:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.017688:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.018159:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532031.018177:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467944448
00000100:00100000:1.0:1651532031.018194:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2897
00000100:00100000:1.0:1651532031.018196:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467944448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532031.018213:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.018218:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532031.018219:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.018222:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532031.018223:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.018227:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.018230:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.134196:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792743 is committed
00010000:00010000:0.0:1651532031.134217:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.134222:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.134228:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.134232:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532031.134243:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467943040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866394us (866451us total) trans 158913792742 rc 0/0
00000100:00100000:0.0:1651532031.134247:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2889
00000100:00100000:1.0:1651532031.134265:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467943168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749715us (749744us total) trans 158913792743 rc 0/0
00000100:00100000:1.0:1651532031.134269:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2890
00010000:00010000:0.0:1651532031.134270:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.134276:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532031.134277:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.134278:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.134283:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.134292:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532031.134293:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.134297:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.134306:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.134307:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.134309:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.134312:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.134317:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.134320:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a663 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->10043391] (req 3923968->10043391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.134321:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.134324:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a65c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3198976->3203071] (req 3198976->3203071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.134330:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.134333:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532031.134694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532031.134716:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467944640
00000100:00100000:1.0:1651532031.134731:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2898
00000100:00100000:1.0:1651532031.134733:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467944640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532031.134740:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.134744:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532031.134745:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.134748:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532031.134749:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.134764:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.134767:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.266439:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792744 is committed
00010000:00010000:0.0:1651532031.266455:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.266459:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532031.266494:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467943360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 814901us (814929us total) trans 158913792744 rc 0/0
00000100:00100000:0.0:1651532031.266498:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2891
00010000:00010000:0.0:1651532031.266505:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.266509:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532031.266510:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.266513:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.266518:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.266519:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.266519:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.266523:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.266532:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.266535:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a66a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2584576->10207231] (req 2584576->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.266545:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.266550:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532031.267049:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532031.267059:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467944832
00000100:00100000:0.0:1651532031.267070:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2899
00000100:00100000:0.0:1651532031.267072:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467944832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532031.267079:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.267084:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532031.267084:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.267087:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532031.267088:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.267092:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.267096:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.375863:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792745 is committed
00010000:00010000:1.0:1651532031.375894:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.375899:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.375918:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467943552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 782898us (782929us total) trans 158913792745 rc 0/0
00000100:00100000:1.0:1651532031.375921:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2892
00010000:00010000:1.0:1651532031.375928:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.375932:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532031.375933:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.375947:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.375953:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532031.375954:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532031.375955:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.375958:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.375965:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.375968:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a671 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->9072639] (req 2453504->9072639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.375974:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.375977:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.376429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532031.376447:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467945024
00000100:00100000:1.0:1651532031.376464:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2900
00000100:00100000:1.0:1651532031.376466:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467945024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532031.376483:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.376487:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532031.376488:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.376491:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532031.376492:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.376496:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.376500:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.484216:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792746 is committed
00010000:00010000:1.0:1651532031.484248:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.484262:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.484285:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467943744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 776681us (776713us total) trans 158913792746 rc 0/0
00010000:00010000:0.0:1651532031.484287:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.484288:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2893
00010000:00010000:0.0:1651532031.484292:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532031.484301:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.484305:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.484311:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.484312:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.484312:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.484316:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.484325:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.484328:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a678 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->6717439] (req 28672->6717439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.484349:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.484364:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.484657:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532031.484666:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467945216
00000100:00100000:1.0:1651532031.484686:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2901
00000100:00100000:1.0:1651532031.484688:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467945216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532031.484702:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.484706:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532031.484707:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.484717:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532031.484717:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.484722:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.484726:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.605461:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792747 is committed
00010000:00010000:1.0:1651532031.605491:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.605506:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.605528:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467943936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 837175us (837301us total) trans 158913792747 rc 0/0
00010000:00010000:0.0:1651532031.605529:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.605531:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2894
00010000:00010000:0.0:1651532031.605533:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532031.605534:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.605537:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.605553:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.605554:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.605555:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.605558:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.605564:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.605567:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a67f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9109503] (req 12288->9109503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.605582:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.605586:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.606117:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532031.606205:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467945408
00000100:00100000:1.0:1651532031.606222:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2902
00000100:00100000:1.0:1651532031.606223:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467945408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532031.606231:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.606235:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532031.606236:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.606239:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532031.606239:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.606275:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.606279:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.668469:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792748 is committed
00010000:00010000:1.0:1651532031.668497:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668501:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.668519:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467944128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 775524us (775548us total) trans 158913792748 rc 0/0
00000100:00100000:1.0:1651532031.668522:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2895
00010000:00010000:1.0:1651532031.668528:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668532:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532031.668533:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668536:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668540:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532031.668541:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532031.668550:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668554:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668565:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668568:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a686 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7299072->9232383] (req 7299072->9232383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.668578:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.668583:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532031.668856:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532031.668866:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467945600
00000100:00100000:1.0:1651532031.668881:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2903
00000100:00100000:1.0:1651532031.668883:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467945600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532031.668889:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668893:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532031.668894:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668897:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532031.668898:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668902:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.668905:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.734317:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792749 is committed
00010000:00010000:0.0:1651532031.734332:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.734336:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532031.734370:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467944320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841362us (841390us total) trans 158913792749 rc 0/0
00000100:00100000:0.0:1651532031.734374:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2896
00010000:00010000:0.0:1651532031.734382:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.734385:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532031.734386:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.734389:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.734394:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.734395:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.734396:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.734399:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.734408:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.734411:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a68d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8638464->8642559] (req 8638464->8642559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.734420:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.734424:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.734677:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532031.734694:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467945792
00000100:00100000:0.0:1651532031.734715:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2904
00000100:00100000:0.0:1651532031.734717:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467945792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532031.734724:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.734728:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532031.734729:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532031.734730:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.734733:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.801069:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792750 is committed
00002000:00010000:1.0:1651532031.801101:0:330054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532030 -> 1651532031
00002000:00010000:1.0:1651532031.801103:0:330054:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532030 -> 1651532031
00010000:00010000:1.0:1651532031.801106:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.801110:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.801132:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467944448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 782935us (782973us total) trans 158913792750 rc 0/0
00010000:00010000:0.0:1651532031.801134:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.801135:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2897
00010000:00010000:0.0:1651532031.801138:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532031.801139:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.801143:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.801148:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.801149:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.801150:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.801153:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.801171:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.801174:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a694 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9334783] (req 135168->9334783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.801187:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.801191:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.801677:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532031.801757:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467945920
00000100:00100000:1.0:1651532031.801781:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2905
00000100:00100000:1.0:1651532031.801783:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467945920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532031.801791:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.801795:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532031.801796:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.801799:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.801802:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532031.801818:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.801824:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.801827:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.801830:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.892715:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792751 is committed
00010000:00010000:1.0:1651532031.892742:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.892746:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.892775:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467944640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 758042us (758082us total) trans 158913792751 rc 0/0
00010000:00010000:0.0:1651532031.892776:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.892779:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2898
00010000:00010000:0.0:1651532031.892780:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532031.892781:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.892784:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.892790:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.892791:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.892791:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.892794:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.892812:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.892825:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a69b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5672959] (req 888832->5672959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.892826:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.892830:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.893118:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532031.893144:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532031.893154:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467946112
00000100:00100000:0.0:1651532031.893167:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467946176
00000100:00100000:0.0:1651532031.893175:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2906
00000100:00100000:0.0:1651532031.893177:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467946112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532031.893185:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.893189:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532031.893190:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.893193:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532031.893194:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.893198:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.893202:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.893213:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2907
00000100:00100000:1.0:1651532031.893215:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467946176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532031.893224:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.893228:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532031.893229:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.893232:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532031.893233:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.893237:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.893240:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532031.959491:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792752 is committed
00010000:00010000:1.0:1651532031.959524:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.959528:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.959547:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.959551:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467944832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 692478us (692502us total) trans 158913792752 rc 0/0
00000100:00100000:1.0:1651532031.959555:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2899
00010000:00010000:0.0:1651532031.959560:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532031.959561:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.959565:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.959571:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.959571:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532031.959572:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.959575:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.959585:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532031.959589:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6a2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9826303] (req 1069056->9826303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.959602:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.959606:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532031.960086:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532031.960104:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467946368
00000100:00100000:1.0:1651532031.960120:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2908
00000100:00100000:1.0:1651532031.960122:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467946368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532031.960129:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.960133:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532031.960134:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.960137:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532031.960147:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.960152:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532031.960155:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532032.076131:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792753 is committed
00010000:00010000:1.0:1651532032.076162:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076167:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.076185:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467945024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699718us (699756us total) trans 158913792753 rc 0/0
00000100:00100000:1.0:1651532032.076188:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2900
00010000:00010000:1.0:1651532032.076195:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076199:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532032.076200:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076203:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076208:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532032.076217:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532032.076218:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076221:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076229:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076232:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6a9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->10379263] (req 2093056->10379263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076238:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076241:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.076680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532032.076698:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467946560
00000100:00100000:1.0:1651532032.076709:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2909
00000100:00100000:1.0:1651532032.076711:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467946560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532032.076718:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076723:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532032.076724:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076739:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532032.076740:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076744:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.076748:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532032.184493:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792754 is committed
00010000:00010000:1.0:1651532032.184525:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.184529:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.184551:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467945216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699861us (699894us total) trans 158913792754 rc 0/0
00010000:00010000:0.0:1651532032.184553:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.184554:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2901
00010000:00010000:0.0:1651532032.184559:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532032.184560:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.184572:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.184578:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.184578:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.184579:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.184582:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.184589:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.184592:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a6b0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10235903] (req 1105920->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.184606:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.184610:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.184977:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532032.184994:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467946752
00000100:00100000:1.0:1651532032.185014:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2910
00000100:00100000:1.0:1651532032.185016:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467946752:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532032.185023:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.185027:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532032.185028:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.185031:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532032.185032:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.185036:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.185040:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532032.259584:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792755 is committed
00010000:00010000:1.0:1651532032.259615:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.259620:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.259642:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467945408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 653418us (653525us total) trans 158913792755 rc 0/0
00010000:00010000:0.0:1651532032.259643:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.259646:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2902
00010000:00010000:0.0:1651532032.259647:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532032.259648:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.259652:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.259667:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.259668:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.259669:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.259672:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.259675:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.259676:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.259676:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.259679:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.259690:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.259694:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a6b7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10473471] (req 0->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.259696:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.259699:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.259702:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.259708:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.260281:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532032.260291:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467946944
00000100:00100000:1.0:1651532032.260301:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2911
00000100:00100000:1.0:1651532032.260303:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467946944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532032.260310:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.260315:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532032.260316:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.260319:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532032.260319:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.260324:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.260327:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532032.384570:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792757 is committed
00010000:00010000:0.0:1651532032.384600:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384604:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.384610:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532032.384626:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467945792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 649908us (649950us total) trans 158913792756 rc 0/0
00000100:00100000:0.0:1651532032.384630:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2904
00010000:00010000:1.0:1651532032.384632:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384650:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.384652:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467945600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 715769us (715798us total) trans 158913792757 rc 0/0
00010000:00010000:0.0:1651532032.384654:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532032.384655:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.384656:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2903
00010000:00010000:0.0:1651532032.384658:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384664:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384667:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a6c5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->1486847] (req 1482752->1486847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384671:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384673:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532032.384682:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384685:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384689:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.384690:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.384690:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384693:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384703:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.384706:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a6be lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5083136->10141695] (req 5083136->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.384716:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.384721:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.385089:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532032.385113:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532032.385134:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467947264
00000100:00100000:0.0:1651532032.385148:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467947136
00000100:00100000:0.0:1651532032.385156:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2912
00000100:00100000:1.0:1651532032.385158:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2913
00000100:00100000:0.0:1651532032.385158:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467947264:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532032.385161:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467947136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532032.385165:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.385169:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532032.385170:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.385176:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.385184:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532032.385185:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.385189:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532032.385190:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532032.385191:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.385195:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.385195:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.385199:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532032.492866:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792758 is committed
00010000:00010000:1.0:1651532032.492899:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.492903:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.492926:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467945920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691142us (691256us total) trans 158913792758 rc 0/0
00010000:00010000:0.0:1651532032.492926:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.492930:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2905
00010000:00010000:0.0:1651532032.492931:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532032.492932:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.492935:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.492941:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.492941:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.492942:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.492945:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.492964:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.492967:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a6cc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10145791] (req 225280->10145791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.492973:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.492976:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.493516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532032.493561:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467947456
00000100:00100000:1.0:1651532032.493575:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2914
00000100:00100000:1.0:1651532032.493577:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467947456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532032.493584:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.493589:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532032.493590:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.493593:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.493595:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532032.493596:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.493612:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.493615:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.493618:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532032.584565:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792759 is committed
00010000:00010000:0.0:1651532032.584580:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.584584:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532032.584606:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467946112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691428us (691489us total) trans 158913792759 rc 0/0
00010000:00010000:1.0:1651532032.584609:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532032.584610:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2906
00010000:00010000:1.0:1651532032.584614:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532032.584615:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.584618:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.584624:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532032.584625:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532032.584626:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.584629:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.584637:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.584647:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.584652:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.584655:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40a6d3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3244032->9953279] (req 3244032->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.584944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532032.584968:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467947648
00000100:00100000:0.0:1651532032.584980:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2915
00000100:00100000:0.0:1651532032.584982:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467947648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532032.584990:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.584994:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.584995:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.584998:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532032.584999:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.585003:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.585007:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532032.692933:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792760 is committed
00010000:00010000:0.0:1651532032.692949:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.692953:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532032.692983:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467946176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799766us (799839us total) trans 158913792760 rc 0/0
00000100:00100000:0.0:1651532032.692987:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2907
00010000:00010000:0.0:1651532032.692994:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.692998:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532032.692999:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.693002:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.693007:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.693007:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.693008:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.693011:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.693024:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.693027:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a6da lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8577024->8581119] (req 8577024->8581119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.693036:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.693043:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532032.693355:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532032.693373:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467947840
00000100:00100000:0.0:1651532032.693385:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2916
00000100:00100000:0.0:1651532032.693387:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467947840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532032.693394:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.693399:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532032.693400:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.693403:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532032.693403:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.693408:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.693411:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532032.759652:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792761 is committed
00010000:00010000:1.0:1651532032.759683:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.759688:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.759711:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467946368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799588us (799625us total) trans 158913792761 rc 0/0
00010000:00010000:0.0:1651532032.759711:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.759715:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2908
00010000:00010000:0.0:1651532032.759716:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532032.759717:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.759721:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.759734:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.759735:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532032.759736:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.759739:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.759749:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532032.759752:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a6e1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10190847] (req 57344->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.759773:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.759777:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.760238:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532032.760291:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467947968
00000100:00100000:1.0:1651532032.760316:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2917
00000100:00100000:1.0:1651532032.760318:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467947968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532032.760326:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.760331:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532032.760332:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532032.760333:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.760336:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532032.884644:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792762 is committed
00002000:00010000:1.0:1651532032.884671:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532031 -> 1651532032
00002000:00010000:1.0:1651532032.884673:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532031 -> 1651532032
00010000:00010000:1.0:1651532032.884675:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.884679:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.884702:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467946560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 807990us (808022us total) trans 158913792762 rc 0/0
00000100:00100000:1.0:1651532032.884705:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2909
00010000:00010000:1.0:1651532032.884713:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.884716:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532032.884726:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.884729:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.884743:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532032.884744:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532032.884745:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.884748:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.884756:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.884759:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a6e8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9908223] (req 225280->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.884764:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.884767:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532032.885149:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532032.885158:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467948160
00000100:00100000:1.0:1651532032.885173:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2918
00000100:00100000:1.0:1651532032.885175:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467948160:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532032.885191:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.885195:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532032.885196:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.885199:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.885201:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532032.885202:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.885206:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.885209:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532032.885212:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532033.001361:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792763 is committed
00010000:00010000:1.0:1651532033.001391:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.001396:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.001426:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.001431:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467946752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816414us (816455us total) trans 158913792763 rc 0/0
00000100:00100000:1.0:1651532033.001435:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2910
00010000:00010000:0.0:1651532033.001437:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532033.001438:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.001442:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.001448:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532033.001448:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532033.001458:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.001461:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.001472:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.001475:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a6ef lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3555328->10285055] (req 3555328->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.001486:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.001490:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.001788:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532033.001797:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467948352
00000100:00100000:1.0:1651532033.001821:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2919
00000100:00100000:1.0:1651532033.001823:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467948352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532033.001831:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.001835:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532033.001836:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.001839:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532033.001840:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.001850:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.001864:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532033.132470:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792764 is committed
00010000:00010000:1.0:1651532033.132500:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132504:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.132523:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467946944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 872218us (872242us total) trans 158913792764 rc 0/0
00000100:00100000:1.0:1651532033.132526:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2911
00010000:00010000:1.0:1651532033.132533:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132536:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532033.132537:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132540:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132545:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.132546:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.132547:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132561:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132565:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.132565:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.132566:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132569:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132582:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132585:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a6f6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10285055] (req 151552->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132591:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.132593:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.132595:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.132600:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.133174:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532033.133192:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467948544
00000100:00100000:1.0:1651532033.133209:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2920
00000100:00100000:1.0:1651532033.133211:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467948544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532033.133218:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.133230:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532033.133231:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.133234:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532033.133235:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.133239:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.133243:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532033.230024:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792766 is committed
00010000:00010000:0.0:1651532033.230046:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230051:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.230056:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.230061:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.230078:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467947264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 844919us (844989us total) trans 158913792766 rc 0/0
00000100:00100000:1.0:1651532033.230084:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467947136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 844923us (844970us total) trans 158913792765 rc 0/0
00000100:00100000:1.0:1651532033.230088:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2913
00000100:00100000:0.0:1651532033.230092:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2912
00010000:00010000:0.0:1651532033.230102:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230105:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532033.230107:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230109:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230115:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230118:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a6fd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->5894143] (req 1048576->5894143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230122:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230124:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532033.230125:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230128:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230131:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532033.230138:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532033.230139:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230142:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230151:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230155:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a704 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8028160->8032255] (req 8028160->8032255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.230157:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.230161:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.230531:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532033.230551:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467948736
00000100:00100000:1.0:1651532033.230562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532033.230567:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2921
00000100:00100000:0.0:1651532033.230569:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467948736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532033.230577:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230587:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532033.230588:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230591:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532033.230592:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230596:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230611:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.230618:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467948864
00000100:00100000:0.0:1651532033.230628:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2922
00000100:00100000:0.0:1651532033.230630:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467948864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532033.230635:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230638:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532033.230639:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230642:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532033.230643:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230646:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.230649:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.248094:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532033.248104:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229120
00000100:00100000:0.0:1651532033.248113:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 43
00000100:00100000:0.0:1651532033.248115:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951229120:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532033.248130:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1433600 granted 357225024 pending 401408 free 81138851840 avail 76963782656
00000100:00100000:0.0:1651532033.248148:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951229120:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 32us (54us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532033.248151:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 43
00000001:00080000:0.0:1651532033.293066:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792767 is committed
00010000:00010000:1.0:1651532033.293094:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.293099:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.293121:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467947456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799543us (799606us total) trans 158913792767 rc 0/0
00000100:00100000:1.0:1651532033.293124:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2914
00010000:00010000:1.0:1651532033.293132:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.293135:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532033.293136:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.293139:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.293144:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.293145:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.293146:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.293149:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.293180:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.293183:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a70b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->8232959] (req 499712->8232959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.293191:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.293197:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.293653:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532033.293688:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467949056
00000100:00100000:1.0:1651532033.293703:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2923
00000100:00100000:1.0:1651532033.293705:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467949056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532033.293712:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.293716:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532033.293717:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532033.293718:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.293721:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532033.401428:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792768 is committed
00010000:00010000:0.0:1651532033.401444:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.401449:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.401470:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.401472:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467947648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816488us (816528us total) trans 158913792768 rc 0/0
00010000:00010000:1.0:1651532033.401475:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532033.401476:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.401476:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2915
00010000:00010000:1.0:1651532033.401490:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.401496:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.401496:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.401497:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.401500:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.401503:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.401504:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.401505:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.401515:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.401529:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.401532:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40a712 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->8065023] (req 2342912->8065023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.401538:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.401541:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.401543:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.401548:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.401849:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532033.401866:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467949248
00000100:00100000:0.0:1651532033.401880:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2924
00000100:00100000:0.0:1651532033.401882:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754467949248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532033.401890:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.401895:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532033.401896:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.401899:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.401901:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532033.401902:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.401906:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.401909:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.401912:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532033.484796:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792770 is committed
00010000:00010000:0.0:1651532033.484835:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.484839:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.484844:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.484849:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.484856:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467947840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791468us (791502us total) trans 158913792770 rc 0/0
00000100:00100000:0.0:1651532033.484860:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2916
00000100:00100000:1.0:1651532033.484865:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467947968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724546us (724628us total) trans 158913792769 rc 0/0
00010000:00010000:0.0:1651532033.484867:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.484869:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2917
00010000:00010000:0.0:1651532033.484870:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532033.484871:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.484874:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.484877:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.484880:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532033.484880:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.484881:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.484883:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a719 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.484884:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.484889:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.484890:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.484890:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.484893:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.484912:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.484915:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a720 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4116480->4120575] (req 4116480->4120575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.484918:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.484922:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.485162:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532033.485183:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467949568
00000100:00100000:1.0:1651532033.485201:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2925
00000100:00100000:1.0:1651532033.485203:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467949568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532033.485210:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.485214:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532033.485215:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.485218:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532033.485219:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.485223:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.485226:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.485308:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532033.485393:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467949696
00000100:00100000:0.0:1651532033.485410:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2926
00000100:00100000:0.0:1651532033.485412:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467949696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532033.485420:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.485424:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532033.485426:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532033.485426:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.485430:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532033.605575:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792771 is committed
00010000:00010000:0.0:1651532033.605591:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.605595:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.605617:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.605617:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467948160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 720441us (720468us total) trans 158913792771 rc 0/0
00000100:00100000:0.0:1651532033.605621:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2918
00010000:00010000:1.0:1651532033.605622:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532033.605623:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.605626:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.605631:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.605632:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.605633:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.605636:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.605643:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.605647:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a727 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9408511] (req 32768->9408511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.605652:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.605663:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.606180:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532033.606200:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467949824
00000100:00100000:0.0:1651532033.606216:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2927
00000100:00100000:0.0:1651532033.606225:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467949824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532033.606234:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.606238:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532033.606239:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.606242:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532033.606243:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.606248:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.606251:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532033.689583:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792772 is committed
00010000:00010000:1.0:1651532033.689613:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.689618:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.689638:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467948352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 687814us (687851us total) trans 158913792772 rc 0/0
00000100:00100000:1.0:1651532033.689642:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2919
00010000:00010000:0.0:1651532033.689642:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.689646:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532033.689648:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.689651:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.689667:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532033.689668:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532033.689669:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.689672:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.689679:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.689682:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a72e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9940991] (req 2072576->9940991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.689694:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.689698:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.690072:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532033.690081:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467950016
00000100:00100000:1.0:1651532033.690092:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2928
00000100:00100000:1.0:1651532033.690094:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467950016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532033.690101:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.690105:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532033.690106:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.690122:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.690125:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532033.690125:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.690130:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.690133:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.690137:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532033.736249:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792773 is committed
00002000:00010000:1.0:1651532033.736281:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532032 -> 1651532033
00010000:00010000:1.0:1651532033.736284:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736288:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.736305:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467948544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 603094us (603132us total) trans 158913792773 rc 0/0
00000100:00100000:1.0:1651532033.736309:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2920
00010000:00010000:1.0:1651532033.736315:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736327:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532033.736329:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736332:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736337:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.736337:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.736338:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736341:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736353:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736356:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a735 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8253439] (req 532480->8253439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.736367:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.736371:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.736722:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532033.736731:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467950208
00000100:00100000:1.0:1651532033.736741:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2929
00000100:00100000:1.0:1651532033.736743:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467950208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532033.736750:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736770:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532033.736771:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736774:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532033.736775:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736779:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.736783:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532033.860861:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792774 is committed
00010000:00010000:0.0:1651532033.860877:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.860883:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.860917:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467948736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 630347us (630387us total) trans 158913792774 rc 0/0
00010000:00010000:1.0:1651532033.860918:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.860921:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2921
00010000:00010000:1.0:1651532033.860923:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532033.860924:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.860927:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.860932:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.860933:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.860934:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.860947:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.860951:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.860951:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.860952:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.860955:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.860976:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.860979:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40a73c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9613311] (req 196608->9613311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.860985:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.860985:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.860988:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.860990:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.861500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532033.861514:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467950400
00000100:00100000:0.0:1651532033.861528:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2930
00000100:00100000:0.0:1651532033.861530:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467950400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532033.861538:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.861543:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532033.861544:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.861547:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532033.861548:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.861552:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.861567:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532033.911317:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792776 is committed
00010000:00010000:0.0:1651532033.911338:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.911342:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911346:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911351:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.911358:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467948864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 680728us (680797us total) trans 158913792775 rc 0/0
00000100:00100000:0.0:1651532033.911362:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2922
00010000:00010000:0.0:1651532033.911369:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.911373:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532033.911374:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.911377:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.911379:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467949056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 617674us (617727us total) trans 158913792776 rc 0/0
00010000:00010000:0.0:1651532033.911382:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532033.911383:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2923
00010000:00010000:0.0:1651532033.911385:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a743 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->2174975] (req 2170880->2174975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911390:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911394:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532033.911395:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911398:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911403:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.911404:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532033.911404:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911407:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911417:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911421:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a74a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3678208->5119999] (req 3678208->5119999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911430:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911447:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532033.911857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532033.911879:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532033.911900:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467950592
00000100:00100000:0.0:1651532033.911914:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467950720
00000100:00100000:0.0:1651532033.911921:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2931
00000100:00100000:0.0:1651532033.911923:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467950592:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532033.911926:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2932
00000100:00100000:1.0:1651532033.911928:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467950720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532033.911930:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.911934:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532033.911935:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911936:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.911938:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532033.911939:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911943:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532033.911944:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911947:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532033.911948:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.911951:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911952:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532033.911955:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532033.911955:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.028006:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792777 is committed
00010000:00010000:1.0:1651532034.028035:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.028040:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.028068:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.028073:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467949248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 626190us (626224us total) trans 158913792777 rc 0/0
00000100:00100000:1.0:1651532034.028076:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2924
00010000:00010000:0.0:1651532034.028078:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532034.028087:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.028091:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.028096:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.028097:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.028098:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.028101:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.028104:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.028105:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.028105:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.028108:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.028116:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.028119:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a751 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->8814591] (req 315392->8814591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.028125:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.028128:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.028133:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.028136:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.028615:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.028695:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467950912
00000100:00100000:1.0:1651532034.028712:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2933
00000100:00100000:1.0:1651532034.028714:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467950912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532034.028721:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.028726:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532034.028726:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532034.028727:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.028730:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.119702:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792779 is committed
00010000:00010000:0.0:1651532034.119724:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.119729:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.119734:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.119750:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467949696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 634337us (634442us total) trans 158913792778 rc 0/0
00000100:00100000:0.0:1651532034.119754:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2926
00010000:00010000:1.0:1651532034.119755:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.119767:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.119770:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532034.119772:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.119773:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467949568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 634569us (634611us total) trans 158913792779 rc 0/0
00010000:00010000:0.0:1651532034.119774:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.119776:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2925
00010000:00010000:0.0:1651532034.119780:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.119783:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a75f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.119784:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.119788:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532034.119789:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.119792:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.119797:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532034.119797:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532034.119798:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.119801:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.119827:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.119840:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a758 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1155072->10395647] (req 1155072->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.119846:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.119850:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.120017:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.120028:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467951104
00000100:00100000:1.0:1651532034.120043:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2934
00000100:00100000:1.0:1651532034.120045:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467951104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532034.120052:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.120056:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532034.120057:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.120059:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.120062:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532034.120063:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.120067:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.120070:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.120073:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.120154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532034.120162:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467951232
00000100:00100000:0.0:1651532034.120173:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2935
00000100:00100000:0.0:1651532034.120175:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467951232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532034.120182:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.120187:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.120188:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.120191:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532034.120192:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.120196:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.120199:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.186406:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792780 is committed
00010000:00010000:0.0:1651532034.186422:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.186426:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.186461:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467949824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 580233us (580280us total) trans 158913792780 rc 0/0
00000100:00100000:0.0:1651532034.186466:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2927
00010000:00010000:0.0:1651532034.186477:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.186483:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532034.186484:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.186489:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.186497:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.186498:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.186499:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.186504:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.186541:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.186546:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a766 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9515008->9519103] (req 9515008->9519103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.186559:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.186563:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.186858:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532034.186866:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467951360
00000100:00100000:0.0:1651532034.186878:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2936
00000100:00100000:0.0:1651532034.186880:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467951360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532034.186887:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.186892:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532034.186893:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532034.186893:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.186897:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.286453:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792781 is committed
00010000:00010000:1.0:1651532034.286484:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.286488:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.286507:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.286512:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467950016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 596417us (596440us total) trans 158913792781 rc 0/0
00000100:00100000:1.0:1651532034.286515:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2928
00010000:00010000:0.0:1651532034.286517:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532034.286519:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.286531:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.286537:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.286537:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.286538:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.286541:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.286551:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.286554:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a76d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10080255] (req 118784->10080255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.286565:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.286569:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.286789:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.286874:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467951488
00000100:00100000:1.0:1651532034.286885:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2937
00000100:00100000:1.0:1651532034.286887:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467951488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532034.286901:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.286914:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532034.286916:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.286918:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532034.286919:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.286924:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.286927:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.397159:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792782 is committed
00010000:00010000:1.0:1651532034.397188:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397192:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.397215:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467950208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 660471us (660500us total) trans 158913792782 rc 0/0
00000100:00100000:1.0:1651532034.397219:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2929
00010000:00010000:1.0:1651532034.397226:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397229:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532034.397230:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397241:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397247:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532034.397247:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532034.397248:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397251:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397284:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397287:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a774 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8261631] (req 8192->8261631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.397303:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.397310:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.397667:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.397688:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467951680
00000100:00100000:1.0:1651532034.397699:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2938
00000100:00100000:1.0:1651532034.397701:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467951680:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532034.397708:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397712:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532034.397713:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397715:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397728:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532034.397728:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397733:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397736:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.397739:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.488849:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792783 is committed
00010000:00010000:0.0:1651532034.488865:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.488881:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.488900:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467950400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 627369us (627400us total) trans 158913792783 rc 0/0
00000100:00100000:0.0:1651532034.488903:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2930
00010000:00010000:0.0:1651532034.488911:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.488914:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532034.488915:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.488918:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.488923:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.488924:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.488925:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.488928:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.488934:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.488937:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a77b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3723264->8925183] (req 3723264->8925183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.488951:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.488954:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.489395:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532034.489404:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467951872
00000100:00100000:0.0:1651532034.489416:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2939
00000100:00100000:0.0:1651532034.489418:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467951872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532034.489426:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.489433:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532034.489434:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.489440:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532034.489440:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.489446:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.489449:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.547304:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792784 is committed
00010000:00010000:0.0:1651532034.547320:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547325:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.547348:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467950592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 635424us (635491us total) trans 158913792784 rc 0/0
00000100:00100000:0.0:1651532034.547352:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2931
00010000:00010000:0.0:1651532034.547360:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547363:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532034.547364:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547367:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547373:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.547373:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.547374:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547377:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547392:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.547393:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.547393:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547396:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547406:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547409:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a782 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9854975] (req 651264->9854975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.547412:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.547417:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547419:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.547422:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.547958:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.547976:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467952064
00000100:00100000:1.0:1651532034.547990:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2940
00000100:00100000:1.0:1651532034.547992:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467952064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532034.547999:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.548003:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532034.548011:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.548014:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532034.548015:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.548020:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.548023:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.647252:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792786 is committed
00010000:00010000:0.0:1651532034.647281:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647285:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647290:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647300:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.647312:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467950912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 618592us (618692us total) trans 158913792786 rc 0/0
00000100:00100000:1.0:1651532034.647319:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467950720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 735390us (735440us total) trans 158913792785 rc 0/0
00000100:00100000:1.0:1651532034.647322:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2932
00000100:00100000:0.0:1651532034.647324:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2933
00010000:00010000:1.0:1651532034.647330:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647333:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647334:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532034.647335:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647337:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532034.647338:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647341:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647347:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647348:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647350:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a789 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8560640->8564735] (req 8560640->8564735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647354:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532034.647355:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532034.647356:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647359:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647366:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647369:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a790 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1818624->8282111] (req 1818624->8282111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647374:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647377:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.647880:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.647897:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.647905:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467952384
00000100:00100000:0.0:1651532034.647905:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467952256
00000100:00100000:1.0:1651532034.647920:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2941
00000100:00100000:1.0:1651532034.647922:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467952384:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532034.647927:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2942
00000100:00100000:0.0:1651532034.647929:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467952256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532034.647937:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647937:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647941:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532034.647942:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647945:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532034.647946:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647952:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532034.647953:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647956:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532034.647964:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647968:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647969:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.647972:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.647973:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.763961:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792787 is committed
00002000:00010000:1.0:1651532034.763991:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532033 -> 1651532034
00002000:00010000:1.0:1651532034.763993:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532032 -> 1651532033
00010000:00010000:1.0:1651532034.763996:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.763999:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.764021:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467951104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 643975us (644005us total) trans 158913792787 rc 0/0
00010000:00010000:0.0:1651532034.764023:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.764024:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2934
00010000:00010000:0.0:1651532034.764028:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532034.764029:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.764033:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.764038:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.764039:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.764040:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.764043:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.764047:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.764047:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.764055:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.764059:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.764068:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.764069:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.764071:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a797 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->9842687] (req 565248->9842687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.764077:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.764080:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.764082:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.764614:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.764645:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467952704
00000100:00100000:1.0:1651532034.764659:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2943
00000100:00100000:1.0:1651532034.764661:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467952704:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532034.764668:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.764673:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532034.764674:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.764677:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532034.764677:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.764682:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.764685:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.872356:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792789 is committed
00002000:00010000:0.0:1651532034.872376:0:330280:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532033 -> 1651532034
00010000:00010000:0.0:1651532034.872379:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872383:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.872389:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532034.872404:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467951232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 752228us (752250us total) trans 158913792789 rc 0/0
00000100:00100000:0.0:1651532034.872408:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2935
00010000:00010000:1.0:1651532034.872409:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.872425:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467951360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 685544us (685568us total) trans 158913792788 rc 0/0
00010000:00010000:0.0:1651532034.872425:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.872428:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2936
00010000:00010000:0.0:1651532034.872428:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532034.872429:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872432:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.872437:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872438:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.872438:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.872439:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872442:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.872446:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532034.872447:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872452:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872454:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a79e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->3596287] (req 94208->3596287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.872455:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.872461:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.872464:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40a7a5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8077312->8081407] (req 8077312->8081407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.872470:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.872473:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.872820:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.872829:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.872839:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467953024
00000100:00100000:0.0:1651532034.872839:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467952896
00000100:00100000:1.0:1651532034.872850:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2944
00000100:00100000:1.0:1651532034.872852:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467953024:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532034.872853:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2945
00000100:00100000:0.0:1651532034.872855:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467952896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532034.872859:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872862:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.872863:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532034.872864:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532034.872865:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.872868:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872878:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532034.872879:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872882:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872884:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532034.872885:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872889:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872892:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.872895:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532034.972364:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792790 is committed
00010000:00010000:1.0:1651532034.972395:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.972399:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.972419:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467951488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 685530us (685630us total) trans 158913792790 rc 0/0
00000100:00100000:1.0:1651532034.972422:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2937
00010000:00010000:0.0:1651532034.972423:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.972427:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532034.972428:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.972442:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.972448:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.972448:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532034.972449:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.972452:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.972459:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532034.972462:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a7ac lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2732032->2736127] (req 2732032->2736127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.972475:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.972489:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532034.972714:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532034.972721:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467953216
00000100:00100000:1.0:1651532034.972740:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2946
00000100:00100000:1.0:1651532034.972741:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467953216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532034.972756:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.972760:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532034.972761:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.972764:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532034.972765:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.972769:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532034.972772:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532035.047381:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792791 is committed
00010000:00010000:1.0:1651532035.047409:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.047429:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.047447:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467951680:12345-10.240.43.64@tcp:4:fio.0 Request processed in 649745us (649781us total) trans 158913792791 rc 0/0
00000100:00100000:1.0:1651532035.047451:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2938
00010000:00010000:1.0:1651532035.047458:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.047461:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532035.047462:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.047465:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.047470:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532035.047471:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532035.047471:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.047474:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.047486:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.047498:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a7b3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9379839] (req 1077248->9379839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.047499:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.047503:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.048077:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532035.048086:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467953344
00000100:00100000:1.0:1651532035.048097:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2947
00000100:00100000:1.0:1651532035.048099:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467953344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532035.048106:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.048110:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532035.048111:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532035.048111:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.048115:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532035.114121:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792792 is committed
00010000:00010000:0.0:1651532035.114136:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114152:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532035.114176:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467951872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 624757us (624781us total) trans 158913792792 rc 0/0
00000100:00100000:0.0:1651532035.114180:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2939
00010000:00010000:0.0:1651532035.114188:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114191:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532035.114192:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114195:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114200:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.114201:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.114202:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114205:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114215:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114227:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a7ba lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->10297343] (req 1204224->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.114228:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.114232:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.114590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532035.114627:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467953536
00000100:00100000:0.0:1651532035.114639:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2948
00000100:00100000:0.0:1651532035.114641:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467953536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532035.114648:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114653:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532035.114654:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114657:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114659:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532035.114660:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114664:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114667:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.114670:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532035.247468:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792793 is committed
00010000:00010000:1.0:1651532035.247500:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.247515:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.247534:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.247538:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467952064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699545us (699580us total) trans 158913792793 rc 0/0
00010000:00010000:0.0:1651532035.247539:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532035.247540:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.247541:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2940
00010000:00010000:0.0:1651532035.247543:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.247549:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.247549:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.247550:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.247553:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.247563:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.247567:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a7c1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->5820415] (req 737280->5820415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.247572:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.247584:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.247934:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532035.248000:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467953728
00000100:00100000:1.0:1651532035.248011:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2949
00000100:00100000:1.0:1651532035.248013:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467953728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532035.248028:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.248033:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532035.248034:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.248037:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532035.248038:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.248059:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.248062:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532035.388461:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792794 is committed
00010000:00010000:1.0:1651532035.388490:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388495:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.388512:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467952384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 740590us (740615us total) trans 158913792794 rc 0/0
00000100:00100000:1.0:1651532035.388515:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2941
00010000:00010000:1.0:1651532035.388522:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388525:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532035.388526:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388529:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388534:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532035.388535:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532035.388544:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388548:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388560:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388562:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a7c8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->6029311] (req 5562368->6029311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.388569:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.388585:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.388890:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532035.388898:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467953920
00000100:00100000:1.0:1651532035.388909:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2950
00000100:00100000:1.0:1651532035.388911:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467953920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532035.388917:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388922:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532035.388923:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388933:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532035.388934:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388938:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.388960:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532035.464203:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792795 is committed
00010000:00010000:0.0:1651532035.464220:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464225:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532035.464249:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467952256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816319us (816369us total) trans 158913792795 rc 0/0
00000100:00100000:0.0:1651532035.464253:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2942
00010000:00010000:0.0:1651532035.464273:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464279:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532035.464281:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464286:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464294:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.464295:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.464296:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464316:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464322:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.464322:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.464323:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464328:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464344:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464350:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a7cf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->10317823] (req 503808->10317823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.464357:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.464361:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464363:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464367:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.464877:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532035.464902:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467954112
00000100:00100000:0.0:1651532035.464922:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2951
00000100:00100000:0.0:1651532035.464924:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467954112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532035.464932:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464945:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532035.464946:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464949:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532035.464950:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464955:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.464958:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532035.555837:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792797 is committed
00010000:00010000:0.0:1651532035.555858:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.555863:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555869:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555874:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532035.555885:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467953024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 683032us (683055us total) trans 158913792797 rc 0/0
00000100:00100000:0.0:1651532035.555888:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2944
00000100:00100000:1.0:1651532035.555894:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467952704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791232us (791281us total) trans 158913792796 rc 0/0
00010000:00010000:0.0:1651532035.555896:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.555898:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2943
00010000:00010000:0.0:1651532035.555900:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532035.555905:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555909:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532035.555909:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555910:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555913:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.555913:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.555919:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.555921:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a7dd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->3956735] (req 1523712->3956735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555928:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532035.555928:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532035.555929:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555932:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555942:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555945:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a7d6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1208320->1212415] (req 1208320->1212415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555955:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.555958:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532035.556370:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532035.556396:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467954432
00000100:00100000:1.0:1651532035.556414:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2952
00000100:00100000:1.0:1651532035.556416:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467954432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532035.556424:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.556430:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532035.556439:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.556443:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532035.556444:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.556449:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.556453:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.556462:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532035.556478:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467954304
00000100:00100000:0.0:1651532035.556502:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2953
00000100:00100000:0.0:1651532035.556506:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467954304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532035.556517:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.556525:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532035.556527:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.556532:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532035.556533:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.556539:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.556554:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532035.630956:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792798 is committed
00010000:00010000:1.0:1651532035.630999:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.631004:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.631027:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467952896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 758171us (758207us total) trans 158913792798 rc 0/0
00010000:00010000:0.0:1651532035.631029:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.631031:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2945
00010000:00010000:0.0:1651532035.631034:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532035.631035:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.631038:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.631044:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.631044:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.631045:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.631048:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.631052:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.631052:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.631053:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.631056:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.631073:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.631077:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a7e4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10485759] (req 524288->10485759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.631086:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.631088:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.631090:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.631093:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.631570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532035.631585:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467954624
00000100:00100000:1.0:1651532035.631597:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2954
00000100:00100000:1.0:1651532035.631599:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467954624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532035.631607:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.631612:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532035.631613:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.631616:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532035.631616:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.631621:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.631624:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532035.747619:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792800 is committed
00010000:00010000:0.0:1651532035.747641:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.747646:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747655:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747660:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532035.747667:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467953216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774924us (774954us total) trans 158913792800 rc 0/0
00000100:00100000:0.0:1651532035.747671:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2946
00010000:00010000:0.0:1651532035.747680:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.747684:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532035.747685:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.747691:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467953344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699592us (699614us total) trans 158913792799 rc 0/0
00000100:00100000:1.0:1651532035.747695:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2947
00010000:00010000:0.0:1651532035.747696:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.747702:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747703:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.747705:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a7eb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747706:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532035.747708:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747711:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747716:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532035.747716:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532035.747717:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747720:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747732:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747735:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a7f2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8556544->8560639] (req 8556544->8560639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747745:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.747761:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532035.748116:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532035.748135:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532035.748143:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467954816
00000100:00100000:0.0:1651532035.748157:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467954944
00000100:00100000:0.0:1651532035.748165:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2955
00000100:00100000:0.0:1651532035.748167:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467954816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532035.748175:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.748179:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532035.748180:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.748183:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532035.748184:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.748188:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.748206:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.748214:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2956
00000100:00100000:1.0:1651532035.748217:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467954944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532035.748225:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.748230:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532035.748231:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.748234:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532035.748234:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.748239:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.748242:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532035.814302:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792801 is committed
00002000:00010000:1.0:1651532035.814332:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532034 -> 1651532035
00010000:00010000:1.0:1651532035.814336:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.814340:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.814370:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467953536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699729us (699781us total) trans 158913792801 rc 0/0
00010000:00010000:0.0:1651532035.814373:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.814374:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2948
00010000:00010000:0.0:1651532035.814378:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532035.814379:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.814382:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.814388:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.814388:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.814389:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.814392:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.814404:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.814407:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a7f9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10059775] (req 192512->10059775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.814422:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.814426:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.814912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532035.814937:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467955136
00000100:00100000:0.0:1651532035.814953:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2957
00000100:00100000:0.0:1651532035.814955:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467955136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532035.814963:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.814968:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532035.814969:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.814972:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532035.814972:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.814977:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.814980:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532035.922618:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792802 is committed
00010000:00010000:1.0:1651532035.922650:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.922654:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.922676:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467953728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674661us (674756us total) trans 158913792802 rc 0/0
00010000:00010000:0.0:1651532035.922678:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.922679:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2949
00010000:00010000:0.0:1651532035.922683:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532035.922684:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.922698:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.922704:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.922704:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532035.922705:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.922708:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.922715:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532035.922718:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a800 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9568255] (req 761856->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.922735:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.922740:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532035.923110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532035.923132:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467955328
00000100:00100000:1.0:1651532035.923149:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2958
00000100:00100000:1.0:1651532035.923151:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467955328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532035.923159:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.923163:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532035.923164:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.923167:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532035.923168:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.923172:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532035.923176:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532036.022658:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792803 is committed
00010000:00010000:1.0:1651532036.022688:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.022699:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.022722:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467953920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 633810us (633832us total) trans 158913792803 rc 0/0
00010000:00010000:0.0:1651532036.022722:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.022725:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2950
00010000:00010000:0.0:1651532036.022727:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532036.022728:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.022732:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.022748:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.022749:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.022750:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.022753:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.022761:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.022763:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a807 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.022776:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.022780:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.023112:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532036.023130:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467955520
00000100:00100000:1.0:1651532036.023144:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2959
00000100:00100000:1.0:1651532036.023146:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467955520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532036.023153:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.023158:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532036.023159:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.023162:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532036.023163:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.023167:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.023171:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532036.114343:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792804 is committed
00010000:00010000:1.0:1651532036.114374:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.114388:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.114411:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.114412:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467954112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 649486us (649540us total) trans 158913792804 rc 0/0
00000100:00100000:1.0:1651532036.114415:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2951
00010000:00010000:0.0:1651532036.114415:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532036.114416:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.114420:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.114425:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.114426:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.114427:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.114437:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.114447:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.114450:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a80e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->8278015] (req 3321856->8278015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.114461:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.114465:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.114695:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532036.114711:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467955712
00000100:00100000:1.0:1651532036.114727:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2960
00000100:00100000:1.0:1651532036.114729:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467955712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532036.114737:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.114741:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532036.114742:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.114745:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532036.114746:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.114761:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.114764:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532036.214398:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792805 is committed
00002000:00010000:1.0:1651532036.214430:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532034 -> 1651532035
00010000:00010000:1.0:1651532036.214433:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.214437:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.214455:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467954432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 658038us (658086us total) trans 158913792805 rc 0/0
00000100:00100000:1.0:1651532036.214458:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2952
00010000:00010000:1.0:1651532036.214465:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.214468:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532036.214469:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.214472:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.214477:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532036.214486:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532036.214487:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.214491:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.214503:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.214506:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a815 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5824512->5828607] (req 5824512->5828607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.214516:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.214521:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.214880:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532036.214890:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467955904
00000100:00100000:1.0:1651532036.214900:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2961
00000100:00100000:1.0:1651532036.214902:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c0148d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467955904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532036.214909:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.214913:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532036.214914:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532036.214915:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.214918:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532036.306094:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792806 is committed
00010000:00010000:0.0:1651532036.306111:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306116:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532036.306139:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467954304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749633us (749677us total) trans 158913792806 rc 0/0
00000100:00100000:0.0:1651532036.306143:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2953
00010000:00010000:0.0:1651532036.306151:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306163:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532036.306164:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306168:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306173:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.306174:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.306174:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306178:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306187:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306191:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a81c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->10051583] (req 544768->10051583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.306202:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.306217:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.306703:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532036.306723:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467956032
00000100:00100000:0.0:1651532036.306736:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2962
00000100:00100000:0.0:1651532036.306738:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467956032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532036.306746:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306762:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532036.306763:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306766:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306769:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532036.306769:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306774:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306777:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.306780:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532036.397817:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792807 is committed
00010000:00010000:1.0:1651532036.397848:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.397853:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.397875:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.397876:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467954624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766275us (766306us total) trans 158913792807 rc 0/0
00000100:00100000:1.0:1651532036.397879:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2954
00010000:00010000:0.0:1651532036.397880:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532036.397881:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.397895:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.397902:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.397902:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.397903:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.397906:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.397914:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.397917:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a823 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->8720383] (req 798720->8720383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.397923:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.397926:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.398175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532036.398190:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467956224
00000100:00100000:1.0:1651532036.398210:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2963
00000100:00100000:1.0:1651532036.398212:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467956224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532036.398220:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.398224:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532036.398225:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.398228:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532036.398229:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.398245:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.398249:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532036.506136:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792808 is committed
00010000:00010000:0.0:1651532036.506153:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.506157:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532036.506192:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467954816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 758023us (758076us total) trans 158913792808 rc 0/0
00010000:00010000:1.0:1651532036.506193:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532036.506196:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2955
00010000:00010000:1.0:1651532036.506197:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532036.506199:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.506202:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.506208:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532036.506209:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532036.506209:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.506212:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.506220:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.506223:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a82a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.506233:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.506238:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532036.506745:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532036.506755:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467956352
00000100:00100000:0.0:1651532036.506766:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2964
00000100:00100000:0.0:1651532036.506768:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467956352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532036.506776:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.506781:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532036.506782:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532036.506783:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.506786:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532036.589508:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792809 is committed
00010000:00010000:0.0:1651532036.589523:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.589538:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532036.589557:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467954944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841339us (841422us total) trans 158913792809 rc 0/0
00000100:00100000:0.0:1651532036.589560:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2956
00010000:00010000:0.0:1651532036.589567:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.589571:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532036.589572:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.589575:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.589580:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.589581:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.589581:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.589584:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.589591:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.589594:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a831 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2437120->9351167] (req 2437120->9351167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.589607:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.589610:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532036.589979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532036.589992:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467956544
00000100:00100000:0.0:1651532036.590008:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2965
00000100:00100000:0.0:1651532036.590011:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467956544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532036.590022:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.590030:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532036.590031:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.590035:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.590040:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532036.590041:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.590047:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.590067:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.590073:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532036.689516:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792810 is committed
00010000:00010000:0.0:1651532036.689532:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689536:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532036.689554:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467955136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 874598us (874643us total) trans 158913792810 rc 0/0
00000100:00100000:0.0:1651532036.689558:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2957
00010000:00010000:0.0:1651532036.689565:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689568:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532036.689569:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689572:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689577:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.689587:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.689588:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689591:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689606:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689610:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a838 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2908160->8986623] (req 2908160->8986623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.689617:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.689622:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532036.689881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532036.689907:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467956800
00000100:00100000:0.0:1651532036.689918:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2966
00000100:00100000:0.0:1651532036.689920:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467956800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532036.689927:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689932:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532036.689933:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689936:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532036.689936:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689941:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.689957:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532036.789567:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792811 is committed
00010000:00010000:1.0:1651532036.789598:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789604:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.789630:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467955328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866477us (866520us total) trans 158913792811 rc 0/0
00000100:00100000:1.0:1651532036.789634:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2958
00010000:00010000:1.0:1651532036.789642:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789646:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532036.789647:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789650:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789655:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532036.789656:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532036.789665:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789677:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789686:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789689:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a83f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9814015] (req 401408->9814015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789695:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789698:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532036.789901:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532036.789963:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467956992
00000100:00100000:1.0:1651532036.789980:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2967
00000100:00100000:1.0:1651532036.789982:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467956992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532036.789990:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789995:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532036.789996:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.789999:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532036.790008:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.790013:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.790016:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532036.914570:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792812 is committed
00002000:00010000:1.0:1651532036.914599:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532035 -> 1651532036
00002000:00010000:1.0:1651532036.914601:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532035 -> 1651532036
00010000:00010000:1.0:1651532036.914603:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.914607:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.914628:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467955520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 891481us (891516us total) trans 158913792812 rc 0/0
00000100:00100000:1.0:1651532036.914631:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2959
00010000:00010000:0.0:1651532036.914631:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.914636:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532036.914637:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.914641:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.914647:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.914648:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.914648:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.914651:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.914655:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.914656:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532036.914656:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.914669:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.914680:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.914683:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a846 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8298495] (req 770048->8298495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.914693:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.914693:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532036.914696:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.914698:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532036.914909:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532036.914919:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467957184
00000100:00100000:1.0:1651532036.914934:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2968
00000100:00100000:1.0:1651532036.914943:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467957184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532036.914950:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.914955:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532036.914956:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.914959:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532036.914959:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.914964:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532036.914967:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532037.006312:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792814 is committed
00010000:00010000:0.0:1651532037.006340:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006348:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.006354:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.006364:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532037.006381:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467955712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 891650us (891687us total) trans 158913792814 rc 0/0
00000100:00100000:1.0:1651532037.006382:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c0148d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467955904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791479us (791503us total) trans 158913792813 rc 0/0
00000100:00100000:0.0:1651532037.006386:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2960
00000100:00100000:1.0:1651532037.006387:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2961
00010000:00010000:0.0:1651532037.006394:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006410:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532037.006411:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006414:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006420:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006423:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a84d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->2367487] (req 2232320->2367487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006427:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006430:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532037.006431:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006433:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006437:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.006437:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.006438:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006443:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006451:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006453:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a854 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5840896->5844991] (req 5840896->5844991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006459:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.006462:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532037.006968:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532037.006996:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532037.007006:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467957376
00000100:00100000:1.0:1651532037.007014:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467957504
00000100:00100000:0.0:1651532037.007024:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2969
00000100:00100000:0.0:1651532037.007027:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467957376:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532037.007040:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2970
00000100:00100000:1.0:1651532037.007042:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467957504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532037.007046:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.007050:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.007054:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532037.007056:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.007071:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532037.007072:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.007077:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532037.007078:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.007081:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532037.007081:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.007086:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.007086:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.007090:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.007090:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532037.137191:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792815 is committed
00010000:00010000:0.0:1651532037.137208:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137212:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532037.137236:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467956032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 830496us (830534us total) trans 158913792815 rc 0/0
00000100:00100000:0.0:1651532037.137240:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2962
00010000:00010000:0.0:1651532037.137247:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137251:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532037.137252:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137278:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137286:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.137287:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.137288:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137294:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137299:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.137300:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.137301:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137306:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137326:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137332:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a85b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9805823] (req 532480->9805823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.137337:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.137343:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137343:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.137348:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.137982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532037.138028:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467957696
00000100:00100000:0.0:1651532037.138046:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2971
00000100:00100000:0.0:1651532037.138048:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467957696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532037.138056:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.138061:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532037.138062:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.138065:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532037.138066:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.138070:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.138074:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532037.204169:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792817 is committed
00010000:00010000:0.0:1651532037.204190:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204195:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.204212:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532037.204228:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467956352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 697458us (697483us total) trans 158913792816 rc 0/0
00000100:00100000:0.0:1651532037.204231:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2964
00010000:00010000:1.0:1651532037.204232:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204248:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204252:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532037.204253:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467956224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 806039us (806078us total) trans 158913792817 rc 0/0
00010000:00010000:0.0:1651532037.204253:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.204256:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2963
00010000:00010000:0.0:1651532037.204256:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204276:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204281:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a869 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->5935103] (req 5931008->5935103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204287:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204292:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532037.204293:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204298:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204314:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.204315:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.204316:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204321:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204334:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204339:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a862 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4710400->4857855] (req 4710400->4857855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204349:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.204354:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532037.204769:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532037.204826:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467957888
00000100:00100000:1.0:1651532037.204844:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2972
00000100:00100000:1.0:1651532037.204846:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467957888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532037.204855:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.204861:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532037.204862:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.204865:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532037.204866:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.204871:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.204875:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532037.303951:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792818 is committed
00010000:00010000:0.0:1651532037.303967:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.303971:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532037.304006:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467956544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 713994us (714029us total) trans 158913792818 rc 0/0
00000100:00100000:0.0:1651532037.304010:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2965
00010000:00010000:0.0:1651532037.304018:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.304021:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532037.304022:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.304025:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.304030:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.304031:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.304032:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.304035:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.304042:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.304045:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a870 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.304057:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.304071:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.304622:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532037.304647:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467958080
00000100:00100000:0.0:1651532037.304677:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2973
00000100:00100000:0.0:1651532037.304679:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467958080:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532037.304688:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.304692:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532037.304693:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.304696:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532037.304697:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.304701:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.304705:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532037.403976:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792819 is committed
00010000:00010000:1.0:1651532037.404006:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404011:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.404030:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467956800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 714109us (714150us total) trans 158913792819 rc 0/0
00000100:00100000:1.0:1651532037.404034:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2966
00010000:00010000:1.0:1651532037.404041:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404045:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532037.404046:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404049:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404054:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532037.404055:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532037.404056:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404071:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404079:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404082:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a877 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4464640->9125887] (req 4464640->9125887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404087:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404090:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.404574:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532037.404593:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532037.404601:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467958272
00000100:00100000:1.0:1651532037.404612:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467958336
00000100:00100000:1.0:1651532037.404623:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2974
00000100:00100000:1.0:1651532037.404646:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467958272:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532037.404650:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2975
00010000:00010000:1.0:1651532037.404654:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532037.404654:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467958336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532037.404659:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532037.404661:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.404668:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404675:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532037.404676:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.404682:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532037.404683:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532037.404684:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404704:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.404704:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.404708:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532037.487344:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792820 is committed
00010000:00010000:1.0:1651532037.487377:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.487381:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.487403:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467956992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 697420us (697503us total) trans 158913792820 rc 0/0
00010000:00010000:0.0:1651532037.487405:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.487406:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2967
00010000:00010000:0.0:1651532037.487410:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532037.487411:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.487415:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.487420:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.487421:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.487422:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.487425:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.487434:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.487438:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a87e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.487451:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.487455:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.488105:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532037.488114:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467958528
00000100:00100000:1.0:1651532037.488133:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2976
00000100:00100000:1.0:1651532037.488135:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467958528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532037.488143:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.488148:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532037.488148:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532037.488149:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.488152:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532037.604028:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792821 is committed
00010000:00010000:1.0:1651532037.604056:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604060:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.604081:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467957184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 689138us (689179us total) trans 158913792821 rc 0/0
00010000:00010000:0.0:1651532037.604083:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.604085:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2968
00010000:00010000:0.0:1651532037.604088:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532037.604089:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.604093:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.604098:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.604099:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.604100:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.604103:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.604111:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.604114:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a885 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->9572351] (req 946176->9572351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604126:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604131:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.604574:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532037.604592:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467958720
00000100:00100000:1.0:1651532037.604608:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2977
00000100:00100000:1.0:1651532037.604610:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467958720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532037.604617:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604621:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532037.604622:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604625:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604628:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604630:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532037.604631:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604635:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604638:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604641:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.604654:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532037.662422:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792822 is committed
00010000:00010000:1.0:1651532037.662451:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.662455:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.662472:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467957376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 655445us (655505us total) trans 158913792822 rc 0/0
00000100:00100000:1.0:1651532037.662475:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2969
00010000:00010000:1.0:1651532037.662482:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.662486:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532037.662487:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.662490:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.662495:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532037.662495:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532037.662496:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.662510:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.662518:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.662521:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a88c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.662526:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.662529:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.662997:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532037.663005:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467958912
00000100:00100000:1.0:1651532037.663022:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2978
00000100:00100000:1.0:1651532037.663024:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467958912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532037.663032:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.663036:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532037.663037:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.663040:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532037.663049:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.663054:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.663057:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532037.779137:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792823 is committed
00002000:00010000:1.0:1651532037.779168:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532036 -> 1651532037
00002000:00010000:1.0:1651532037.779170:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532036 -> 1651532037
00010000:00010000:1.0:1651532037.779172:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.779176:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.779198:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467957504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 772155us (772202us total) trans 158913792823 rc 0/0
00010000:00010000:0.0:1651532037.779199:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.779201:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2970
00010000:00010000:0.0:1651532037.779212:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532037.779213:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.779217:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.779223:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.779224:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.779225:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.779228:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.779236:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.779239:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a893 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->9986047] (req 5066752->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.779248:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.779253:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.779624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532037.779632:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467959104
00000100:00100000:1.0:1651532037.779646:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2979
00000100:00100000:1.0:1651532037.779648:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467959104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532037.779655:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.779659:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532037.779674:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.779677:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532037.779678:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.779683:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.779686:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532037.904128:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792824 is committed
00010000:00010000:0.0:1651532037.904154:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904159:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532037.904184:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467957696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766135us (766202us total) trans 158913792824 rc 0/0
00000100:00100000:0.0:1651532037.904188:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2971
00010000:00010000:0.0:1651532037.904196:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904199:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532037.904200:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904204:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904209:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.904209:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532037.904210:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904214:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904220:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904236:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a89a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->10055679] (req 4096->10055679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.904237:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532037.904242:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532037.904770:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532037.904792:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467959360
00000100:00100000:0.0:1651532037.904826:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2980
00000100:00100000:0.0:1651532037.904829:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467959360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532037.904837:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904842:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532037.904843:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904846:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532037.904847:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904851:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532037.904855:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532038.029095:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792825 is committed
00010000:00010000:1.0:1651532038.029124:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.029129:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.029151:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467957888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824304us (824382us total) trans 158913792825 rc 0/0
00010000:00010000:0.0:1651532038.029152:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.029154:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2972
00010000:00010000:0.0:1651532038.029168:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.029169:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.029172:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.029178:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.029178:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.029179:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.029183:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.029191:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.029194:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a8a1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8069119] (req 565248->8069119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.029196:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.029208:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.029546:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.029554:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467959552
00000100:00100000:1.0:1651532038.029565:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2981
00000100:00100000:1.0:1651532038.029566:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467959552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532038.029574:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.029578:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532038.029579:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.029582:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532038.029583:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.029587:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.029590:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532038.145777:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792826 is committed
00010000:00010000:1.0:1651532038.145819:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.145835:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.145858:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467958080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841178us (841244us total) trans 158913792826 rc 0/0
00010000:00010000:0.0:1651532038.145859:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.145861:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2973
00010000:00010000:0.0:1651532038.145864:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.145865:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145871:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145877:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.145877:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.145878:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145881:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145885:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.145885:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.145886:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145889:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145891:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.145892:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.145892:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145895:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145905:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.145913:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.145918:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145925:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8a8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->10350591] (req 532480->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145936:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.145941:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.145975:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.145979:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.146458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.146467:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467959808
00000100:00100000:1.0:1651532038.146477:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2982
00000100:00100000:1.0:1651532038.146479:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754467959808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532038.146486:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.146491:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532038.146501:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.146504:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532038.146505:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.146510:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.146514:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532038.212502:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792829 is committed
00010000:00010000:0.0:1651532038.212526:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212530:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.212536:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.212545:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532038.212553:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467958336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 807898us (807959us total) trans 158913792828 rc 0/0
00000100:00100000:0.0:1651532038.212562:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2975
00000100:00100000:1.0:1651532038.212568:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467958272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 807942us (807994us total) trans 158913792827 rc 0/0
00010000:00010000:0.0:1651532038.212570:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.212572:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2974
00010000:00010000:0.0:1651532038.212574:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.212575:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212578:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.212580:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.212583:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532038.212584:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212594:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212597:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a8b6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5177344->5181439] (req 5177344->5181439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.212598:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.212604:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.212607:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a8af lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3620864->3624959] (req 3620864->3624959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212614:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212617:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532038.212631:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467958528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724495us (724527us total) trans 158913792829 rc 0/0
00000100:00100000:0.0:1651532038.212634:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2976
00010000:00010000:0.0:1651532038.212641:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212644:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.212645:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212648:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212654:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.212656:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.212667:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212672:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212690:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.212696:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a8bd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1196032->1200127] (req 1196032->1200127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.212698:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.212702:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.212955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532038.212989:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467960000
00000100:00100000:0.0:1651532038.213014:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2983
00000100:00100000:0.0:1651532038.213017:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467960000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532038.213029:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.213037:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532038.213038:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.213042:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532038.213044:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.213097:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.213105:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.213129:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.213145:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.213155:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467960192
00000100:00100000:0.0:1651532038.213158:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467960128
00000100:00100000:1.0:1651532038.213166:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2984
00000100:00100000:1.0:1651532038.213168:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467960192:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532038.213176:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2985
00000100:00100000:0.0:1651532038.213178:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467960128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532038.213181:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.213186:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532038.213186:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.213187:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532038.213188:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.213199:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532038.213200:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.213203:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532038.213204:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.213209:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.213209:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.213212:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532038.279217:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792830 is committed
00010000:00010000:1.0:1651532038.279248:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.279252:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.279279:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.279281:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467958720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674670us (674707us total) trans 158913792830 rc 0/0
00000100:00100000:1.0:1651532038.279284:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2977
00010000:00010000:0.0:1651532038.279284:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.279285:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.279299:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.279304:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.279305:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.279306:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.279309:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.279316:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.279319:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a8c4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->10428415] (req 196608->10428415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.279333:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.279337:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.279911:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.279920:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467960384
00000100:00100000:1.0:1651532038.279930:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2986
00000100:00100000:1.0:1651532038.279932:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467960384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532038.279946:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.279951:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532038.279956:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532038.279957:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.279960:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.368109:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532038.368134:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229248
00000100:00100000:0.0:1651532038.368146:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44
00000100:00100000:0.0:1651532038.368148:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bb47476 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951229248:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532038.368154:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1490944 granted 356278848 pending 200704 free 81138851840 avail 76965933056
00000100:00100000:0.0:1651532038.368173:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bb47476 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951229248:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 24us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532038.368176:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44
00000001:00080000:0.0:1651532038.412571:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792831 is committed
00010000:00010000:1.0:1651532038.412601:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.412606:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.412623:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467958912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749598us (749627us total) trans 158913792831 rc 0/0
00000100:00100000:1.0:1651532038.412626:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2978
00010000:00010000:1.0:1651532038.412633:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.412636:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532038.412638:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.412640:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.412646:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532038.412646:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532038.412660:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.412663:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.412671:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.412673:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a8cb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9969663] (req 114688->9969663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.412679:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.412682:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.412986:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.413001:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467960576
00000100:00100000:1.0:1651532038.413012:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2987
00000100:00100000:1.0:1651532038.413014:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467960576:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532038.413035:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.413039:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532038.413040:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.413043:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.413055:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532038.413055:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.413060:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.413063:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.413066:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532038.479289:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792832 is committed
00010000:00010000:1.0:1651532038.479322:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.479326:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.479348:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467959104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699700us (699725us total) trans 158913792832 rc 0/0
00010000:00010000:0.0:1651532038.479350:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.479352:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2979
00010000:00010000:0.0:1651532038.479363:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.479364:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.479368:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.479374:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.479374:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.479375:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.479378:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.479386:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.479390:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a8d2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9428991] (req 2297856->9428991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.479399:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.479404:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.479642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.479670:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467960768
00000100:00100000:1.0:1651532038.479680:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2988
00000100:00100000:1.0:1651532038.479682:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467960768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532038.479699:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.479703:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532038.479704:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.479707:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532038.479708:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.479712:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.479716:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532038.587635:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792833 is committed
00010000:00010000:0.0:1651532038.587659:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.587663:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532038.587688:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467959360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 682858us (682918us total) trans 158913792833 rc 0/0
00000100:00100000:0.0:1651532038.587691:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2980
00010000:00010000:0.0:1651532038.587699:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.587703:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.587704:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.587707:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.587712:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.587713:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.587714:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.587717:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.587729:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.587733:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.587737:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.587748:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a8d9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->5701631] (req 3399680->5701631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.588052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532038.588111:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467960960
00000100:00100000:0.0:1651532038.588128:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2989
00000100:00100000:0.0:1651532038.588130:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467960960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532038.588142:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.588149:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532038.588151:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.588156:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532038.588157:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.588164:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.588170:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532038.692890:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792834 is committed
00010000:00010000:1.0:1651532038.692922:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.692927:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.692956:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467959552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 663389us (663411us total) trans 158913792834 rc 0/0
00000100:00100000:1.0:1651532038.692960:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2981
00010000:00010000:1.0:1651532038.692967:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.692970:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532038.692971:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.692974:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.692979:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532038.692980:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532038.692980:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.692983:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.692990:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.692993:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a8e0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10321919] (req 159744->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.693009:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.693012:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.693639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.693657:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467961216
00000100:00100000:1.0:1651532038.693668:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2990
00000100:00100000:1.0:1651532038.693670:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467961216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532038.693677:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.693682:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532038.693683:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.693686:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532038.693686:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.693691:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.693694:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532038.784573:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792835 is committed
00002000:00010000:1.0:1651532038.784601:0:330054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532037 -> 1651532038
00010000:00010000:1.0:1651532038.784604:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.784608:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.784629:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467959808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 638148us (638171us total) trans 158913792835 rc 0/0
00010000:00010000:0.0:1651532038.784631:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.784632:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2982
00010000:00010000:0.0:1651532038.784647:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.784648:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.784651:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.784658:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.784658:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.784659:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.784662:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.784666:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.784666:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.784667:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.784671:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.784688:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.784691:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.784694:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a8e7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3952640->8212479] (req 3952640->8212479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.784695:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.784718:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.784723:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.785004:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.785012:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467961408
00000100:00100000:1.0:1651532038.785023:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2991
00000100:00100000:1.0:1651532038.785025:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467961408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532038.785032:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.785036:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 2/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.785054:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532038.785055:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.785058:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532038.785059:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.785063:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.785066:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.785070:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532038.867992:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792837 is committed
00010000:00010000:0.0:1651532038.868015:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868020:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868025:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868029:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532038.868042:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467960000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 655023us (655086us total) trans 158913792837 rc 0/0
00000100:00100000:0.0:1651532038.868045:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2983
00000100:00100000:1.0:1651532038.868050:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467960192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 654880us (654921us total) trans 158913792836 rc 0/0
00000100:00100000:1.0:1651532038.868053:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2984
00010000:00010000:0.0:1651532038.868054:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868057:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.868058:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868061:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868061:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868066:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.868076:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.868077:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868080:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868083:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.868084:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.868085:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868087:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868091:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532038.868092:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868098:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868100:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868101:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a8ee lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->9060351] (req 49152->9060351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868106:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868106:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868109:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a8f5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9732096->9736191] (req 9732096->9736191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868109:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868115:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868118:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.868750:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.868776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.868789:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467961664
00000100:00100000:1.0:1651532038.868800:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467961792
00000100:00100000:0.0:1651532038.868820:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2992
00000100:00100000:0.0:1651532038.868824:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467961664:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532038.868827:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2993
00000100:00100000:1.0:1651532038.868829:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754467961792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532038.868833:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868836:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868848:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532038.868849:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868851:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532038.868852:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868856:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532038.868858:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868861:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532038.868861:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868865:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868866:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.868868:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.868870:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532038.976311:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792839 is committed
00010000:00010000:0.0:1651532038.976339:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976346:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.976353:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.976358:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532038.976378:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467960128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 763199us (763233us total) trans 158913792839 rc 0/0
00000100:00100000:1.0:1651532038.976383:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467960384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 696450us (696472us total) trans 158913792838 rc 0/0
00000100:00100000:0.0:1651532038.976383:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2985
00000100:00100000:1.0:1651532038.976386:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2986
00010000:00010000:0.0:1651532038.976391:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976395:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.976404:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976408:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976414:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976416:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a8fc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7966720->7970815] (req 7966720->7970815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976420:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976423:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532038.976424:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976427:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976433:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.976434:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532038.976436:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976441:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976472:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976478:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40a903 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2752512->2756607] (req 2752512->2756607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.976484:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.976488:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.976752:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532038.976775:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467961920
00000100:00100000:1.0:1651532038.976789:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2994
00000100:00100000:1.0:1651532038.976791:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467961920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532038.976798:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.976818:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532038.976819:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.976822:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532038.976823:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.976828:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532038.976831:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532038.976852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532038.976875:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467962048
00000100:00100000:0.0:1651532038.976898:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2995
00000100:00100000:0.0:1651532038.976902:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467962048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532038.976913:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976920:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532038.976921:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976924:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532038.976925:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976930:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532038.976934:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532039.059686:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792840 is committed
00010000:00010000:1.0:1651532039.059727:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.059731:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.059759:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467960576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 646745us (646774us total) trans 158913792840 rc 0/0
00000100:00100000:1.0:1651532039.059763:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2987
00010000:00010000:1.0:1651532039.059770:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.059774:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532039.059775:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.059778:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.059782:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.059783:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.059784:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.059787:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.059793:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.059796:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a90a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9576447] (req 200704->9576447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.059801:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.059830:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.060416:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532039.060430:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467962176
00000100:00100000:1.0:1651532039.060448:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2996
00000100:00100000:1.0:1651532039.060450:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467962176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532039.060457:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.060461:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532039.060462:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532039.060463:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.060466:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532039.201353:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792841 is committed
00010000:00010000:1.0:1651532039.201385:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.201389:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.201412:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467960768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 721728us (721775us total) trans 158913792841 rc 0/0
00010000:00010000:0.0:1651532039.201413:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.201415:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2988
00010000:00010000:0.0:1651532039.201419:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532039.201420:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.201424:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.201429:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.201430:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.201431:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.201434:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.201442:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.201445:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40a911 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->8445951] (req 311296->8445951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.201457:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.201469:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.201725:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532039.201734:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467962432
00000100:00100000:1.0:1651532039.201749:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2997
00000100:00100000:1.0:1651532039.201751:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467962432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532039.201758:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.201762:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532039.201763:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.201766:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.201769:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532039.201769:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.201781:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.201784:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.201801:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532039.309697:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792842 is committed
00010000:00010000:1.0:1651532039.309728:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.309733:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.309751:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467960960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 721620us (721705us total) trans 158913792842 rc 0/0
00000100:00100000:1.0:1651532039.309754:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2989
00010000:00010000:1.0:1651532039.309761:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.309764:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532039.309765:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.309768:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.309773:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.309774:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.309775:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.309789:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.309797:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.309800:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a918 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->7299071] (req 1150976->7299071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.309820:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.309824:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.310160:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532039.310169:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467962560
00000100:00100000:1.0:1651532039.310186:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2998
00000100:00100000:1.0:1651532039.310188:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467962560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532039.310195:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.310200:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532039.310201:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.310204:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532039.310212:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.310217:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.310221:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532039.376446:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792843 is committed
00010000:00010000:1.0:1651532039.376477:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376481:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.376504:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467961216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 682833us (682866us total) trans 158913792843 rc 0/0
00000100:00100000:1.0:1651532039.376507:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2990
00010000:00010000:1.0:1651532039.376515:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376518:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532039.376519:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376522:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376527:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.376535:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.376536:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376540:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376556:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376560:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a91f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9043967] (req 106496->9043967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376565:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376568:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.376847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532039.376868:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467962752
00000100:00100000:1.0:1651532039.376887:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2999
00000100:00100000:1.0:1651532039.376889:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467962752:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532039.376895:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376900:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532039.376901:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376904:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532039.376918:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376923:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.376926:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532039.501432:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792844 is committed
00010000:00010000:1.0:1651532039.501472:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.501476:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.501498:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467961408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716473us (716495us total) trans 158913792844 rc 0/0
00010000:00010000:0.0:1651532039.501500:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.501502:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2991
00010000:00010000:0.0:1651532039.501505:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532039.501506:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.501510:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.501516:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.501516:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.501517:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.501520:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.501530:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.501533:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a926 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->9936895] (req 1392640->9936895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.501547:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.501551:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.502105:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532039.502129:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467962944
00000100:00100000:1.0:1651532039.502145:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3000
00000100:00100000:1.0:1651532039.502147:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467962944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532039.502154:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.502166:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.502167:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.502170:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532039.502171:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.502175:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.502179:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532039.576472:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792845 is committed
00002000:00010000:1.0:1651532039.576502:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532037 -> 1651532038
00010000:00010000:1.0:1651532039.576506:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.576509:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.576526:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467961792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 707697us (707750us total) trans 158913792845 rc 0/0
00000100:00100000:1.0:1651532039.576529:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2993
00010000:00010000:1.0:1651532039.576536:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.576550:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532039.576551:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.576554:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.576559:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.576560:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.576561:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.576564:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.576576:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.576579:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a934 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5611520->5615615] (req 5611520->5615615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.576584:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.576589:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.576968:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532039.576981:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467963136
00000100:00100000:1.0:1651532039.576995:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3001
00000100:00100000:1.0:1651532039.576997:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467963136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532039.577004:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.577018:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532039.577019:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.577022:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532039.577023:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.577027:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.577030:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532039.676502:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792846 is committed
00010000:00010000:0.0:1651532039.676519:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.676523:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.676546:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467961664:12345-10.240.43.64@tcp:4:fio.0 Request processed in 807722us (807796us total) trans 158913792846 rc 0/0
00010000:00010000:1.0:1651532039.676547:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.676549:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2992
00010000:00010000:1.0:1651532039.676551:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532039.676552:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.676555:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.676560:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.676561:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.676561:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.676574:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.676582:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.676587:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.676592:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a92d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4775936->9179135] (req 4775936->9179135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.676593:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.676941:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532039.676983:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467963264
00000100:00100000:0.0:1651532039.676999:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3002
00000100:00100000:0.0:1651532039.677002:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467963264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532039.677013:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.677018:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532039.677019:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.677032:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532039.677032:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.677037:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.677041:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532039.778427:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792847 is committed
00010000:00010000:0.0:1651532039.778443:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778447:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.778465:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467961920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 801673us (801728us total) trans 158913792847 rc 0/0
00000100:00100000:0.0:1651532039.778469:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2994
00010000:00010000:0.0:1651532039.778476:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778480:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532039.778481:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778496:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778501:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.778502:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.778503:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778506:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778509:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.778510:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.778510:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778513:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778526:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778530:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a93b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->10051583] (req 327680->10051583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778535:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.778538:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.778539:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.778543:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.779179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532039.779193:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467963520
00000100:00100000:0.0:1651532039.779210:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3003
00000100:00100000:0.0:1651532039.779213:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467963520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532039.779224:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.779231:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.779232:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.779235:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532039.779236:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.779240:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.779244:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532039.843759:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792849 is committed
00010000:00010000:0.0:1651532039.843781:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.843785:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.843801:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.843821:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.843827:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467962048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866924us (866974us total) trans 158913792848 rc 0/0
00000100:00100000:0.0:1651532039.843831:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2995
00000100:00100000:1.0:1651532039.843837:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467962176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783386us (783423us total) trans 158913792849 rc 0/0
00000100:00100000:1.0:1651532039.843840:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2996
00010000:00010000:1.0:1651532039.843848:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.843862:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532039.843864:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.843867:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.843869:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.843873:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532039.843875:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.843880:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.843881:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.843884:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40a942 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.843889:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.843890:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.843891:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.843896:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.843914:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.843920:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a949 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2158592->2162687] (req 2158592->2162687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.843922:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.843926:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.844211:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532039.844232:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467963712
00000100:00100000:1.0:1651532039.844252:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3004
00000100:00100000:1.0:1651532039.844254:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467963712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532039.844273:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.844275:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532039.844278:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532039.844279:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.844289:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532039.844290:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.844294:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.844298:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.844310:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467963840
00000100:00100000:1.0:1651532039.844325:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3005
00000100:00100000:1.0:1651532039.844327:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467963840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532039.844333:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.844336:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532039.844337:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.844340:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532039.844340:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.844344:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.844347:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.868865:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003504775b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966863104:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651532039.869091:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003504775b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966863104:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:0.0:1651532039.901662:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792850 is committed
00002000:00010000:1.0:1651532039.901690:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532038 -> 1651532039
00002000:00010000:1.0:1651532039.901692:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532038 -> 1651532039
00010000:00010000:1.0:1651532039.901694:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.901698:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532039.901718:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467962432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699967us (699994us total) trans 158913792850 rc 0/0
00000100:00100000:1.0:1651532039.901722:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2997
00010000:00010000:0.0:1651532039.901722:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.901727:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532039.901728:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.901731:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.901737:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.901738:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532039.901738:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.901741:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.901751:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532039.901754:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a950 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->10227711] (req 442368->10227711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.901768:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.901772:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532039.902059:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532039.902074:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467964032
00000100:00100000:1.0:1651532039.902088:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3006
00000100:00100000:1.0:1651532039.902089:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467964032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532039.902096:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.902100:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532039.902107:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532039.902108:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532039.902118:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532040.001663:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792851 is committed
00010000:00010000:1.0:1651532040.001695:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.001699:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.001717:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467962560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691528us (691557us total) trans 158913792851 rc 0/0
00000100:00100000:1.0:1651532040.001720:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2998
00010000:00010000:1.0:1651532040.001726:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.001730:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532040.001731:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.001734:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.001739:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532040.001739:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532040.001740:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.001754:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.001761:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.001764:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a957 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->10305535] (req 1634304->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.001770:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.001773:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.002088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532040.002096:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467964160
00000100:00100000:1.0:1651532040.002111:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3007
00000100:00100000:1.0:1651532040.002112:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467964160:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532040.002119:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.002124:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532040.002125:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.002128:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.002150:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532040.002151:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.002156:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.002159:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.002162:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532040.159984:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792852 is committed
00010000:00010000:1.0:1651532040.160017:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.160021:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.160040:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.160045:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467962752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783155us (783199us total) trans 158913792852 rc 0/0
00000100:00100000:1.0:1651532040.160048:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2999
00010000:00010000:0.0:1651532040.160051:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532040.160052:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.160056:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.160061:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.160062:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.160063:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.160066:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.160076:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.160079:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a95e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->9736191] (req 479232->9736191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.160094:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.160098:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.160320:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532040.160388:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467964352
00000100:00100000:1.0:1651532040.160404:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3008
00000100:00100000:1.0:1651532040.160406:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467964352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532040.160414:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.160418:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532040.160419:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.160422:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532040.160423:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.160427:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.160430:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532040.276697:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792853 is committed
00010000:00010000:1.0:1651532040.276736:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.276740:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.276769:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467962944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774621us (774666us total) trans 158913792853 rc 0/0
00000100:00100000:1.0:1651532040.276772:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3000
00010000:00010000:1.0:1651532040.276779:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.276782:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532040.276784:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.276786:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.276791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532040.276792:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532040.276792:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.276795:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.276802:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.276823:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a965 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2203648->4698111] (req 2203648->4698111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.276829:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.276839:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.277304:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532040.277320:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467964544
00000100:00100000:1.0:1651532040.277335:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3009
00000100:00100000:1.0:1651532040.277337:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467964544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532040.277344:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.277348:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532040.277349:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.277352:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532040.277353:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.277357:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.277360:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532040.397888:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792854 is committed
00010000:00010000:1.0:1651532040.397919:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.397933:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.397955:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467963136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 820957us (820988us total) trans 158913792854 rc 0/0
00010000:00010000:0.0:1651532040.397957:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.397958:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3001
00010000:00010000:0.0:1651532040.397963:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532040.397964:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.397968:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.397975:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.397976:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.397976:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.397980:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.397988:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.397991:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40a96c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9953279] (req 28672->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.397994:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.398006:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.398551:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532040.398569:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467964800
00000100:00100000:1.0:1651532040.398586:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3010
00000100:00100000:1.0:1651532040.398588:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467964800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532040.398595:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.398599:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532040.398600:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.398603:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532040.398604:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.398619:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.398622:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532040.460085:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792855 is committed
00010000:00010000:1.0:1651532040.460118:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.460122:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.460140:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.460143:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467963264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783140us (783203us total) trans 158913792855 rc 0/0
00010000:00010000:0.0:1651532040.460145:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532040.460146:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3002
00010000:00010000:0.0:1651532040.460155:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.460159:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.460165:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.460166:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.460166:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.460170:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.460178:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.460181:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a973 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.460186:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.460189:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.460399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532040.460408:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467964992
00000100:00100000:1.0:1651532040.460422:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3011
00000100:00100000:1.0:1651532040.460423:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467964992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532040.460431:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.460435:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532040.460436:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.460439:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532040.460446:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.460451:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.460455:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532040.526828:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792856 is committed
00010000:00010000:0.0:1651532040.526843:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.526859:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532040.526882:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467963520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 747668us (747704us total) trans 158913792856 rc 0/0
00010000:00010000:1.0:1651532040.526885:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532040.526886:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3003
00010000:00010000:1.0:1651532040.526889:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532040.526890:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.526893:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.526899:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532040.526899:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532040.526900:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.526903:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.526911:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.526923:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.526928:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.526931:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40a97a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->9822207] (req 3588096->9822207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.527220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532040.527239:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467965120
00000100:00100000:0.0:1651532040.527252:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3012
00000100:00100000:0.0:1651532040.527254:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467965120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532040.527273:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.527281:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532040.527282:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.527287:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532040.527288:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.527296:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.527310:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532040.601822:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792857 is committed
00010000:00010000:0.0:1651532040.601837:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601841:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532040.601859:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467963712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 757604us (757669us total) trans 158913792857 rc 0/0
00000100:00100000:0.0:1651532040.601862:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3004
00010000:00010000:0.0:1651532040.601870:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601873:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532040.601874:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601877:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601882:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.601883:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.601883:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601898:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601902:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.601902:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.601903:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601906:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601918:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601921:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40a981 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9097215] (req 1060864->9097215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.601931:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.601935:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601954:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.601958:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.602460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532040.602478:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467965376
00000100:00100000:0.0:1651532040.602490:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3013
00000100:00100000:0.0:1651532040.602492:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754467965376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532040.602499:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.602513:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532040.602514:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.602517:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532040.602517:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.602522:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.602525:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532040.726834:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792859 is committed
00010000:00010000:0.0:1651532040.726855:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.726859:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.726864:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.726869:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532040.726875:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467964032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824785us (824817us total) trans 158913792859 rc 0/0
00000100:00100000:0.0:1651532040.726879:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3006
00000100:00100000:1.0:1651532040.726885:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467963840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 882557us (882611us total) trans 158913792858 rc 0/0
00010000:00010000:0.0:1651532040.726886:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.726888:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3005
00010000:00010000:0.0:1651532040.726890:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532040.726896:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.726899:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532040.726900:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.726900:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.726903:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.726908:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.726911:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40a98f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->1249279] (req 1245184->1249279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.726914:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.726920:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532040.726921:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532040.726921:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.726925:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.726932:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.726935:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a988 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3612672->3616767] (req 3612672->3616767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.726940:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.726943:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532040.727193:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532040.727272:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467965568
00000100:00100000:1.0:1651532040.727287:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3014
00000100:00100000:1.0:1651532040.727289:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467965568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532040.727304:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.727317:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532040.727318:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.727320:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532040.727321:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.727326:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532040.727328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532040.727329:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532040.727343:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467965696
00000100:00100000:0.0:1651532040.727357:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3015
00000100:00100000:0.0:1651532040.727359:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467965696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532040.727366:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.727371:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532040.727372:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.727375:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532040.727376:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.727380:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.727392:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532040.843487:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792860 is committed
00010000:00010000:1.0:1651532040.843518:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.843523:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.843544:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467964160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841431us (841457us total) trans 158913792860 rc 0/0
00010000:00010000:0.0:1651532040.843545:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.843548:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3007
00010000:00010000:0.0:1651532040.843550:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532040.843551:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.843554:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.843560:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.843560:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.843561:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.843564:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.843574:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.843577:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40a996 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10301439] (req 122880->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.843587:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.843592:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.844089:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532040.844118:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467965824
00000100:00100000:1.0:1651532040.844133:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3016
00000100:00100000:1.0:1651532040.844134:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467965824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532040.844141:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.844146:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532040.844146:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532040.844147:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.844150:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532040.943513:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792861 is committed
00002000:00010000:1.0:1651532040.943541:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532039 -> 1651532040
00010000:00010000:1.0:1651532040.943544:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.943547:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.943568:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467964352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783160us (783248us total) trans 158913792861 rc 0/0
00000100:00100000:1.0:1651532040.943571:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3008
00010000:00010000:0.0:1651532040.943571:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.943575:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532040.943576:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.943580:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.943585:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.943586:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532040.943587:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.943590:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.943599:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532040.943603:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40a99d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->8085503] (req 516096->8085503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.943615:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.943627:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532040.944044:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532040.944053:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467966016
00000100:00100000:1.0:1651532040.944067:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3017
00000100:00100000:1.0:1651532040.944069:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467966016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532040.944077:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.944081:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532040.944082:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.944085:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.944087:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532040.944088:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.944092:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.944095:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532040.944109:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532041.001915:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792862 is committed
00010000:00010000:1.0:1651532041.001947:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.001951:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.001968:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467964544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724630us (724664us total) trans 158913792862 rc 0/0
00000100:00100000:1.0:1651532041.001971:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3009
00010000:00010000:1.0:1651532041.001977:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.001981:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532041.001982:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.001985:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.001989:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.001990:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.001991:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.002004:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.002012:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.002015:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9a4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1740800->8769535] (req 1740800->8769535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.002020:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.002023:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.002310:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532041.002319:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467966208
00000100:00100000:0.0:1651532041.002347:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3018
00000100:00100000:0.0:1651532041.002349:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467966208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532041.002368:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.002373:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532041.002374:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.002377:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532041.002377:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.002382:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.002385:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532041.068652:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792863 is committed
00010000:00010000:1.0:1651532041.068680:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.068684:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.068705:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467964800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 670116us (670154us total) trans 158913792863 rc 0/0
00010000:00010000:0.0:1651532041.068707:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.068708:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3010
00010000:00010000:0.0:1651532041.068711:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532041.068713:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.068716:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.068721:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.068729:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.068730:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.068734:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.068743:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.068746:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40a9ab lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->6168575] (req 2347008->6168575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.068753:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.068765:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.069014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532041.069022:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467966400
00000100:00100000:1.0:1651532041.069038:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3019
00000100:00100000:1.0:1651532041.069040:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467966400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532041.069047:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.069051:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532041.069052:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.069055:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532041.069056:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.069060:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.069064:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532041.135360:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792864 is committed
00010000:00010000:1.0:1651532041.135389:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.135404:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.135422:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467964992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674998us (675024us total) trans 158913792864 rc 0/0
00000100:00100000:1.0:1651532041.135425:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3011
00010000:00010000:1.0:1651532041.135432:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.135436:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532041.135437:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.135440:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.135444:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.135445:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.135446:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.135449:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.135461:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.135464:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40a9b2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10289151] (req 53248->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.135473:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.135478:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.136053:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532041.136061:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467966592
00000100:00100000:1.0:1651532041.136071:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3020
00000100:00100000:1.0:1651532041.136073:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467966592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532041.136080:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.136084:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.136085:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.136088:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532041.136089:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.136093:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.136096:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532041.218736:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792865 is committed
00010000:00010000:0.0:1651532041.218751:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.218755:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532041.218777:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467965120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691522us (691557us total) trans 158913792865 rc 0/0
00000100:00100000:0.0:1651532041.218781:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3012
00010000:00010000:0.0:1651532041.218813:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.218817:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532041.218818:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.218822:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.218827:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.218828:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.218829:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.218832:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.218839:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.218842:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9b9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8888320->8892415] (req 8888320->8892415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.218847:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.218850:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.219085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532041.219108:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467966784
00000100:00100000:0.0:1651532041.219124:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3021
00000100:00100000:0.0:1651532041.219126:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467966784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532041.219133:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.219137:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532041.219138:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.219141:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532041.219142:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.219146:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.219149:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532041.335454:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792866 is committed
00010000:00010000:0.0:1651532041.335469:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335473:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532041.335506:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467965376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 733013us (733047us total) trans 158913792866 rc 0/0
00000100:00100000:0.0:1651532041.335510:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3013
00010000:00010000:0.0:1651532041.335518:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335521:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532041.335522:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335525:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335530:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.335531:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.335532:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335535:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335544:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335547:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40a9c0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2162688->10072063] (req 2162688->10072063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.335564:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.335568:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.335861:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532041.335878:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467966912
00000100:00100000:0.0:1651532041.335893:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3022
00000100:00100000:0.0:1651532041.335895:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467966912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532041.335902:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335906:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532041.335907:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335910:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532041.335911:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335915:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.335918:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532041.435457:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792867 is committed
00010000:00010000:1.0:1651532041.435489:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435493:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.435511:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467965568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 708221us (708319us total) trans 158913792867 rc 0/0
00000100:00100000:1.0:1651532041.435515:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3014
00010000:00010000:1.0:1651532041.435521:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435525:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532041.435526:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435529:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435534:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.435534:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.435535:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435538:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435553:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.435553:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.435554:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435557:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435570:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435573:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40a9c7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->8855551] (req 856064->8855551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435579:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435582:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.435583:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.435588:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.435873:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532041.435881:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467967104
00000100:00100000:1.0:1651532041.435896:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3023
00000100:00100000:1.0:1651532041.435898:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754467967104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532041.435912:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435917:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532041.435922:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435925:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532041.435926:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435930:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.435934:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532041.552103:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792869 is committed
00002000:00010000:0.0:1651532041.552122:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532039 -> 1651532040
00010000:00010000:0.0:1651532041.552126:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552129:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.552136:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.552140:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532041.552156:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467965696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824796us (824829us total) trans 158913792869 rc 0/0
00000100:00100000:0.0:1651532041.552160:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3015
00000100:00100000:1.0:1651532041.552162:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467965824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 708027us (708073us total) trans 158913792868 rc 0/0
00000100:00100000:1.0:1651532041.552166:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3016
00010000:00010000:0.0:1651532041.552167:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552171:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532041.552172:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552175:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552180:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552183:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40a9ce lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7196672->7200767] (req 7196672->7200767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552199:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552202:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532041.552202:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552205:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552209:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.552209:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.552210:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552213:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552222:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552225:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40a9d5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->3190783] (req 3186688->3190783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.552229:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.552234:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.552484:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532041.552510:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467967296
00000100:00100000:1.0:1651532041.552529:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3024
00000100:00100000:1.0:1651532041.552531:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467967296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532041.552546:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.552550:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532041.552551:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.552554:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532041.552555:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.552559:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.552562:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.552574:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532041.552592:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467967424
00000100:00100000:0.0:1651532041.552604:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3025
00000100:00100000:0.0:1651532041.552606:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467967424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532041.552623:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552628:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.552629:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552632:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532041.552633:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552637:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.552640:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532041.685430:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792870 is committed
00010000:00010000:1.0:1651532041.685461:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.685465:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.685483:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467966016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 741412us (741439us total) trans 158913792870 rc 0/0
00000100:00100000:1.0:1651532041.685496:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3017
00010000:00010000:1.0:1651532041.685503:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.685507:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532041.685508:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.685511:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.685515:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.685516:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.685517:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.685520:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.685531:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.685534:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40a9dc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1802240->9183231] (req 1802240->9183231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.685544:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.685548:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.686108:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532041.686117:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467967552
00000100:00100000:1.0:1651532041.686131:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3026
00000100:00100000:1.0:1651532041.686139:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467967552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532041.686146:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.686151:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532041.686152:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532041.686152:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.686156:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532041.820520:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792871 is committed
00010000:00010000:0.0:1651532041.820536:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.820540:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532041.820571:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467966208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 818221us (818262us total) trans 158913792871 rc 0/0
00010000:00010000:1.0:1651532041.820574:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532041.820575:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3018
00010000:00010000:1.0:1651532041.820579:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532041.820580:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.820583:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.820588:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.820589:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532041.820590:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.820593:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.820620:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.820623:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40a9e3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2613248->7499775] (req 2613248->7499775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.820630:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.820632:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532041.820845:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532041.820870:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467967744
00000100:00100000:0.0:1651532041.820882:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3027
00000100:00100000:0.0:1651532041.820884:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467967744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532041.820891:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.820896:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532041.820897:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.820900:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.820902:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532041.820903:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.820907:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.820910:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.820925:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532041.912144:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792872 is committed
00002000:00010000:1.0:1651532041.912174:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532040 -> 1651532041
00010000:00010000:1.0:1651532041.912178:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.912182:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.912200:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.912204:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467966400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 843163us (843190us total) trans 158913792872 rc 0/0
00010000:00010000:0.0:1651532041.912204:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532041.912206:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.912207:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3019
00010000:00010000:0.0:1651532041.912209:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.912214:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.912215:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532041.912216:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.912219:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.912228:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532041.912232:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40a9ea lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->6053887] (req 253952->6053887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.912245:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.912249:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532041.912440:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532041.912449:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467967936
00000100:00100000:1.0:1651532041.912466:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3028
00000100:00100000:1.0:1651532041.912468:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467967936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532041.912475:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.912479:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532041.912480:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.912483:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532041.912484:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.912488:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532041.912491:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.002222:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792873 is committed
00010000:00010000:1.0:1651532042.002254:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002258:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532042.002297:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467966592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866223us (866244us total) trans 158913792873 rc 0/0
00000100:00100000:1.0:1651532042.002300:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3020
00010000:00010000:1.0:1651532042.002307:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002311:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532042.002312:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002315:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002319:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.002320:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.002321:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002324:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002335:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002339:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40a9f1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->3252223] (req 94208->3252223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.002346:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.002350:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.002700:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532042.002712:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467968128
00000100:00100000:1.0:1651532042.002732:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3029
00000100:00100000:1.0:1651532042.002734:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467968128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532042.002741:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002745:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532042.002746:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002749:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532042.002750:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002754:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.002757:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.068942:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792874 is committed
00010000:00010000:0.0:1651532042.068958:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.068963:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.068987:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467966784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849861us (849909us total) trans 158913792874 rc 0/0
00010000:00010000:1.0:1651532042.068988:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.068991:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3021
00010000:00010000:1.0:1651532042.068992:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532042.068993:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.068997:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.069012:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.069013:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.069014:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.069017:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.069026:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.069029:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40a9f8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9814015] (req 69632->9814015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.069033:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.069038:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.069561:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532042.069570:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467968320
00000100:00100000:0.0:1651532042.069586:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3030
00000100:00100000:0.0:1651532042.069596:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467968320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532042.069604:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.069609:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532042.069610:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.069613:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532042.069613:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.069618:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.069622:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.152312:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792875 is committed
00010000:00010000:0.0:1651532042.152326:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.152330:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.152351:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.152352:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467966912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816456us (816491us total) trans 158913792875 rc 0/0
00000100:00100000:0.0:1651532042.152355:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3022
00010000:00010000:1.0:1651532042.152356:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532042.152357:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.152360:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.152366:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.152366:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.152367:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.152380:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.152387:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.152390:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40a9ff lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->3284991] (req 3280896->3284991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.152397:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.152401:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.152655:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532042.152722:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467968512
00000100:00100000:0.0:1651532042.152738:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3031
00000100:00100000:0.0:1651532042.152740:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467968512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532042.152748:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.152753:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532042.152754:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.152757:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532042.152758:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.152762:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.152766:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.260670:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792876 is committed
00010000:00010000:0.0:1651532042.260691:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.260703:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.260725:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.260725:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467967104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824826us (824853us total) trans 158913792876 rc 0/0
00000100:00100000:0.0:1651532042.260728:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3023
00010000:00010000:1.0:1651532042.260729:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532042.260730:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.260734:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.260739:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.260739:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.260740:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.260743:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.260750:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.260760:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa06 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->9039871] (req 2007040->9039871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.260761:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.260765:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.261081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532042.261089:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467968640
00000100:00100000:0.0:1651532042.261103:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3032
00000100:00100000:0.0:1651532042.261105:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467968640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532042.261112:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.261117:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532042.261118:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.261121:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532042.261122:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.261136:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.261140:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.385661:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792877 is committed
00010000:00010000:0.0:1651532042.385676:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385680:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.385711:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467967296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 833179us (833228us total) trans 158913792877 rc 0/0
00000100:00100000:0.0:1651532042.385714:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3024
00010000:00010000:0.0:1651532042.385721:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385725:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532042.385726:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385729:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385734:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.385743:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.385744:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385748:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385751:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.385752:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.385752:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385755:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385768:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385771:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aa0d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->10260479] (req 98304->10260479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.385777:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385777:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.385779:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.385781:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.386326:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532042.386335:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467968896
00000100:00100000:0.0:1651532042.386351:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3033
00000100:00100000:0.0:1651532042.386353:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754467968896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532042.386367:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.386372:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532042.386372:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532042.386373:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.386376:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.444055:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792879 is committed
00002000:00010000:0.0:1651532042.444073:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532040 -> 1651532041
00010000:00010000:0.0:1651532042.444076:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444079:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444084:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444094:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.444098:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467967424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 891491us (891524us total) trans 158913792878 rc 0/0
00000100:00100000:0.0:1651532042.444101:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3025
00000100:00100000:1.0:1651532042.444111:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467967552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 757971us (758002us total) trans 158913792879 rc 0/0
00000100:00100000:1.0:1651532042.444114:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3026
00010000:00010000:1.0:1651532042.444122:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444125:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532042.444126:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444129:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444136:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444141:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532042.444142:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444152:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444156:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40aa14 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->1318911] (req 1314816->1318911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444156:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444161:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.444162:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.444163:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444166:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444173:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444176:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa1b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5300224->5304319] (req 5300224->5304319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444181:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444184:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.444353:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532042.444365:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467969088
00000100:00100000:1.0:1651532042.444379:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3034
00000100:00100000:1.0:1651532042.444381:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467969088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532042.444388:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444392:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532042.444393:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444403:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444406:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532042.444407:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444412:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444414:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.444426:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.444535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532042.444543:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467969216
00000100:00100000:0.0:1651532042.444557:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3035
00000100:00100000:0.0:1651532042.444559:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467969216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532042.444573:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444577:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532042.444578:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444581:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532042.444582:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444586:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.444590:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.510799:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792880 is committed
00010000:00010000:0.0:1651532042.510823:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.510827:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.510844:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467967744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 689959us (689999us total) trans 158913792880 rc 0/0
00000100:00100000:0.0:1651532042.510847:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3027
00010000:00010000:0.0:1651532042.510853:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.510865:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532042.510867:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.510870:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.510875:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.510875:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.510876:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.510879:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.510891:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.510894:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa22 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10194943] (req 28672->10194943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.510903:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.510907:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.511188:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532042.511197:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467969344
00000100:00100000:0.0:1651532042.511210:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3036
00000100:00100000:0.0:1651532042.511212:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467969344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532042.511219:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.511233:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532042.511234:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532042.511234:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.511238:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.627488:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792881 is committed
00010000:00010000:1.0:1651532042.627522:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627527:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532042.627551:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467967936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 715082us (715110us total) trans 158913792881 rc 0/0
00000100:00100000:1.0:1651532042.627554:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3028
00010000:00010000:1.0:1651532042.627562:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627566:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532042.627567:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627570:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627592:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.627592:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.627593:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627601:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627609:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627612:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa29 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2637824->10018815] (req 2637824->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627618:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627621:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.627777:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532042.627788:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467969536
00000100:00100000:1.0:1651532042.627800:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3037
00000100:00100000:1.0:1651532042.627817:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467969536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532042.627831:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627841:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532042.627849:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627852:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627855:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532042.627855:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627860:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627863:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.627866:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.710867:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792882 is committed
00010000:00010000:1.0:1651532042.710895:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.710900:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532042.710920:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467968128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 708185us (708221us total) trans 158913792882 rc 0/0
00010000:00010000:0.0:1651532042.710923:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532042.710924:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3029
00010000:00010000:0.0:1651532042.710928:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532042.710929:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.710932:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.710938:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.710938:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.710939:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.710942:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.710961:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.710964:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa30 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->10309631] (req 2486272->10309631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.710969:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.710972:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.711349:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532042.711365:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467969728
00000100:00100000:1.0:1651532042.711387:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3038
00000100:00100000:1.0:1651532042.711389:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467969728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532042.711397:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.711401:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532042.711402:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.711405:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532042.711405:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.711410:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.711413:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.819250:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792883 is committed
00002000:00010000:0.0:1651532042.819274:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532041 -> 1651532042
00010000:00010000:0.0:1651532042.819278:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819282:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.819305:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467968320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749708us (749744us total) trans 158913792883 rc 0/0
00000100:00100000:0.0:1651532042.819308:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3030
00010000:00010000:0.0:1651532042.819316:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819330:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532042.819331:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819335:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819340:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.819340:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532042.819341:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819344:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819352:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819355:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa37 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->6037503] (req 233472->6037503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819360:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819364:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532042.819592:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532042.819611:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467969920
00000100:00100000:0.0:1651532042.819652:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3039
00000100:00100000:0.0:1651532042.819654:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467969920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532042.819661:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819666:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532042.819667:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819670:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532042.819670:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819675:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.819678:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532042.927561:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792884 is committed
00010000:00010000:0.0:1651532042.927576:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.927580:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.927601:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467968512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774860us (774946us total) trans 158913792884 rc 0/0
00010000:00010000:1.0:1651532042.927603:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.927605:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3031
00010000:00010000:1.0:1651532042.927607:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532042.927609:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.927612:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.927628:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.927628:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.927629:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.927632:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.927635:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.927636:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532042.927636:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.927639:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.927656:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.927659:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40aa3e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9932799] (req 73728->9932799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.927665:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.927669:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.927670:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532042.927672:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532042.927914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532042.927935:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467970112
00000100:00100000:0.0:1651532042.927946:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3040
00000100:00100000:0.0:1651532042.927948:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467970112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532042.927956:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.927960:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532042.927961:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.927964:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532042.927965:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.927969:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532042.927973:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532043.027572:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792886 is committed
00010000:00010000:0.0:1651532043.027591:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.027604:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.027609:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.027620:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.027620:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467968640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766515us (766540us total) trans 158913792885 rc 0/0
00000100:00100000:0.0:1651532043.027624:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3032
00010000:00010000:0.0:1651532043.027637:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.027639:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467968896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 641285us (641313us total) trans 158913792886 rc 0/0
00010000:00010000:0.0:1651532043.027641:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532043.027642:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.027643:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3033
00010000:00010000:0.0:1651532043.027645:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.027651:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.027653:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aa45 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->1216511] (req 1212416->1216511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.027657:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.027660:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532043.027660:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.027671:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.027674:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532043.027675:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532043.027676:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.027679:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.027685:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.027688:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aa4c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3645440->9740287] (req 3645440->9740287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.027702:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.027706:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.027922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532043.027931:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467970304
00000100:00100000:1.0:1651532043.027945:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3041
00000100:00100000:1.0:1651532043.027947:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467970304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532043.027961:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.027966:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532043.027967:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.027976:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532043.027977:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.027992:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.027995:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.028098:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532043.028110:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467970432
00000100:00100000:0.0:1651532043.028122:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3042
00000100:00100000:0.0:1651532043.028124:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467970432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532043.028132:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.028136:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532043.028137:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.028140:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532043.028149:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.028154:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.028158:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532043.094315:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792887 is committed
00010000:00010000:1.0:1651532043.094346:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094350:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.094373:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467969088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 649991us (650020us total) trans 158913792887 rc 0/0
00000100:00100000:1.0:1651532043.094376:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3034
00010000:00010000:1.0:1651532043.094384:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094387:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532043.094388:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094391:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094396:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.094405:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.094406:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094409:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094421:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.094422:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.094422:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094425:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094437:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094440:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa53 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10469375] (req 790528->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094450:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.094450:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094453:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.094454:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.094896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532043.094905:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467970688
00000100:00100000:1.0:1651532043.094922:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3043
00000100:00100000:1.0:1651532043.094924:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467970688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532043.094938:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094943:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532043.094944:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094947:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532043.094947:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094952:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.094955:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532043.186000:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792889 is committed
00010000:00010000:0.0:1651532043.186020:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.186024:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186030:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186035:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.186040:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467969344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674827us (674852us total) trans 158913792888 rc 0/0
00000100:00100000:0.0:1651532043.186043:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3036
00000100:00100000:1.0:1651532043.186050:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467969216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 741490us (741516us total) trans 158913792889 rc 0/0
00010000:00010000:0.0:1651532043.186050:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.186053:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3035
00010000:00010000:1.0:1651532043.186061:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.186065:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532043.186066:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.186069:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186075:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532043.186075:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186077:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.186078:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aa61 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7327744->7331839] (req 7327744->7331839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186080:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186085:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.186086:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.186086:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186089:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186097:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186100:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40aa5a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6443008->6447103] (req 6443008->6447103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186105:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186108:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.186427:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532043.186439:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467971008
00000100:00100000:1.0:1651532043.186460:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3044
00000100:00100000:1.0:1651532043.186462:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467971008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532043.186469:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186474:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532043.186475:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532043.186475:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.186478:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.186486:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532043.186494:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467970880
00000100:00100000:0.0:1651532043.186506:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3045
00000100:00100000:0.0:1651532043.186508:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467970880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532043.186516:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.186520:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532043.186521:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.186524:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532043.186525:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.186540:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.186544:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532043.252780:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792890 is committed
00010000:00010000:1.0:1651532043.252817:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.252821:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.252843:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467969536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 625040us (625066us total) trans 158913792890 rc 0/0
00000100:00100000:1.0:1651532043.252846:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3037
00010000:00010000:1.0:1651532043.252853:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.252857:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532043.252858:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.252871:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.252876:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.252877:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.252886:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.252889:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.252897:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.252899:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aa68 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9957375] (req 36864->9957375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.252905:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.252908:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.253399:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532043.253407:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467971200
00000100:00100000:1.0:1651532043.253425:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3046
00000100:00100000:1.0:1651532043.253427:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467971200:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532043.253443:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.253447:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532043.253448:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.253451:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.253454:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532043.253455:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.253459:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.253462:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.253465:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532043.361087:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792891 is committed
00010000:00010000:1.0:1651532043.361115:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.361119:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.361150:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467969728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 649760us (649802us total) trans 158913792891 rc 0/0
00010000:00010000:0.0:1651532043.361153:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.361154:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3038
00010000:00010000:0.0:1651532043.361158:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532043.361159:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.361162:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.361168:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532043.361169:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532043.361169:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.361172:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.361180:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.361193:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40aa6f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->10113023] (req 774144->10113023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.361196:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.361201:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.361614:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532043.361631:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467971392
00000100:00100000:1.0:1651532043.361647:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3047
00000100:00100000:1.0:1651532043.361649:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467971392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532043.361657:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.361661:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532043.361662:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.361665:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532043.361665:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.361670:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.361683:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.488091:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532043.488116:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229376
00000100:00100000:0.0:1651532043.488128:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 45
00000100:00100000:0.0:1651532043.488130:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951229376:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532043.488136:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1605632 granted 356078144 pending 143360 free 81138851840 avail 76968140800
00000100:00100000:0.0:1651532043.488155:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951229376:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 24us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532043.488158:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 45
00000001:00080000:0.0:1651532043.494419:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792892 is committed
00010000:00010000:1.0:1651532043.494448:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.494453:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.494470:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467969920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674815us (674879us total) trans 158913792892 rc 0/0
00000100:00100000:1.0:1651532043.494473:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3039
00010000:00010000:1.0:1651532043.494480:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.494483:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532043.494484:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.494487:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.494492:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.494493:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.494494:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.494508:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.494520:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.494523:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aa76 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->4681727] (req 1949696->4681727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.494533:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.494537:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.494955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532043.494964:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467971584
00000100:00100000:1.0:1651532043.494979:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3048
00000100:00100000:1.0:1651532043.494981:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467971584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532043.494988:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.494992:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532043.494993:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.494996:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532043.494996:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.495000:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.495014:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532043.586110:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792893 is committed
00010000:00010000:0.0:1651532043.586125:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.586129:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.586151:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467970112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 658202us (658238us total) trans 158913792893 rc 0/0
00010000:00010000:1.0:1651532043.586153:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.586158:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532043.586159:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.586162:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.586165:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3040
00010000:00010000:1.0:1651532043.586167:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.586167:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.586168:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.586171:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.586178:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.586181:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aa7d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->8544255] (req 3522560->8544255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.586187:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.586197:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.586486:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532043.586495:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467971776
00000100:00100000:0.0:1651532043.586507:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3049
00000100:00100000:0.0:1651532043.586509:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467971776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532043.586540:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.586546:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532043.586547:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532043.586548:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.586551:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532043.702811:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792894 is committed
00010000:00010000:1.0:1651532043.702839:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.702844:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.702864:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467970304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674916us (674942us total) trans 158913792894 rc 0/0
00000100:00100000:1.0:1651532043.702867:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3041
00010000:00010000:0.0:1651532043.702867:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.702872:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532043.702873:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.702876:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.702882:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532043.702890:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532043.702891:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.702895:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.702903:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.702906:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40aa84 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9695231] (req 450560->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.702912:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.702914:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.703460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532043.703468:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467971968
00000100:00100000:1.0:1651532043.703481:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3050
00000100:00100000:1.0:1651532043.703483:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467971968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532043.703490:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.703495:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532043.703496:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.703499:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.703501:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532043.703509:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.703515:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.703517:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.703521:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532043.794464:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792895 is committed
00002000:00010000:0.0:1651532043.794478:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532042 -> 1651532043
00002000:00010000:0.0:1651532043.794479:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532041 -> 1651532043
00010000:00010000:0.0:1651532043.794482:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.794486:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.794510:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467970432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766385us (766412us total) trans 158913792895 rc 0/0
00010000:00010000:1.0:1651532043.794512:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.794516:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532043.794517:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.794520:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.794524:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3042
00010000:00010000:1.0:1651532043.794525:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.794526:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.794527:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.794530:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.794543:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.794544:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.794545:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.794547:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.794555:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.794558:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aa8b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->3768319] (req 1044480->3768319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.794561:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.794565:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.794571:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.794575:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.794918:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532043.794954:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467972160
00000100:00100000:0.0:1651532043.794971:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3051
00000100:00100000:0.0:1651532043.794974:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467972160:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532043.794984:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.794991:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532043.794993:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.794998:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532043.794999:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.795006:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.795012:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532043.886196:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792897 is committed
00010000:00010000:0.0:1651532043.886226:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.886230:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.886235:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.886245:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.886250:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467971008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699787us (699824us total) trans 158913792896 rc 0/0
00000100:00100000:0.0:1651532043.886260:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3044
00000100:00100000:1.0:1651532043.886273:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467970688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791339us (791367us total) trans 158913792897 rc 0/0
00010000:00010000:0.0:1651532043.886283:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.886284:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3043
00010000:00010000:0.0:1651532043.886289:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532043.886290:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.886292:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.886296:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532043.886296:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.886297:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.886300:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.886306:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532043.886307:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532043.886308:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.886313:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.886320:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.886323:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aa92 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->6619135] (req 2273280->6619135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.886324:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.886343:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aa99 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1748992->1757183] (req 1748992->1757183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.886352:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.886357:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.886900:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532043.886919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532043.886962:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467972480
00000100:00100000:0.0:1651532043.886962:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467972352
00000100:00100000:1.0:1651532043.886976:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3052
00000100:00100000:1.0:1651532043.886978:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467972480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532043.886985:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.886987:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3053
00010000:00010000:1.0:1651532043.886989:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532043.886989:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467972352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532043.886990:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532043.886998:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.886998:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.887002:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.887003:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532043.887004:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532043.887005:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.887008:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532043.952897:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792898 is committed
00010000:00010000:0.0:1651532043.952913:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.952929:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.952952:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.952956:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532043.952957:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.952960:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.952970:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.952971:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532043.952972:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.952972:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467970880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766461us (766483us total) trans 158913792898 rc 0/0
00010000:00010000:1.0:1651532043.952975:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532043.952977:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3045
00010000:00010000:1.0:1651532043.952982:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.952985:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aaa0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3227648->10473471] (req 3227648->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.953001:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532043.953004:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532043.953631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532043.953651:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467972672
00000100:00100000:0.0:1651532043.953667:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3054
00000100:00100000:0.0:1651532043.953669:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467972672:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532043.953678:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.953683:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532043.953683:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.953686:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.953689:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.953691:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532043.953692:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.953697:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.953708:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.953711:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532043.953715:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532044.019641:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792899 is committed
00010000:00010000:1.0:1651532044.019671:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.019675:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.019697:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467971200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766269us (766299us total) trans 158913792899 rc 0/0
00000100:00100000:1.0:1651532044.019700:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3046
00010000:00010000:1.0:1651532044.019708:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.019711:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532044.019712:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.019715:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.019720:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.019728:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.019729:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.019732:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.019749:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.019752:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaa7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->9699327] (req 1228800->9699327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.019758:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.019760:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.020283:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532044.020293:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467972864
00000100:00100000:1.0:1651532044.020303:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3055
00000100:00100000:1.0:1651532044.020305:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467972864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532044.020312:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.020317:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532044.020317:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.020332:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532044.020333:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.020338:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.020342:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532044.136315:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792900 is committed
00010000:00010000:1.0:1651532044.136347:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.136351:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.136373:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467971392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774722us (774759us total) trans 158913792900 rc 0/0
00000100:00100000:1.0:1651532044.136376:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3047
00010000:00010000:0.0:1651532044.136376:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.136382:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532044.136383:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.136387:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.136392:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532044.136393:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532044.136394:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.136397:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.136409:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532044.136410:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532044.136410:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.136413:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.136432:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.136437:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.136438:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40aaae lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4444160->10313727] (req 4444160->10313727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.136441:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.136448:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.136453:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.136901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532044.136917:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467973056
00000100:00100000:1.0:1651532044.136937:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3056
00000100:00100000:1.0:1651532044.136939:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754467973056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532044.136946:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.136951:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532044.136952:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.136955:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532044.136955:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.136960:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.136963:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532044.219698:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792902 is committed
00010000:00010000:0.0:1651532044.219720:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.219725:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219731:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219740:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532044.219755:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467971776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 633238us (633262us total) trans 158913792902 rc 0/0
00000100:00100000:1.0:1651532044.219762:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467971584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724780us (724813us total) trans 158913792901 rc 0/0
00000100:00100000:1.0:1651532044.219765:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3048
00000100:00100000:0.0:1651532044.219768:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3049
00010000:00010000:1.0:1651532044.219773:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.219777:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.219781:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532044.219782:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219784:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532044.219785:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219786:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219790:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.219791:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.219794:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40aab5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6197248->9932799] (req 6197248->9932799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219795:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.219796:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.219797:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219800:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219818:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219821:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aabc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3530752->4362239] (req 3530752->4362239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219827:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.219830:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.220292:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532044.220328:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467973248
00000100:00100000:0.0:1651532044.220350:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3057
00000100:00100000:0.0:1651532044.220353:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467973248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532044.220363:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.220369:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532044.220370:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.220373:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532044.220382:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.220388:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.220391:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532044.328015:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792903 is committed
00010000:00010000:1.0:1651532044.328045:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328049:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.328071:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467971968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 624587us (624611us total) trans 158913792903 rc 0/0
00000100:00100000:1.0:1651532044.328074:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3050
00010000:00010000:1.0:1651532044.328081:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328085:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532044.328086:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328089:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328094:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.328094:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.328095:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328098:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328101:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.328102:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.328102:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328119:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328123:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.328123:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.328124:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328126:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328140:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328144:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aac3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->9822207] (req 729088->9822207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328149:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328152:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.328157:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.328164:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328204:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328208:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532044.328713:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532044.328735:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467973440
00000100:00100000:1.0:1651532044.328748:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3058
00000100:00100000:1.0:1651532044.328750:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754467973440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532044.328757:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328762:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532044.328763:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328765:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532044.328766:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328770:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.328774:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532044.457621:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792906 is committed
00010000:00010000:0.0:1651532044.457644:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.457650:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457656:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457661:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532044.457671:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467972160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 662696us (662753us total) trans 158913792906 rc 0/0
00000100:00100000:0.0:1651532044.457675:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3051
00000100:00100000:1.0:1651532044.457682:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467972352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 570691us (570782us total) trans 158913792904 rc 0/0
00010000:00010000:0.0:1651532044.457683:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.457694:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3053
00010000:00010000:0.0:1651532044.457698:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532044.457699:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457702:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.457702:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457708:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532044.457709:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.457709:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457712:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.457712:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aaca lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5971968->7970815] (req 5971968->7970815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457718:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457721:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40aad8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3112960->3117055] (req 3112960->3117055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.457729:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.457733:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532044.457750:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467972480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 570771us (570830us total) trans 158913792905 rc 0/0
00000100:00100000:0.0:1651532044.457753:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3052
00010000:00010000:1.0:1651532044.457762:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457782:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532044.457783:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457791:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457796:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.457819:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.457820:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457824:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457830:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457833:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aad1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8462336->8749055] (req 8462336->8749055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457842:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.457845:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532044.458223:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532044.458239:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532044.458249:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467973632
00000100:00100000:1.0:1651532044.458262:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467973888
00000100:00100000:1.0:1651532044.458279:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3059
00000100:00100000:1.0:1651532044.458281:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467973632:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532044.458290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532044.458295:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.458305:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532044.458306:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.458316:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532044.458317:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.458322:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.458325:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.458333:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467973696
00000100:00100000:1.0:1651532044.458344:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3060
00000100:00100000:1.0:1651532044.458345:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467973888:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532044.458350:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532044.458359:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.458363:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532044.458364:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532044.458364:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.458367:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.458374:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467973952
00000100:00100000:1.0:1651532044.458380:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3061
00000100:00100000:1.0:1651532044.458381:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467973696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532044.458397:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532044.458399:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3062
00010000:00010000:1.0:1651532044.458401:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532044.458402:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532044.458402:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532044.458402:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467973952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532044.458405:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.458422:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.458427:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532044.458428:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.458431:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532044.458431:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.458436:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.458440:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532044.566011:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792907 is committed
00010000:00010000:1.0:1651532044.566039:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566043:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.566065:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467972672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 612395us (612435us total) trans 158913792907 rc 0/0
00010000:00010000:0.0:1651532044.566066:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.566068:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3054
00010000:00010000:0.0:1651532044.566072:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532044.566073:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.566076:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.566082:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532044.566090:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532044.566091:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.566095:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.566102:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.566107:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aadf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10231807] (req 401408->10231807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566119:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566123:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.566657:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532044.566666:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467974144
00000100:00100000:1.0:1651532044.566687:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3063
00000100:00100000:1.0:1651532044.566697:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467974144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532044.566704:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566709:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532044.566710:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566720:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566723:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566725:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532044.566726:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566731:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566733:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566736:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.566739:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532044.632689:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792908 is committed
00002000:00010000:1.0:1651532044.632715:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532043 -> 1651532044
00002000:00010000:1.0:1651532044.632717:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532043 -> 1651532044
00010000:00010000:1.0:1651532044.632720:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.632723:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.632740:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467972864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 612434us (612465us total) trans 158913792908 rc 0/0
00000100:00100000:1.0:1651532044.632743:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3055
00010000:00010000:1.0:1651532044.632750:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.632754:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532044.632755:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.632757:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.632762:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.632763:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.632764:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.632766:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.632782:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.632785:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40aae6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->10141695] (req 651264->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.632791:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.632793:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.633371:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532044.633387:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467974336
00000100:00100000:1.0:1651532044.633403:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3064
00000100:00100000:1.0:1651532044.633405:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467974336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532044.633412:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.633416:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532044.633417:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.633420:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532044.633420:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.633425:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.633436:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532044.757696:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792909 is committed
00010000:00010000:1.0:1651532044.757725:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.757729:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.757750:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467973056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 620810us (620850us total) trans 158913792909 rc 0/0
00000100:00100000:1.0:1651532044.757754:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3056
00010000:00010000:1.0:1651532044.757761:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.757764:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532044.757765:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.757768:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.757773:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.757773:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.757774:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.757787:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.757823:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.757826:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aaed lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.757831:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.757839:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.758445:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532044.758460:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467974528
00000100:00100000:1.0:1651532044.758474:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3065
00000100:00100000:1.0:1651532044.758476:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467974528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532044.758482:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.758486:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532044.758487:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.758490:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532044.758491:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.758495:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.758498:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532044.816109:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792910 is committed
00010000:00010000:0.0:1651532044.816126:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816131:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532044.816149:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467973248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 595795us (595858us total) trans 158913792910 rc 0/0
00000100:00100000:0.0:1651532044.816164:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3057
00010000:00010000:0.0:1651532044.816173:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816176:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532044.816178:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816181:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816186:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532044.816187:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532044.816187:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816191:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816203:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816206:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40aaf4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->7770111] (req 3170304->7770111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.816214:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.816218:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.816747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532044.816781:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467974720
00000100:00100000:0.0:1651532044.816800:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3066
00000100:00100000:0.0:1651532044.816823:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467974720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532044.816841:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816846:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532044.816847:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816850:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532044.816851:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816855:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532044.816858:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532044.882846:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792911 is committed
00010000:00010000:1.0:1651532044.882875:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882879:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.882901:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467973440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 554150us (554188us total) trans 158913792911 rc 0/0
00000100:00100000:1.0:1651532044.882904:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3058
00010000:00010000:1.0:1651532044.882912:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882915:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532044.882916:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882919:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882924:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.882932:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.882933:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882945:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882949:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.882949:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.882950:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882953:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882955:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.882956:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532044.882957:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882959:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882968:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882971:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aafb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9850879] (req 77824->9850879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882976:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.882988:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.883010:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.883013:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.883063:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.883067:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532044.883530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532044.883546:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467974912
00000100:00100000:1.0:1651532044.883557:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3067
00000100:00100000:1.0:1651532044.883559:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754467974912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532044.883566:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.883571:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532044.883571:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.883574:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532044.883584:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.883589:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532044.883592:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532045.007855:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792914 is committed
00010000:00010000:1.0:1651532045.007885:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.007889:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.007911:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467973888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549565us (549673us total) trans 158913792914 rc 0/0
00000100:00100000:1.0:1651532045.007915:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3060
00010000:00010000:1.0:1651532045.007922:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.007926:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.007927:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.007930:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.007935:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.007943:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.007944:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.007956:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.007964:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.007967:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.007970:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ab09 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8773631] (req 4194304->8773631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.007980:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.007987:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.007990:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.008011:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467973632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549730us (549809us total) trans 158913792913 rc 0/0
00000100:00100000:0.0:1651532045.008012:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467973696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549629us (549722us total) trans 158913792912 rc 0/0
00000100:00100000:1.0:1651532045.008015:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3059
00000100:00100000:0.0:1651532045.008018:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3061
00010000:00010000:1.0:1651532045.008021:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008024:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.008025:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.008031:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008038:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008043:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008046:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ab10 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9465856->9469951] (req 9465856->9469951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008049:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.008049:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008052:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.008053:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008055:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008059:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008061:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ab02 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1810432->1814527] (req 1810432->1814527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.008365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532045.008381:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467975104
00000100:00100000:0.0:1651532045.008407:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3068
00000100:00100000:0.0:1651532045.008411:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467975104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532045.008422:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.008430:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532045.008431:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.008461:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532045.008462:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.008467:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532045.008467:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.008471:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.008475:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532045.008491:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467975296
00000100:00100000:1.0:1651532045.008500:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467975424
00000100:00100000:1.0:1651532045.008509:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3069
00000100:00100000:1.0:1651532045.008511:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467975296:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532045.008516:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3070
00010000:00010000:1.0:1651532045.008518:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.008518:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467975424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532045.008522:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.008523:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008526:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532045.008526:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.008527:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.008531:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532045.008532:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.008535:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532045.008536:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008539:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.008540:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.008543:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.008543:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532045.116202:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792915 is committed
00010000:00010000:0.0:1651532045.116218:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.116222:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.116244:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467973952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 657842us (657894us total) trans 158913792915 rc 0/0
00010000:00010000:1.0:1651532045.116245:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.116248:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3062
00010000:00010000:1.0:1651532045.116250:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.116251:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.116254:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.116276:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.116277:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.116278:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.116281:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.116289:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.116292:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ab17 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8736768->8740863] (req 8736768->8740863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.116297:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.116319:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.116682:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532045.116754:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467975616
00000100:00100000:0.0:1651532045.116770:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3071
00000100:00100000:0.0:1651532045.116772:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467975616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532045.116779:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.116784:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532045.116785:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.116788:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532045.116789:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.116793:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.116797:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532045.249509:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792916 is committed
00010000:00010000:0.0:1651532045.249525:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.249541:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.249563:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.249565:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467974144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 682867us (682908us total) trans 158913792916 rc 0/0
00010000:00010000:1.0:1651532045.249567:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.249568:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.249568:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3063
00010000:00010000:1.0:1651532045.249572:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.249577:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.249578:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.249578:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.249589:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.249597:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.249600:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ab1e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9580543] (req 77824->9580543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.249602:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.249606:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.250176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532045.250201:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467975744
00000100:00100000:0.0:1651532045.250222:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3072
00000100:00100000:0.0:1651532045.250226:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467975744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532045.250237:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.250242:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532045.250243:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.250245:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532045.250246:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.250251:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.250274:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532045.366183:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792917 is committed
00010000:00010000:0.0:1651532045.366199:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.366204:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.366228:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.366230:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467974336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 732824us (732859us total) trans 158913792917 rc 0/0
00010000:00010000:1.0:1651532045.366233:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.366234:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.366234:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3064
00010000:00010000:1.0:1651532045.366237:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.366243:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.366244:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.366245:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.366248:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.366284:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.366288:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab25 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->10395647] (req 475136->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.366294:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.366297:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.366760:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532045.366780:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467975936
00000100:00100000:0.0:1651532045.366796:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3073
00000100:00100000:0.0:1651532045.366798:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467975936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532045.366818:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.366823:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532045.366824:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.366827:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532045.366828:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.366844:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.366848:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532045.449602:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792918 is committed
00010000:00010000:1.0:1651532045.449632:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.449636:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.449660:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467974528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691183us (691215us total) trans 158913792918 rc 0/0
00000100:00100000:1.0:1651532045.449663:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3065
00010000:00010000:1.0:1651532045.449671:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.449674:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.449675:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.449687:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.449692:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.449693:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.449693:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.449705:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.449716:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.449719:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab2c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10403839] (req 90112->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.449723:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.449727:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.450153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532045.450161:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467976128
00000100:00100000:1.0:1651532045.450172:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3074
00000100:00100000:1.0:1651532045.450174:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467976128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532045.450181:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.450186:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532045.450187:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.450201:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532045.450202:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.450207:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.450211:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532045.541303:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792919 is committed
00010000:00010000:0.0:1651532045.541323:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.541330:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.541356:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.541359:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467974720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724555us (724612us total) trans 158913792919 rc 0/0
00010000:00010000:1.0:1651532045.541360:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.541361:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.541365:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.541365:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3066
00010000:00010000:1.0:1651532045.541370:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.541371:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.541372:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.541374:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.541393:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.541396:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ab33 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->10117119] (req 827392->10117119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.541401:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.541406:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.541734:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532045.541744:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467976320
00000100:00100000:1.0:1651532045.541770:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3075
00000100:00100000:1.0:1651532045.541778:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467976320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532045.541786:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.541791:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532045.541791:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.541794:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532045.541795:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.541799:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.541818:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532045.632955:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792920 is committed
00010000:00010000:0.0:1651532045.632972:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.632976:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.632997:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.632999:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467974912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749439us (749468us total) trans 158913792920 rc 0/0
00000100:00100000:0.0:1651532045.633002:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3067
00010000:00010000:1.0:1651532045.633011:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.633013:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.633016:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.633021:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.633021:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.633022:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.633025:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.633035:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.633045:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab3a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10067967] (req 81920->10067967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.633053:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.633057:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.633248:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532045.633263:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467976576
00000100:00100000:0.0:1651532045.633289:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3076
00000100:00100000:0.0:1651532045.633292:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467976576:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532045.633302:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.633309:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532045.633310:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.633330:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532045.633331:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.633338:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.633344:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532045.724680:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792921 is committed
00002000:00010000:0.0:1651532045.724694:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532044 -> 1651532045
00002000:00010000:0.0:1651532045.724695:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532044 -> 1651532045
00010000:00010000:0.0:1651532045.724698:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.724702:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.724723:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.724724:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467975104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716313us (716360us total) trans 158913792921 rc 0/0
00000100:00100000:0.0:1651532045.724727:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3068
00010000:00010000:1.0:1651532045.724728:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.724729:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.724742:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.724747:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.724748:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.724748:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.724751:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.724759:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.724770:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ab41 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6799360->6803455] (req 6799360->6803455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.724776:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.724779:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.724957:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532045.724967:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467976768
00000100:00100000:0.0:1651532045.724977:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3077
00000100:00100000:0.0:1651532045.724979:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467976768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532045.724997:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.725002:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532045.725003:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.725005:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532045.725006:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.725011:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.725014:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532045.824692:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792922 is committed
00010000:00010000:1.0:1651532045.824722:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.824726:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532045.824760:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467975296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816248us (816293us total) trans 158913792922 rc 0/0
00000100:00100000:1.0:1651532045.824764:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3069
00010000:00010000:1.0:1651532045.824772:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.824775:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.824776:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.824779:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.824784:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.824785:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.824786:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.824789:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.824819:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.824819:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.824822:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ab48 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8110079] (req 380928->8110079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.824823:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.825076:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532045.825087:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467976896
00000100:00100000:1.0:1651532045.825107:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3078
00000100:00100000:1.0:1651532045.825109:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467976896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532045.825116:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.825120:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.825121:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.825124:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532045.825124:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.825129:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.825132:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532045.916394:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792923 is committed
00010000:00010000:0.0:1651532045.916416:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.916432:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.916457:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467975424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 907938us (907981us total) trans 158913792923 rc 0/0
00010000:00010000:1.0:1651532045.916458:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.916460:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3070
00010000:00010000:1.0:1651532045.916462:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532045.916463:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.916467:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.916482:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.916483:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532045.916484:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.916487:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.916496:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.916504:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532045.916506:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ab4f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->4358143] (req 81920->4358143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.916508:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532045.916736:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532045.916745:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467977088
00000100:00100000:0.0:1651532045.916759:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3079
00000100:00100000:0.0:1651532045.916761:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467977088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532045.916768:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.916773:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532045.916774:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.916777:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532045.916778:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.916793:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532045.916797:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532046.008101:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792924 is committed
00010000:00010000:0.0:1651532046.008117:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.008121:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.008143:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467975616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 891370us (891462us total) trans 158913792924 rc 0/0
00010000:00010000:1.0:1651532046.008144:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.008146:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3071
00010000:00010000:1.0:1651532046.008148:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532046.008149:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.008152:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.008158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.008158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.008159:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.008172:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.008188:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.008189:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.008191:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab56 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3674112->3678207] (req 3674112->3678207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.008193:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.008415:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532046.008497:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467977280
00000100:00100000:0.0:1651532046.008513:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3080
00000100:00100000:0.0:1651532046.008515:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467977280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532046.008533:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.008537:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532046.008538:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.008541:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532046.008542:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.008547:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.008550:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532046.074842:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792925 is committed
00010000:00010000:0.0:1651532046.074858:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.074862:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.074883:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.074885:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467975744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824659us (824709us total) trans 158913792925 rc 0/0
00010000:00010000:1.0:1651532046.074888:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532046.074888:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3072
00010000:00010000:1.0:1651532046.074889:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.074892:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.074898:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.074898:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.074899:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.074902:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.074911:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.074920:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.074928:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ab5d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1519616->9965567] (req 1519616->9965567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.074934:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.075490:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532046.075504:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467977408
00000100:00100000:0.0:1651532046.075531:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3081
00000100:00100000:0.0:1651532046.075535:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467977408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532046.075547:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.075554:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532046.075556:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532046.075557:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.075563:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532046.208140:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792926 is committed
00010000:00010000:0.0:1651532046.208157:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.208161:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.208183:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.208185:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467975936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841385us (841425us total) trans 158913792926 rc 0/0
00010000:00010000:1.0:1651532046.208188:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532046.208189:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.208192:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.208198:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.208198:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.208199:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.208202:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.208205:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3073
00010000:00010000:1.0:1651532046.208210:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.208213:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ab64 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.208218:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.208229:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.208777:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532046.208787:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467977600
00000100:00100000:0.0:1651532046.208814:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3082
00000100:00100000:0.0:1651532046.208816:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467977600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532046.208825:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.208830:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532046.208830:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.208833:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.208836:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532046.208837:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.208841:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.208844:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.208847:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532046.316492:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792927 is committed
00010000:00010000:1.0:1651532046.316521:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316525:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532046.316548:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467976128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866372us (866395us total) trans 158913792927 rc 0/0
00000100:00100000:1.0:1651532046.316552:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3074
00010000:00010000:1.0:1651532046.316560:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316563:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532046.316564:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316567:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316572:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.316572:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.316573:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316576:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316598:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316601:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ab6b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->9895935] (req 32768->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316607:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316610:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.316784:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532046.316822:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467977792
00000100:00100000:1.0:1651532046.316846:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3083
00000100:00100000:1.0:1651532046.316848:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467977792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532046.316856:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316860:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532046.316861:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316864:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532046.316865:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316869:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.316881:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532046.449814:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792928 is committed
00010000:00010000:1.0:1651532046.449842:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.449847:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532046.449870:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467976320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 908096us (908136us total) trans 158913792928 rc 0/0
00000100:00100000:1.0:1651532046.449873:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3075
00010000:00010000:1.0:1651532046.449881:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.449884:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532046.449885:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.449888:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.449893:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.449894:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.449894:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.449916:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.449928:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.449931:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ab72 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3751936->10477567] (req 3751936->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.449941:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.449947:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.450131:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532046.450142:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467977984
00000100:00100000:1.0:1651532046.450157:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3084
00000100:00100000:1.0:1651532046.450159:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467977984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532046.450166:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.450170:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532046.450171:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.450174:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532046.450175:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.450178:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.450182:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532046.566470:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792929 is committed
00010000:00010000:0.0:1651532046.566485:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.566490:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.566512:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.566513:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467976576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 933220us (933265us total) trans 158913792929 rc 0/0
00010000:00010000:1.0:1651532046.566516:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532046.566516:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3076
00010000:00010000:1.0:1651532046.566517:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.566520:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.566525:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.566526:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.566526:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.566529:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.566538:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.566541:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ab79 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->8134655] (req 1933312->8134655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.566549:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.566553:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.566935:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532046.566954:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467978240
00000100:00100000:0.0:1651532046.566969:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3085
00000100:00100000:0.0:1651532046.566972:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467978240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532046.566983:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.566991:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532046.566992:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.566996:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532046.566996:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.567001:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.567005:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532046.684478:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792930 is committed
00010000:00010000:0.0:1651532046.684494:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.684498:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.684519:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.684521:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467976768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 959541us (959564us total) trans 158913792930 rc 0/0
00010000:00010000:1.0:1651532046.684523:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532046.684531:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.684534:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.684535:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3077
00010000:00010000:1.0:1651532046.684539:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.684540:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.684541:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.684544:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.684551:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.684554:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ab80 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->10244095] (req 401408->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.684559:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.684562:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.684826:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532046.684835:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467978432
00000100:00100000:0.0:1651532046.684849:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3086
00000100:00100000:0.0:1651532046.684851:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467978432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532046.684858:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.684863:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532046.684864:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.684867:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532046.684867:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.684872:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.684875:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532046.767813:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792931 is committed
00010000:00010000:1.0:1651532046.767841:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.767846:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532046.767876:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467976896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 942765us (942800us total) trans 158913792931 rc 0/0
00000100:00100000:1.0:1651532046.767880:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3078
00010000:00010000:1.0:1651532046.767887:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.767890:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532046.767891:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.767894:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.767899:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.767900:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.767901:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.767904:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.767913:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.767924:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ab87 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8044544->8048639] (req 8044544->8048639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.767929:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.767933:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.768115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532046.768130:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467978624
00000100:00100000:1.0:1651532046.768141:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3087
00000100:00100000:1.0:1651532046.768143:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467978624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532046.768150:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.768154:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532046.768155:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.768158:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532046.768158:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.768162:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.768166:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532046.859540:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792932 is committed
00010000:00010000:0.0:1651532046.859555:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.859559:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.859580:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.859581:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467977088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 942819us (942846us total) trans 158913792932 rc 0/0
00010000:00010000:1.0:1651532046.859584:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532046.859585:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.859585:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3079
00010000:00010000:1.0:1651532046.859598:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.859603:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.859603:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.859604:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.859607:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.859610:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.859611:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532046.859611:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.859614:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.859632:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.859635:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ab8e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->9330687] (req 3272704->9330687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.859645:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.859646:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.859647:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.859651:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.859934:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532046.859955:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467978752
00000100:00100000:0.0:1651532046.859968:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3088
00000100:00100000:0.0:1651532046.859970:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467978752:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532046.859978:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.859982:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532046.859983:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.859994:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532046.859994:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.859999:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.860002:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532046.959551:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792934 is committed
00010000:00010000:0.0:1651532046.959573:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.959577:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.959583:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.959592:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.959598:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467977408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 884063us (884109us total) trans 158913792933 rc 0/0
00000100:00100000:0.0:1651532046.959601:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3081
00000100:00100000:1.0:1651532046.959608:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467977280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 951092us (951193us total) trans 158913792934 rc 0/0
00000100:00100000:1.0:1651532046.959612:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3080
00010000:00010000:1.0:1651532046.959619:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.959623:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532046.959624:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.959627:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.959632:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.959635:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ab9c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6410240->6414335] (req 6410240->6414335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.959638:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.959642:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532046.959643:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.959658:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.959664:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532046.959664:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532046.959665:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.959669:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.959676:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.959679:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ab95 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4427776->5398527] (req 4427776->5398527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.959685:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532046.959688:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.959955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532046.959962:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467978944
00000100:00100000:1.0:1651532046.959977:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3089
00000100:00100000:1.0:1651532046.959986:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467978944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532046.959993:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532046.959994:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532046.959997:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532046.960004:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.960007:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532046.960008:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.960012:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.960016:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532046.960023:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467979136
00000100:00100000:1.0:1651532046.960031:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3090
00000100:00100000:1.0:1651532046.960032:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467979136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532046.960037:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.960041:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532046.960041:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532046.960042:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532046.960055:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532047.042938:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792935 is committed
00002000:00010000:0.0:1651532047.042952:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532045 -> 1651532046
00010000:00010000:0.0:1651532047.042955:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.042968:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.042989:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.042991:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467977600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 834174us (834214us total) trans 158913792935 rc 0/0
00010000:00010000:1.0:1651532047.042993:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532047.042994:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.042995:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3082
00010000:00010000:1.0:1651532047.042998:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.043003:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.043003:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.043004:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.043007:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.043014:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.043017:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aba3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->9302015] (req 937984->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.043022:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.043037:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.043562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532047.043594:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467979264
00000100:00100000:0.0:1651532047.043606:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3091
00000100:00100000:0.0:1651532047.043608:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467979264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532047.043615:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.043620:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532047.043621:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.043624:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532047.043625:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.043629:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.043632:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532047.176234:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792936 is committed
00010000:00010000:1.0:1651532047.176264:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176276:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532047.176299:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467977792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 859450us (859516us total) trans 158913792936 rc 0/0
00000100:00100000:1.0:1651532047.176303:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3083
00010000:00010000:1.0:1651532047.176310:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176314:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532047.176315:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176318:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176323:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.176323:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.176324:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176346:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176354:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176357:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abaa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->10272767] (req 1253376->10272767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176363:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176366:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.176527:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532047.176544:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467979456
00000100:00100000:1.0:1651532047.176559:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3092
00000100:00100000:1.0:1651532047.176561:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467979456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532047.176568:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176572:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532047.176573:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176584:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176602:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532047.176603:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176608:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176610:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.176614:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532047.276311:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792937 is committed
00010000:00010000:1.0:1651532047.276343:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276347:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532047.276369:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467977984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 826209us (826239us total) trans 158913792937 rc 0/0
00000100:00100000:1.0:1651532047.276372:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3084
00010000:00010000:1.0:1651532047.276379:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276383:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532047.276384:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276395:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276400:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.276400:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.276401:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276412:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276422:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276425:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40abb1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->10121215] (req 2473984->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.276430:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.276435:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.276600:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532047.276610:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467979648
00000100:00100000:1.0:1651532047.276624:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3093
00000100:00100000:1.0:1651532047.276626:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467979648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532047.276632:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276637:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532047.276638:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276640:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532047.276648:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276653:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.276656:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532047.392927:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792938 is committed
00010000:00010000:0.0:1651532047.392943:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.392947:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.392970:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.392971:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467978240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 825999us (826036us total) trans 158913792938 rc 0/0
00010000:00010000:1.0:1651532047.392974:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532047.392975:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.392975:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3085
00010000:00010000:1.0:1651532047.392978:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.392983:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.392984:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.392985:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.392988:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.392996:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.393007:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.393012:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.393016:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40abb8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->6098943] (req 2007040->6098943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.393278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532047.393300:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467979840
00000100:00100000:0.0:1651532047.393318:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3094
00000100:00100000:0.0:1651532047.393337:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467979840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532047.393347:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.393354:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532047.393356:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.393360:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532047.393361:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.393366:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.393370:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532047.509616:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792939 is committed
00010000:00010000:0.0:1651532047.509636:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.509640:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.509657:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467978432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824805us (824831us total) trans 158913792939 rc 0/0
00000100:00100000:0.0:1651532047.509671:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3086
00010000:00010000:0.0:1651532047.509679:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.509682:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532047.509684:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.509686:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.509691:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532047.509692:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532047.509693:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.509696:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.509708:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.509711:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40abbf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2199552->10371071] (req 2199552->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.509720:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.509725:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.510097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532047.510105:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467980096
00000100:00100000:0.0:1651532047.510119:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3095
00000100:00100000:0.0:1651532047.510129:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467980096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532047.510137:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.510141:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532047.510142:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.510145:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532047.510146:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.510150:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.510154:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532047.576363:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792940 is committed
00010000:00010000:1.0:1651532047.576392:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576396:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532047.576418:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467978624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 808274us (808304us total) trans 158913792940 rc 0/0
00000100:00100000:1.0:1651532047.576422:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3087
00010000:00010000:1.0:1651532047.576429:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576432:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532047.576433:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576436:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576466:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.576467:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.576468:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576471:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576482:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576485:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40abc6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.576496:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.576500:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.576674:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532047.576686:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467980288
00000100:00100000:1.0:1651532047.576697:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3096
00000100:00100000:1.0:1651532047.576699:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467980288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532047.576713:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576718:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532047.576719:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576721:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532047.576722:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576734:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.576737:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532047.659743:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792941 is committed
00010000:00010000:0.0:1651532047.659758:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.659773:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659795:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.659795:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467978752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799824us (799862us total) trans 158913792941 rc 0/0
00000100:00100000:0.0:1651532047.659799:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3088
00010000:00010000:1.0:1651532047.659800:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532047.659801:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659812:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659817:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.659818:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.659819:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659822:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659825:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.659825:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.659826:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659839:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659855:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659858:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40abcd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->7602175] (req 7598080->7602175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659864:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659866:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659896:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.659900:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.660062:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532047.660091:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467980480
00000100:00100000:0.0:1651532047.660104:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3097
00000100:00100000:0.0:1651532047.660106:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467980480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532047.660113:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.660118:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532047.660119:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.660122:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532047.660123:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.660127:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.660130:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532047.776410:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792943 is committed
00010000:00010000:1.0:1651532047.776439:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.776444:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532047.776464:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467979136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816431us (816470us total) trans 158913792942 rc 0/0
00010000:00010000:0.0:1651532047.776467:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.776471:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532047.776472:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532047.776476:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3090
00010000:00010000:0.0:1651532047.776476:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.776481:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532047.776482:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532047.776483:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.776486:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.776491:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.776494:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.776500:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.776503:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40abdb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2768895] (req 167936->2768895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532047.776506:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467978944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816520us (816603us total) trans 158913792943 rc 0/0
00010000:00010000:0.0:1651532047.776506:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532047.776509:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3089
00010000:00010000:0.0:1651532047.776519:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532047.776520:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.776523:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.776527:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.776530:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40abd4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4255744->9834495] (req 4255744->9834495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.776536:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.776539:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.776889:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532047.776907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532047.776917:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467980608
00000100:00100000:1.0:1651532047.776927:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467980736
00000100:00100000:1.0:1651532047.776932:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3098
00000100:00100000:1.0:1651532047.776934:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467980608:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532047.776941:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.776945:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.776946:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.776949:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532047.776949:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.776954:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.776967:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532047.776975:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3099
00000100:00100000:1.0:1651532047.776976:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467980736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532047.776982:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.776985:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.776986:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532047.776987:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.776989:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532047.918052:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792944 is committed
00010000:00010000:0.0:1651532047.918066:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.918070:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.918103:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532047.918103:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467979264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 874494us (874541us total) trans 158913792944 rc 0/0
00010000:00010000:1.0:1651532047.918107:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532047.918107:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3091
00010000:00010000:1.0:1651532047.918108:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.918111:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.918116:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.918124:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532047.918125:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.918128:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.918135:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.918146:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40abe2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->1425407] (req 1421312->1425407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.918152:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532047.918155:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532047.918485:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532047.918509:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467980928
00000100:00100000:0.0:1651532047.918523:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3100
00000100:00100000:0.0:1651532047.918525:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467980928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532047.918533:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.918538:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532047.918539:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.918542:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532047.918542:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.918547:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532047.918550:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532048.018101:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792945 is committed
00002000:00010000:1.0:1651532048.018132:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532046 -> 1651532047
00010000:00010000:1.0:1651532048.018136:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018139:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532048.018164:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467979456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841601us (841637us total) trans 158913792945 rc 0/0
00000100:00100000:1.0:1651532048.018167:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3092
00010000:00010000:1.0:1651532048.018183:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018187:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532048.018188:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018191:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018196:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.018197:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.018197:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018209:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018217:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018220:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40abe9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8196095] (req 57344->8196095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018225:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018228:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532048.018769:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532048.018778:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467981056
00000100:00100000:1.0:1651532048.018789:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3101
00000100:00100000:1.0:1651532048.018791:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467981056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532048.018799:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018822:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532048.018824:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018827:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532048.018828:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018832:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.018836:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532048.113753:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792946 is committed
00010000:00010000:1.0:1651532048.113786:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.113791:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532048.113834:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467979648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 837207us (837235us total) trans 158913792946 rc 0/0
00010000:00010000:0.0:1651532048.113836:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532048.113838:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3093
00010000:00010000:0.0:1651532048.113852:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532048.113853:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.113857:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.113863:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532048.113864:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532048.113864:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.113868:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.113876:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.113879:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40abf0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [733184->8773631] (req 733184->8773631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.113884:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.113887:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532048.114432:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532048.114441:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467981248
00000100:00100000:1.0:1651532048.114456:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3102
00000100:00100000:1.0:1651532048.114458:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467981248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532048.114465:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.114470:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532048.114471:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.114474:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532048.114474:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.114479:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.114482:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532048.238782:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792947 is committed
00010000:00010000:0.0:1651532048.238817:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.238821:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.238846:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467979840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 845524us (845581us total) trans 158913792947 rc 0/0
00010000:00010000:1.0:1651532048.238850:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.238850:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3094
00010000:00010000:1.0:1651532048.238865:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532048.238866:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.238870:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.238876:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.238876:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.238877:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.238880:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.238887:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.238895:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.238898:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40abf7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1527808->10326015] (req 1527808->10326015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.238899:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.239284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532048.239369:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467981440
00000100:00100000:0.0:1651532048.239381:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3103
00000100:00100000:0.0:1651532048.239383:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467981440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532048.239391:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.239396:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532048.239397:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.239400:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.239414:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532048.239415:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.239430:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.239433:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.239437:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532048.405478:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792948 is committed
00010000:00010000:0.0:1651532048.405494:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.405499:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.405523:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467980096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 895393us (895426us total) trans 158913792948 rc 0/0
00000100:00100000:0.0:1651532048.405527:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3095
00010000:00010000:0.0:1651532048.405535:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.405538:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532048.405548:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.405551:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.405557:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532048.405558:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532048.405559:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.405562:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.405572:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.405575:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40abfe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9412607] (req 331776->9412607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.405587:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.405593:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.405972:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532048.405982:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467981632
00000100:00100000:0.0:1651532048.405994:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3104
00000100:00100000:0.0:1651532048.405996:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467981632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532048.406003:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.406008:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532048.406009:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.406022:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532048.406023:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.406028:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.406031:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532048.497093:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792949 is committed
00010000:00010000:1.0:1651532048.497126:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497139:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532048.497160:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467980288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 920459us (920486us total) trans 158913792949 rc 0/0
00000100:00100000:1.0:1651532048.497164:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3096
00010000:00010000:1.0:1651532048.497172:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497175:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532048.497176:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497179:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497184:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.497185:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.497186:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497189:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497202:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497205:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac05 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->9392127] (req 2166784->9392127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.497214:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.497218:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.497668:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532048.497681:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467981824
00000100:00100000:1.0:1651532048.497705:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3105
00000100:00100000:1.0:1651532048.497709:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467981824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532048.497717:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497722:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532048.497723:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497726:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532048.497727:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497731:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.497735:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532048.588832:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792950 is committed
00010000:00010000:0.0:1651532048.588847:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.588852:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.588874:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467980480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 928767us (928812us total) trans 158913792950 rc 0/0
00010000:00010000:1.0:1651532048.588876:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.588882:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532048.588883:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.588888:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3097
00010000:00010000:1.0:1651532048.588897:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.588903:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.588903:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.588904:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.588907:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.588910:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.588911:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.588912:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.588914:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.588923:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.588926:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ac0c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->9883647] (req 344064->9883647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.588926:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.588930:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.588940:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.588943:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.589526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532048.589535:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467981952
00000100:00100000:0.0:1651532048.589547:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3106
00000100:00100000:0.0:1651532048.589549:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467981952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532048.589556:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.589561:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532048.589562:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532048.589563:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.589566:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.608112:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532048.608121:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229696
00000100:00100000:0.0:1651532048.608130:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 46
00000100:00100000:0.0:1651532048.608132:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229696:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532048.608138:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1748992 granted 355390016 pending 143360 free 81138851840 avail 76965703680
00000100:00100000:0.0:1651532048.608160:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229696:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 28us (49us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532048.608163:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 46
00000001:00080000:0.0:1651532048.713820:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792952 is committed
00002000:00010000:0.0:1651532048.713839:0:330280:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532045 -> 1651532047
00010000:00010000:0.0:1651532048.713842:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.713847:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.713854:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.713858:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.713864:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467980736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 936887us (936957us total) trans 158913792952 rc 0/0
00000100:00100000:0.0:1651532048.713868:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3099
00010000:00010000:0.0:1651532048.713875:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532048.713876:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467980608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 936941us (936988us total) trans 158913792951 rc 0/0
00010000:00010000:0.0:1651532048.713878:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532048.713880:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3098
00010000:00010000:0.0:1651532048.713880:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.713883:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.713888:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.713888:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532048.713888:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532048.713889:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.713908:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.713915:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532048.713916:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.713919:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.713921:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.713925:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.713926:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac1a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3514368->8830975] (req 3514368->8830975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.713928:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac13 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.713936:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.713941:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.714297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532048.714317:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467982144
00000100:00100000:0.0:1651532048.714319:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532048.714333:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467982272
00000100:00100000:0.0:1651532048.714342:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3107
00000100:00100000:0.0:1651532048.714346:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467982144:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532048.714349:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3108
00000100:00100000:1.0:1651532048.714351:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467982272:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532048.714358:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.714359:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.714363:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532048.714364:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.714367:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.714380:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532048.714381:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.714385:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532048.714386:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.714389:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532048.714390:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.714395:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.714395:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.714398:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.714399:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.714402:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532048.789100:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792953 is committed
00010000:00010000:0.0:1651532048.789115:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.789119:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.789140:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467980928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 870614us (870656us total) trans 158913792953 rc 0/0
00000100:00100000:0.0:1651532048.789144:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3100
00010000:00010000:1.0:1651532048.789145:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.789150:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532048.789151:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.789155:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.789171:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.789172:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.789173:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.789176:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.789191:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.789195:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ac21 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5787648->5791743] (req 5787648->5791743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.789201:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.789204:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.789547:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532048.789557:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467982464
00000100:00100000:0.0:1651532048.789569:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3109
00000100:00100000:0.0:1651532048.789571:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467982464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532048.789586:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.789591:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532048.789592:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.789595:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532048.789596:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.789600:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.789603:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532048.880546:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792954 is committed
00002000:00010000:1.0:1651532048.880577:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532047 -> 1651532048
00002000:00010000:1.0:1651532048.880579:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532047 -> 1651532048
00010000:00010000:1.0:1651532048.880582:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.880586:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532048.880623:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467981056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 861830us (861854us total) trans 158913792954 rc 0/0
00000100:00100000:1.0:1651532048.880627:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3101
00010000:00010000:1.0:1651532048.880635:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.880639:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532048.880640:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.880643:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.880648:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.880648:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532048.880649:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.880652:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.880669:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.880673:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac28 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9674751] (req 1069056->9674751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.880689:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.880692:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.881319:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532048.881335:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467982592
00000100:00100000:1.0:1651532048.881355:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3110
00000100:00100000:1.0:1651532048.881357:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467982592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532048.881365:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.881369:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532048.881370:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.881373:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532048.881374:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.881378:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.881382:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532048.997227:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792955 is committed
00010000:00010000:1.0:1651532048.997259:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.997287:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532048.997310:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467981248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 882851us (882878us total) trans 158913792955 rc 0/0
00010000:00010000:0.0:1651532048.997312:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532048.997314:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3102
00010000:00010000:0.0:1651532048.997317:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532048.997318:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.997321:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.997338:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532048.997339:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532048.997340:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.997343:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.997351:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.997354:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac2f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->10321919] (req 1339392->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.997360:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532048.997363:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532048.998083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532048.998108:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467982784
00000100:00100000:1.0:1651532048.998123:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3111
00000100:00100000:1.0:1651532048.998125:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467982784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532048.998133:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.998137:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532048.998138:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.998141:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532048.998142:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.998146:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532048.998150:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532049.105603:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792956 is committed
00010000:00010000:0.0:1651532049.105620:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.105625:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.105659:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467981440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866274us (866376us total) trans 158913792956 rc 0/0
00010000:00010000:1.0:1651532049.105661:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.105662:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3103
00010000:00010000:1.0:1651532049.105674:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532049.105675:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.105678:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.105684:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.105685:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.105686:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.105689:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.105706:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.105706:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.105709:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ac36 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->9474047] (req 376832->9474047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.105711:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.106131:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532049.106204:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467982976
00000100:00100000:0.0:1651532049.106216:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3112
00000100:00100000:0.0:1651532049.106218:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467982976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532049.106226:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.106230:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532049.106232:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.106235:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532049.106235:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.106240:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.106255:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532049.222294:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792957 is committed
00010000:00010000:0.0:1651532049.222309:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.222313:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.222336:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467981632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816340us (816364us total) trans 158913792957 rc 0/0
00010000:00010000:1.0:1651532049.222338:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.222340:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3104
00010000:00010000:1.0:1651532049.222343:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532049.222344:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.222357:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.222363:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.222364:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.222365:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.222368:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.222379:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.222379:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.222380:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.222383:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.222397:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.222400:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ac3d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6057983] (req 905216->6057983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.222406:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.222409:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.222409:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.222413:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.222793:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532049.222814:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467983168
00000100:00100000:0.0:1651532049.222826:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3113
00000100:00100000:0.0:1651532049.222828:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467983168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532049.222836:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.222871:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532049.222872:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.222875:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532049.222875:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.222880:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.222883:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532049.333164:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792959 is committed
00010000:00010000:0.0:1651532049.333185:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333189:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.333201:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.333206:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.333210:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467981952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 743660us (743684us total) trans 158913792959 rc 0/0
00000100:00100000:0.0:1651532049.333213:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3106
00000100:00100000:1.0:1651532049.333223:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467981824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 835514us (835555us total) trans 158913792958 rc 0/0
00000100:00100000:1.0:1651532049.333226:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3105
00010000:00010000:1.0:1651532049.333234:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.333238:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532049.333239:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.333242:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.333248:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333249:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333253:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532049.333260:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ac4b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3784704->9744383] (req 3784704->9744383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333263:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333278:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333287:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532049.333288:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532049.333289:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333294:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333306:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333311:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ac44 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1937408->1941503] (req 1937408->1941503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333322:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.333326:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.333665:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532049.333680:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467983360
00000100:00100000:1.0:1651532049.333695:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3114
00000100:00100000:1.0:1651532049.333705:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467983360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532049.333712:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.333717:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532049.333717:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.333720:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532049.333721:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.333725:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.333729:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532049.422311:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792960 is committed
00010000:00010000:0.0:1651532049.422328:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.422344:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.422363:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467982144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 708017us (708067us total) trans 158913792960 rc 0/0
00000100:00100000:0.0:1651532049.422366:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3107
00010000:00010000:0.0:1651532049.422374:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.422377:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532049.422378:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.422381:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.422387:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532049.422388:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532049.422388:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.422391:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.422404:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.422407:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac52 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.422417:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.422423:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.423148:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532049.423159:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467983552
00000100:00100000:0.0:1651532049.423171:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3115
00000100:00100000:0.0:1651532049.423173:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467983552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532049.423181:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.423186:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532049.423187:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.423190:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532049.423190:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.423195:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.423198:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532049.522318:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792961 is committed
00010000:00010000:1.0:1651532049.522350:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522355:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532049.522391:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467982272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 808039us (808072us total) trans 158913792961 rc 0/0
00000100:00100000:1.0:1651532049.522395:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3108
00010000:00010000:1.0:1651532049.522403:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522407:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532049.522408:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522411:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522416:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.522417:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.522417:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522421:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522427:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.522437:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522439:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac59 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->6549503] (req 1654784->6549503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.522441:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.522785:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532049.522818:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467983744
00000100:00100000:1.0:1651532049.522840:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3116
00000100:00100000:1.0:1651532049.522842:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467983744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532049.522849:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522853:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.522855:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522857:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532049.522858:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522862:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.522866:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532049.639005:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792962 is committed
00010000:00010000:0.0:1651532049.639020:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639025:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.639042:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467982464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849470us (849495us total) trans 158913792962 rc 0/0
00000100:00100000:0.0:1651532049.639045:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3109
00010000:00010000:0.0:1651532049.639052:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639056:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532049.639057:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639060:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639065:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532049.639065:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532049.639066:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639069:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639091:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639094:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ac60 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->1781759] (req 1777664->1781759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.639104:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.639109:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.639545:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532049.639554:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467983936
00000100:00100000:0.0:1651532049.639566:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3117
00000100:00100000:0.0:1651532049.639568:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467983936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532049.639576:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639580:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532049.639581:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639584:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532049.639585:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639589:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.639593:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532049.747344:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792963 is committed
00010000:00010000:1.0:1651532049.747386:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.747392:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532049.747424:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467982592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866066us (866106us total) trans 158913792963 rc 0/0
00010000:00010000:0.0:1651532049.747426:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532049.747428:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3110
00010000:00010000:0.0:1651532049.747430:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532049.747431:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.747435:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.747440:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532049.747441:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532049.747442:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.747445:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.747454:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.747457:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ac67 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9568255] (req 0->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.747467:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.747470:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.748075:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532049.748090:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467984064
00000100:00100000:1.0:1651532049.748106:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3118
00000100:00100000:1.0:1651532049.748108:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467984064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532049.748116:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.748121:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532049.748122:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.748125:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532049.748126:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.748130:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.748134:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532049.855734:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792964 is committed
00010000:00010000:0.0:1651532049.855750:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.855754:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.855776:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467982784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 857650us (857693us total) trans 158913792964 rc 0/0
00010000:00010000:1.0:1651532049.855779:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.855779:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3111
00010000:00010000:1.0:1651532049.855785:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532049.855793:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.855797:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.855814:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.855815:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532049.855815:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.855826:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.855842:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532049.855845:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ac6e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9744383] (req 1110016->9744383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.855856:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.855860:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.856553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532049.856562:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467984256
00000100:00100000:0.0:1651532049.856574:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3119
00000100:00100000:0.0:1651532049.856576:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467984256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532049.856584:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.856589:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532049.856590:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.856602:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532049.856603:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.856608:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.856612:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532049.933529:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792965 is committed
00002000:00010000:0.0:1651532049.933543:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532048 -> 1651532049
00002000:00010000:0.0:1651532049.933545:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532048 -> 1651532049
00010000:00010000:0.0:1651532049.933547:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.933551:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.933568:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467982976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 827349us (827439us total) trans 158913792965 rc 0/0
00000100:00100000:0.0:1651532049.933572:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3112
00010000:00010000:0.0:1651532049.933578:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.933582:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532049.933583:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.933596:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.933601:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532049.933602:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532049.933603:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.933606:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.933613:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.933616:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ac75 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->8966143] (req 667648->8966143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.933621:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.933625:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532049.934213:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532049.934223:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467984448
00000100:00100000:0.0:1651532049.934234:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3120
00000100:00100000:0.0:1651532049.934236:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467984448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532049.934256:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.934261:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532049.934262:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.934265:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532049.934266:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.934282:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532049.934285:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532050.047433:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792966 is committed
00010000:00010000:0.0:1651532050.047448:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.047452:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.047468:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467983168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824639us (824676us total) trans 158913792966 rc 0/0
00000100:00100000:0.0:1651532050.047472:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3113
00010000:00010000:0.0:1651532050.047479:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.047494:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532050.047495:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.047498:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.047503:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.047504:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.047505:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.047508:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.047520:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.047523:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ac7c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->7077887] (req 1720320->7077887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.047533:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.047538:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.047887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532050.047897:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467984640
00000100:00100000:0.0:1651532050.047908:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3121
00000100:00100000:0.0:1651532050.047910:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467984640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532050.047918:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.047934:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532050.047935:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532050.047936:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.047939:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.108864:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1651532050.108873:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007b89d421 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966863168:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651532050.109091:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007b89d421 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966863168:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:0.0:1651532050.114151:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792967 is committed
00010000:00010000:1.0:1651532050.114182:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.114188:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.114221:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467983360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 780515us (780557us total) trans 158913792967 rc 0/0
00000100:00100000:1.0:1651532050.114225:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3114
00010000:00010000:1.0:1651532050.114233:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.114237:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532050.114238:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.114241:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.114247:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.114247:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.114248:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.114251:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.114280:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.114284:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ac83 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1572864->9138175] (req 1572864->9138175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.114292:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.114298:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.114754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532050.114776:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467984832
00000100:00100000:0.0:1651532050.114817:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3122
00000100:00100000:0.0:1651532050.114819:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467984832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532050.114829:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.114833:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532050.114834:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.114846:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.114849:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532050.114850:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.114854:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.114857:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.114860:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532050.180876:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792968 is committed
00010000:00010000:0.0:1651532050.180892:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.180896:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.180913:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467983552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 757739us (757766us total) trans 158913792968 rc 0/0
00000100:00100000:0.0:1651532050.180917:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3115
00010000:00010000:0.0:1651532050.180924:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.180936:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532050.180937:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.180940:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.180945:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.180946:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.180947:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.180950:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.180962:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.180965:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ac8a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->9740287] (req 606208->9740287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.180975:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.180981:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.181576:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532050.181585:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467985024
00000100:00100000:0.0:1651532050.181602:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3123
00000100:00100000:0.0:1651532050.181604:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467985024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532050.181612:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.181627:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532050.181628:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.181631:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532050.181632:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.181636:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.181640:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532050.272596:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792969 is committed
00010000:00010000:1.0:1651532050.272627:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.272632:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.272651:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.272656:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467983744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749813us (749871us total) trans 158913792969 rc 0/0
00000100:00100000:1.0:1651532050.272660:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3116
00010000:00010000:0.0:1651532050.272661:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532050.272662:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.272666:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.272671:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.272672:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.272673:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.272684:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.272692:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.272695:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ac91 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5947392->9936895] (req 5947392->9936895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.272698:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.272711:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.273008:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532050.273029:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532050.273039:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467985216
00000100:00100000:1.0:1651532050.273049:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467985280
00000100:00100000:1.0:1651532050.273055:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3124
00000100:00100000:1.0:1651532050.273057:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467985216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532050.273065:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.273082:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532050.273083:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.273086:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532050.273086:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.273091:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.273094:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.273103:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3125
00000100:00100000:1.0:1651532050.273105:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467985280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532050.273110:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.273113:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.273114:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.273117:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532050.273117:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.273121:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.273131:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532050.355945:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792970 is committed
00010000:00010000:1.0:1651532050.355977:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.355982:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.356001:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.356005:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467983936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716436us (716461us total) trans 158913792970 rc 0/0
00000100:00100000:1.0:1651532050.356008:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3117
00010000:00010000:0.0:1651532050.356010:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532050.356011:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.356015:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.356021:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.356021:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.356022:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.356025:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.356047:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.356050:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ac98 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->6119423] (req 6115328->6119423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.356062:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.356067:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.356265:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532050.356305:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467985472
00000100:00100000:1.0:1651532050.356317:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3126
00000100:00100000:1.0:1651532050.356319:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076897090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467985472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532050.356326:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.356330:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532050.356339:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532050.356340:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.356344:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532050.481187:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792971 is committed
00010000:00010000:1.0:1651532050.481219:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.481224:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.481248:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467984064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 733139us (733174us total) trans 158913792971 rc 0/0
00010000:00010000:0.0:1651532050.481248:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.481251:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3118
00010000:00010000:0.0:1651532050.481253:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532050.481254:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.481257:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.481263:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.481263:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.481264:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.481277:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.481290:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.481296:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.481308:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.481310:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ac9f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->8605695] (req 4096->8605695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.481890:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532050.481990:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467985600
00000100:00100000:1.0:1651532050.482002:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3127
00000100:00100000:1.0:1651532050.482005:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467985600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532050.482015:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.482039:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532050.482041:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532050.482042:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.482048:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532050.605943:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792972 is committed
00010000:00010000:1.0:1651532050.605975:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.605979:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.605998:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467984256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749421us (749446us total) trans 158913792972 rc 0/0
00000100:00100000:1.0:1651532050.606001:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3119
00010000:00010000:1.0:1651532050.606009:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606012:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532050.606013:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606016:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606021:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.606030:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.606031:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606034:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606038:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.606039:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.606039:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606042:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606054:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606057:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40aca6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9965567] (req 921600->9965567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.606066:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.606071:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606089:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606110:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.606371:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532050.606451:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467985792
00000100:00100000:1.0:1651532050.606466:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3128
00000100:00100000:1.0:1651532050.606469:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467985792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532050.606493:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606498:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532050.606499:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606502:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606505:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606507:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532050.606508:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606515:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606519:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606522:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.606526:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532050.730927:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792974 is committed
00010000:00010000:0.0:1651532050.730948:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.730952:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.730959:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.730964:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.730981:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467984448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 796743us (796767us total) trans 158913792974 rc 0/0
00000100:00100000:0.0:1651532050.730984:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3120
00000100:00100000:1.0:1651532050.730988:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467984640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 683077us (683102us total) trans 158913792973 rc 0/0
00000100:00100000:1.0:1651532050.730992:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3121
00010000:00010000:0.0:1651532050.730992:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.730996:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532050.730997:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731012:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731018:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731021:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40acad lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->5210111] (req 155648->5210111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731024:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731027:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532050.731028:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731031:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731034:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.731034:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532050.731035:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731038:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731045:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731054:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acb4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7077888->9527295] (req 7077888->9527295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731060:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.731062:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.731439:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532050.731448:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532050.731459:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467985984
00000100:00100000:1.0:1651532050.731472:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467986112
00000100:00100000:1.0:1651532050.731478:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3129
00000100:00100000:1.0:1651532050.731480:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467985984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532050.731487:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.731492:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532050.731493:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.731496:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532050.731497:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.731501:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.731513:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532050.731521:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3130
00000100:00100000:1.0:1651532050.731523:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467986112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532050.731528:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.731532:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532050.731532:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.731535:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532050.731536:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.731542:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.731547:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532050.839299:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792975 is committed
00002000:00010000:0.0:1651532050.839312:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532049 -> 1651532050
00002000:00010000:0.0:1651532050.839314:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532049 -> 1651532050
00010000:00010000:0.0:1651532050.839317:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.839321:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.839343:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467984832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724523us (724589us total) trans 158913792975 rc 0/0
00010000:00010000:1.0:1651532050.839345:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.839347:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3122
00010000:00010000:1.0:1651532050.839350:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532050.839352:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.839362:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.839368:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.839369:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.839370:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.839373:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.839382:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.839386:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40acbb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9551871] (req 929792->9551871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.839390:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.839395:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.839602:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532050.839649:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467986368
00000100:00100000:0.0:1651532050.839669:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3131
00000100:00100000:0.0:1651532050.839672:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467986368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532050.839684:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.839703:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532050.839704:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.839709:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532050.839710:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.839718:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.839724:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532050.947655:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792976 is committed
00010000:00010000:0.0:1651532050.947671:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.947675:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.947710:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.947710:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467985024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766105us (766134us total) trans 158913792976 rc 0/0
00000100:00100000:0.0:1651532050.947713:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3123
00010000:00010000:1.0:1651532050.947715:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532050.947716:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.947720:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.947725:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.947734:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532050.947735:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.947738:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.947747:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.947758:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40acc2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9900031] (req 1626112->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.947764:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532050.947767:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532050.947997:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532050.948005:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467986560
00000100:00100000:0.0:1651532050.948020:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3132
00000100:00100000:0.0:1651532050.948022:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467986560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532050.948037:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.948041:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532050.948042:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.948045:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532050.948046:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.948050:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532050.948054:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532051.040012:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792977 is committed
00010000:00010000:1.0:1651532051.040044:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.040049:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.040071:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467985216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 767012us (767063us total) trans 158913792977 rc 0/0
00010000:00010000:0.0:1651532051.040073:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.040074:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3124
00010000:00010000:0.0:1651532051.040088:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.040089:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040093:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040099:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.040099:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.040100:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040103:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040106:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.040107:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.040108:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040110:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040113:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.040113:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.040114:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040117:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040140:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040143:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40acc9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9748479] (req 2064384->9748479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.040149:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040154:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.040157:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.040161:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.040220:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.040226:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.040361:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532051.040371:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467986752
00000100:00100000:1.0:1651532051.040389:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3133
00000100:00100000:1.0:1651532051.040391:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754467986752:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532051.040399:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.040404:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532051.040405:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.040408:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532051.040409:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.040413:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.040427:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532051.098407:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792980 is committed
00010000:00010000:0.0:1651532051.098442:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098446:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.098458:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.098464:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532051.098468:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076897090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467985472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 742148us (742209us total) trans 158913792978 rc 0/0
00000100:00100000:0.0:1651532051.098471:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3126
00010000:00010000:0.0:1651532051.098485:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.098487:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467985280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 825381us (825458us total) trans 158913792979 rc 0/0
00010000:00010000:0.0:1651532051.098488:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.098489:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.098491:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3125
00010000:00010000:0.0:1651532051.098501:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098507:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098510:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40acd7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7307264->7311359] (req 7307264->7311359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098514:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098516:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.098517:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098520:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098523:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098526:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40acd0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8679424->8683519] (req 8679424->8683519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098538:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098550:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532051.098563:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467985600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616558us (616674us total) trans 158913792980 rc 0/0
00000100:00100000:0.0:1651532051.098566:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3127
00010000:00010000:0.0:1651532051.098573:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098576:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.098577:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098580:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098584:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.098584:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.098585:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098588:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098598:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.098601:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40acde lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2084864->2088959] (req 2084864->2088959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.098637:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.098642:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.098931:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532051.098941:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467987008
00000100:00100000:1.0:1651532051.098960:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3134
00000100:00100000:1.0:1651532051.098962:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467987008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532051.098969:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.098974:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532051.098984:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.098987:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532051.098988:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.098993:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.098997:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.099099:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532051.099113:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467987136
00000100:00100000:0.0:1651532051.099127:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3135
00000100:00100000:0.0:1651532051.099129:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467987136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532051.099137:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.099142:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532051.099143:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.099146:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532051.099146:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.099151:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.099154:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532051.181813:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792981 is committed
00010000:00010000:1.0:1651532051.181843:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.181848:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.181870:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467985792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 575400us (575499us total) trans 158913792981 rc 0/0
00010000:00010000:0.0:1651532051.181871:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.181873:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3128
00010000:00010000:0.0:1651532051.181876:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.181877:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.181890:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.181896:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.181897:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.181897:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.181900:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.181910:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.181913:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ace5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1081344->10235903] (req 1081344->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.181934:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.181939:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.182533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532051.182542:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467987328
00000100:00100000:1.0:1651532051.182558:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3136
00000100:00100000:1.0:1651532051.182560:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467987328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532051.182568:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.182573:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532051.182574:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.182577:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532051.182578:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.182582:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.182585:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532051.290142:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792982 is committed
00010000:00010000:1.0:1651532051.290172:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.290177:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.290210:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467985984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 558729us (558772us total) trans 158913792982 rc 0/0
00010000:00010000:0.0:1651532051.290211:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.290214:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3129
00010000:00010000:0.0:1651532051.290216:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.290217:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.290220:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.290236:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.290237:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.290238:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.290241:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.290248:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.290250:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40acec lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1269760->10235903] (req 1269760->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.290263:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.290278:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.290838:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532051.290846:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467987520
00000100:00100000:1.0:1651532051.290863:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3137
00000100:00100000:1.0:1651532051.290865:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467987520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532051.290873:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.290877:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532051.290878:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.290881:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532051.290882:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.290887:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.290901:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532051.415165:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792983 is committed
00010000:00010000:1.0:1651532051.415198:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.415202:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.415226:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467986112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 683702us (683777us total) trans 158913792983 rc 0/0
00010000:00010000:0.0:1651532051.415226:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.415229:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3130
00010000:00010000:0.0:1651532051.415230:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.415231:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415235:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415241:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.415241:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.415242:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415253:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415261:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415264:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40acf3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1290240->4964351] (req 1290240->4964351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415281:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415287:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.415670:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532051.415706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532051.415717:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467987776
00000100:00100000:0.0:1651532051.415721:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467987712
00000100:00100000:1.0:1651532051.415731:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3138
00000100:00100000:1.0:1651532051.415733:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467987776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532051.415740:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532051.415741:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3139
00000100:00100000:0.0:1651532051.415743:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467987712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532051.415745:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532051.415746:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.415749:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532051.415750:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415751:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415762:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532051.415763:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415766:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532051.415766:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.415778:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415779:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.415782:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.415783:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532051.540146:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792984 is committed
00010000:00010000:0.0:1651532051.540162:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540166:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532051.540189:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467986368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 700516us (700588us total) trans 158913792984 rc 0/0
00000100:00100000:0.0:1651532051.540193:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3131
00010000:00010000:0.0:1651532051.540200:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540204:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.540205:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540208:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540213:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.540221:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.540222:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540225:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540233:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540236:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40acfa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->9080831] (req 2658304->9080831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540242:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540245:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.540738:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532051.540758:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467987968
00000100:00100000:0.0:1651532051.540772:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3140
00000100:00100000:0.0:1651532051.540774:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467987968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532051.540782:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540787:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532051.540788:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540791:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532051.540801:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540823:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.540827:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532051.665147:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792985 is committed
00010000:00010000:0.0:1651532051.665162:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665166:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532051.665189:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467986560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 717166us (717192us total) trans 158913792985 rc 0/0
00000100:00100000:0.0:1651532051.665192:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3132
00010000:00010000:0.0:1651532051.665200:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665203:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.665205:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665208:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665224:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.665224:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.665225:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665229:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665238:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665241:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad01 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.665253:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.665258:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.665719:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532051.665737:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467988160
00000100:00100000:0.0:1651532051.665751:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3141
00000100:00100000:0.0:1651532051.665753:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467988160:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532051.665760:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665765:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532051.665766:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665769:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532051.665770:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665787:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.665791:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532051.756847:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792986 is committed
00010000:00010000:1.0:1651532051.756878:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.756884:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.756908:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.756909:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467986752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716516us (716548us total) trans 158913792986 rc 0/0
00010000:00010000:0.0:1651532051.756912:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532051.756913:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3133
00010000:00010000:0.0:1651532051.756913:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.756917:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.756922:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.756923:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.756924:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.756927:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.756936:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.756949:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ad08 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->9826303] (req 1585152->9826303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.756961:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.756967:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.757516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532051.757606:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467988352
00000100:00100000:1.0:1651532051.757619:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3142
00000100:00100000:1.0:1651532051.757621:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467988352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532051.757628:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.757633:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532051.757635:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.757638:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532051.757638:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.757643:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.757661:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532051.881816:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792987 is committed
00002000:00010000:1.0:1651532051.881845:0:330054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532050 -> 1651532051
00010000:00010000:1.0:1651532051.881849:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.881853:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.881888:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467987008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 782926us (782965us total) trans 158913792987 rc 0/0
00010000:00010000:0.0:1651532051.881888:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.881892:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3134
00010000:00010000:0.0:1651532051.881892:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.881893:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.881897:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.881902:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.881903:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.881904:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.881907:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.881914:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.881917:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ad0f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->9629695] (req 2125824->9629695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.881943:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.881948:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.882299:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532051.882322:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467988544
00000100:00100000:1.0:1651532051.882334:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3143
00000100:00100000:1.0:1651532051.882336:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467988544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532051.882343:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.882348:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532051.882349:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.882352:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532051.882353:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.882358:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.882374:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532051.948569:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792988 is committed
00002000:00010000:1.0:1651532051.948595:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532050 -> 1651532051
00010000:00010000:1.0:1651532051.948598:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.948602:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.948623:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467987136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849493us (849524us total) trans 158913792988 rc 0/0
00010000:00010000:0.0:1651532051.948624:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.948627:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3135
00010000:00010000:0.0:1651532051.948629:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532051.948630:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.948633:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.948639:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.948639:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532051.948640:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.948643:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.948653:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.948656:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad16 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6115328->8323071] (req 6115328->8323071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.948666:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532051.948679:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532051.949003:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532051.949012:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467988736
00000100:00100000:1.0:1651532051.949023:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3144
00000100:00100000:1.0:1651532051.949025:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467988736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532051.949032:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.949037:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532051.949038:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.949041:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532051.949041:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.949054:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532051.949058:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532052.056888:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792989 is committed
00010000:00010000:0.0:1651532052.056904:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.056908:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532052.056931:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467987328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 874370us (874398us total) trans 158913792989 rc 0/0
00000100:00100000:0.0:1651532052.056935:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3136
00010000:00010000:0.0:1651532052.056943:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.056946:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532052.056948:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.056951:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.056956:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.056956:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.056957:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.056973:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.056983:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.056986:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ad1d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10403839] (req 1122304->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.056997:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.057002:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.057180:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532052.057227:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467988992
00000100:00100000:0.0:1651532052.057247:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3145
00000100:00100000:0.0:1651532052.057250:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467988992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532052.057261:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.057281:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532052.057283:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.057288:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532052.057289:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.057296:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.057302:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532052.156927:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792990 is committed
00010000:00010000:1.0:1651532052.156959:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.156964:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.156987:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467987520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866121us (866149us total) trans 158913792990 rc 0/0
00010000:00010000:0.0:1651532052.156987:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.156990:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3137
00010000:00010000:0.0:1651532052.156991:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532052.156992:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.156995:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.157001:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.157001:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.157002:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.157005:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.157014:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.157017:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ad24 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8466431] (req 335872->8466431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.157027:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.157040:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.157247:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532052.157279:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467989184
00000100:00100000:1.0:1651532052.157296:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3146
00000100:00100000:1.0:1651532052.157298:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467989184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532052.157315:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.157320:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532052.157321:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.157324:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532052.157325:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.157329:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.157333:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532052.215550:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792991 is committed
00010000:00010000:0.0:1651532052.215565:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215576:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532052.215599:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467987776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799865us (799929us total) trans 158913792991 rc 0/0
00000100:00100000:0.0:1651532052.215602:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3138
00010000:00010000:0.0:1651532052.215610:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215614:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532052.215615:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215618:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215623:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.215624:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.215624:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215638:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215646:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215649:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ad2b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7897088->7901183] (req 7897088->7901183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215655:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215657:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.215910:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532052.215964:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467989376
00000100:00100000:0.0:1651532052.215977:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3147
00000100:00100000:0.0:1651532052.215979:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467989376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532052.215987:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215992:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532052.215993:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.215996:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532052.215996:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.216010:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.216014:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532052.348666:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792992 is committed
00010000:00010000:0.0:1651532052.348681:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.348685:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532052.348708:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467987712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 932964us (933002us total) trans 158913792992 rc 0/0
00000100:00100000:0.0:1651532052.348712:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3139
00010000:00010000:0.0:1651532052.348720:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.348723:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532052.348724:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.348727:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.348732:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.348740:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.348741:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.348745:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.348752:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.348755:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad32 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->10264575] (req 3817472->10264575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.348761:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.348764:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.349124:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532052.349136:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467989504
00000100:00100000:0.0:1651532052.349149:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3148
00000100:00100000:0.0:1651532052.349151:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467989504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532052.349159:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.349164:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532052.349165:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.349167:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532052.349177:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.349182:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.349186:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532052.506923:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792993 is committed
00010000:00010000:0.0:1651532052.506938:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.506942:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532052.506964:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467987968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 966189us (966227us total) trans 158913792993 rc 0/0
00000100:00100000:0.0:1651532052.506968:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3140
00010000:00010000:0.0:1651532052.506976:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.506979:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532052.506980:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.506983:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.506999:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.507000:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.507001:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.507004:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.507011:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.507014:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad39 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9539583] (req 98304->9539583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.507019:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.507022:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.507249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532052.507365:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467989696
00000100:00100000:0.0:1651532052.507386:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3149
00000100:00100000:0.0:1651532052.507389:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467989696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532052.507400:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.507408:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532052.507421:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532052.507422:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.507428:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532052.598640:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792994 is committed
00010000:00010000:0.0:1651532052.598655:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.598659:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532052.598682:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467988160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 932928us (932965us total) trans 158913792994 rc 0/0
00000100:00100000:0.0:1651532052.598685:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3141
00010000:00010000:0.0:1651532052.598693:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.598696:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532052.598697:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.598700:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.598705:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.598706:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.598714:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.598718:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.598724:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.598727:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ad40 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9396223] (req 1724416->9396223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.598746:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.598752:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.599014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532052.599034:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467989888
00000100:00100000:0.0:1651532052.599053:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3150
00000100:00100000:0.0:1651532052.599057:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467989888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532052.599068:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.599075:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532052.599076:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.599081:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.599085:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532052.599087:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.599094:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.599113:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.599119:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532052.706987:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792995 is committed
00010000:00010000:1.0:1651532052.707022:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.707040:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.707064:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.707066:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467988352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 949444us (949551us total) trans 158913792995 rc 0/0
00010000:00010000:0.0:1651532052.707069:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532052.707070:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3142
00010000:00010000:0.0:1651532052.707070:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.707074:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.707079:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.707080:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.707081:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.707084:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.707093:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.707104:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.707105:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ad47 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->10072063] (req 114688->10072063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.707120:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.707409:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532052.707418:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467990080
00000100:00100000:1.0:1651532052.707438:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3151
00000100:00100000:1.0:1651532052.707440:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467990080:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532052.707448:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.707453:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532052.707454:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.707457:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532052.707458:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.707474:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.707478:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532052.790377:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792996 is committed
00010000:00010000:1.0:1651532052.790406:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.790410:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.790432:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467988544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 908095us (908135us total) trans 158913792996 rc 0/0
00010000:00010000:0.0:1651532052.790433:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.790436:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3143
00010000:00010000:0.0:1651532052.790438:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532052.790439:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.790442:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.790448:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.790449:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.790449:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.790453:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.790462:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.790465:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ad4e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->9519103] (req 3518464->9519103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.790477:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.790481:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.790740:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532052.790749:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467990272
00000100:00100000:1.0:1651532052.790766:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3152
00000100:00100000:1.0:1651532052.790768:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467990272:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532052.790775:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.790788:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532052.790789:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.790792:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532052.790792:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.790797:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.790800:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532052.940388:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792997 is committed
00010000:00010000:1.0:1651532052.940417:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.940421:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.940442:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467988736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 991416us (991440us total) trans 158913792997 rc 0/0
00010000:00010000:0.0:1651532052.940444:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.940445:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3144
00010000:00010000:0.0:1651532052.940449:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532052.940451:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.940454:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.940460:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.940460:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532052.940461:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.940464:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.940472:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532052.940475:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad55 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7163904->7167999] (req 7163904->7167999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.940485:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.940489:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532052.940776:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532052.940784:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467990464
00000100:00100000:1.0:1651532052.940799:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3153
00000100:00100000:1.0:1651532052.940801:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467990464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532052.940831:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.940836:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532052.940837:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.940840:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532052.940841:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.940845:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532052.940848:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532053.040404:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792998 is committed
00010000:00010000:1.0:1651532053.040433:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.040437:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.040471:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467988992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 983220us (983292us total) trans 158913792998 rc 0/0
00010000:00010000:0.0:1651532053.040471:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.040474:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3145
00010000:00010000:0.0:1651532053.040486:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.040487:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.040491:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.040496:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.040497:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.040498:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.040501:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.040508:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.040511:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ad5c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3325952->7974911] (req 3325952->7974911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.040523:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.040528:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.040788:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532053.040892:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467990592
00000100:00100000:1.0:1651532053.040907:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3154
00000100:00100000:1.0:1651532053.040909:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467990592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532053.040917:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.040921:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532053.040922:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532053.040922:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.040926:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532053.166846:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913792999 is committed
00002000:00010000:1.0:1651532053.166875:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532051 -> 1651532052
00010000:00010000:1.0:1651532053.166878:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.166890:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.166913:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467989184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 1009614us (1009668us total) trans 158913792999 rc 0/0
00010000:00010000:0.0:1651532053.166913:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.166917:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3146
00010000:00010000:0.0:1651532053.166921:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.166923:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.166954:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.166960:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.166961:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.166962:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.166965:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.166974:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.166977:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ad63 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->10076159] (req 1769472->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.166983:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.166986:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.167476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532053.167485:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467990848
00000100:00100000:1.0:1651532053.167498:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3155
00000100:00100000:1.0:1651532053.167500:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467990848:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532053.167523:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.167528:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532053.167529:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.167531:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532053.167532:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.167537:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.167540:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532053.275126:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793000 is committed
00010000:00010000:0.0:1651532053.275143:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275148:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532053.275182:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467989376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 1059201us (1059273us total) trans 158913793000 rc 0/0
00000100:00100000:0.0:1651532053.275186:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3147
00010000:00010000:0.0:1651532053.275194:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275198:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.275199:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275203:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275208:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.275208:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.275209:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275212:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275216:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.275216:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.275217:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275219:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275238:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275241:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ad6a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9973759] (req 135168->9973759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275246:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275249:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275300:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275307:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.275814:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532053.275825:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467991040
00000100:00100000:0.0:1651532053.275839:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3156
00000100:00100000:0.0:1651532053.275841:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467991040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532053.275849:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275854:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532053.275855:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275870:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275873:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532053.275874:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275878:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275881:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.275885:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532053.323792:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793002 is committed
00010000:00010000:0.0:1651532053.323821:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323825:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532053.323847:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467989504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 974695us (974723us total) trans 158913793001 rc 0/0
00000100:00100000:0.0:1651532053.323850:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3148
00010000:00010000:0.0:1651532053.323858:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323870:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.323871:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323874:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323880:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323883:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ad71 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->2363391] (req 2359296->2363391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.323902:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.323907:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323928:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.323931:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467989696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816542us (816683us total) trans 158913793002 rc 0/0
00010000:00010000:0.0:1651532053.323931:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.323932:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.323935:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3149
00010000:00010000:0.0:1651532053.323935:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323941:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.323942:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.323943:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323963:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323976:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323981:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ad78 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4993024->9011199] (req 4993024->9011199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323991:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.323995:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.324259:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532053.324317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532053.324331:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467991232
00000100:00100000:1.0:1651532053.324343:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467991360
00000100:00100000:0.0:1651532053.324350:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3157
00000100:00100000:0.0:1651532053.324352:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467991232:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532053.324358:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3158
00000100:00100000:1.0:1651532053.324360:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467991360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532053.324365:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.324367:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.324370:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532053.324371:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.324374:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532053.324374:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.324388:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532053.324389:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.324392:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532053.324393:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.324397:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.324398:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.324401:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.324409:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532053.390548:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793003 is committed
00010000:00010000:0.0:1651532053.390563:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.390567:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532053.390591:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467989888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791534us (791578us total) trans 158913793003 rc 0/0
00000100:00100000:0.0:1651532053.390595:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3150
00010000:00010000:0.0:1651532053.390603:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.390607:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.390608:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.390610:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.390615:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.390624:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.390625:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.390628:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.390638:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.390641:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ad7f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->10330111] (req 278528->10330111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.390650:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.390655:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.390907:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532053.390933:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467991616
00000100:00100000:0.0:1651532053.390953:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3159
00000100:00100000:0.0:1651532053.390956:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467991616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532053.390968:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.390975:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532053.390976:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532053.390977:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.390982:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532053.448914:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793004 is committed
00010000:00010000:1.0:1651532053.448944:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.448949:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.448968:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.448972:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467990080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 741530us (741563us total) trans 158913793004 rc 0/0
00000100:00100000:1.0:1651532053.448975:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3151
00010000:00010000:0.0:1651532053.448984:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.448985:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.448989:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.448994:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.448995:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.448996:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.448999:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.449006:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.449009:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ad86 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->10334207] (req 1847296->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.449023:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.449027:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.449223:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532053.449231:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467991808
00000100:00100000:1.0:1651532053.449253:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3160
00000100:00100000:1.0:1651532053.449254:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467991808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532053.449295:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.449305:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532053.449306:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.449309:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.449312:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532053.449312:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.449317:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.449320:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.449323:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532053.523984:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793005 is committed
00010000:00010000:1.0:1651532053.524013:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.524018:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.524049:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467990272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 733280us (733309us total) trans 158913793005 rc 0/0
00010000:00010000:0.0:1651532053.524050:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.524052:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3152
00010000:00010000:0.0:1651532053.524055:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.524056:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.524070:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.524076:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.524076:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.524077:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.524080:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.524083:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.524084:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.524085:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.524087:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.524097:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.524100:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ad8d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9859071] (req 135168->9859071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.524107:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.524110:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.524112:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.524113:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.524362:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532053.524371:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467992000
00000100:00100000:1.0:1651532053.524390:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3161
00000100:00100000:1.0:1651532053.524392:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467992000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532053.524399:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.524403:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532053.524404:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.524407:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532053.524408:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.524412:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.524428:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532053.657361:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793007 is committed
00010000:00010000:0.0:1651532053.657382:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657386:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657391:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657395:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532053.657413:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467990464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716611us (716637us total) trans 158913793007 rc 0/0
00000100:00100000:0.0:1651532053.657416:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3153
00000100:00100000:1.0:1651532053.657418:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467990592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616508us (616630us total) trans 158913793006 rc 0/0
00000100:00100000:1.0:1651532053.657422:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3154
00010000:00010000:0.0:1651532053.657425:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657428:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.657429:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657432:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657437:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.657438:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.657439:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657442:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657463:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657466:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ad94 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2740224->4321279] (req 2740224->4321279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657472:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657476:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.657476:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657478:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657479:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657481:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657487:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657490:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ad9b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532053.657863:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532053.657873:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467992192
00000100:00100000:0.0:1651532053.657875:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532053.657886:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467992320
00000100:00100000:0.0:1651532053.657891:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3162
00000100:00100000:0.0:1651532053.657898:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467992192:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532053.657899:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3163
00000100:00100000:1.0:1651532053.657900:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467992320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532053.657907:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657908:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657912:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532053.657913:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657916:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532053.657917:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657930:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532053.657932:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657935:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532053.657935:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657939:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657940:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.657943:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.657943:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.728183:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532053.728207:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229760
00000100:00100000:0.0:1651532053.728226:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 47
00000100:00100000:0.0:1651532053.728228:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229760:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532053.728234:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1347584 granted 355304000 pending 86016 free 81138851840 avail 76967452672
00000100:00100000:0.0:1651532053.728248:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229760:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 19us (66us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532053.728251:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 47
00000001:00080000:0.0:1651532053.798938:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793008 is committed
00002000:00010000:0.0:1651532053.798952:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532052 -> 1651532053
00010000:00010000:0.0:1651532053.798955:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.798958:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532053.798980:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467990848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 631479us (631505us total) trans 158913793008 rc 0/0
00000100:00100000:0.0:1651532053.798984:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3155
00010000:00010000:0.0:1651532053.798992:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799003:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.799004:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799007:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799012:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.799013:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.799014:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799017:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799025:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799028:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ada2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->2879487] (req 786432->2879487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799033:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799036:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.799295:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532053.799344:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467992512
00000100:00100000:0.0:1651532053.799369:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3164
00000100:00100000:0.0:1651532053.799371:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467992512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532053.799379:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799383:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532053.799384:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799387:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532053.799388:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799392:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.799396:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532053.865685:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793009 is committed
00010000:00010000:0.0:1651532053.865701:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.865705:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532053.865728:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467991040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 589885us (589914us total) trans 158913793009 rc 0/0
00000100:00100000:0.0:1651532053.865731:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3156
00010000:00010000:0.0:1651532053.865746:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.865750:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532053.865751:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.865754:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.865759:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.865759:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532053.865760:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.865763:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.865770:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.865773:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ada9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->9768959] (req 81920->9768959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.865778:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.865781:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532053.866055:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532053.866125:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467992640
00000100:00100000:0.0:1651532053.866137:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3165
00000100:00100000:0.0:1651532053.866139:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467992640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532053.866146:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.866151:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532053.866152:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532053.866153:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.866156:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532053.932413:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793010 is committed
00010000:00010000:0.0:1651532053.932428:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.932431:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.932453:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532053.932454:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467991232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 608101us (608195us total) trans 158913793010 rc 0/0
00000100:00100000:0.0:1651532053.932457:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3157
00010000:00010000:1.0:1651532053.932458:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532053.932466:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.932470:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.932476:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532053.932477:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532053.932477:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.932481:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.932484:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532053.932484:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532053.932485:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.932487:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.932509:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.932512:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40adb0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->8556543] (req 753664->8556543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.932518:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.932521:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.932529:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532053.932535:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532053.932997:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532053.933019:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467992832
00000100:00100000:1.0:1651532053.933035:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3166
00000100:00100000:1.0:1651532053.933037:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467992832:12345-10.240.43.64@tcp:4:fio.
00010000:00010000:1.0:1651532053.933044:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.933049:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532053.933050:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.933053:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.933055:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532053.933056:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.933060:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.933063:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532053.933066:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532054.082380:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793012 is committed
00010000:00010000:0.0:1651532054.082399:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082403:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.082412:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.082417:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.082423:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467991616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691467us (691517us total) trans 158913793012 rc 0/0
00000100:00100000:0.0:1651532054.082427:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3159
00010000:00010000:0.0:1651532054.082440:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.082441:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467991360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 758080us (758124us total) trans 158913793011 rc 0/0
00010000:00010000:0.0:1651532054.082444:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532054.082445:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3158
00010000:00010000:0.0:1651532054.082445:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082448:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082453:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082467:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40adbe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->5029887] (req 552960->5029887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082471:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082473:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532054.082474:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082477:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082481:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.082481:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.082482:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082485:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082494:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.082497:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40adb7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6836224->6840319] (req 6836224->6840319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.082506:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.082510:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.082682:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532054.082692:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467993024
00000100:00100000:1.0:1651532054.082718:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3167
00000100:00100000:1.0:1651532054.082720:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467993024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532054.082727:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.082731:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532054.082732:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.082735:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532054.082748:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.082753:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.082757:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.082987:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532054.082998:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467993152
00000100:00100000:0.0:1651532054.083019:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3168
00000100:00100000:0.0:1651532054.083020:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467993152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532054.083027:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.083032:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532054.083033:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.083036:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532054.083036:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.083041:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.083044:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532054.224031:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793013 is committed
00010000:00010000:1.0:1651532054.224064:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224069:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.224093:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467991808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774837us (774870us total) trans 158913793013 rc 0/0
00000100:00100000:1.0:1651532054.224096:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3160
00010000:00010000:1.0:1651532054.224104:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224107:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532054.224108:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224111:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224128:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532054.224128:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532054.224138:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224141:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224149:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224152:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40adc5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3706880->9748479] (req 3706880->9748479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224158:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224161:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.224379:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532054.224471:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467993344
00000100:00100000:1.0:1651532054.224487:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3169
00000100:00100000:1.0:1651532054.224489:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467993344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532054.224504:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224508:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532054.224514:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532054.224515:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.224518:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532054.332399:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793014 is committed
00010000:00010000:1.0:1651532054.332429:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332434:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.332456:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467992000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 808063us (808094us total) trans 158913793014 rc 0/0
00000100:00100000:1.0:1651532054.332459:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3161
00010000:00010000:1.0:1651532054.332467:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332470:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532054.332472:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332474:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332479:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532054.332480:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532054.332480:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332503:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332515:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332518:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40adcc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->5951487] (req 1007616->5951487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.332528:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.332533:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.332701:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532054.332731:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467993536
00000100:00100000:1.0:1651532054.332745:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3170
00000100:00100000:1.0:1651532054.332747:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467993536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532054.332753:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332758:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532054.332765:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332768:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332770:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532054.332771:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332775:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332786:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.332789:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532054.440707:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793015 is committed
00010000:00010000:0.0:1651532054.440722:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.440727:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.440750:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.440750:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467992192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 782851us (782887us total) trans 158913793015 rc 0/0
00000100:00100000:0.0:1651532054.440753:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3162
00010000:00010000:1.0:1651532054.440755:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532054.440756:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.440759:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.440765:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532054.440766:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532054.440766:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.440769:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.440777:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.440780:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40add3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9961471] (req 98304->9961471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.440786:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.440790:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.441381:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532054.441415:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467993728
00000100:00100000:0.0:1651532054.441428:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3171
00000100:00100000:0.0:1651532054.441430:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467993728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532054.441444:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.441448:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532054.441449:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.441452:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532054.441461:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.441466:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.441470:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532054.540763:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793016 is committed
00002000:00010000:1.0:1651532054.540793:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532051 -> 1651532053
00010000:00010000:1.0:1651532054.540796:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.540800:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540825:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.540832:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467992320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 882930us (882956us total) trans 158913793016 rc 0/0
00010000:00010000:0.0:1651532054.540833:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532054.540835:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3163
00010000:00010000:0.0:1651532054.540835:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540838:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540843:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.540844:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.540845:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540848:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540851:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.540852:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.540860:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540864:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540872:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540875:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40adda lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->7086079] (req 1286144->7086079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540880:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540883:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540954:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.540958:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.541196:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532054.541219:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467993920
00000100:00100000:1.0:1651532054.541231:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3172
00000100:00100000:1.0:1651532054.541233:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467993920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532054.541239:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.541244:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532054.541245:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.541248:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532054.541249:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.541253:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.541268:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532054.599125:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793018 is committed
00010000:00010000:0.0:1651532054.599140:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599144:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.599176:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467992640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 733035us (733122us total) trans 158913793017 rc 0/0
00000100:00100000:0.0:1651532054.599180:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3165
00010000:00010000:0.0:1651532054.599187:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599191:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532054.599192:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599195:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599200:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599203:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ade8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->1343487] (req 1339392->1343487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599214:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599217:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.599233:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467992512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799862us (799939us total) trans 158913793018 rc 0/0
00010000:00010000:1.0:1651532054.599235:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.599240:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532054.599241:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.599244:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.599245:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3164
00010000:00010000:1.0:1651532054.599249:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532054.599250:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532054.599251:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.599254:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.599261:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.599264:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ade1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2850816->7270399] (req 2850816->7270399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.599269:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.599292:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.599495:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532054.599504:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467994176
00000100:00100000:0.0:1651532054.599538:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3173
00000100:00100000:0.0:1651532054.599540:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467994176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532054.599549:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599553:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532054.599555:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599557:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532054.599558:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599562:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599566:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.599582:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532054.599589:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467994304
00000100:00100000:0.0:1651532054.599597:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3174
00000100:00100000:0.0:1651532054.599599:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467994304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532054.599604:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599617:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532054.599618:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599620:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532054.599621:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599625:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.599628:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532054.664339:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793019 is committed
00010000:00010000:1.0:1651532054.664369:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.664374:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.664396:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467992832:12345-10.240.43.64@tcp:4:fio. Request processed in 731357us (731399us total) trans 158913793019 rc 0/0
00010000:00010000:0.0:1651532054.664396:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.664399:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3166
00010000:00010000:0.0:1651532054.664401:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532054.664402:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.664405:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.664411:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.664411:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.664412:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.664423:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.664432:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.664435:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40adef lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10153983] (req 1187840->10153983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.664446:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.664450:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.664978:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532054.664993:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467994496
00000100:00100000:1.0:1651532054.665008:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3175
00000100:00100000:1.0:1651532054.665009:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467994496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532054.665017:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.665022:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532054.665023:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.665034:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532054.665035:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.665039:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.665043:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532054.731115:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793020 is committed
00010000:00010000:1.0:1651532054.731144:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.731149:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.731170:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467993024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 648450us (648488us total) trans 158913793020 rc 0/0
00010000:00010000:0.0:1651532054.731172:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.731174:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3167
00010000:00010000:0.0:1651532054.731177:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532054.731178:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.731181:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.731187:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.731187:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.731188:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.731192:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.731205:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.731206:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532054.731206:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.731209:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.731217:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.731220:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40adf6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.731222:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.731225:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.731226:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.731228:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.731744:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532054.731753:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467994688
00000100:00100000:1.0:1651532054.731776:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3176
00000100:00100000:1.0:1651532054.731778:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467994688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532054.731785:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.731789:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532054.731790:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.731793:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532054.731794:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.731798:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.731801:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532054.839456:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793022 is committed
00002000:00010000:0.0:1651532054.839471:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532053 -> 1651532054
00010000:00010000:0.0:1651532054.839474:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.839477:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.839510:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467993152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 756489us (756523us total) trans 158913793021 rc 0/0
00010000:00010000:1.0:1651532054.839511:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.839514:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3168
00010000:00010000:1.0:1651532054.839515:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532054.839516:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.839520:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.839527:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.839530:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.839537:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.839540:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40adfd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6967296->6971391] (req 6967296->6971391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.839541:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467993344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 615051us (615164us total) trans 158913793022 rc 0/0
00010000:00010000:1.0:1651532054.839543:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.839544:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3169
00010000:00010000:1.0:1651532054.839546:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532054.839547:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.839550:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.839553:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532054.839554:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532054.839555:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.839558:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.839565:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532054.839568:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae04 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1863680->2916351] (req 1863680->2916351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.839579:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.839583:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532054.839954:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532054.839968:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532054.839977:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467994944
00000100:00100000:0.0:1651532054.839987:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467994880
00000100:00100000:0.0:1651532054.839993:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3177
00000100:00100000:0.0:1651532054.839995:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467994944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532054.840002:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.840018:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532054.840020:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.840022:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532054.840023:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.840028:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.840031:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532054.840039:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3178
00000100:00100000:0.0:1651532054.840041:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467994880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532054.840046:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.840049:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532054.840050:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.840053:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532054.840053:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.840056:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532054.840067:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532055.014419:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793023 is committed
00010000:00010000:0.0:1651532055.014433:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014437:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.014459:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467993536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 681712us (681759us total) trans 158913793023 rc 0/0
00000100:00100000:0.0:1651532055.014462:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3170
00010000:00010000:0.0:1651532055.014470:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014473:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532055.014474:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014477:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014482:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.014483:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.014484:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014497:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014505:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014508:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae0b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9224191] (req 806912->9224191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014514:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014517:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.014925:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532055.014933:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467995136
00000100:00100000:0.0:1651532055.014944:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3179
00000100:00100000:0.0:1651532055.014946:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467995136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532055.014953:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014957:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.014958:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532055.014959:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.014962:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532055.131083:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793024 is committed
00010000:00010000:0.0:1651532055.131097:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131101:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.131123:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467993728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 689692us (689742us total) trans 158913793024 rc 0/0
00000100:00100000:0.0:1651532055.131127:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3171
00010000:00010000:0.0:1651532055.131134:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131137:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532055.131138:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131141:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131146:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.131147:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.131148:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131151:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131171:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131175:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae12 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8941567] (req 1867776->8941567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.131184:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.131190:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532055.131393:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532055.131431:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467995328
00000100:00100000:0.0:1651532055.131444:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3180
00000100:00100000:0.0:1651532055.131446:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467995328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532055.131453:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131457:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532055.131458:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131461:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532055.131461:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131466:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.131469:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532055.301884:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793025 is committed
00010000:00010000:1.0:1651532055.301923:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.301929:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532055.301948:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467993920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 760715us (760753us total) trans 158913793025 rc 0/0
00000100:00100000:1.0:1651532055.301952:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3172
00010000:00010000:1.0:1651532055.301959:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.301963:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532055.301965:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.301968:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.301985:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532055.301986:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532055.301987:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.301990:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.302002:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.302005:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae19 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10330111] (req 106496->10330111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.302016:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.302021:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.302311:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532055.302334:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467995584
00000100:00100000:1.0:1651532055.302348:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3181
00000100:00100000:1.0:1651532055.302350:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467995584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532055.302358:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.302363:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532055.302364:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.302368:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.302370:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532055.302381:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.302386:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.302389:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.302393:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532055.422697:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793026 is committed
00010000:00010000:0.0:1651532055.422712:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.422717:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.422740:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467994176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 823198us (823245us total) trans 158913793026 rc 0/0
00000100:00100000:0.0:1651532055.422743:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3173
00010000:00010000:0.0:1651532055.422751:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.422754:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532055.422756:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.422759:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.422764:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.422764:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.422774:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.422777:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.422785:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.422788:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae20 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3493888->9187327] (req 3493888->9187327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.422793:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.422796:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532055.423058:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532055.423070:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467995712
00000100:00100000:0.0:1651532055.423090:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3182
00000100:00100000:0.0:1651532055.423092:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467995712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532055.423100:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.423104:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532055.423105:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.423108:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532055.423117:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.423122:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.423126:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532055.551339:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793027 is committed
00002000:00010000:0.0:1651532055.551352:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532053 -> 1651532054
00010000:00010000:0.0:1651532055.551355:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.551358:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.551380:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467994304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 951780us (951797us total) trans 158913793027 rc 0/0
00010000:00010000:1.0:1651532055.551382:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.551383:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3174
00010000:00010000:1.0:1651532055.551388:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532055.551389:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551392:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551398:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532055.551399:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532055.551400:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551403:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551432:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551435:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ae27 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1773568->4730879] (req 1773568->4730879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551441:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551444:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.551673:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532055.551682:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467995904
00000100:00100000:1.0:1651532055.551701:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3183
00000100:00100000:1.0:1651532055.551703:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467995904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532055.551712:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551716:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532055.551717:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551720:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532055.551721:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551725:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.551752:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532055.656019:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793028 is committed
00010000:00010000:1.0:1651532055.656047:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.656052:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532055.656073:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467994496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 991062us (991096us total) trans 158913793028 rc 0/0
00010000:00010000:0.0:1651532055.656075:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532055.656077:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3175
00010000:00010000:0.0:1651532055.656080:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532055.656081:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.656094:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.656100:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.656100:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.656101:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.656104:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.656114:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.656117:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ae2e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->10362879] (req 1314816->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.656135:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.656139:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532055.656585:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532055.656594:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467996160
00000100:00100000:1.0:1651532055.656609:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3184
00000100:00100000:1.0:1651532055.656611:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467996160:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532055.656618:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.656623:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532055.656639:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.656642:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532055.656643:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.656648:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.656651:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532055.722758:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793029 is committed
00010000:00010000:1.0:1651532055.722788:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.722793:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.722816:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.722820:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532055.722821:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532055.722825:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467994688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 991046us (991081us total) trans 158913793029 rc 0/0
00010000:00010000:0.0:1651532055.722825:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532055.722828:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3176
00010000:00010000:0.0:1651532055.722840:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.722840:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.722841:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.722844:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.722852:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.722855:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ae35 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10162175] (req 45056->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.722869:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.722873:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.723299:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532055.723321:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467996352
00000100:00100000:1.0:1651532055.723346:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3185
00000100:00100000:1.0:1651532055.723348:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467996352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532055.723355:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.723360:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532055.723361:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.723363:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532055.723364:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.723369:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.723372:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532055.764740:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793030 is committed
00010000:00010000:1.0:1651532055.764766:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764771:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532055.764787:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467994944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 924791us (924834us total) trans 158913793030 rc 0/0
00000100:00100000:1.0:1651532055.764790:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3177
00010000:00010000:1.0:1651532055.764797:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764822:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532055.764823:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764826:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764832:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532055.764832:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532055.764833:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764836:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764839:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532055.764840:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532055.764841:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764843:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764852:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.764859:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764863:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ae3c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->1527807] (req 1523712->1527807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.764863:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764883:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.764886:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.765023:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532055.765034:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467996544
00000100:00100000:1.0:1651532055.765050:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3186
00000100:00100000:1.0:1651532055.765051:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467996544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532055.765059:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.765063:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532055.765064:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.765067:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532055.765067:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.765072:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.765075:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532055.864528:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793032 is committed
00010000:00010000:0.0:1651532055.864548:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864552:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.864565:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.864576:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.864578:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467994880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 1024537us (1024611us total) trans 158913793032 rc 0/0
00000100:00100000:0.0:1651532055.864582:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3178
00010000:00010000:0.0:1651532055.864595:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532055.864596:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467995136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849649us (849672us total) trans 158913793031 rc 0/0
00000100:00100000:1.0:1651532055.864599:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3179
00010000:00010000:0.0:1651532055.864599:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532055.864600:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864603:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864608:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.864609:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532055.864610:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864613:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864620:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864623:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ae43 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->8323071] (req 405504->8323071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864626:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864637:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532055.864638:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864641:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864645:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.864648:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae4a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9474048->9478143] (req 9474048->9478143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.864651:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.864655:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532055.864965:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532055.864985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532055.864997:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467996672
00000100:00100000:1.0:1651532055.865002:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467996800
00000100:00100000:0.0:1651532055.865008:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3187
00000100:00100000:0.0:1651532055.865010:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467996672:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532055.865018:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3188
00000100:00100000:1.0:1651532055.865019:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467996800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532055.865023:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.865027:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532055.865029:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.865031:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532055.865032:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.865041:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.865046:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532055.865047:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532055.865048:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532055.865051:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.865052:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532055.865055:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.014533:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793033 is committed
00002000:00010000:1.0:1651532056.014562:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532054 -> 1651532055
00010000:00010000:1.0:1651532056.014566:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014570:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.014594:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467995328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 883147us (883202us total) trans 158913793033 rc 0/0
00000100:00100000:1.0:1651532056.014597:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3180
00010000:00010000:1.0:1651532056.014605:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014609:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532056.014610:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014613:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014618:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.014619:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.014620:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014622:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014648:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014651:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ae51 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6610943] (req 569344->6610943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014657:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014660:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.014850:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532056.014860:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467996992
00000100:00100000:1.0:1651532056.014880:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3189
00000100:00100000:1.0:1651532056.014882:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467996992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532056.014889:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014893:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532056.014894:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014897:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532056.014898:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014902:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.014914:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.081213:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793034 is committed
00002000:00010000:1.0:1651532056.081240:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532054 -> 1651532055
00010000:00010000:1.0:1651532056.081243:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081247:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.081265:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467995584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 778914us (778955us total) trans 158913793034 rc 0/0
00000100:00100000:1.0:1651532056.081268:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3181
00010000:00010000:1.0:1651532056.081286:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081290:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532056.081291:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081294:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081299:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.081300:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.081301:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081314:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081327:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081330:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ae58 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.081336:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.081340:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.081560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532056.081569:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467997184
00000100:00100000:1.0:1651532056.081582:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3190
00000100:00100000:1.0:1651532056.081584:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467997184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532056.081592:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081596:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532056.081597:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081600:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081602:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532056.081603:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081607:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081618:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.081621:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.147962:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793035 is committed
00010000:00010000:0.0:1651532056.147977:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.147981:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.148004:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467995712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724910us (724946us total) trans 158913793035 rc 0/0
00000100:00100000:0.0:1651532056.148007:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3182
00010000:00010000:0.0:1651532056.148015:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.148029:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532056.148030:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.148033:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.148038:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532056.148039:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532056.148040:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.148043:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.148053:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.148056:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ae5f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->9908223] (req 233472->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.148062:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.148067:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.148608:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532056.148616:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467997376
00000100:00100000:0.0:1651532056.148627:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3191
00000100:00100000:0.0:1651532056.148629:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467997376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532056.148636:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.148653:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532056.148654:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.148657:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532056.148658:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.148662:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.148665:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.247968:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793036 is committed
00010000:00010000:1.0:1651532056.247997:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248002:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.248020:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467995904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 696316us (696347us total) trans 158913793036 rc 0/0
00000100:00100000:1.0:1651532056.248023:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3183
00010000:00010000:1.0:1651532056.248030:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248034:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532056.248035:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248047:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248053:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.248053:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.248054:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248057:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248064:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248067:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ae66 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->9543679] (req 3244032->9543679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248072:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248075:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.248429:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532056.248438:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467997568
00000100:00100000:1.0:1651532056.248455:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3192
00000100:00100000:1.0:1651532056.248457:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467997568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532056.248474:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248478:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532056.248479:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248482:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532056.248483:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248488:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.248491:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.372988:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793037 is committed
00010000:00010000:1.0:1651532056.373016:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373021:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.373043:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467996160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716431us (716459us total) trans 158913793037 rc 0/0
00000100:00100000:1.0:1651532056.373047:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3184
00010000:00010000:1.0:1651532056.373054:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373068:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532056.373069:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373073:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373078:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.373078:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.373079:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373091:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373099:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373102:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ae6d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->9404415] (req 1695744->9404415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373107:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373110:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.373346:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532056.373381:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467997760
00000100:00100000:1.0:1651532056.373411:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3193
00000100:00100000:1.0:1651532056.373413:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467997760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532056.373425:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373430:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532056.373430:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373433:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532056.373434:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373438:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.373441:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.489695:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793038 is committed
00010000:00010000:1.0:1651532056.489724:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.489729:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.489752:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467996352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766403us (766453us total) trans 158913793038 rc 0/0
00000100:00100000:1.0:1651532056.489755:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3185
00010000:00010000:1.0:1651532056.489763:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.489774:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532056.489775:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.489778:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.489783:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.489784:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.489785:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.489788:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.489819:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.489823:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ae74 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->10207231] (req 2269184->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.489834:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.489840:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.490258:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532056.490284:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467998016
00000100:00100000:1.0:1651532056.490298:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3194
00000100:00100000:1.0:1651532056.490300:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467998016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532056.490312:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.490334:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532056.490335:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.490338:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532056.490338:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.490343:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.490346:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.556373:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793039 is committed
00010000:00010000:0.0:1651532056.556389:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.556405:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.556427:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.556429:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467996544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791376us (791406us total) trans 158913793039 rc 0/0
00010000:00010000:1.0:1651532056.556432:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532056.556432:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3186
00010000:00010000:1.0:1651532056.556433:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.556436:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.556441:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.556442:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.556443:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.556456:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.556459:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.556460:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.556460:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.556463:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.556484:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.556488:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ae7b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9883647] (req 53248->9883647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.556494:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.556497:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.556498:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.556503:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.556953:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532056.556964:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467998208
00000100:00100000:0.0:1651532056.556975:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3195
00000100:00100000:0.0:1651532056.556977:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467998208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532056.556984:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.556989:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532056.556990:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.556993:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532056.556994:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.557010:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.557014:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.648075:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793041 is committed
00010000:00010000:0.0:1651532056.648095:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.648099:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648105:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648109:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.648116:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467996672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783105us (783151us total) trans 158913793040 rc 0/0
00000100:00100000:0.0:1651532056.648119:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3187
00010000:00010000:0.0:1651532056.648127:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.648131:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532056.648132:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.648135:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.648138:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467996800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783117us (783153us total) trans 158913793041 rc 0/0
00010000:00010000:0.0:1651532056.648140:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.648141:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3188
00010000:00010000:1.0:1651532056.648149:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648152:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532056.648152:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ae82 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->1089535] (req 1085440->1089535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648154:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648157:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648161:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.648162:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.648163:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648166:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648172:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648175:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ae89 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2662400->10244095] (req 2662400->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.648186:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.648190:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.648385:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532056.648400:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467998400
00000100:00100000:1.0:1651532056.648416:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3196
00000100:00100000:1.0:1651532056.648418:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467998400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532056.648425:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648429:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532056.648430:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648433:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532056.648433:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648438:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.648441:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.648508:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532056.648517:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467998528
00000100:00100000:0.0:1651532056.648528:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3197
00000100:00100000:0.0:1651532056.648530:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467998528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532056.648537:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aec8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.648541:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532056.648542:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532056.648543:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aec8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10334208->10338303] (req 10334208->10338303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.648547:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aec8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10334208->10338303] (req 10334208->10338303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.756437:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793043 is committed
00002000:00010000:0.0:1651532056.756452:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532055 -> 1651532056
00002000:00010000:0.0:1651532056.756453:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532055 -> 1651532056
00010000:00010000:0.0:1651532056.756464:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aec8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10334208->10338303] (req 10334208->10338303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756468:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aec8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10334208->10338303] (req 10334208->10338303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.756492:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467998528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 107961us (107984us total) trans 158913793043 rc 0/0
00010000:00010000:1.0:1651532056.756493:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aec8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10334208->10338303] (req 10334208->10338303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.756495:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3197
00010000:00010000:1.0:1651532056.756497:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532056.756499:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aec8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10334208->10338303] (req 10334208->10338303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756509:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756512:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.756515:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aec8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10334208->10338303] (req 10334208->10338303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.756521:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aec8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10334208->10338303] (req 10334208->10338303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.756523:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467996992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 741640us (741674us total) trans 158913793042 rc 0/0
00010000:00010000:1.0:1651532056.756524:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40aec8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10334208->10338303] (req 10334208->10338303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.756526:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3189
00010000:00010000:1.0:1651532056.756528:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.756530:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532056.756531:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.756534:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.756537:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.756538:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.756539:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.756541:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.756548:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.756557:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ae90 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7249920->7254015] (req 7249920->7254015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756564:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756568:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.756753:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532056.756762:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467998720
00000100:00100000:0.0:1651532056.756772:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3198
00000100:00100000:0.0:1651532056.756774:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467998720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532056.756790:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756794:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532056.756795:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756798:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532056.756799:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756819:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756823:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.756930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532056.756939:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467998848
00000100:00100000:0.0:1651532056.756949:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3199
00000100:00100000:0.0:1651532056.756951:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467998848:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532056.756958:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756962:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532056.756963:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756966:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532056.756974:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756981:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.756986:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.864774:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793044 is committed
00010000:00010000:0.0:1651532056.864788:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.864792:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.864813:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.864817:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532056.864818:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.864821:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.864824:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467997184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783238us (783264us total) trans 158913793044 rc 0/0
00010000:00010000:1.0:1651532056.864826:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.864826:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532056.864827:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.864827:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3190
00010000:00010000:1.0:1651532056.864830:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.864839:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.864842:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ae97 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8695807] (req 638976->8695807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.864851:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.864862:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532056.865083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532056.865106:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467998976
00000100:00100000:0.0:1651532056.865117:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3200
00000100:00100000:0.0:1651532056.865119:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467998976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532056.865127:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.865131:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532056.865132:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532056.865133:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.865143:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532056.998124:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793045 is committed
00010000:00010000:1.0:1651532056.998152:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.998157:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.998177:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467997376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849547us (849570us total) trans 158913793045 rc 0/0
00000100:00100000:1.0:1651532056.998181:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3191
00010000:00010000:0.0:1651532056.998181:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.998185:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532056.998186:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.998190:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.998195:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532056.998196:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532056.998197:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.998200:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.998209:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532056.998212:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ae9e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9322495] (req 237568->9322495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.998226:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.998230:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532056.998408:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532056.998417:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467999168
00000100:00100000:1.0:1651532056.998432:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3201
00000100:00100000:1.0:1651532056.998434:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467999168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532056.998442:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.998446:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532056.998455:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.998466:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.998469:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532056.998470:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.998474:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.998483:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532056.998486:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532057.098112:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793046 is committed
00010000:00010000:1.0:1651532057.098142:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098146:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.098165:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467997568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849707us (849736us total) trans 158913793046 rc 0/0
00000100:00100000:1.0:1651532057.098168:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3192
00010000:00010000:1.0:1651532057.098176:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098188:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532057.098189:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098192:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098198:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.098198:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.098199:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098202:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098209:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098212:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aea5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->9916415] (req 614400->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098218:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098220:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.098782:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532057.098800:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467999360
00000100:00100000:1.0:1651532057.098832:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3202
00000100:00100000:1.0:1651532057.098834:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467999360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532057.098842:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098846:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532057.098847:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098850:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532057.098850:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098855:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.098858:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532057.206489:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793047 is committed
00010000:00010000:1.0:1651532057.206518:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206523:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.206546:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467997760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 833132us (833201us total) trans 158913793047 rc 0/0
00000100:00100000:1.0:1651532057.206549:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3193
00010000:00010000:1.0:1651532057.206565:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206568:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532057.206569:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206572:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206577:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.206578:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.206579:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206591:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206599:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206602:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aeac lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3297280->9842687] (req 3297280->9842687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206607:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206610:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532057.206882:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532057.206951:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467999552
00000100:00100000:1.0:1651532057.206968:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3203
00000100:00100000:1.0:1651532057.206970:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467999552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532057.206977:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206982:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532057.206982:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206985:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532057.206986:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206990:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.206994:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532057.264848:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793048 is committed
00010000:00010000:1.0:1651532057.264876:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.264880:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.264901:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467998016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774600us (774644us total) trans 158913793048 rc 0/0
00010000:00010000:0.0:1651532057.264904:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.264909:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532057.264911:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.264912:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3194
00010000:00010000:0.0:1651532057.264914:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.264920:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532057.264921:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532057.264922:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.264925:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.264933:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.264936:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40aeb3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2846720->5631999] (req 2846720->5631999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.264959:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.264963:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.265191:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532057.265199:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467999744
00000100:00100000:1.0:1651532057.265213:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3204
00000100:00100000:1.0:1651532057.265215:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467999744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532057.265222:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.265226:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532057.265227:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.265236:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532057.265237:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.265242:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.265245:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532057.339933:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793049 is committed
00010000:00010000:1.0:1651532057.339963:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.339967:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.339985:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467998208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783008us (783032us total) trans 158913793049 rc 0/0
00000100:00100000:1.0:1651532057.339989:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3195
00010000:00010000:1.0:1651532057.339996:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.339999:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532057.340000:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340003:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340008:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.340009:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.340009:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340012:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340019:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340030:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40aeba lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10027007] (req 16384->10027007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340036:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340039:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.340595:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532057.340604:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467999936
00000100:00100000:1.0:1651532057.340620:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3205
00000100:00100000:1.0:1651532057.340622:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467999936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532057.340636:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340640:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532057.340641:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340644:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532057.340645:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340649:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.340660:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532057.506539:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793050 is committed
00010000:00010000:1.0:1651532057.506568:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.506573:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.506595:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467998400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 858176us (858210us total) trans 158913793050 rc 0/0
00010000:00010000:0.0:1651532057.506595:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.506598:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3196
00010000:00010000:0.0:1651532057.506601:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532057.506602:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.506605:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.506611:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532057.506612:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532057.506613:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.506616:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.506624:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.506627:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40aec1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->10170367] (req 425984->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.506639:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.506643:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.507151:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532057.507225:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468000128
00000100:00100000:1.0:1651532057.507243:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3206
00000100:00100000:1.0:1651532057.507245:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468000128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532057.507254:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.507284:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532057.507293:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.507298:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532057.507298:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.507304:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.507308:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532057.596093:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793051 is committed
00010000:00010000:1.0:1651532057.596125:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596130:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.596150:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467998720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 839375us (839398us total) trans 158913793051 rc 0/0
00000100:00100000:1.0:1651532057.596154:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3198
00010000:00010000:1.0:1651532057.596162:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596165:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532057.596167:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596186:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596192:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.596192:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.596193:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596196:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596200:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.596200:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.596201:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596204:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596216:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596219:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40aecf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9482239] (req 7516160->9482239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.596228:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.596240:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596263:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596267:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532057.596519:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532057.596531:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468000320
00000100:00100000:1.0:1651532057.596547:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3207
00000100:00100000:1.0:1651532057.596549:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468000320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532057.596556:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596561:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532057.596562:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596565:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532057.596565:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596570:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.596573:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532057.754426:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793053 is committed
00010000:00010000:0.0:1651532057.754447:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.754452:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754464:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754469:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532057.754473:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467998848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 997520us (997542us total) trans 158913793052 rc 0/0
00000100:00100000:0.0:1651532057.754476:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3199
00010000:00010000:0.0:1651532057.754491:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.754494:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467998976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 889373us (889411us total) trans 158913793053 rc 0/0
00010000:00010000:0.0:1651532057.754495:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532057.754497:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.754500:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.754505:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.754506:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3200
00010000:00010000:1.0:1651532057.754515:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754519:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532057.754519:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40aed6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9404416->9408511] (req 9404416->9408511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754520:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754523:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754528:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.754529:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.754530:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754532:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754540:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754543:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40aedd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2527232->2531327] (req 2527232->2531327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754548:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754551:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532057.754717:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532057.754753:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468000512
00000100:00100000:1.0:1651532057.754772:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3208
00000100:00100000:1.0:1651532057.754774:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468000512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532057.754781:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754785:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532057.754786:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754789:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532057.754790:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754794:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.754797:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532057.754881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532057.754887:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468000640
00000100:00100000:0.0:1651532057.754898:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3209
00000100:00100000:0.0:1651532057.754900:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468000640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532057.754908:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.754912:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532057.754913:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532057.754914:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.754917:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532057.851535:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793054 is committed
00010000:00010000:1.0:1651532057.851568:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.851573:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.851597:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467999168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 853161us (853188us total) trans 158913793054 rc 0/0
00000100:00100000:1.0:1651532057.851608:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3201
00010000:00010000:1.0:1651532057.851617:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.851620:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532057.851621:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.851624:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.851638:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.851639:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532057.851640:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.851643:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.851651:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.851654:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40aee4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9555967] (req 466944->9555967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.851659:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.851662:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532057.852002:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532057.852010:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468000832
00000100:00100000:1.0:1651532057.852026:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3210
00000100:00100000:1.0:1651532057.852028:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468000832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532057.852035:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.852040:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532057.852041:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.852044:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.852046:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532057.852047:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.852051:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.852054:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.852057:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532057.934792:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793055 is committed
00010000:00010000:1.0:1651532057.934819:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.934831:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532057.934852:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467999360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 836017us (836071us total) trans 158913793055 rc 0/0
00000100:00100000:1.0:1651532057.934855:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3202
00010000:00010000:0.0:1651532057.934855:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.934860:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532057.934861:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.934871:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.934877:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532057.934878:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532057.934878:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.934881:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.934891:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532057.934894:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40aeeb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->6209535] (req 454656->6209535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.934907:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.934911:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532057.935240:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532057.935254:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468001024
00000100:00100000:1.0:1651532057.935268:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3211
00000100:00100000:1.0:1651532057.935270:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468001024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532057.935290:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.935295:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532057.935295:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.935298:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532057.935299:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.935303:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532057.935316:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532058.021053:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793056 is committed
00002000:00010000:1.0:1651532058.021084:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532056 -> 1651532057
00010000:00010000:1.0:1651532058.021088:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021092:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.021111:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467999552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 814140us (814230us total) trans 158913793056 rc 0/0
00000100:00100000:1.0:1651532058.021114:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3203
00010000:00010000:1.0:1651532058.021121:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021125:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532058.021126:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021129:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021134:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.021135:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.021136:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021150:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021158:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021161:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aef2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9920511] (req 172032->9920511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021167:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021169:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.021780:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532058.021789:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468001216
00000100:00100000:1.0:1651532058.021822:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3212
00000100:00100000:1.0:1651532058.021824:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468001216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532058.021832:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021836:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532058.021837:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021840:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532058.021848:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021853:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.021857:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532058.146157:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793057 is committed
00010000:00010000:1.0:1651532058.146189:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146194:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.146217:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467999744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 881001us (881027us total) trans 158913793057 rc 0/0
00000100:00100000:1.0:1651532058.146221:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3204
00010000:00010000:1.0:1651532058.146229:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146232:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532058.146233:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146236:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146241:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.146258:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.146259:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146263:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146271:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146285:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40aef9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->5459967] (req 3870720->5459967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146292:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146295:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532058.146519:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532058.146595:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468001408
00000100:00100000:1.0:1651532058.146611:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3213
00000100:00100000:1.0:1651532058.146613:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468001408:12345-10.240.43.64@tcp:4:fio.
00010000:00010000:1.0:1651532058.146620:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146625:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532058.146626:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146628:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532058.146637:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146654:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.146658:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532058.246200:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793058 is committed
00010000:00010000:1.0:1651532058.246231:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.246236:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.246257:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467999936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 905634us (905663us total) trans 158913793058 rc 0/0
00010000:00010000:0.0:1651532058.246259:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.246260:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3205
00010000:00010000:0.0:1651532058.246265:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532058.246266:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.246289:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.246297:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532058.246299:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532058.246300:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.246306:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.246316:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.246321:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af00 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->7442431] (req 2207744->7442431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.246325:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.246329:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.246589:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532058.246617:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468001600
00000100:00100000:1.0:1651532058.246635:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3214
00000100:00100000:1.0:1651532058.246637:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468001600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532058.246652:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.246656:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532058.246657:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532058.246658:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.246661:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532058.370420:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793059 is committed
00010000:00010000:1.0:1651532058.370453:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370458:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.370477:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468000128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 863231us (863327us total) trans 158913793059 rc 0/0
00000100:00100000:1.0:1651532058.370481:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3206
00010000:00010000:1.0:1651532058.370488:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370491:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532058.370493:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370495:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370511:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.370511:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.370512:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370515:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370523:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370526:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af07 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->10063871] (req 569344->10063871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370531:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370534:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.370893:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532058.370901:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468001856
00000100:00100000:1.0:1651532058.370918:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3215
00000100:00100000:1.0:1651532058.370919:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468001856:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532058.370927:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370932:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532058.370941:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370944:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532058.370944:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370949:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.370953:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532058.479563:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793060 is committed
00010000:00010000:1.0:1651532058.479595:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479600:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.479618:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468000320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 883069us (883101us total) trans 158913793060 rc 0/0
00000100:00100000:1.0:1651532058.479622:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3207
00010000:00010000:1.0:1651532058.479629:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479633:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532058.479634:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479649:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479654:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.479655:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.479655:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479658:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479662:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.479662:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.479663:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479666:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479679:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479682:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af0e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9977855] (req 49152->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479687:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.479690:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.479690:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.479696:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.480258:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532058.480266:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468002048
00000100:00100000:1.0:1651532058.480294:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3216
00000100:00100000:1.0:1651532058.480297:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468002048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532058.480305:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.480309:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532058.480310:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.480313:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.480316:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532058.480316:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.480321:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.480324:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.480327:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532058.596183:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793062 is committed
00002000:00010000:0.0:1651532058.596203:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532056 -> 1651532057
00010000:00010000:0.0:1651532058.596206:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.596218:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596224:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596234:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532058.596241:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468000640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841339us (841360us total) trans 158913793062 rc 0/0
00000100:00100000:0.0:1651532058.596245:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3209
00000100:00100000:1.0:1651532058.596256:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468000512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841481us (841539us total) trans 158913793061 rc 0/0
00010000:00010000:0.0:1651532058.596258:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.596259:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3208
00010000:00010000:0.0:1651532058.596262:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532058.596263:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.596266:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596267:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596271:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532058.596272:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.596272:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596286:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.596289:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af1c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4411392->5353471] (req 4411392->5353471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596292:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.596293:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.596294:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596297:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596315:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596318:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af15 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1839104->3256319] (req 1839104->3256319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596324:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596327:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.596621:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532058.596629:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532058.596630:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468002240
00000100:00100000:0.0:1651532058.596638:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468002304
00000100:00100000:1.0:1651532058.596645:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3217
00000100:00100000:1.0:1651532058.596647:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468002240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532058.596655:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532058.596656:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3218
00000100:00100000:0.0:1651532058.596658:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468002304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532058.596659:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532058.596660:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596663:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532058.596664:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596668:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.596674:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.596679:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532058.596680:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532058.596681:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.596684:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.596695:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532058.762860:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793063 is committed
00010000:00010000:1.0:1651532058.762893:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.762898:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.762921:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468000832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 910892us (910920us total) trans 158913793063 rc 0/0
00010000:00010000:0.0:1651532058.762921:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.762925:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3210
00010000:00010000:0.0:1651532058.762925:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532058.762926:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.762930:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.762935:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532058.762936:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532058.762937:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.762940:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.762957:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.762960:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40af23 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->8970239] (req 1327104->8970239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.762968:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.762973:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.763169:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532058.763178:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468002624
00000100:00100000:1.0:1651532058.763191:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3219
00000100:00100000:1.0:1651532058.763193:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468002624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532058.763201:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.763205:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532058.763213:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.763216:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532058.763217:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.763221:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.763225:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532058.848129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532058.848138:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229888
00000100:00100000:0.0:1651532058.848148:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 48
00000100:00100000:0.0:1651532058.848150:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229888:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532058.848155:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1691648 granted 355992128 pending 143360 free 81138851840 avail 76966019072
00000100:00100000:0.0:1651532058.848174:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229888:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (46us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532058.848177:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 48
00000001:00080000:0.0:1651532058.870784:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793064 is committed
00010000:00010000:1.0:1651532058.870821:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.870825:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.870845:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468001024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 935574us (935606us total) trans 158913793064 rc 0/0
00010000:00010000:0.0:1651532058.870848:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.870849:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3211
00010000:00010000:0.0:1651532058.870853:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532058.870854:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.870858:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.870863:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532058.870872:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532058.870873:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.870876:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.870883:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532058.870886:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40af2a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->3379199] (req 831488->3379199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.870902:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.870907:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.871053:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532058.871071:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468002816
00000100:00100000:1.0:1651532058.871085:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3220
00000100:00100000:1.0:1651532058.871087:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468002816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532058.871108:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.871118:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532058.871119:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.871122:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532058.871123:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.871127:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.871130:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532058.929589:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793065 is committed
00002000:00010000:1.0:1651532058.929616:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532057 -> 1651532058
00002000:00010000:1.0:1651532058.929618:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532057 -> 1651532058
00010000:00010000:1.0:1651532058.929620:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929624:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.929641:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468001216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 907816us (907862us total) trans 158913793065 rc 0/0
00000100:00100000:1.0:1651532058.929653:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3212
00010000:00010000:1.0:1651532058.929661:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929664:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532058.929665:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929668:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929673:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.929674:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.929675:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929678:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929681:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.929682:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532058.929682:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929685:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929692:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929704:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af31 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10117119] (req 2936832->10117119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929710:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929712:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929767:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.929771:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532058.930053:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532058.930060:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468003072
00000100:00100000:1.0:1651532058.930089:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3221
00000100:00100000:1.0:1651532058.930091:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468003072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532058.930099:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.930103:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532058.930104:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.930107:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532058.930115:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.930120:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532058.930124:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532059.021335:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793067 is committed
00010000:00010000:1.0:1651532059.021369:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.021373:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.021396:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468001600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774758us (774807us total) trans 158913793066 rc 0/0
00010000:00010000:0.0:1651532059.021397:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.021399:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3214
00010000:00010000:0.0:1651532059.021401:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532059.021402:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021406:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.021412:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021412:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021415:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40af3f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7450624->7454719] (req 7450624->7454719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.021416:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.021430:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468001408:12345-10.240.43.64@tcp:4:fio. Request processed in 874816us (874912us total) trans 158913793067 rc 0/0
00000100:00100000:1.0:1651532059.021433:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3213
00010000:00010000:0.0:1651532059.021437:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021440:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532059.021441:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021444:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021447:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.021448:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.021449:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021452:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021462:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021465:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40af38 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [319488->6975487] (req 319488->6975487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.021484:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.021499:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.021802:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532059.021826:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532059.021834:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468003200
00000100:00100000:1.0:1651532059.021847:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468003328
00000100:00100000:0.0:1651532059.021851:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3222
00000100:00100000:0.0:1651532059.021854:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468003200:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532059.021858:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3223
00000100:00100000:1.0:1651532059.021860:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468003328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532059.021867:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021869:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.021872:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532059.021873:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.021876:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532059.021876:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021881:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532059.021882:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021885:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532059.021886:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.021889:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021890:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.021893:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.021893:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532059.147598:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793068 is committed
00010000:00010000:1.0:1651532059.147629:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.147641:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.147661:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468001856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 776741us (776768us total) trans 158913793068 rc 0/0
00000100:00100000:1.0:1651532059.147664:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3215
00010000:00010000:1.0:1651532059.147672:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.147675:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532059.147676:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.147679:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.147684:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532059.147685:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532059.147686:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.147689:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.147696:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.147699:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af46 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->6782975] (req 1900544->6782975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.147712:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.147715:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.148070:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532059.148086:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468003520
00000100:00100000:1.0:1651532059.148098:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3224
00000100:00100000:1.0:1651532059.148099:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468003520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532059.148107:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.148111:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532059.148112:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.148115:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532059.148116:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.148120:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.148123:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532059.272937:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793069 is committed
00010000:00010000:1.0:1651532059.272967:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.272971:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.272990:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.272994:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468002048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 792696us (792736us total) trans 158913793069 rc 0/0
00010000:00010000:0.0:1651532059.272995:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532059.272996:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.272997:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3216
00010000:00010000:0.0:1651532059.273000:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.273005:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.273006:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.273015:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.273019:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.273022:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.273023:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.273023:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.273026:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.273037:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.273040:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40af4d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->9854975] (req 20480->9854975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.273046:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.273049:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.273051:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.273055:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.273575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532059.273678:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468003712
00000100:00100000:1.0:1651532059.273689:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3225
00000100:00100000:1.0:1651532059.273691:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468003712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532059.273698:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.273703:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532059.273704:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.273707:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532059.273715:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.273720:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.273724:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532059.380942:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793071 is committed
00010000:00010000:0.0:1651532059.380963:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.380968:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.380981:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.380991:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532059.380998:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468002304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 784338us (784369us total) trans 158913793070 rc 0/0
00000100:00100000:0.0:1651532059.381001:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3218
00000100:00100000:1.0:1651532059.381012:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468002240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 784364us (784392us total) trans 158913793071 rc 0/0
00010000:00010000:0.0:1651532059.381015:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.381016:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3217
00010000:00010000:0.0:1651532059.381019:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532059.381020:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.381023:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381024:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381028:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532059.381029:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.381029:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381032:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.381032:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40af5b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381038:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532059.381047:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532059.381048:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381051:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381059:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381062:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40af54 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->10440703] (req 286720->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.381066:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.381070:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.381303:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532059.381313:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468003904
00000100:00100000:1.0:1651532059.381327:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3226
00000100:00100000:1.0:1651532059.381329:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468003904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532059.381336:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381340:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532059.381341:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381344:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532059.381345:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381349:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.381362:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532059.381416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532059.381424:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468004032
00000100:00100000:0.0:1651532059.381456:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3227
00000100:00100000:0.0:1651532059.381458:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468004032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532059.381466:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.381471:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532059.381472:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.381475:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532059.381476:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.381480:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.381484:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532059.472664:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793072 is committed
00010000:00010000:0.0:1651532059.472679:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.472682:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532059.472705:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468002624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 709510us (709536us total) trans 158913793072 rc 0/0
00000100:00100000:0.0:1651532059.472708:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3219
00010000:00010000:0.0:1651532059.472724:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.472727:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532059.472728:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.472731:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.472736:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.472737:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.472738:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.472741:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.472751:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.472754:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40af62 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->9248767] (req 3231744->9248767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.472763:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.472768:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.472945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532059.472961:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468004288
00000100:00100000:0.0:1651532059.472977:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3228
00000100:00100000:0.0:1651532059.472979:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468004288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532059.472986:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.473000:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532059.473002:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.473004:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532059.473005:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.473010:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.473013:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532059.580982:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793073 is committed
00010000:00010000:1.0:1651532059.581010:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581015:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.581032:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468002816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 709944us (709979us total) trans 158913793073 rc 0/0
00000100:00100000:1.0:1651532059.581036:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3220
00010000:00010000:1.0:1651532059.581043:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581046:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532059.581047:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581050:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581064:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532059.581065:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532059.581066:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581069:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581076:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581079:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40af69 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2781184->7319551] (req 2781184->7319551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581084:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581087:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.581516:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532059.581525:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468004544
00000100:00100000:1.0:1651532059.581536:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3229
00000100:00100000:1.0:1651532059.581538:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468004544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532059.581545:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581550:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532059.581560:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581563:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532059.581563:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581568:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.581571:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532059.639409:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793074 is committed
00010000:00010000:1.0:1651532059.639439:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.639443:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.639464:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468003072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 709372us (709411us total) trans 158913793074 rc 0/0
00000100:00100000:1.0:1651532059.639467:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3221
00010000:00010000:0.0:1651532059.639467:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.639472:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532059.639473:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.639476:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.639482:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.639482:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.639490:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.639494:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.639501:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.639504:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40af70 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2797568->7262207] (req 2797568->7262207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.639519:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.639523:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.639708:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532059.639730:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468004736
00000100:00100000:1.0:1651532059.639747:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3230
00000100:00100000:1.0:1651532059.639749:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468004736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532059.639757:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.639761:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532059.639762:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.639765:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532059.639765:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.639769:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.639773:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532059.731085:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793075 is committed
00002000:00010000:1.0:1651532059.731111:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532058 -> 1651532059
00002000:00010000:1.0:1651532059.731113:0:330280:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532058 -> 1651532059
00010000:00010000:1.0:1651532059.731115:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.731119:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.731140:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468003328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 709279us (709314us total) trans 158913793075 rc 0/0
00010000:00010000:0.0:1651532059.731141:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.731146:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532059.731147:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.731150:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.731152:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3223
00010000:00010000:0.0:1651532059.731155:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.731156:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.731157:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.731160:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.731178:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.731181:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40af77 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2826240->9601023] (req 2826240->9601023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.731184:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.731196:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.731416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532059.731424:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468004928
00000100:00100000:1.0:1651532059.731434:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3231
00000100:00100000:1.0:1651532059.731436:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468004928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532059.731443:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.731447:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532059.731448:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.731451:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532059.731452:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.731456:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.731459:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532059.797883:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793076 is committed
00010000:00010000:1.0:1651532059.797912:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.797916:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.797933:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468003200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 776079us (776132us total) trans 158913793076 rc 0/0
00000100:00100000:1.0:1651532059.797937:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3222
00010000:00010000:1.0:1651532059.797943:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.797946:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532059.797947:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.797950:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.797955:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532059.797956:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532059.797957:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.797959:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.797978:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.797981:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40af7e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10219519] (req 1646592->10219519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.797987:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.797990:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.798290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532059.798299:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468005184
00000100:00100000:1.0:1651532059.798321:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3232
00000100:00100000:1.0:1651532059.798323:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468005184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532059.798330:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.798334:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532059.798335:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.798338:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532059.798338:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.798343:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.798355:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532059.971035:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793077 is committed
00010000:00010000:1.0:1651532059.971065:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.971069:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.971087:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.971090:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468003520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 822990us (823021us total) trans 158913793077 rc 0/0
00010000:00010000:0.0:1651532059.971093:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532059.971094:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3224
00010000:00010000:0.0:1651532059.971094:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.971097:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.971103:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.971104:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532059.971105:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.971108:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.971121:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.971126:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.971130:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532059.971139:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40af85 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->3547135] (req 2502656->3547135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532059.971409:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532059.971426:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468005504
00000100:00100000:1.0:1651532059.971437:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3233
00000100:00100000:1.0:1651532059.971439:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468005504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532059.971446:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.971450:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532059.971459:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.971462:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532059.971463:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.971468:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532059.971471:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532060.089431:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793078 is committed
00010000:00010000:1.0:1651532060.089461:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.089465:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.089486:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468003712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 815794us (815911us total) trans 158913793078 rc 0/0
00010000:00010000:0.0:1651532060.089487:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.089489:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3225
00010000:00010000:0.0:1651532060.089492:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532060.089493:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.089496:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.089502:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.089502:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.089503:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.089506:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.089519:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.089524:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40af8c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->2564095] (req 2560000->2564095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.089535:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.089539:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.089794:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532060.089903:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468005696
00000100:00100000:1.0:1651532060.089914:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3234
00000100:00100000:1.0:1651532060.089916:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468005696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532060.089924:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.089928:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532060.089929:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.089932:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532060.089932:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.089937:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.089940:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532060.156148:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793079 is committed
00010000:00010000:1.0:1651532060.156176:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.156180:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.156197:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468003904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774868us (774894us total) trans 158913793079 rc 0/0
00000100:00100000:1.0:1651532060.156200:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3226
00010000:00010000:1.0:1651532060.156216:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.156219:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532060.156220:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.156223:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.156228:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532060.156229:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532060.156229:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.156232:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.156244:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.156247:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40af93 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->9392127] (req 909312->9392127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.156257:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.156261:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.156817:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532060.156826:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468005824
00000100:00100000:1.0:1651532060.156835:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3235
00000100:00100000:1.0:1651532060.156837:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468005824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532060.156844:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.156855:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532060.156856:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532060.156857:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.156860:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532060.247881:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793080 is committed
00010000:00010000:0.0:1651532060.247896:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.247900:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532060.247925:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468004032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866465us (866509us total) trans 158913793080 rc 0/0
00000100:00100000:0.0:1651532060.247928:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3227
00010000:00010000:0.0:1651532060.247936:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.247940:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532060.247941:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.247944:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.247965:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.247966:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.247967:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.247972:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.247982:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.247985:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40af9a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7471104->9388031] (req 7471104->9388031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.247991:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.247994:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.248165:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532060.248218:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468006016
00000100:00100000:0.0:1651532060.248234:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3236
00000100:00100000:0.0:1651532060.248236:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468006016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532060.248244:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.248255:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532060.248264:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.248267:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.248270:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532060.248270:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.248285:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.248290:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.248295:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532060.314585:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793081 is committed
00010000:00010000:0.0:1651532060.314600:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.314604:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532060.314627:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468004288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841647us (841682us total) trans 158913793081 rc 0/0
00000100:00100000:0.0:1651532060.314630:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3228
00010000:00010000:0.0:1651532060.314646:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.314649:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532060.314651:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.314656:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.314664:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.314665:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.314666:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.314672:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.314684:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.314687:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40afa1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->10444799] (req 811008->10444799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.314690:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.314695:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.315167:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532060.315187:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468006208
00000100:00100000:0.0:1651532060.315203:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3237
00000100:00100000:0.0:1651532060.315205:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468006208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532060.315213:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.315228:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532060.315229:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.315232:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532060.315232:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.315237:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.315240:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532060.398018:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793082 is committed
00010000:00010000:1.0:1651532060.398047:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398051:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.398068:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468004544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816530us (816553us total) trans 158913793082 rc 0/0
00000100:00100000:1.0:1651532060.398071:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3229
00010000:00010000:1.0:1651532060.398078:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398093:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532060.398095:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398098:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398103:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532060.398104:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532060.398105:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398108:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398115:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398118:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afa8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->8646655] (req 1331200->8646655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398124:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398126:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.398462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532060.398484:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468006400
00000100:00100000:1.0:1651532060.398494:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3238
00000100:00100000:1.0:1651532060.398496:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468006400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532060.398504:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398508:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532060.398509:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398512:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532060.398527:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398533:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.398536:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532060.522991:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793083 is committed
00010000:00010000:1.0:1651532060.523022:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.523026:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.523048:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468004736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 883298us (883340us total) trans 158913793083 rc 0/0
00010000:00010000:0.0:1651532060.523049:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.523052:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3230
00010000:00010000:0.0:1651532060.523054:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532060.523055:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.523058:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.523064:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.523064:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.523072:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.523076:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.523088:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.523093:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40afaf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4132864->10432511] (req 4132864->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.523094:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.523105:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.523321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532060.523408:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468006592
00000100:00100000:1.0:1651532060.523419:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3239
00000100:00100000:1.0:1651532060.523421:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468006592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532060.523428:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.523433:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532060.523434:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.523436:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532060.523437:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.523442:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.523445:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532060.647984:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793084 is committed
00010000:00010000:1.0:1651532060.648013:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648028:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.648046:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468004928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 916609us (916630us total) trans 158913793084 rc 0/0
00000100:00100000:1.0:1651532060.648049:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3231
00010000:00010000:1.0:1651532060.648056:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648059:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532060.648060:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648063:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648068:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532060.648069:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532060.648069:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648072:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648079:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648082:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40afb6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1146880->9674751] (req 1146880->9674751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648095:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648098:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.648381:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532060.648397:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468006784
00000100:00100000:1.0:1651532060.648407:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3240
00000100:00100000:1.0:1651532060.648421:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468006784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532060.648429:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648433:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532060.648434:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648437:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532060.648438:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648442:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.648445:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532060.747989:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793085 is committed
00010000:00010000:1.0:1651532060.748018:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.748023:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.748044:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468005184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 949721us (949755us total) trans 158913793085 rc 0/0
00010000:00010000:0.0:1651532060.748045:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.748047:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3232
00010000:00010000:0.0:1651532060.748050:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532060.748051:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.748054:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.748060:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.748060:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.748061:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.748064:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.748089:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.748092:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40afbd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->7987199] (req 282624->7987199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.748102:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.748106:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.748364:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532060.748374:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468006976
00000100:00100000:1.0:1651532060.748390:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3241
00000100:00100000:1.0:1651532060.748392:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468006976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532060.748399:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.748421:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532060.748423:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.748426:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532060.748436:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.748441:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.748445:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532060.839699:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793086 is committed
00010000:00010000:1.0:1651532060.839730:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.839734:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.839753:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.839756:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468005504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 868316us (868348us total) trans 158913793086 rc 0/0
00010000:00010000:0.0:1651532060.839757:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532060.839758:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.839760:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3233
00010000:00010000:0.0:1651532060.839762:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.839767:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.839768:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.839768:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.839771:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.839775:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.839775:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532060.839776:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.839791:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.839813:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.839819:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.839822:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.839822:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40afc4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->9969663] (req 471040->9969663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.839833:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.839836:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532060.840026:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532060.840055:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468007168
00000100:00100000:1.0:1651532060.840067:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3242
00000100:00100000:1.0:1651532060.840068:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468007168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532060.840089:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.840094:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532060.840095:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532060.840095:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.840098:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532060.964678:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793088 is committed
00010000:00010000:0.0:1651532060.964700:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.964704:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.964709:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.964718:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532060.964727:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468005696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 874809us (874933us total) trans 158913793088 rc 0/0
00000100:00100000:0.0:1651532060.964737:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3234
00000100:00100000:1.0:1651532060.964742:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468005824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 807904us (807939us total) trans 158913793087 rc 0/0
00000100:00100000:1.0:1651532060.964745:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3235
00010000:00010000:0.0:1651532060.964745:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.964753:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.964757:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532060.964758:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.964760:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532060.964761:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.964761:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.964764:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.964770:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.964773:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40afcb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->4042751] (req 1363968->4042751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.964775:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532060.964776:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532060.964777:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.964780:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.964789:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.964792:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40afd2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.964816:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.964820:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532060.965152:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532060.965176:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468007360
00000100:00100000:0.0:1651532060.965178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532060.965188:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468007488
00000100:00100000:0.0:1651532060.965189:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3243
00000100:00100000:0.0:1651532060.965192:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468007360:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532060.965199:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3244
00000100:00100000:1.0:1651532060.965201:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468007488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532060.965207:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.965208:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.965212:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532060.965213:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.965216:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.965229:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532060.965229:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.965234:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532060.965242:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532060.965243:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532060.965247:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.965247:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.965250:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532060.965254:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532061.098031:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793089 is committed
00002000:00010000:1.0:1651532061.098062:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532059 -> 1651532060
00010000:00010000:1.0:1651532061.098065:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.098069:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.098092:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468006016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849855us (849927us total) trans 158913793089 rc 0/0
00010000:00010000:0.0:1651532061.098092:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.098096:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3236
00010000:00010000:0.0:1651532061.098097:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532061.098098:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.098101:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.098106:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532061.098107:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532061.098108:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.098123:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.098135:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.098140:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40afd9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->9801727] (req 245760->9801727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.098147:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.098150:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.098369:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532061.098384:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468007680
00000100:00100000:1.0:1651532061.098395:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3245
00000100:00100000:1.0:1651532061.098397:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468007680:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532061.098404:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.098408:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532061.098409:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.098412:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.098425:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532061.098425:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.098430:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.098433:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.098436:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532061.256336:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793090 is committed
00010000:00010000:0.0:1651532061.256352:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256356:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532061.256374:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468006208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 941168us (941207us total) trans 158913793090 rc 0/0
00000100:00100000:0.0:1651532061.256378:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3237
00010000:00010000:0.0:1651532061.256385:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256400:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532061.256401:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256404:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256409:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532061.256410:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532061.256411:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256414:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256426:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256429:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40afe0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->5357567] (req 1318912->5357567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.256440:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.256444:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.256761:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532061.256782:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468007872
00000100:00100000:0.0:1651532061.256795:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3246
00000100:00100000:0.0:1651532061.256797:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468007872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532061.256823:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256838:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532061.256839:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256842:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532061.256843:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256848:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.256851:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532061.348021:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793091 is committed
00010000:00010000:1.0:1651532061.348050:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348055:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.348077:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468006400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 949579us (949615us total) trans 158913793091 rc 0/0
00000100:00100000:1.0:1651532061.348089:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3238
00010000:00010000:1.0:1651532061.348097:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348100:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532061.348101:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348104:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348109:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.348110:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.348111:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348114:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348130:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348134:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40afe7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348139:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348143:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532061.348598:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532061.348669:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468008064
00000100:00100000:1.0:1651532061.348681:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3247
00000100:00100000:1.0:1651532061.348683:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468008064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532061.348690:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348695:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532061.348695:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348698:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532061.348699:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348703:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.348707:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532061.511614:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793092 is committed
00010000:00010000:1.0:1651532061.511645:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.511649:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.511670:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468006592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 988248us (988349us total) trans 158913793092 rc 0/0
00010000:00010000:0.0:1651532061.511674:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.511679:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532061.511680:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.511682:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3239
00010000:00010000:0.0:1651532061.511684:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.511691:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532061.511699:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532061.511700:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.511703:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.511716:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.511722:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.511722:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40afee lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1368064->6946815] (req 1368064->6946815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.511733:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.511948:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532061.512049:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468008256
00000100:00100000:1.0:1651532061.512061:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3248
00000100:00100000:1.0:1651532061.512063:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468008256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532061.512070:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.512075:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532061.512076:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.512079:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532061.512079:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.512084:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.512087:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532061.586811:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793093 is committed
00010000:00010000:1.0:1651532061.586841:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586845:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.586863:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468006784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 938442us (938483us total) trans 158913793093 rc 0/0
00000100:00100000:1.0:1651532061.586866:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3240
00010000:00010000:1.0:1651532061.586873:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586876:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532061.586877:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586880:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586885:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.586886:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.586886:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586889:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586904:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.586905:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.586905:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586908:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586916:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586919:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40aff5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->8699903] (req 2027520->8699903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586924:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586927:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586947:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.586950:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.587241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532061.587257:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468008448
00000100:00100000:1.0:1651532061.587302:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3249
00000100:00100000:1.0:1651532061.587304:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468008448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532061.587312:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.587316:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532061.587317:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.587320:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532061.587321:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.587325:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.587328:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532061.719696:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793095 is committed
00010000:00010000:1.0:1651532061.719728:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719735:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.719758:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.719760:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468006976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 971366us (971395us total) trans 158913793094 rc 0/0
00000100:00100000:1.0:1651532061.719764:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3241
00010000:00010000:0.0:1651532061.719764:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532061.719765:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.719769:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.719775:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719777:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.719778:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40affc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->6230015] (req 286720->6230015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719791:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.719821:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468007168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 879751us (879795us total) trans 158913793095 rc 0/0
00000100:00100000:1.0:1651532061.719824:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3242
00010000:00010000:1.0:1651532061.719837:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719840:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532061.719842:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719845:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719859:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.719860:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.719861:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719864:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719867:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.719868:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.719869:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719882:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719896:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719899:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b003 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8204288->10084351] (req 8204288->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719905:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.719906:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.719908:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.719910:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.720197:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532061.720227:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532061.720243:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468008640
00000100:00100000:1.0:1651532061.720253:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468008768
00000100:00100000:1.0:1651532061.720259:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3250
00000100:00100000:1.0:1651532061.720261:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468008640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532061.720268:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.720273:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532061.720274:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.720300:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532061.720301:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.720306:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.720310:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532061.720321:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3251
00000100:00100000:0.0:1651532061.720325:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468008768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532061.720336:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.720342:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532061.720344:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.720348:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532061.720349:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.720356:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.720362:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532061.786385:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793097 is committed
00010000:00010000:0.0:1651532061.786406:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.786418:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786423:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786433:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532061.786439:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468007360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 821246us (821288us total) trans 158913793097 rc 0/0
00000100:00100000:0.0:1651532061.786448:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3243
00000100:00100000:1.0:1651532061.786453:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468007488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 821251us (821275us total) trans 158913793096 rc 0/0
00010000:00010000:0.0:1651532061.786456:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.786457:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3244
00010000:00010000:0.0:1651532061.786460:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532061.786461:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.786464:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786465:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786469:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532061.786469:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786470:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.786472:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b00a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->9977855] (req 1126400->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786473:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786487:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.786488:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.786489:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786492:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786500:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786503:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b011 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->1126399] (req 1122304->1126399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.786508:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.786512:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532061.786775:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532061.786818:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532061.786828:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468009024
00000100:00100000:1.0:1651532061.786843:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468009152
00000100:00100000:0.0:1651532061.786848:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3252
00000100:00100000:0.0:1651532061.786850:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468009024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532061.786857:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.786859:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3253
00000100:00100000:1.0:1651532061.786861:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468009152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532061.786861:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532061.786862:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532061.786863:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.786866:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786868:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786872:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532061.786873:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532061.786874:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.786877:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532061.869811:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793098 is committed
00010000:00010000:0.0:1651532061.869825:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.869829:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532061.869851:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468007680:12345-10.240.43.64@tcp:4:fio.0 Request processed in 771453us (771483us total) trans 158913793098 rc 0/0
00010000:00010000:1.0:1651532061.869852:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532061.869855:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3245
00010000:00010000:1.0:1651532061.869857:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532061.869858:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.869861:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.869867:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.869868:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532061.869869:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.869872:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.869881:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.869885:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b018 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->2486271] (req 49152->2486271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.869892:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.869907:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532061.870078:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532061.870087:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468009408
00000100:00100000:0.0:1651532061.870118:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3254
00000100:00100000:0.0:1651532061.870120:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468009408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532061.870127:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.870131:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532061.870132:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.870135:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.870138:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.870140:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532061.870141:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.870145:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.870165:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.870167:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.870171:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532061.961476:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793099 is committed
00002000:00010000:0.0:1651532061.961490:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532060 -> 1651532061
00010000:00010000:0.0:1651532061.961493:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.961496:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532061.961514:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468007872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 704716us (704753us total) trans 158913793099 rc 0/0
00000100:00100000:0.0:1651532061.961517:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3246
00010000:00010000:0.0:1651532061.961524:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.961528:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532061.961529:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.961543:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.961548:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532061.961549:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532061.961550:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.961553:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.961565:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.961568:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b01f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->10055679] (req 573440->10055679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.961576:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532061.961580:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532061.962122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532061.962143:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468009600
00000100:00100000:0.0:1651532061.962160:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3255
00000100:00100000:0.0:1651532061.962162:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468009600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532061.962169:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.962173:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532061.962174:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.962177:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532061.962185:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.962190:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532061.962194:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532062.028434:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793100 is committed
00010000:00010000:1.0:1651532062.028462:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028467:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.028490:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468008064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 679806us (679893us total) trans 158913793100 rc 0/0
00000100:00100000:1.0:1651532062.028493:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3247
00010000:00010000:1.0:1651532062.028501:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028504:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532062.028506:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028509:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028513:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.028514:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.028515:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028518:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028542:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028545:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b026 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6414336->9486335] (req 6414336->9486335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028551:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028554:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532062.028755:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532062.028776:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468009792
00000100:00100000:1.0:1651532062.028796:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3256
00000100:00100000:1.0:1651532062.028798:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468009792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.028821:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028825:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532062.028826:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028829:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532062.028830:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028834:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.028845:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532062.141397:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793101 is committed
00010000:00010000:1.0:1651532062.141428:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.141432:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.141456:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468008256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 629391us (629508us total) trans 158913793101 rc 0/0
00000100:00100000:1.0:1651532062.141459:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3248
00010000:00010000:1.0:1651532062.141467:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.141470:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532062.141471:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.141474:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.141479:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.141480:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.141481:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.141502:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.141511:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.141514:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b02d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->8200191] (req 610304->8200191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.141519:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.141522:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532062.141961:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532062.142040:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468009984
00000100:00100000:1.0:1651532062.142057:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3257
00000100:00100000:1.0:1651532062.142059:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468009984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.142066:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.142070:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.142071:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.142074:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532062.142075:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.142099:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.142103:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532062.186616:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793102 is committed
00010000:00010000:1.0:1651532062.186643:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.186647:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.186668:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468008448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599363us (599427us total) trans 158913793102 rc 0/0
00010000:00010000:0.0:1651532062.186670:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.186671:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3249
00010000:00010000:0.0:1651532062.186675:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532062.186676:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.186680:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.186685:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532062.186686:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532062.186687:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.186690:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.186704:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.186706:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.186708:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b034 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1921024->8785919] (req 1921024->8785919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.186718:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.186979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532062.186996:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468010176
00000100:00100000:1.0:1651532062.187012:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3258
00000100:00100000:1.0:1651532062.187014:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468010176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.187021:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.187034:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532062.187035:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.187037:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532062.187038:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.187056:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.187060:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532062.286676:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793103 is committed
00010000:00010000:1.0:1651532062.286704:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286708:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.286725:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468008640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566463us (566529us total) trans 158913793103 rc 0/0
00000100:00100000:1.0:1651532062.286728:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3250
00010000:00010000:1.0:1651532062.286734:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286738:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532062.286739:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286750:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286755:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.286756:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.286757:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286760:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286763:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.286764:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.286764:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286767:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286770:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.286770:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.286771:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286773:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286786:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286797:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b03b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8364031] (req 323584->8364031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.286799:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.286811:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286818:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.286821:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.286838:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.286842:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532062.287311:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532062.287324:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468010368
00000100:00100000:1.0:1651532062.287339:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3259
00000100:00100000:1.0:1651532062.287341:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468010368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.287348:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.287353:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532062.287354:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.287357:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532062.287357:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.287362:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.287365:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532062.378346:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793106 is committed
00010000:00010000:0.0:1651532062.378369:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378373:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378378:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378388:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532062.378395:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468009024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 591544us (591620us total) trans 158913793106 rc 0/0
00000100:00100000:1.0:1651532062.378410:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468009152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 591547us (591607us total) trans 158913793104 rc 0/0
00000100:00100000:0.0:1651532062.378411:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3252
00000100:00100000:1.0:1651532062.378413:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3253
00010000:00010000:0.0:1651532062.378419:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378421:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378422:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532062.378423:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378424:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532062.378425:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378426:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378428:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378433:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378435:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378435:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b049 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7397376->9945087] (req 7397376->9945087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378438:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b050 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->1368063] (req 1363968->1368063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378447:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378450:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532062.378467:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754468008768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 658143us (658241us total) trans 158913793105 rc 0/0
00000100:00100000:0.0:1651532062.378470:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3251
00010000:00010000:1.0:1651532062.378495:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378501:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532062.378502:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378510:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378515:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.378515:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.378516:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378520:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378531:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378533:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b042 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1880064->5464063] (req 1880064->5464063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378556:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378568:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532062.378865:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532062.378888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532062.378898:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468010560
00000100:00100000:0.0:1651532062.378908:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468010688
00000100:00100000:0.0:1651532062.378920:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3260
00000100:00100000:1.0:1651532062.378924:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3261
00000100:00100000:1.0:1651532062.378927:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468010688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.378935:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532062.378935:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468010560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.378939:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532062.378943:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378948:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378951:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532062.378952:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378956:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532062.378958:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378961:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532062.378961:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378965:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378966:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.378968:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.378969:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532062.379081:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532062.379106:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468010880
00000100:00100000:1.0:1651532062.379121:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3262
00000100:00100000:1.0:1651532062.379123:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468010880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.379129:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.379132:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532062.379133:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.379136:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532062.379137:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.379141:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.379154:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532062.503388:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793107 is committed
00010000:00010000:0.0:1651532062.503404:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.503408:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532062.503430:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468009408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 633309us (633353us total) trans 158913793107 rc 0/0
00000100:00100000:0.0:1651532062.503433:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3254
00010000:00010000:0.0:1651532062.503441:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.503444:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532062.503445:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.503448:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.503453:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532062.503454:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532062.503454:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.503457:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.503464:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.503476:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.503476:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b057 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->10346495] (req 180224->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.503481:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532062.504046:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532062.504055:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468011072
00000100:00100000:0.0:1651532062.504065:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3263
00000100:00100000:0.0:1651532062.504067:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468011072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532062.504074:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.504078:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532062.504079:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.504082:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532062.504083:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.504087:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.504090:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532062.620033:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793108 is committed
00010000:00010000:1.0:1651532062.620060:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620064:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.620081:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468009600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 657918us (657959us total) trans 158913793108 rc 0/0
00000100:00100000:1.0:1651532062.620084:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3255
00010000:00010000:1.0:1651532062.620091:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620094:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532062.620095:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620098:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620112:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.620113:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.620114:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620117:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620124:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620127:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b05e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9842688->9900031] (req 9842688->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620132:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620135:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.620498:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532062.620508:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468011264
00000100:00100000:1.0:1651532062.620523:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3264
00000100:00100000:1.0:1651532062.620525:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468011264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.620532:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620536:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532062.620545:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620548:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532062.620548:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620553:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.620557:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532062.679714:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793109 is committed
00010000:00010000:1.0:1651532062.679743:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.679747:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.679767:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468009792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 650968us (651012us total) trans 158913793109 rc 0/0
00010000:00010000:0.0:1651532062.679769:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.679770:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3256
00010000:00010000:0.0:1651532062.679781:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532062.679782:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.679785:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.679791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532062.679791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532062.679792:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.679795:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.679815:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.679818:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b065 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9990143] (req 24576->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.679827:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.679831:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.680364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532062.680388:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468011456
00000100:00100000:1.0:1651532062.680403:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3265
00000100:00100000:1.0:1651532062.680405:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468011456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.680413:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.680417:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532062.680418:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.680421:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532062.680421:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.680426:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.680429:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532062.779742:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793110 is committed
00002000:00010000:1.0:1651532062.779772:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532061 -> 1651532062
00010000:00010000:1.0:1651532062.779775:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.779779:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.779797:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468009984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 637738us (637837us total) trans 158913793110 rc 0/0
00000100:00100000:1.0:1651532062.779825:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3257
00010000:00010000:0.0:1651532062.779836:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.779840:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532062.779841:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.779854:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.779860:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532062.779860:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532062.779861:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.779864:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.779873:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532062.779876:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b06c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->1892351] (req 36864->1892351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.779879:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.779884:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.780104:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532062.780120:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468011648
00000100:00100000:1.0:1651532062.780138:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3266
00000100:00100000:1.0:1651532062.780140:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468011648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.780146:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.780151:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532062.780152:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.780155:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532062.780155:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.780159:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.780163:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532062.913100:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793111 is committed
00010000:00010000:1.0:1651532062.913128:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913132:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.913149:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468010176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 726135us (726171us total) trans 158913793111 rc 0/0
00000100:00100000:1.0:1651532062.913153:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3258
00010000:00010000:1.0:1651532062.913159:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913163:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532062.913164:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913167:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913172:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.913172:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532062.913173:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913176:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913182:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913194:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b073 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9535487] (req 376832->9535487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913200:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913203:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532062.913771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532062.913780:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468011840
00000100:00100000:1.0:1651532062.913797:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3267
00000100:00100000:1.0:1651532062.913799:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468011840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532062.913822:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913827:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532062.913828:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913831:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532062.913831:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913835:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532062.913849:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532063.004759:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793112 is committed
00010000:00010000:1.0:1651532063.004787:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.004791:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.004814:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.004819:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532063.004820:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.004822:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468010368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 717480us (717512us total) trans 158913793112 rc 0/0
00010000:00010000:0.0:1651532063.004823:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.004825:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3259
00010000:00010000:0.0:1651532063.004839:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.004840:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.004841:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.004844:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.004854:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.004857:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b07a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3452928->8744959] (req 3452928->8744959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.004869:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.004874:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.005160:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532063.005176:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468012032
00000100:00100000:1.0:1651532063.005192:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3268
00000100:00100000:1.0:1651532063.005194:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468012032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532063.005201:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.005205:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532063.005227:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.005230:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532063.005231:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.005236:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.005239:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532063.090229:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793113 is committed
00002000:00010000:1.0:1651532063.090257:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532059 -> 1651532062
00010000:00010000:1.0:1651532063.090260:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.090263:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.090292:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.090295:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468010688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 711367us (711406us total) trans 158913793113 rc 0/0
00000100:00100000:1.0:1651532063.090298:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3261
00010000:00010000:0.0:1651532063.090299:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532063.090300:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.090306:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.090313:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.090314:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.090315:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.090330:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.090341:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.090346:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b081 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10252287] (req 2035712->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.090355:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.090360:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.090550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532063.090577:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468012224
00000100:00100000:1.0:1651532063.090590:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3269
00000100:00100000:1.0:1651532063.090592:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468012224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532063.090599:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.090610:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532063.090611:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532063.090612:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.090615:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532063.196518:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793114 is committed
00010000:00010000:0.0:1651532063.196533:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.196537:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.196558:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468010560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 817622us (817693us total) trans 158913793114 rc 0/0
00010000:00010000:1.0:1651532063.196560:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.196561:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3260
00010000:00010000:1.0:1651532063.196564:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532063.196565:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.196569:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.196574:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532063.196574:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532063.196575:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.196578:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.196586:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.196598:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.196604:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b088 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1929216->9756671] (req 1929216->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.196613:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.196825:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532063.196891:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468012544
00000100:00100000:0.0:1651532063.196907:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3270
00000100:00100000:0.0:1651532063.196909:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468012544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532063.196917:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.196921:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532063.196922:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.196925:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532063.196926:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.196930:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.196934:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532063.288208:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793115 is committed
00010000:00010000:0.0:1651532063.288223:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288237:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.288255:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468010880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 909131us (909174us total) trans 158913793115 rc 0/0
00000100:00100000:0.0:1651532063.288258:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3262
00010000:00010000:0.0:1651532063.288265:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288269:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532063.288270:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288273:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288290:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.288291:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.288292:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288295:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288302:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288305:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b08f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3256320->8310783] (req 3256320->8310783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288318:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288321:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.288682:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532063.288690:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468012736
00000100:00100000:0.0:1651532063.288706:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3271
00000100:00100000:0.0:1651532063.288708:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468012736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532063.288715:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288720:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532063.288721:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288724:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532063.288724:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288729:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.288732:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532063.354906:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793116 is committed
00010000:00010000:0.0:1651532063.354921:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.354925:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.354947:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468011072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 850879us (850902us total) trans 158913793116 rc 0/0
00000100:00100000:0.0:1651532063.354950:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3263
00010000:00010000:0.0:1651532063.354958:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.354961:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532063.354962:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.354965:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.354971:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.354971:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.354972:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.354975:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.354993:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.354996:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b096 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->9986047] (req 1810432->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.355000:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.355005:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.355176:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532063.355187:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468012928
00000100:00100000:0.0:1651532063.355202:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3272
00000100:00100000:0.0:1651532063.355204:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468012928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532063.355211:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.355215:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532063.355216:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.355219:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.355221:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532063.355222:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.355226:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.355229:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.355240:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532063.438321:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793117 is committed
00010000:00010000:1.0:1651532063.438351:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438355:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.438377:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468011264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 817851us (817886us total) trans 158913793117 rc 0/0
00000100:00100000:1.0:1651532063.438381:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3264
00010000:00010000:1.0:1651532063.438388:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438392:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532063.438393:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438396:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438418:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532063.438419:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532063.438420:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438424:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438431:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438434:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b09d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5226496->10452991] (req 5226496->10452991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438440:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438443:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.438598:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532063.438617:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468013120
00000100:00100000:1.0:1651532063.438629:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3273
00000100:00100000:1.0:1651532063.438631:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468013120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532063.438638:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438649:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532063.438657:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438661:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532063.438661:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438666:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.438669:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532063.538322:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793118 is committed
00010000:00010000:1.0:1651532063.538354:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.538359:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.538379:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468011456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 857973us (858016us total) trans 158913793118 rc 0/0
00000100:00100000:1.0:1651532063.538383:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3265
00010000:00010000:0.0:1651532063.538383:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.538388:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532063.538389:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.538393:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.538399:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.538400:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.538400:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.538403:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.538413:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.538416:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0a4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->8761343] (req 28672->8761343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.538430:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.538434:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.538933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532063.538949:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468013312
00000100:00100000:1.0:1651532063.538960:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3274
00000100:00100000:1.0:1651532063.538962:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468013312:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532063.538969:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.538973:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532063.538974:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.538977:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532063.538978:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.538982:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.538985:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532063.663357:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793119 is committed
00010000:00010000:1.0:1651532063.663386:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663390:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.663408:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468011648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 883268us (883305us total) trans 158913793119 rc 0/0
00000100:00100000:1.0:1651532063.663412:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3266
00010000:00010000:1.0:1651532063.663428:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663432:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532063.663433:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663436:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663441:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532063.663441:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532063.663442:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663445:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663452:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663455:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0ab lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4984832->5701631] (req 4984832->5701631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663460:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663463:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.663736:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532063.663831:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468013504
00000100:00100000:1.0:1651532063.663842:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3275
00000100:00100000:1.0:1651532063.663844:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468013504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532063.663852:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663856:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532063.663857:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663860:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532063.663861:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663865:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.663868:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532063.763341:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793120 is committed
00010000:00010000:1.0:1651532063.763367:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.763372:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.763403:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468011840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849603us (849639us total) trans 158913793120 rc 0/0
00010000:00010000:0.0:1651532063.763404:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.763407:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3267
00010000:00010000:0.0:1651532063.763409:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532063.763410:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.763413:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.763419:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.763419:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.763420:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.763423:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.763426:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.763427:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.763428:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.763430:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.763440:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.763450:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b0b2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9785343] (req 356352->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.763454:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.763458:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.763460:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.763463:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.763958:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532063.763974:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468013696
00000100:00100000:1.0:1651532063.763985:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3276
00000100:00100000:1.0:1651532063.763987:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468013696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532063.763994:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.763998:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532063.763999:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.764002:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532063.764002:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.764006:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.764022:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532063.880078:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793122 is committed
00002000:00010000:0.0:1651532063.880098:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532062 -> 1651532063
00002000:00010000:0.0:1651532063.880099:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532062 -> 1651532063
00010000:00010000:0.0:1651532063.880102:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.880106:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880111:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880116:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.880126:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468012224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 789533us (789576us total) trans 158913793121 rc 0/0
00000100:00100000:0.0:1651532063.880130:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3269
00000100:00100000:1.0:1651532063.880138:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468012032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 874943us (874979us total) trans 158913793122 rc 0/0
00010000:00010000:0.0:1651532063.880138:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.880141:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3268
00010000:00010000:0.0:1651532063.880141:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532063.880143:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880149:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880153:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532063.880154:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.880154:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880159:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.880160:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.880163:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b0c0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880164:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532063.880165:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532063.880166:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880180:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880190:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880193:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b0b9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5505024->9973759] (req 5505024->9973759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.880202:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.880206:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.880435:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532063.880459:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468013888
00000100:00100000:1.0:1651532063.880474:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3277
00000100:00100000:1.0:1651532063.880476:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468013888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532063.880483:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880487:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532063.880488:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880491:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532063.880492:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880496:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532063.880499:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.880571:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532063.880580:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468014016
00000100:00100000:0.0:1651532063.880594:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3278
00000100:00100000:0.0:1651532063.880596:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468014016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532063.880603:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.880608:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532063.880609:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.880628:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532063.880630:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.880637:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.880642:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532063.968121:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532063.968144:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230080
00000100:00100000:0.0:1651532063.968156:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 49
00000100:00100000:0.0:1651532063.968158:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230080:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532063.968164:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1490944 granted 355619392 pending 172032 free 81138851840 avail 76967194624
00000100:00100000:0.0:1651532063.968178:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230080:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 20us (58us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532063.968181:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 49
00000001:00080000:0.0:1651532063.988410:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793123 is committed
00010000:00010000:0.0:1651532063.988427:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.988431:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.988455:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468012544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791544us (791676us total) trans 158913793123 rc 0/0
00000100:00100000:0.0:1651532063.988468:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3270
00010000:00010000:0.0:1651532063.988476:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.988480:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532063.988481:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.988484:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.988489:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.988490:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.988491:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.988499:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.988512:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.988518:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b0c7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->8564735] (req 475136->8564735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.988527:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.988533:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532063.988802:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532063.988954:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468014144
00000100:00100000:0.0:1651532063.988979:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3279
00000100:00100000:0.0:1651532063.988982:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468014144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532063.989006:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.989014:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532063.989015:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.989020:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532063.989021:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.989029:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532063.989050:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532064.105054:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793124 is committed
00010000:00010000:0.0:1651532064.105070:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105075:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532064.105110:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468012736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816401us (816428us total) trans 158913793124 rc 0/0
00000100:00100000:0.0:1651532064.105113:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3271
00010000:00010000:0.0:1651532064.105121:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105125:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532064.105126:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105129:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105134:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.105135:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.105136:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105139:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105146:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105150:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b0ce lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->8216575] (req 2363392->8216575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.105156:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.105161:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.105399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532064.105420:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468014464
00000100:00100000:0.0:1651532064.105449:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3280
00000100:00100000:0.0:1651532064.105451:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468014464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532064.105458:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105463:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532064.105464:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105467:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532064.105468:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105472:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.105476:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532064.198813:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793125 is committed
00010000:00010000:1.0:1651532064.198848:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.198854:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.198875:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468012928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 843671us (843700us total) trans 158913793125 rc 0/0
00000100:00100000:1.0:1651532064.198879:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3272
00010000:00010000:1.0:1651532064.198887:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.198891:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532064.198892:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.198896:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.198914:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532064.198915:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532064.198916:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.198919:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.198926:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.198929:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b0d5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9760767] (req 331776->9760767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.198935:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.198938:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.199309:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532064.199319:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468014656
00000100:00100000:1.0:1651532064.199330:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3281
00000100:00100000:1.0:1651532064.199332:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468014656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532064.199340:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.199346:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532064.199357:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.199360:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532064.199361:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.199366:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.199370:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532064.323823:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793126 is committed
00010000:00010000:1.0:1651532064.323856:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.323861:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.323880:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.323885:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468013120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 885252us (885287us total) trans 158913793126 rc 0/0
00000100:00100000:1.0:1651532064.323888:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3273
00010000:00010000:0.0:1651532064.323890:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532064.323891:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.323895:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.323909:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.323910:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.323911:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.323914:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.323924:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.323927:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b0dc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->10350591] (req 983040->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.323939:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.323944:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.324158:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532064.324233:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468014848
00000100:00100000:1.0:1651532064.324245:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3282
00000100:00100000:1.0:1651532064.324247:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468014848:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532064.324254:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.324258:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532064.324259:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.324262:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532064.324263:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.324267:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.324271:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532064.407194:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793127 is committed
00010000:00010000:1.0:1651532064.407223:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.407228:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.407250:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468013312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 868287us (868317us total) trans 158913793127 rc 0/0
00010000:00010000:0.0:1651532064.407251:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.407253:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3274
00010000:00010000:0.0:1651532064.407255:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532064.407256:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.407259:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.407265:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.407266:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.407267:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.407277:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.407301:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.407306:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b0e3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6782976->8450047] (req 6782976->8450047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.407316:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.407321:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.407570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532064.407651:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468015040
00000100:00100000:1.0:1651532064.407662:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3283
00000100:00100000:1.0:1651532064.407664:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468015040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532064.407672:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.407676:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532064.407677:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.407680:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532064.407681:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.407685:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.407688:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532064.507173:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793128 is committed
00010000:00010000:1.0:1651532064.507205:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507220:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.507240:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468013504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 843394us (843509us total) trans 158913793128 rc 0/0
00000100:00100000:1.0:1651532064.507243:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3275
00010000:00010000:1.0:1651532064.507250:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507254:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532064.507255:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507258:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507263:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532064.507263:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532064.507264:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507267:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507274:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507277:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b0ea lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10174463] (req 167936->10174463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507300:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507303:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.507578:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532064.507586:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468015232
00000100:00100000:1.0:1651532064.507609:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3284
00000100:00100000:1.0:1651532064.507611:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468015232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532064.507618:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507623:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532064.507624:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507626:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532064.507627:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507631:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.507634:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532064.615531:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793129 is committed
00010000:00010000:1.0:1651532064.615562:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.615567:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.615585:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.615589:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468013696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 851601us (851631us total) trans 158913793129 rc 0/0
00010000:00010000:0.0:1651532064.615590:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532064.615591:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.615592:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3276
00010000:00010000:0.0:1651532064.615594:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.615600:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.615600:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.615601:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.615604:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.615622:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.615625:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b0f1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3579904->8142847] (req 3579904->8142847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.615632:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.615636:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.615912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532064.615989:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468015424
00000100:00100000:1.0:1651532064.616001:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3285
00000100:00100000:1.0:1651532064.616002:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468015424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532064.616010:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.616014:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532064.616015:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.616018:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532064.616027:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.616032:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.616036:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532064.723877:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793130 is committed
00010000:00010000:1.0:1651532064.723907:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.723912:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.723929:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468013888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 843452us (843495us total) trans 158913793130 rc 0/0
00000100:00100000:1.0:1651532064.723933:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3277
00010000:00010000:1.0:1651532064.723939:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.723943:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532064.723944:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.723947:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.723952:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532064.723961:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532064.723962:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.723965:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.723977:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.723980:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b0f8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->10350591] (req 1142784->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.723990:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.723995:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.724261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532064.724293:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468015616
00000100:00100000:1.0:1651532064.724305:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3286
00000100:00100000:1.0:1651532064.724306:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468015616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532064.724313:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.724318:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532064.724319:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.724322:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532064.724322:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.724327:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532064.724343:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532064.840550:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793131 is committed
00010000:00010000:0.0:1651532064.840566:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.840570:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532064.840593:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468014016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 959996us (960022us total) trans 158913793131 rc 0/0
00000100:00100000:0.0:1651532064.840597:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3278
00010000:00010000:0.0:1651532064.840605:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.840608:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532064.840617:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.840621:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.840626:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.840627:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.840628:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.840631:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.840639:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.840642:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b0ff lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->2281471] (req 524288->2281471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.840647:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.840650:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.840945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532064.840959:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468015808
00000100:00100000:0.0:1651532064.840975:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3287
00000100:00100000:0.0:1651532064.840977:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468015808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532064.840993:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.840997:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532064.840998:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.841001:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532064.841002:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.841006:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.841010:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532064.923936:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793132 is committed
00010000:00010000:0.0:1651532064.923951:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.923955:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532064.923977:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468014144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 934994us (935176us total) trans 158913793132 rc 0/0
00000100:00100000:0.0:1651532064.923980:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3279
00010000:00010000:0.0:1651532064.923987:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.923998:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532064.924000:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924003:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924008:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.924009:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532064.924009:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924012:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924020:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924023:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b106 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1396736->1400831] (req 1396736->1400831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924028:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924031:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532064.924218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532064.924242:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468016000
00000100:00100000:0.0:1651532064.924268:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3288
00000100:00100000:0.0:1651532064.924270:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468016000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532064.924277:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924296:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532064.924297:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924302:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532064.924303:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924310:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532064.924316:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532065.040636:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793133 is committed
00010000:00010000:0.0:1651532065.040651:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.040655:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.040677:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468014464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 935225us (935279us total) trans 158913793133 rc 0/0
00010000:00010000:1.0:1651532065.040680:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.040681:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3280
00010000:00010000:1.0:1651532065.040685:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532065.040686:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.040689:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.040695:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532065.040696:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532065.040697:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.040700:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.040707:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.040711:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b10d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9277439] (req 593920->9277439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.040726:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.040730:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.041072:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532065.041101:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468016128
00000100:00100000:0.0:1651532065.041116:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3289
00000100:00100000:0.0:1651532065.041118:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468016128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532065.041126:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.041131:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532065.041132:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.041135:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532065.041135:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.041140:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.041143:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532065.157266:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793134 is committed
00002000:00010000:0.0:1651532065.157290:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532063 -> 1651532064
00010000:00010000:0.0:1651532065.157294:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157305:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.157323:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468014656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 957990us (958015us total) trans 158913793134 rc 0/0
00000100:00100000:0.0:1651532065.157327:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3281
00010000:00010000:0.0:1651532065.157334:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157337:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532065.157338:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157341:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157346:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.157347:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.157348:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157350:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157363:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157375:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b114 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->10469375] (req 1941504->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.157376:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.157381:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.157768:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532065.157777:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468016384
00000100:00100000:0.0:1651532065.157791:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3290
00000100:00100000:0.0:1651532065.157793:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468016384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532065.157801:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157819:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532065.157820:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157823:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532065.157824:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157828:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.157832:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532065.215669:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793135 is committed
00010000:00010000:1.0:1651532065.215696:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.215701:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.215722:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468014848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 891475us (891565us total) trans 158913793135 rc 0/0
00010000:00010000:0.0:1651532065.215723:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.215726:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3282
00010000:00010000:0.0:1651532065.215738:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532065.215739:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.215742:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.215748:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.215748:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.215749:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.215752:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.215762:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.215765:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b11b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->4931583] (req 3039232->4931583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.215772:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.215776:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.215951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532065.215960:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468016576
00000100:00100000:1.0:1651532065.215976:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3291
00000100:00100000:1.0:1651532065.215978:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468016576:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532065.215993:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.215998:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532065.215999:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.216002:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532065.216003:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.216007:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.216011:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532065.290720:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793136 is committed
00010000:00010000:1.0:1651532065.290751:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.290756:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.290774:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468015040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 883108us (883204us total) trans 158913793136 rc 0/0
00000100:00100000:1.0:1651532065.290777:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3283
00010000:00010000:1.0:1651532065.290784:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.290798:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532065.290800:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.290819:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.290825:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532065.290826:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532065.290826:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.290830:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.290837:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.290840:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b122 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10133503] (req 110592->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.290846:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.290849:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.291111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532065.291119:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468016768
00000100:00100000:1.0:1651532065.291130:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3292
00000100:00100000:1.0:1651532065.291144:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468016768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532065.291151:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.291156:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532065.291157:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.291160:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532065.291160:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.291165:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.291168:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532065.374106:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793137 is committed
00010000:00010000:1.0:1651532065.374135:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.374139:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.374160:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.374161:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468015232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866550us (866584us total) trans 158913793137 rc 0/0
00000100:00100000:1.0:1651532065.374164:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3284
00010000:00010000:0.0:1651532065.374166:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532065.374167:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.374177:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.374183:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.374184:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.374185:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.374188:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.374198:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.374201:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b129 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->7778303] (req 2105344->7778303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.374212:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.374215:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.374417:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532065.374425:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468016960
00000100:00100000:1.0:1651532065.374441:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3293
00000100:00100000:1.0:1651532065.374443:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468016960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532065.374450:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.374455:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532065.374456:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.374458:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532065.374459:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.374464:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.374467:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532065.442173:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793138 is committed
00010000:00010000:0.0:1651532065.442189:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442194:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.442226:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468015424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 826222us (826314us total) trans 158913793138 rc 0/0
00000100:00100000:0.0:1651532065.442229:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3285
00010000:00010000:0.0:1651532065.442238:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442241:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532065.442242:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442245:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442251:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.442251:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.442252:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442255:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442265:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442268:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b130 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->9490431] (req 1171456->9490431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.442277:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.442292:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.442778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532065.442798:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468017152
00000100:00100000:0.0:1651532065.442824:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3294
00000100:00100000:0.0:1651532065.442826:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468017152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532065.442833:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442838:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532065.442839:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442842:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532065.442843:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442847:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.442850:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.468858:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4acdd69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966863232:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651532065.469127:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4acdd69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966863232:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:0.0:1651532065.525501:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793139 is committed
00010000:00010000:1.0:1651532065.525530:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525543:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.525562:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468015616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 801254us (801301us total) trans 158913793139 rc 0/0
00000100:00100000:1.0:1651532065.525565:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3286
00010000:00010000:1.0:1651532065.525572:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525575:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532065.525577:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525580:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525585:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532065.525585:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532065.525586:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525589:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525601:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525604:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b137 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3944448->8327167] (req 3944448->8327167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.525610:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.525625:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.525887:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532065.525895:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468017344
00000100:00100000:1.0:1651532065.525905:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3295
00000100:00100000:1.0:1651532065.525907:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468017344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532065.525914:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525918:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532065.525919:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525922:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532065.525923:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525927:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.525930:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532065.700465:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793140 is committed
00010000:00010000:0.0:1651532065.700481:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700485:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.700508:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468015808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 859530us (859563us total) trans 158913793140 rc 0/0
00000100:00100000:0.0:1651532065.700512:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3287
00010000:00010000:0.0:1651532065.700519:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700523:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532065.700524:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700527:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700532:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.700533:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.700533:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700547:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700555:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700558:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b13e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9584639] (req 61440->9584639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700564:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700566:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.700758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532065.700825:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468017536
00000100:00100000:0.0:1651532065.700839:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3296
00000100:00100000:0.0:1651532065.700841:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468017536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532065.700848:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700853:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532065.700854:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700856:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532065.700857:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700878:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.700881:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532065.783862:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793141 is committed
00010000:00010000:0.0:1651532065.783878:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.783882:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.783906:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468016000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 859635us (859689us total) trans 158913793141 rc 0/0
00010000:00010000:1.0:1651532065.783908:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.783910:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3288
00010000:00010000:1.0:1651532065.783913:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532065.783914:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.783926:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.783932:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532065.783932:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532065.783933:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.783936:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.783951:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.783953:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.783955:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b145 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2367488->8843263] (req 2367488->8843263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.783957:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.784133:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532065.784161:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468017728
00000100:00100000:0.0:1651532065.784176:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3297
00000100:00100000:0.0:1651532065.784177:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468017728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532065.784185:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.784197:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532065.784198:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.784201:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532065.784202:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.784206:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.784210:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532065.858878:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793142 is committed
00010000:00010000:0.0:1651532065.858893:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.858897:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.858914:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468016128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 817794us (817842us total) trans 158913793142 rc 0/0
00000100:00100000:0.0:1651532065.858917:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3289
00010000:00010000:0.0:1651532065.858924:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.858928:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532065.858937:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.858940:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.858946:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.858946:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.858947:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.858950:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.858958:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.858961:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b14c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5828608->5832703] (req 5828608->5832703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.858966:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.858969:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.859299:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532065.859311:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468017920
00000100:00100000:0.0:1651532065.859329:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3298
00000100:00100000:0.0:1651532065.859332:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468017920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532065.859351:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.859357:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.859359:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.859364:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532065.859365:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.859371:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.859393:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532065.917291:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793143 is committed
00002000:00010000:0.0:1651532065.917306:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532064 -> 1651532065
00010000:00010000:0.0:1651532065.917309:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.917312:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532065.917348:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468016384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 759553us (759579us total) trans 158913793143 rc 0/0
00000100:00100000:0.0:1651532065.917353:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3290
00010000:00010000:0.0:1651532065.917377:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.917383:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532065.917384:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.917389:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.917397:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.917398:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532065.917399:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.917405:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.917425:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.917430:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b153 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->6143999] (req 1892352->6143999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.917435:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532065.917439:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532065.917700:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532065.917720:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468018048
00000100:00100000:0.0:1651532065.917736:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3299
00000100:00100000:0.0:1651532065.917738:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468018048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532065.917746:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.917761:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532065.917762:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532065.917762:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532065.917766:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532066.033972:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793144 is committed
00010000:00010000:1.0:1651532066.034000:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034015:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.034038:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468016576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 818059us (818087us total) trans 158913793144 rc 0/0
00000100:00100000:1.0:1651532066.034042:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3291
00010000:00010000:1.0:1651532066.034049:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034053:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532066.034054:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034057:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034062:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532066.034063:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532066.034063:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034066:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.034082:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034084:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034087:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b15a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->9764863] (req 12288->9764863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.034087:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532066.034319:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532066.034331:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468018240
00000100:00100000:1.0:1651532066.034346:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3300
00000100:00100000:1.0:1651532066.034348:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468018240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532066.034356:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034360:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532066.034361:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034364:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034367:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532066.034367:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034371:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034374:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.034377:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532066.158936:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793145 is committed
00010000:00010000:0.0:1651532066.158952:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.158956:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532066.158979:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468016768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 867834us (867868us total) trans 158913793145 rc 0/0
00000100:00100000:0.0:1651532066.158982:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3292
00010000:00010000:0.0:1651532066.158990:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.159002:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532066.159003:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.159006:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.159012:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.159012:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.159013:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.159016:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.159023:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.159026:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b161 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1159168->8368127] (req 1159168->8368127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.159033:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.159046:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.159200:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532066.159218:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468018432
00000100:00100000:0.0:1651532066.159251:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3301
00000100:00100000:0.0:1651532066.159253:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468018432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532066.159260:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.159275:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532066.159276:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.159292:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532066.159293:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.159300:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.159306:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532066.292295:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793146 is committed
00010000:00010000:1.0:1651532066.292326:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.292331:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.292353:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468016960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 917909us (917936us total) trans 158913793146 rc 0/0
00010000:00010000:0.0:1651532066.292354:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.292356:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3293
00010000:00010000:0.0:1651532066.292359:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532066.292360:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.292364:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.292369:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.292370:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.292371:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.292382:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.292390:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.292393:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b168 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9990143] (req 475136->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.292399:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.292402:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.292591:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532066.292609:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468018624
00000100:00100000:1.0:1651532066.292620:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3302
00000100:00100000:1.0:1651532066.292622:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468018624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532066.292629:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.292633:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532066.292634:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.292637:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532066.292638:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.292655:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.292658:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532066.392313:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793147 is committed
00010000:00010000:0.0:1651532066.392332:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.392338:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.392363:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532066.392370:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468017152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 949542us (949591us total) trans 158913793147 rc 0/0
00010000:00010000:1.0:1651532066.392372:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532066.392373:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.392376:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532066.392376:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3294
00010000:00010000:1.0:1651532066.392382:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532066.392382:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532066.392383:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.392386:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.392393:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.392396:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b16f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8126464->9416703] (req 8126464->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.392410:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.392421:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532066.392652:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532066.392661:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468018816
00000100:00100000:0.0:1651532066.392681:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3303
00000100:00100000:0.0:1651532066.392683:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468018816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532066.392691:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.392696:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532066.392697:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.392699:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532066.392700:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.392704:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.392708:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532066.484045:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793148 is committed
00010000:00010000:1.0:1651532066.484075:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.484080:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.484101:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468017344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 958192us (958214us total) trans 158913793148 rc 0/0
00000100:00100000:1.0:1651532066.484104:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3295
00010000:00010000:0.0:1651532066.484104:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.484108:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532066.484110:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.484113:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.484129:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.484130:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.484131:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.484134:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.484142:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.484145:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b176 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->9924607] (req 598016->9924607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.484151:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.484154:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.484358:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532066.484367:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468019008
00000100:00100000:1.0:1651532066.484382:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3304
00000100:00100000:1.0:1651532066.484384:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468019008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532066.484391:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.484396:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532066.484397:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.484400:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532066.484408:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.484413:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.484417:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532066.600690:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793149 is committed
00010000:00010000:0.0:1651532066.600705:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.600710:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532066.600733:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468017536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 899891us (899975us total) trans 158913793149 rc 0/0
00000100:00100000:0.0:1651532066.600744:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3296
00010000:00010000:0.0:1651532066.600753:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.600756:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532066.600757:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.600760:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.600766:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.600766:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.600767:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.600770:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.600777:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.600780:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b17d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5656576->6332415] (req 5656576->6332415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.600785:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.600788:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.600964:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532066.600990:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468019200
00000100:00100000:0.0:1651532066.601006:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3305
00000100:00100000:0.0:1651532066.601008:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468019200:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532066.601016:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.601020:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532066.601021:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.601024:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532066.601025:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.601029:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.601032:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532066.733982:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793150 is committed
00010000:00010000:0.0:1651532066.733998:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734002:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532066.734036:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468017728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 949858us (949903us total) trans 158913793150 rc 0/0
00000100:00100000:0.0:1651532066.734040:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3297
00010000:00010000:0.0:1651532066.734048:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734051:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532066.734052:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734055:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734060:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.734061:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.734062:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734065:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734068:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.734069:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.734069:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734072:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734090:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734093:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b184 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->10088447] (req 770048->10088447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734099:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734102:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734156:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734160:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.734257:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532066.734313:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468019392
00000100:00100000:0.0:1651532066.734332:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3306
00000100:00100000:0.0:1651532066.734335:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468019392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532066.734344:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734351:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.734352:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734371:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532066.734372:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734380:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.734383:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532066.800695:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793152 is committed
00010000:00010000:0.0:1651532066.800711:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800715:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532066.800738:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468018048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 882998us (883038us total) trans 158913793151 rc 0/0
00000100:00100000:0.0:1651532066.800741:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3299
00010000:00010000:0.0:1651532066.800749:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800752:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532066.800754:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800767:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800773:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800776:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b192 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7651328->7655423] (req 7651328->7655423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.800791:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.800795:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.800830:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468017920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 941498us (941533us total) trans 158913793152 rc 0/0
00000100:00100000:1.0:1651532066.800833:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3298
00010000:00010000:0.0:1651532066.800853:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800857:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532066.800858:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800861:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800866:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.800867:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.800867:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800871:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800882:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.800892:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b18b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6238208->6287359] (req 6238208->6287359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.800897:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.800901:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.800978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532066.800993:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468019584
00000100:00100000:1.0:1651532066.801009:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3307
00000100:00100000:1.0:1651532066.801019:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468019584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532066.801026:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.801031:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532066.801032:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.801035:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532066.801035:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.801047:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.801051:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.801107:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532066.801124:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468019712
00000100:00100000:0.0:1651532066.801139:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3308
00000100:00100000:0.0:1651532066.801141:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468019712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532066.801148:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.801152:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532066.801153:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.801156:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532066.801157:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.801161:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.801164:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532066.917403:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793153 is committed
00010000:00010000:1.0:1651532066.917439:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.917444:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.917466:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468018240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 883117us (883148us total) trans 158913793153 rc 0/0
00010000:00010000:0.0:1651532066.917467:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.917470:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3300
00010000:00010000:0.0:1651532066.917482:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532066.917484:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.917487:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.917493:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.917493:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.917494:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.917497:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.917506:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.917509:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b199 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->10125311] (req 1380352->10125311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.917519:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.917524:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.917724:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532066.917818:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468019904
00000100:00100000:1.0:1651532066.917838:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3309
00000100:00100000:1.0:1651532066.917840:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468019904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532066.917847:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.917852:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532066.917853:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532066.917854:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.917857:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532066.984107:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793154 is committed
00002000:00010000:1.0:1651532066.984136:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532065 -> 1651532066
00010000:00010000:1.0:1651532066.984139:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.984143:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.984165:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468018432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824911us (824965us total) trans 158913793154 rc 0/0
00010000:00010000:0.0:1651532066.984165:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.984169:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532066.984171:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.984176:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3301
00010000:00010000:0.0:1651532066.984184:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.984190:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.984190:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532066.984191:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.984194:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.984204:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532066.984207:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1a0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->8478719] (req 344064->8478719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.984222:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.984226:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532066.984594:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532066.984603:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468020224
00000100:00100000:1.0:1651532066.984620:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3310
00000100:00100000:1.0:1651532066.984622:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468020224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532066.984629:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.984634:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532066.984634:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.984637:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.984640:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532066.984641:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.984645:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.984658:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532066.984662:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532067.042513:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793155 is committed
00010000:00010000:1.0:1651532067.042542:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.042546:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.042567:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468018624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749945us (749977us total) trans 158913793155 rc 0/0
00010000:00010000:0.0:1651532067.042569:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.042571:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3302
00010000:00010000:0.0:1651532067.042573:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532067.042574:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.042578:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.042593:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.042594:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.042595:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.042598:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.042606:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.042609:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b1a7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->10342399] (req 348160->10342399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.042614:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.042617:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.042792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532067.042821:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468020416
00000100:00100000:1.0:1651532067.042834:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3311
00000100:00100000:1.0:1651532067.042836:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468020416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532067.042842:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.042853:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532067.042854:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.042867:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532067.042868:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.042873:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.042876:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532067.109221:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793156 is committed
00010000:00010000:0.0:1651532067.109237:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109241:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532067.109265:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468018816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716580us (716613us total) trans 158913793156 rc 0/0
00000100:00100000:0.0:1651532067.109277:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3303
00010000:00010000:0.0:1651532067.109298:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109304:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532067.109305:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109310:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109318:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.109319:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.109321:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109325:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109341:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109346:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1ae lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->8572927] (req 184320->8572927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.109353:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.109358:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.109554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532067.109579:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468020608
00000100:00100000:0.0:1651532067.109591:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3312
00000100:00100000:0.0:1651532067.109593:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468020608:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532067.109609:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109613:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532067.109614:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109617:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532067.109618:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109622:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.109625:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532067.209303:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793157 is committed
00010000:00010000:1.0:1651532067.209332:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.209337:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.209359:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468019008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724974us (725001us total) trans 158913793157 rc 0/0
00010000:00010000:0.0:1651532067.209360:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.209362:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3304
00010000:00010000:0.0:1651532067.209365:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532067.209366:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.209369:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.209374:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.209382:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.209383:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.209386:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.209395:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.209398:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b1b5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->4235263] (req 2039808->4235263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.209403:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.209406:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.209584:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532067.209601:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468020800
00000100:00100000:1.0:1651532067.209619:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3313
00000100:00100000:1.0:1651532067.209620:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468020800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532067.209628:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.209632:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532067.209633:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.209636:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532067.209637:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.209641:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.209644:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532067.354585:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793158 is committed
00010000:00010000:0.0:1651532067.354601:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.354605:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532067.354628:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468019200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 753618us (753664us total) trans 158913793158 rc 0/0
00000100:00100000:0.0:1651532067.354632:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3305
00010000:00010000:0.0:1651532067.354639:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.354651:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532067.354652:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.354655:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.354660:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.354661:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.354662:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.354665:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.354672:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.354675:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b1bc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9224191] (req 335872->9224191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.354681:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.354684:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.355189:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532067.355201:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468020992
00000100:00100000:0.0:1651532067.355224:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3314
00000100:00100000:0.0:1651532067.355226:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468020992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532067.355233:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.355238:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532067.355239:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.355242:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532067.355242:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.355247:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.355250:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532067.454604:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793159 is committed
00010000:00010000:0.0:1651532067.454619:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.454623:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532067.454646:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468019392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 720311us (720396us total) trans 158913793159 rc 0/0
00000100:00100000:0.0:1651532067.454650:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3306
00010000:00010000:0.0:1651532067.454665:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.454669:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532067.454670:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.454673:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.454678:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.454679:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.454679:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.454683:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.454692:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.454695:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b1c3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3923968->4743167] (req 3923968->4743167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.454706:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.454711:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.454972:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532067.454983:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468021184
00000100:00100000:0.0:1651532067.454998:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3315
00000100:00100000:0.0:1651532067.455000:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468021184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532067.455013:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.455026:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532067.455026:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.455029:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532067.455030:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.455034:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.455038:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532067.554617:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793160 is committed
00010000:00010000:1.0:1651532067.554647:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.554660:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.554683:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468019584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 753663us (753705us total) trans 158913793160 rc 0/0
00010000:00010000:0.0:1651532067.554683:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.554686:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3307
00010000:00010000:0.0:1651532067.554688:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532067.554689:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.554692:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.554698:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.554698:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.554699:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.554709:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.554713:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.554713:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.554714:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.554717:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.554728:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.554731:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b1ca lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->10354687] (req 372736->10354687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.554737:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.554740:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.554740:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.554744:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.555154:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532067.555225:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468021376
00000100:00100000:1.0:1651532067.555237:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3316
00000100:00100000:1.0:1651532067.555239:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468021376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532067.555245:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.555250:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532067.555251:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.555254:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532067.555255:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.555271:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.555275:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532067.646310:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793162 is committed
00010000:00010000:0.0:1651532067.646330:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646334:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.646346:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.646350:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532067.646369:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468019712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 845227us (845261us total) trans 158913793161 rc 0/0
00000100:00100000:0.0:1651532067.646373:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3308
00000100:00100000:1.0:1651532067.646374:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468019904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 728533us (728658us total) trans 158913793162 rc 0/0
00000100:00100000:1.0:1651532067.646378:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3309
00010000:00010000:0.0:1651532067.646381:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646384:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532067.646385:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646388:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646394:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646396:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b1d1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5603328->5607423] (req 5603328->5607423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646399:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646402:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532067.646403:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646406:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646418:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.646418:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.646419:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646422:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646428:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646431:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b1d8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4235264->4624383] (req 4235264->4624383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.646435:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.646439:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.646701:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532067.646732:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532067.646750:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468021568
00000100:00100000:0.0:1651532067.646765:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468021696
00000100:00100000:0.0:1651532067.646774:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3317
00000100:00100000:0.0:1651532067.646776:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ba6d97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468021568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532067.646782:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646787:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532067.646788:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646790:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532067.646791:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646819:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.646823:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.646836:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3318
00000100:00100000:1.0:1651532067.646838:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fae720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468021696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532067.646846:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.646859:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532067.646860:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.646863:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532067.646863:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.646868:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.646871:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532067.782279:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793163 is committed
00010000:00010000:1.0:1651532067.782318:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782322:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.782339:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468020224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 797717us (797753us total) trans 158913793163 rc 0/0
00000100:00100000:1.0:1651532067.782342:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3310
00010000:00010000:1.0:1651532067.782349:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782353:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532067.782362:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782366:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782371:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532067.782372:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532067.782373:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782376:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782383:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782386:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b1df lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7544831] (req 503808->7544831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782391:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782394:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.782779:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532067.782797:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468021888
00000100:00100000:1.0:1651532067.782821:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3319
00000100:00100000:1.0:1651532067.782823:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061a71a54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468021888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532067.782838:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782842:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532067.782843:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532067.782844:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.782847:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532067.849007:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793164 is committed
00010000:00010000:1.0:1651532067.849039:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.849043:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.849065:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468020416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 806228us (806273us total) trans 158913793164 rc 0/0
00010000:00010000:0.0:1651532067.849066:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.849068:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3311
00010000:00010000:0.0:1651532067.849071:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532067.849072:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.849076:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.849082:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.849083:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.849084:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.849087:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.849095:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.849109:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b1e6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8962047] (req 1097728->8962047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.849114:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.849119:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.849314:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532067.849406:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468022080
00000100:00100000:1.0:1651532067.849427:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3320
00000100:00100000:1.0:1651532067.849429:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d07119c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468022080:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532067.849436:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.849441:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532067.849442:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.849445:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.849447:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532067.849448:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.849466:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.849469:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.849472:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532067.899337:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793165 is committed
00002000:00010000:1.0:1651532067.899366:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532066 -> 1651532067
00010000:00010000:1.0:1651532067.899369:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.899383:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.899402:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.899406:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468020608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 789812us (789853us total) trans 158913793165 rc 0/0
00010000:00010000:0.0:1651532067.899407:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532067.899408:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.899409:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3312
00010000:00010000:0.0:1651532067.899412:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.899417:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.899418:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532067.899419:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.899422:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.899433:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532067.899436:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b1ed lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->10084351] (req 2564096->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.899450:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.899455:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532067.899691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532067.899782:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468022272
00000100:00100000:1.0:1651532067.899793:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3321
00000100:00100000:1.0:1651532067.899795:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1985841 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468022272:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532067.899817:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.899822:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532067.899823:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.899826:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532067.899826:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.899842:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532067.899845:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.011756:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793166 is committed
00010000:00010000:1.0:1651532068.011785:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.011789:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.011825:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468020800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 802203us (802240us total) trans 158913793166 rc 0/0
00000100:00100000:1.0:1651532068.011828:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3313
00010000:00010000:1.0:1651532068.011835:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.011838:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532068.011840:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.011843:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.011848:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532068.011849:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532068.011857:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.011861:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.011872:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.011875:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b1f4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9666559] (req 1134592->9666559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.011884:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.011889:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.012164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532068.012173:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468022528
00000100:00100000:1.0:1651532068.012187:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3322
00000100:00100000:1.0:1651532068.012189:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1b6dbbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468022528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532068.012196:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.012200:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532068.012201:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.012204:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532068.012205:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.012209:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.012223:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.057502:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793167 is committed
00010000:00010000:0.0:1651532068.057518:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057522:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.057546:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468020992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 702318us (702357us total) trans 158913793167 rc 0/0
00000100:00100000:0.0:1651532068.057549:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3314
00010000:00010000:0.0:1651532068.057557:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057561:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532068.057562:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057565:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057581:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.057582:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.057583:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057586:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057593:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057596:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b1fb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->6602751] (req 356352->6602751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057602:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057605:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.057763:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532068.057798:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468022656
00000100:00100000:0.0:1651532068.057822:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3323
00000100:00100000:0.0:1651532068.057824:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f09b247 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468022656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532068.057831:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057836:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532068.057850:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057853:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532068.057854:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057859:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.057862:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.157556:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793168 is committed
00010000:00010000:0.0:1651532068.157572:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157576:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.157599:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468021184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 702598us (702640us total) trans 158913793168 rc 0/0
00000100:00100000:0.0:1651532068.157602:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3315
00010000:00010000:0.0:1651532068.157610:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157614:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532068.157615:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157628:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157634:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.157634:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.157635:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157638:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157648:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157651:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b202 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.157653:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.157658:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.157877:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532068.157902:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468022848
00000100:00100000:0.0:1651532068.157917:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3324
00000100:00100000:0.0:1651532068.157919:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046543f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468022848:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532068.157926:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157931:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532068.157932:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157935:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532068.157943:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157948:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.157951:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.274210:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793169 is committed
00010000:00010000:1.0:1651532068.274238:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274243:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.274261:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468021376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 719021us (719107us total) trans 158913793169 rc 0/0
00000100:00100000:1.0:1651532068.274264:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3316
00010000:00010000:1.0:1651532068.274271:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274274:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532068.274275:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274300:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274305:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532068.274306:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532068.274307:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274310:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274322:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274325:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b209 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->5742591] (req 1196032->5742591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.274335:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.274339:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.274610:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532068.274625:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468023040
00000100:00100000:1.0:1651532068.274640:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3325
00000100:00100000:1.0:1651532068.274642:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc436c49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468023040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532068.274649:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274653:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532068.274654:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274668:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532068.274668:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274673:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.274677:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.374278:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793170 is committed
00010000:00010000:0.0:1651532068.374304:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374309:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.374334:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ba6d97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468021568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 727557us (727633us total) trans 158913793170 rc 0/0
00000100:00100000:0.0:1651532068.374337:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3317
00010000:00010000:0.0:1651532068.374346:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374360:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532068.374361:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374365:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374370:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.374371:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.374372:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374375:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374378:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.374379:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.374379:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374382:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374392:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374395:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b210 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9990143] (req 360448->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.374400:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.374404:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374412:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374416:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.374906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532068.374926:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468023232
00000100:00100000:0.0:1651532068.374944:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3326
00000100:00100000:0.0:1651532068.374946:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e0c6a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468023232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532068.374953:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374957:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.374958:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374961:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532068.374962:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374966:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.374970:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.499227:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793172 is committed
00010000:00010000:0.0:1651532068.499256:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.499260:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499265:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499270:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.499294:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061a71a54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468021888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716470us (716515us total) trans 158913793172 rc 0/0
00000100:00100000:0.0:1651532068.499300:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3319
00000100:00100000:1.0:1651532068.499301:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fae720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468021696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 852462us (852569us total) trans 158913793171 rc 0/0
00000100:00100000:1.0:1651532068.499305:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3318
00010000:00010000:0.0:1651532068.499311:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499313:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.499316:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532068.499318:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.499323:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499326:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532068.499330:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.499331:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499334:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.499336:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b21e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7778304->9777151] (req 7778304->9777151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499339:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532068.499340:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532068.499341:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499344:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499352:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499355:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b217 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7696384->7700479] (req 7696384->7700479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499360:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499363:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.499748:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532068.499761:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468023424
00000100:00100000:0.0:1651532068.499762:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532068.499770:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468023552
00000100:00100000:1.0:1651532068.499785:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3327
00000100:00100000:1.0:1651532068.499787:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468023424:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532068.499790:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3328
00010000:00010000:1.0:1651532068.499794:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499799:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532068.499800:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.499800:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468023552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532068.499816:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532068.499822:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.499825:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499827:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.499830:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532068.499831:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.499834:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532068.499835:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.499838:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.499839:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.499843:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.624292:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793173 is committed
00010000:00010000:1.0:1651532068.624322:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.624326:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.624348:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d07119c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468022080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774919us (775035us total) trans 158913793173 rc 0/0
00010000:00010000:0.0:1651532068.624350:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.624352:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3320
00010000:00010000:0.0:1651532068.624354:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532068.624355:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.624359:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.624374:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.624375:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.624376:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.624379:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.624386:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.624389:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b225 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.624393:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.624398:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.624764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532068.624782:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468023744
00000100:00100000:1.0:1651532068.624796:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3329
00000100:00100000:1.0:1651532068.624798:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468023744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532068.624823:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.624828:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532068.624829:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.624831:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532068.624832:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.624836:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.624840:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.690962:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793174 is committed
00010000:00010000:1.0:1651532068.690991:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.690995:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.691026:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1985841 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468022272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791229us (791335us total) trans 158913793174 rc 0/0
00010000:00010000:0.0:1651532068.691027:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.691029:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3321
00010000:00010000:0.0:1651532068.691032:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532068.691033:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.691037:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.691042:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.691043:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.691051:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.691054:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.691061:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.691064:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b22c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->9850879] (req 16384->9850879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.691080:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.691084:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.691449:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532068.691463:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468023936
00000100:00100000:1.0:1651532068.691478:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3330
00000100:00100000:1.0:1651532068.691479:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468023936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532068.691487:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.691491:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532068.691492:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.691495:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532068.691496:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.691500:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.691503:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.782678:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793175 is committed
00002000:00010000:1.0:1651532068.782704:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532067 -> 1651532068
00002000:00010000:1.0:1651532068.782706:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532063 -> 1651532068
00010000:00010000:1.0:1651532068.782708:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.782712:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.782733:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1b6dbbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468022528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 770544us (770570us total) trans 158913793175 rc 0/0
00010000:00010000:0.0:1651532068.782735:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532068.782737:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3322
00010000:00010000:0.0:1651532068.782739:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532068.782740:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.782744:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.782749:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.782750:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.782751:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.782754:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.782770:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.782773:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b233 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->5976063] (req 954368->5976063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.782779:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.782782:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.783152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532068.783177:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468024128
00000100:00100000:1.0:1651532068.783190:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3331
00000100:00100000:1.0:1651532068.783192:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468024128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532068.783199:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.783203:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532068.783204:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.783207:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532068.783208:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.783212:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.783224:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.857716:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793176 is committed
00010000:00010000:0.0:1651532068.857733:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.857738:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.857762:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f09b247 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468022656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799937us (799998us total) trans 158913793176 rc 0/0
00000100:00100000:0.0:1651532068.857765:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3323
00010000:00010000:0.0:1651532068.857773:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.857777:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532068.857786:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.857789:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.857795:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.857796:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532068.857797:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.857800:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.857820:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.857823:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b23a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->8400895] (req 483328->8400895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.857828:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.857832:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.858329:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532068.858337:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468024320
00000100:00100000:0.0:1651532068.858348:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3332
00000100:00100000:0.0:1651532068.858350:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468024320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532068.858368:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.858372:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532068.858373:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.858376:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532068.858377:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.858381:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.858385:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532068.982761:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793177 is committed
00010000:00010000:0.0:1651532068.982777:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.982781:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.982816:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046543f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468022848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824895us (824939us total) trans 158913793177 rc 0/0
00010000:00010000:1.0:1651532068.982817:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.982820:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3324
00010000:00010000:1.0:1651532068.982821:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532068.982822:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.982825:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.982831:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532068.982831:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532068.982832:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.982835:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.982843:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.982846:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b241 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->5984255] (req 1536000->5984255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.982851:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532068.982862:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532068.983149:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532068.983163:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468024512
00000100:00100000:0.0:1651532068.983174:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3333
00000100:00100000:0.0:1651532068.983176:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468024512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532068.983184:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.983189:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532068.983190:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.983193:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532068.983193:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.983198:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532068.983201:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.088130:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532069.088140:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230208
00000100:00100000:0.0:1651532069.088150:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 50
00000100:00100000:0.0:1651532069.088152:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0a0376b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230208:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532069.088158:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1376256 granted 356278848 pending 401408 free 81138851840 avail 76964872192
00000100:00100000:0.0:1651532069.088170:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0a0376b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230208:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 18us (42us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532069.088173:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 50
00000001:00080000:0.0:1651532069.116067:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793178 is committed
00010000:00010000:1.0:1651532069.116097:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.116102:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.116122:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532069.116126:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc436c49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468023040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841483us (841516us total) trans 158913793178 rc 0/0
00000100:00100000:1.0:1651532069.116130:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3325
00010000:00010000:0.0:1651532069.116132:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532069.116133:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.116136:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.116142:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.116143:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.116144:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.116147:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.116154:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.116157:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b248 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [708608->9527295] (req 708608->9527295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.116163:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.116166:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.116709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532069.116731:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468024704
00000100:00100000:1.0:1651532069.116745:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3334
00000100:00100000:1.0:1651532069.116747:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468024704:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532069.116755:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.116760:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532069.116761:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.116763:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532069.116764:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.116768:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.116781:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532069.241055:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793179 is committed
00010000:00010000:0.0:1651532069.241071:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.241075:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.241098:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e0c6a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468023232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866151us (866202us total) trans 158913793179 rc 0/0
00000100:00100000:0.0:1651532069.241101:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3326
00010000:00010000:0.0:1651532069.241109:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.241113:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532069.241114:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.241117:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.241122:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.241123:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.241124:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.241127:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.241145:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.241148:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b24f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6746112->7114751] (req 6746112->7114751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.241150:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.241155:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.241443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532069.241474:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468024896
00000100:00100000:0.0:1651532069.241486:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3335
00000100:00100000:0.0:1651532069.241488:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468024896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532069.241495:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b28e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.241499:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.241500:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.241501:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b28e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10276864->10280959] (req 10276864->10280959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.241505:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b28e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10276864->10280959] (req 10276864->10280959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532069.374378:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793181 is committed
00002000:00010000:0.0:1651532069.374398:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532068 -> 1651532069
00002000:00010000:0.0:1651532069.374400:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532068 -> 1651532069
00010000:00010000:0.0:1651532069.374403:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b28e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10276864->10280959] (req 10276864->10280959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.374417:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b28e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10276864->10280959] (req 10276864->10280959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374423:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374432:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.374439:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468024896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 132950us (132997us total) trans 158913793181 rc 0/0
00000100:00100000:0.0:1651532069.374442:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3335
00000100:00100000:1.0:1651532069.374456:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468023424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 874668us (874708us total) trans 158913793180 rc 0/0
00010000:00010000:0.0:1651532069.374456:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b28e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10276864->10280959] (req 10276864->10280959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532069.374460:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3327
00010000:00010000:0.0:1651532069.374460:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532069.374461:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b28e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10276864->10280959] (req 10276864->10280959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.374464:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b28e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10276864->10280959] (req 10276864->10280959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374468:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.374470:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b28e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10276864->10280959] (req 10276864->10280959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374472:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532069.374473:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.374473:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b28e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10276864->10280959] (req 10276864->10280959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374476:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374490:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532069.374491:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532069.374492:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374495:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374504:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374507:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b256 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2375680->9605119] (req 2375680->9605119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.374514:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.374518:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.374717:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532069.374728:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468025024
00000100:00100000:1.0:1651532069.374743:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3336
00000100:00100000:1.0:1651532069.374745:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468025024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532069.374752:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374755:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532069.374757:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374759:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532069.374760:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374775:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.374778:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.375113:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532069.375122:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468025152
00000100:00100000:0.0:1651532069.375138:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3337
00000100:00100000:0.0:1651532069.375140:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468025152:12345-10.240.43.64@tcp:4:fio.
00010000:00010000:0.0:1651532069.375148:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.375152:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.375153:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532069.375154:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.375158:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532069.491073:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793182 is committed
00010000:00010000:0.0:1651532069.491088:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491092:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.491110:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468023552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 991309us (991348us total) trans 158913793182 rc 0/0
00000100:00100000:0.0:1651532069.491113:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3328
00010000:00010000:0.0:1651532069.491120:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491134:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532069.491135:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491139:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491144:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.491144:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.491145:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491148:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491160:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491163:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b25d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8179712->10133503] (req 8179712->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.491174:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.491178:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.491410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532069.491444:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468025344
00000100:00100000:0.0:1651532069.491458:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3338
00000100:00100000:0.0:1651532069.491460:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468025344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532069.491468:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491483:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532069.491484:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491487:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491490:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532069.491490:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491495:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491497:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.491501:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532069.557741:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793183 is committed
00010000:00010000:1.0:1651532069.557774:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.557779:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532069.557800:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468023744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 933001us (933037us total) trans 158913793183 rc 0/0
00010000:00010000:0.0:1651532069.557812:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532069.557817:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3329
00010000:00010000:0.0:1651532069.557817:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532069.557818:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.557831:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.557837:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.557838:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.557839:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.557842:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.557852:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.557855:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b264 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9859071] (req 413696->9859071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.557864:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.557868:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532069.558153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532069.558247:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468025536
00000100:00100000:1.0:1651532069.558258:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3339
00000100:00100000:1.0:1651532069.558260:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca85abdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468025536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532069.558268:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.558272:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532069.558273:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.558276:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532069.558277:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.558295:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.558299:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532069.684046:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793184 is committed
00010000:00010000:1.0:1651532069.684075:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684079:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532069.684113:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468023936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 992633us (992665us total) trans 158913793184 rc 0/0
00000100:00100000:1.0:1651532069.684117:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3330
00010000:00010000:1.0:1651532069.684124:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684128:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532069.684129:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684132:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684137:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532069.684137:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532069.684138:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684141:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.684156:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684158:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.684161:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684162:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b26b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->9912319] (req 495616->9912319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.684364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532069.684388:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468025856
00000100:00100000:1.0:1651532069.684406:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3340
00000100:00100000:1.0:1651532069.684408:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468025856:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532069.684415:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684419:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532069.684420:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684423:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532069.684423:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684428:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.684431:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532069.742452:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793185 is committed
00010000:00010000:0.0:1651532069.742468:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.742483:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.742501:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468024128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 959308us (959350us total) trans 158913793185 rc 0/0
00000100:00100000:0.0:1651532069.742505:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3331
00010000:00010000:0.0:1651532069.742512:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.742516:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532069.742517:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.742520:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.742525:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.742526:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.742526:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.742529:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.742536:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.742539:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b272 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->5287935] (req 2433024->5287935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.742552:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.742555:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.742958:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532069.742967:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468026048
00000100:00100000:0.0:1651532069.742983:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3341
00000100:00100000:0.0:1651532069.742985:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468026048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532069.742993:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.742998:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532069.742999:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.743002:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532069.743002:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.743007:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.743010:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532069.809175:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793186 is committed
00010000:00010000:0.0:1651532069.809190:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.809195:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.809216:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.809220:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468024320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 950869us (950892us total) trans 158913793186 rc 0/0
00000100:00100000:0.0:1651532069.809224:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3332
00010000:00010000:1.0:1651532069.809225:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532069.809226:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.809229:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.809245:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532069.809246:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532069.809247:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.809250:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.809266:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.809267:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.809269:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b279 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->10137599] (req 704512->10137599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.809271:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.809850:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532069.809858:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468026240
00000100:00100000:0.0:1651532069.809874:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3342
00000100:00100000:0.0:1651532069.809876:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468026240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532069.809884:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.809889:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532069.809890:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.809904:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532069.809905:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.809909:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.809913:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532069.900871:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793187 is committed
00010000:00010000:0.0:1651532069.900887:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.900891:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.900908:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468024512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 917731us (917760us total) trans 158913793187 rc 0/0
00000100:00100000:0.0:1651532069.900912:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3333
00010000:00010000:0.0:1651532069.900918:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.900922:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532069.900923:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.900937:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.900943:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.900944:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.900944:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.900948:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.900959:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.900962:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b280 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5689344->6340607] (req 5689344->6340607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.900970:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.900975:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.901265:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532069.901274:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468026432
00000100:00100000:0.0:1651532069.901299:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3343
00000100:00100000:0.0:1651532069.901302:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468026432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532069.901312:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.901319:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532069.901320:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.901339:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532069.901340:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.901346:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.901349:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532069.967613:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793188 is committed
00010000:00010000:1.0:1651532069.967645:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.967649:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532069.967672:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468024704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 850923us (850963us total) trans 158913793188 rc 0/0
00010000:00010000:0.0:1651532069.967673:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.967678:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532069.967679:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.967682:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532069.967685:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3334
00010000:00010000:0.0:1651532069.967688:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.967688:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.967689:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.967692:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.967705:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.967706:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532069.967707:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.967710:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.967721:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532069.967724:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b287 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9936895] (req 360448->9936895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.967739:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.967744:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.967801:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.967818:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532069.967950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532069.967979:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468026624
00000100:00100000:1.0:1651532069.967992:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3344
00000100:00100000:1.0:1651532069.967994:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468026624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532069.968001:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.968006:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532069.968007:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.968010:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532069.968010:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.968015:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532069.968027:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532070.059310:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793190 is committed
00010000:00010000:1.0:1651532070.059342:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059347:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.059365:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468025152:12345-10.240.43.64@tcp:4:fio. Request processed in 684224us (684252us total) trans 158913793189 rc 0/0
00000100:00100000:1.0:1651532070.059368:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3337
00010000:00010000:1.0:1651532070.059376:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059379:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532070.059381:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059383:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059389:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059392:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b29c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059414:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059418:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.059435:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468025024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 684689us (684719us total) trans 158913793190 rc 0/0
00000100:00100000:1.0:1651532070.059438:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3336
00010000:00010000:0.0:1651532070.059441:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.059446:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532070.059448:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.059451:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.059457:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.059458:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.059466:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.059469:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.059478:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.059481:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b295 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6680576->6684671] (req 6680576->6684671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.059486:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.059489:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.059743:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532070.059753:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468026816
00000100:00100000:1.0:1651532070.059770:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3345
00000100:00100000:1.0:1651532070.059772:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080619749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468026816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532070.059779:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059783:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532070.059784:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059787:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532070.059787:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532070.059789:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532070.059820:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059834:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.059842:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468026944
00000100:00100000:1.0:1651532070.059851:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3346
00000100:00100000:1.0:1651532070.059853:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468026944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532070.059858:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059862:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532070.059863:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059866:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532070.059866:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059870:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.059873:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532070.184345:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793191 is committed
00010000:00010000:0.0:1651532070.184361:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.184366:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532070.184391:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468025344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 692930us (692982us total) trans 158913793191 rc 0/0
00000100:00100000:0.0:1651532070.184395:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3338
00010000:00010000:0.0:1651532070.184411:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.184415:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532070.184416:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.184420:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.184425:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.184426:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.184426:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.184430:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.184439:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.184442:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b2a3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->10276863] (req 266240->10276863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.184447:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.184451:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.184933:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532070.184952:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468027072
00000100:00100000:0.0:1651532070.184969:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3347
00000100:00100000:0.0:1651532070.184971:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f48ba6b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468027072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532070.184979:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.184994:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.184995:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532070.184996:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.184999:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532070.300966:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793192 is committed
00010000:00010000:1.0:1651532070.300996:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301001:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.301023:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca85abdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468025536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 742762us (742870us total) trans 158913793192 rc 0/0
00000100:00100000:1.0:1651532070.301027:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3339
00010000:00010000:1.0:1651532070.301034:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301038:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532070.301039:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301042:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301047:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532070.301048:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532070.301048:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301052:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301076:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301080:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2aa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->3190783] (req 499712->3190783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301085:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301088:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.301403:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532070.301475:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468027264
00000100:00100000:1.0:1651532070.301491:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3348
00000100:00100000:1.0:1651532070.301493:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000335d2d27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468027264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532070.301501:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301505:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532070.301506:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301509:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301512:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532070.301520:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301525:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301528:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.301531:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532070.401007:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793193 is committed
00010000:00010000:1.0:1651532070.401035:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.401038:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.401059:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468025856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716650us (716696us total) trans 158913793193 rc 0/0
00000100:00100000:1.0:1651532070.401062:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3340
00010000:00010000:0.0:1651532070.401062:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.401068:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532070.401069:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.401073:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.401079:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.401079:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.401080:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.401084:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.401091:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.401103:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2b1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->7495679] (req 1392640->7495679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.401105:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.401109:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.401408:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532070.401485:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468027520
00000100:00100000:1.0:1651532070.401509:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3349
00000100:00100000:1.0:1651532070.401511:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468027520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532070.401518:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.401523:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532070.401524:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.401526:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532070.401527:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.401531:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.401535:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532070.517686:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793194 is committed
00010000:00010000:1.0:1651532070.517717:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.517729:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.517752:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468026048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774765us (774794us total) trans 158913793194 rc 0/0
00010000:00010000:0.0:1651532070.517752:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.517755:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3341
00010000:00010000:0.0:1651532070.517756:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532070.517757:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.517761:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.517766:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.517767:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.517768:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.517771:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.517779:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.517782:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b2b8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->7344127] (req 102400->7344127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.517796:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.517819:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.518136:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532070.518203:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468027840
00000100:00100000:1.0:1651532070.518219:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3350
00000100:00100000:1.0:1651532070.518221:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468027840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532070.518229:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.518233:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532070.518234:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.518237:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532070.518238:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.518242:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.518245:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532070.609402:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793195 is committed
00010000:00010000:1.0:1651532070.609434:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609449:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.609468:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468026240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799590us (799619us total) trans 158913793195 rc 0/0
00000100:00100000:1.0:1651532070.609471:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3342
00010000:00010000:1.0:1651532070.609478:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609481:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532070.609482:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609485:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609490:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532070.609491:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532070.609492:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609494:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609506:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609510:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b2bf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5246976->7671807] (req 5246976->7671807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.609519:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.609524:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.609881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532070.609889:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468028032
00000100:00100000:1.0:1651532070.609904:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3351
00000100:00100000:1.0:1651532070.609906:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468028032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532070.609913:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609917:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532070.609918:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609921:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532070.609921:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609926:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.609929:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532070.676109:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793196 is committed
00010000:00010000:0.0:1651532070.676126:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676131:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532070.676155:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468026432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774852us (774889us total) trans 158913793196 rc 0/0
00000100:00100000:0.0:1651532070.676158:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3343
00010000:00010000:0.0:1651532070.676166:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676170:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532070.676171:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676174:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676191:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.676191:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.676192:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676195:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676205:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676208:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b2c6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.676212:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.676216:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.676695:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532070.676721:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468028224
00000100:00100000:0.0:1651532070.676734:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3352
00000100:00100000:0.0:1651532070.676736:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468028224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532070.676751:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676756:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532070.676757:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676760:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532070.676761:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676772:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.676776:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532070.759461:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793197 is committed
00010000:00010000:1.0:1651532070.759491:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.759496:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.759518:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468026624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791523us (791569us total) trans 158913793197 rc 0/0
00010000:00010000:0.0:1651532070.759519:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.759522:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3344
00010000:00010000:0.0:1651532070.759523:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532070.759524:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.759528:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.759533:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.759534:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.759535:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.759538:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.759547:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.759560:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b2cd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10149887] (req 839680->10149887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.759561:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.759565:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.759830:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532070.759909:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468028416
00000100:00100000:1.0:1651532070.759921:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3353
00000100:00100000:1.0:1651532070.759923:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468028416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532070.759930:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.759935:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532070.759936:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.759949:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532070.759950:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.759955:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.759958:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532070.880840:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793198 is committed
00010000:00010000:1.0:1651532070.880868:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.880872:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.880894:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080619749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468026816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 821121us (821151us total) trans 158913793198 rc 0/0
00010000:00010000:0.0:1651532070.880895:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.880897:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3345
00010000:00010000:0.0:1651532070.880900:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532070.880901:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.880905:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.880910:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.880911:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.880912:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.880915:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.880918:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.880919:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.880919:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.880922:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.880942:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.880945:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b2d4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8953855] (req 65536->8953855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.880949:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.880951:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.880954:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.880954:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.881163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532070.881181:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468028608
00000100:00100000:1.0:1651532070.881201:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3354
00000100:00100000:1.0:1651532070.881203:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468028608:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532070.881209:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.881214:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532070.881214:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.881217:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532070.881218:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.881222:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.881226:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532070.997551:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793200 is committed
00002000:00010000:0.0:1651532070.997571:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532069 -> 1651532070
00002000:00010000:0.0:1651532070.997572:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532069 -> 1651532070
00010000:00010000:0.0:1651532070.997575:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.997579:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.997584:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.997589:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532070.997600:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f48ba6b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468027072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 812628us (812668us total) trans 158913793199 rc 0/0
00000100:00100000:0.0:1651532070.997604:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3347
00000100:00100000:1.0:1651532070.997610:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468026944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 937756us (937822us total) trans 158913793200 rc 0/0
00010000:00010000:0.0:1651532070.997612:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.997614:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3346
00010000:00010000:1.0:1651532070.997621:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.997627:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532070.997628:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.997631:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.997634:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532070.997637:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.997637:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.997640:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.997640:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b2e2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8749056->8753151] (req 8749056->8753151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.997645:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532070.997646:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532070.997647:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.997650:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.997658:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.997661:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b2db lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6381568->6385663] (req 6381568->6385663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.997666:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.997669:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532070.997980:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532070.998052:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468028800
00000100:00100000:1.0:1651532070.998087:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3355
00000100:00100000:1.0:1651532070.998089:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468028800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532070.998097:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.998101:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532070.998102:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.998105:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532070.998105:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.998110:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532070.998113:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532070.998139:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532070.998158:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468028928
00000100:00100000:0.0:1651532070.998173:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3356
00000100:00100000:0.0:1651532070.998175:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468028928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532070.998183:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.998188:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532070.998189:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.998192:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532070.998193:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.998209:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532070.998212:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532071.064262:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793201 is committed
00010000:00010000:1.0:1651532071.064299:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.064303:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.064323:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000335d2d27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468027264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 762829us (762920us total) trans 158913793201 rc 0/0
00000100:00100000:1.0:1651532071.064327:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3348
00010000:00010000:0.0:1651532071.064327:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.064332:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532071.064333:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.064337:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.064342:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.064343:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.064344:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.064347:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.064357:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.064370:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b2e9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9998335] (req 1552384->9998335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.064374:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.064384:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.064869:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532071.064937:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468029056
00000100:00100000:1.0:1651532071.064948:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3357
00000100:00100000:1.0:1651532071.064950:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468029056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532071.064957:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.064961:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532071.064962:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532071.064963:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.064966:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532071.172669:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793202 is committed
00010000:00010000:1.0:1651532071.172699:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.172703:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.172725:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468027520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 771213us (771323us total) trans 158913793202 rc 0/0
00010000:00010000:0.0:1651532071.172725:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.172730:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532071.172731:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.172735:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.172738:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3349
00010000:00010000:0.0:1651532071.172740:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.172741:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.172742:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.172745:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.172755:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.172758:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b2f0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7000063] (req 20480->7000063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.172779:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.172783:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.173072:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532071.173080:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468029248
00000100:00100000:1.0:1651532071.173090:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3358
00000100:00100000:1.0:1651532071.173092:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468029248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532071.173099:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.173104:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532071.173105:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.173107:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.173110:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532071.173111:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.173115:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.173130:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.173134:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532071.305957:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793203 is committed
00010000:00010000:1.0:1651532071.305990:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.305994:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.306013:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468027840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 787790us (787877us total) trans 158913793203 rc 0/0
00000100:00100000:1.0:1651532071.306016:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3350
00010000:00010000:1.0:1651532071.306023:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306026:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532071.306027:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306030:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306035:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532071.306044:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532071.306045:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306048:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306056:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306059:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b2f7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->8491007] (req 520192->8491007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306064:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306067:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.306462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532071.306472:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468029504
00000100:00100000:1.0:1651532071.306482:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3359
00000100:00100000:1.0:1651532071.306484:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468029504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532071.306491:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306495:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532071.306496:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306511:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532071.306512:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306516:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.306520:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532071.414319:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793204 is committed
00010000:00010000:1.0:1651532071.414350:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.414354:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.414377:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468028032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 804470us (804497us total) trans 158913793204 rc 0/0
00010000:00010000:0.0:1651532071.414378:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.414380:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3351
00010000:00010000:0.0:1651532071.414383:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532071.414385:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.414388:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.414394:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.414395:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.414396:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.414399:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.414407:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.414411:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b2fe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8048639] (req 528384->8048639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.414422:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.414426:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.414843:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532071.414862:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468029696
00000100:00100000:1.0:1651532071.414881:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3360
00000100:00100000:1.0:1651532071.414883:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468029696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532071.414890:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.414894:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532071.414895:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.414898:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532071.414899:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.414903:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.414906:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532071.505988:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793205 is committed
00010000:00010000:1.0:1651532071.506018:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.506022:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.506044:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd0a88c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468028224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 829307us (829349us total) trans 158913793205 rc 0/0
00010000:00010000:0.0:1651532071.506045:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.506047:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3352
00010000:00010000:0.0:1651532071.506057:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532071.506058:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.506062:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.506068:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.506068:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.506069:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.506072:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.506082:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.506085:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b305 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->4280319] (req 2531328->4280319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.506123:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.506127:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532071.506373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532071.506405:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468029888
00000100:00100000:1.0:1651532071.506424:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3361
00000100:00100000:1.0:1651532071.506426:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468029888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532071.506433:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.506437:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532071.506438:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.506441:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532071.506441:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.506454:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.506458:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532071.572756:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793206 is committed
00010000:00010000:0.0:1651532071.572773:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.572778:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.572811:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532071.572814:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468028416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 812879us (812973us total) trans 158913793206 rc 0/0
00010000:00010000:1.0:1651532071.572815:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532071.572816:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532071.572818:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3353
00010000:00010000:1.0:1651532071.572819:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.572835:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532071.572835:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532071.572836:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.572839:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.572847:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.572852:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.572856:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.572857:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b30c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->9629695] (req 188416->9629695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532071.573352:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532071.573360:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468030080
00000100:00100000:0.0:1651532071.573378:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3362
00000100:00100000:0.0:1651532071.573380:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468030080:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532071.573388:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.573393:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532071.573394:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.573397:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532071.573406:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.573411:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.573414:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532071.664413:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793207 is committed
00010000:00010000:0.0:1651532071.664428:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664433:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532071.664451:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468028608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783247us (783288us total) trans 158913793207 rc 0/0
00000100:00100000:0.0:1651532071.664454:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3354
00010000:00010000:0.0:1651532071.664461:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664465:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532071.664466:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664469:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664486:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.664487:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.664488:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664491:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664503:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664506:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b313 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->4153343] (req 3891200->4153343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.664516:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.664521:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532071.664755:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532071.664763:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468030272
00000100:00100000:0.0:1651532071.664781:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3363
00000100:00100000:0.0:1651532071.664783:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468030272:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532071.664791:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664796:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532071.664797:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664800:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532071.664801:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664854:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.664858:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532071.731160:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793208 is committed
00010000:00010000:1.0:1651532071.731193:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.731198:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.731219:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468028800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 733130us (733242us total) trans 158913793208 rc 0/0
00010000:00010000:0.0:1651532071.731222:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.731226:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532071.731227:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.731231:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.731233:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3355
00010000:00010000:0.0:1651532071.731236:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.731237:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.731238:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.731241:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.731244:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.731244:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.731245:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.731256:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.731267:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.731270:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b31a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10006527] (req 90112->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.731276:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.731279:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.731282:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.731295:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532071.731721:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532071.731744:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468030464
00000100:00100000:1.0:1651532071.731756:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3364
00000100:00100000:1.0:1651532071.731758:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468030464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532071.731765:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.731770:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532071.731771:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.731774:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532071.731775:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.731779:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.731782:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532071.822822:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793210 is committed
00010000:00010000:1.0:1651532071.822850:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.822854:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822869:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.822873:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468029056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 757923us (758005us total) trans 158913793210 rc 0/0
00010000:00010000:0.0:1651532071.822874:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.822876:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3357
00000100:00100000:0.0:1651532071.822890:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468028928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824714us (824751us total) trans 158913793209 rc 0/0
00000100:00100000:0.0:1651532071.822894:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3356
00010000:00010000:0.0:1651532071.822902:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822918:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532071.822919:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822922:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822928:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822931:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b328 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7606272->7610367] (req 7606272->7610367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822934:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822937:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532071.822938:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822940:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822944:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.822944:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532071.822945:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822955:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822967:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.822981:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.822985:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.822985:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b321 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.823214:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532071.823247:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468030656
00000100:00100000:0.0:1651532071.823263:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3365
00000100:00100000:0.0:1651532071.823265:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468030656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532071.823272:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.823277:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532071.823277:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.823280:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532071.823281:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.823294:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532071.823297:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532071.823317:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532071.823339:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468030784
00000100:00100000:1.0:1651532071.823355:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3366
00000100:00100000:1.0:1651532071.823357:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468030784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532071.823364:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.823368:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532071.823369:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.823372:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532071.823372:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.823389:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.823392:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532071.997815:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793211 is committed
00002000:00010000:1.0:1651532071.997830:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532070 -> 1651532071
00010000:00010000:1.0:1651532071.997833:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.997837:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.997854:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468029248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824761us (824783us total) trans 158913793211 rc 0/0
00000100:00100000:1.0:1651532071.997858:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3358
00010000:00010000:1.0:1651532071.997865:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.997868:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532071.997869:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.997872:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.997889:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532071.997890:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532071.997890:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.997894:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.997901:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.997904:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b32f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.997909:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.997912:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532071.998457:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532071.998467:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468030912
00000100:00100000:1.0:1651532071.998477:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3367
00000100:00100000:1.0:1651532071.998479:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468030912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532071.998486:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.998490:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532071.998498:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532071.998499:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532071.998502:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532072.097840:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793212 is committed
00010000:00010000:1.0:1651532072.097855:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.097858:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.097882:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468029504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791397us (791440us total) trans 158913793212 rc 0/0
00000100:00100000:1.0:1651532072.097885:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3359
00010000:00010000:1.0:1651532072.097892:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.097896:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532072.097897:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.097900:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.097904:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.097905:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.097914:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.097926:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.097934:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.097937:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b336 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9052159] (req 102400->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.097943:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.097946:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.098240:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532072.098252:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468031104
00000100:00100000:1.0:1651532072.098277:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3368
00000100:00100000:1.0:1651532072.098279:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468031104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532072.098296:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.098300:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532072.098301:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.098304:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.098314:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532072.098315:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.098320:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.098322:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.098326:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532072.240874:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793213 is committed
00010000:00010000:1.0:1651532072.240889:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.240893:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.240916:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468029696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 826032us (826072us total) trans 158913793213 rc 0/0
00010000:00010000:0.0:1651532072.240918:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.240919:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3360
00010000:00010000:0.0:1651532072.240924:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532072.240925:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.240929:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.240935:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532072.240936:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532072.240937:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.240940:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.240950:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.240953:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b33d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->8187903] (req 1404928->8187903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.240962:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.240980:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.241261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532072.241273:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468031360
00000100:00100000:1.0:1651532072.241301:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3369
00000100:00100000:1.0:1651532072.241303:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468031360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532072.241319:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.241324:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532072.241325:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.241328:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532072.241328:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.241333:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.241336:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532072.289505:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793214 is committed
00010000:00010000:0.0:1651532072.289534:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.289539:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.289560:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468029888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783133us (783188us total) trans 158913793214 rc 0/0
00010000:00010000:1.0:1651532072.289563:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.289564:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3361
00010000:00010000:1.0:1651532072.289567:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532072.289568:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.289571:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.289576:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.289583:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.289585:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.289588:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.289597:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.289607:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.289608:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b344 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->7569407] (req 540672->7569407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.289611:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.289794:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532072.289871:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468031552
00000100:00100000:0.0:1651532072.289883:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3370
00000100:00100000:0.0:1651532072.289885:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468031552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532072.289892:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.289897:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532072.289898:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.289910:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532072.289911:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.289916:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.289919:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532072.425617:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793215 is committed
00010000:00010000:0.0:1651532072.425647:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.425658:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.425680:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.425681:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468030080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 852299us (852329us total) trans 158913793215 rc 0/0
00010000:00010000:1.0:1651532072.425684:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532072.425684:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3362
00010000:00010000:1.0:1651532072.425685:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.425688:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.425694:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.425695:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.425695:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.425698:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.425723:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.425726:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b34b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->7057407] (req 2371584->7057407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.425733:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.425737:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.425890:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532072.425898:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468031744
00000100:00100000:0.0:1651532072.425940:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3371
00000100:00100000:0.0:1651532072.425942:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468031744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532072.425949:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.425954:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532072.425955:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.425958:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532072.425958:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.425963:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.425966:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532072.490933:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793216 is committed
00010000:00010000:0.0:1651532072.490966:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.490971:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.490988:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468030272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 826204us (826234us total) trans 158913793216 rc 0/0
00000100:00100000:0.0:1651532072.490992:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3363
00010000:00010000:0.0:1651532072.490998:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.491011:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532072.491012:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.491015:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.491020:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532072.491021:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532072.491022:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.491025:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.491036:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.491040:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b352 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10006527] (req 507904->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.491049:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.491054:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.491618:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532072.491638:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468031936
00000100:00100000:0.0:1651532072.491650:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3372
00000100:00100000:0.0:1651532072.491652:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468031936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532072.491659:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.491675:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532072.491676:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.491679:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532072.491680:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.491684:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.491688:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532072.640853:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793217 is committed
00010000:00010000:1.0:1651532072.640868:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.640872:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.640895:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468030464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 909136us (909175us total) trans 158913793217 rc 0/0
00000100:00100000:1.0:1651532072.640898:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3364
00010000:00010000:1.0:1651532072.640906:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.640920:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532072.640921:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.640924:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.640937:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.640938:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.640939:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.640942:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.640954:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.640957:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b359 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6885376->7835647] (req 6885376->7835647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.640967:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.640972:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.641116:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532072.641127:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468032128
00000100:00100000:1.0:1651532072.641142:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3373
00000100:00100000:1.0:1651532072.641144:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468032128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532072.641156:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.641171:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532072.641172:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.641175:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532072.641176:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.641180:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.641183:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532072.749247:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793218 is committed
00010000:00010000:0.0:1651532072.749279:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.749292:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.749316:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.749316:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468030656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 926050us (926102us total) trans 158913793218 rc 0/0
00010000:00010000:1.0:1651532072.749321:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532072.749322:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.749325:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.749328:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3365
00010000:00010000:1.0:1651532072.749331:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.749331:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.749332:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.749343:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.749346:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.749347:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.749347:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.749350:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.749366:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.749368:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.749370:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.749372:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b360 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1417216->9945087] (req 1417216->9945087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.749378:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.749381:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.749852:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532072.749880:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468032320
00000100:00100000:0.0:1651532072.749892:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3374
00000100:00100000:0.0:1651532072.749894:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468032320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532072.749901:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.749906:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532072.749907:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.749910:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532072.749911:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.749915:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.749918:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532072.849212:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793220 is committed
00002000:00010000:1.0:1651532072.849231:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532070 -> 1651532071
00010000:00010000:1.0:1651532072.849235:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849248:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.849253:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.849265:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.849269:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468030784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 1025911us (1025951us total) trans 158913793220 rc 0/0
00000100:00100000:1.0:1651532072.849272:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3366
00010000:00010000:1.0:1651532072.849295:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849300:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532072.849301:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.849302:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468030912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 850822us (850845us total) trans 158913793219 rc 0/0
00010000:00010000:1.0:1651532072.849304:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.849308:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3367
00010000:00010000:1.0:1651532072.849309:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849312:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b367 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4640768->4644863] (req 4640768->4644863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849316:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849318:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532072.849319:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849330:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849333:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.849334:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532072.849334:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849337:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849344:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849347:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b36e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2555904->2559999] (req 2555904->2559999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.849359:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.849365:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.849638:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532072.849674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532072.849684:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468032512
00000100:00100000:1.0:1651532072.849698:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468032640
00000100:00100000:1.0:1651532072.849705:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3375
00000100:00100000:1.0:1651532072.849707:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468032512:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532072.849710:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3376
00000100:00100000:0.0:1651532072.849712:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468032640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532072.849714:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849718:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532072.849719:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.849721:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849732:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532072.849733:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.849737:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532072.849739:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.849742:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532072.849742:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849746:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.849747:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.849749:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.849757:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532072.924306:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793221 is committed
00010000:00010000:0.0:1651532072.924335:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.924339:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532072.924361:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468031104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 826081us (826123us total) trans 158913793221 rc 0/0
00000100:00100000:0.0:1651532072.924365:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3368
00010000:00010000:0.0:1651532072.924372:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.924376:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532072.924377:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.924380:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.924385:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532072.924385:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532072.924386:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.924400:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.924407:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.924410:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b375 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9289727] (req 774144->9289727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.924412:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532072.924416:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532072.924607:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532072.924625:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468032768
00000100:00100000:0.0:1651532072.924638:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3377
00000100:00100000:0.0:1651532072.924639:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468032768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532072.924646:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3b4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.924650:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532072.924651:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532072.924652:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10395648->10399743] (req 10395648->10399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532072.924656:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10395648->10399743] (req 10395648->10399743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.024327:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793223 is committed
00002000:00010000:1.0:1651532073.024347:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532071 -> 1651532072
00010000:00010000:1.0:1651532073.024350:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.024354:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024359:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10395648->10399743] (req 10395648->10399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024369:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10395648->10399743] (req 10395648->10399743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.024376:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468031360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783072us (783115us total) trans 158913793222 rc 0/0
00000100:00100000:1.0:1651532073.024393:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3369
00000100:00100000:0.0:1651532073.024399:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468032768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 99758us (99792us total) trans 158913793223 rc 0/0
00010000:00010000:1.0:1651532073.024401:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.024402:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3377
00010000:00010000:1.0:1651532073.024404:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532073.024405:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.024408:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024411:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10395648->10399743] (req 10395648->10399743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.024414:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532073.024414:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532073.024415:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.024418:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024422:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532073.024423:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10395648->10399743] (req 10395648->10399743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.024428:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.024431:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b37c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->1417215] (req 573440->1417215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024431:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3b4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10395648->10399743] (req 10395648->10399743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024437:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3b4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10395648->10399743] (req 10395648->10399743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024440:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3b4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10395648->10399743] (req 10395648->10399743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024446:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024449:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.024750:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532073.024767:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468032960
00000100:00100000:0.0:1651532073.024790:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3378
00000100:00100000:0.0:1651532073.024792:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468032960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532073.024800:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024816:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532073.024817:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024820:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532073.024821:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024844:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.024848:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.024875:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532073.024891:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468033088
00000100:00100000:1.0:1651532073.024911:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3379
00000100:00100000:1.0:1651532073.024913:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468033088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532073.024920:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.024924:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532073.024925:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.024928:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532073.024929:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.024933:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.024936:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.157666:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793224 is committed
00010000:00010000:0.0:1651532073.157697:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.157702:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.157725:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468031552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 867839us (867932us total) trans 158913793224 rc 0/0
00000100:00100000:0.0:1651532073.157729:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3370
00010000:00010000:0.0:1651532073.157737:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.157748:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532073.157749:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.157752:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.157758:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.157758:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.157759:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.157762:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.157770:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.157773:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b383 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9916415] (req 483328->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.157778:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.157781:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.158082:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532073.158101:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468033280
00000100:00100000:0.0:1651532073.158126:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3380
00000100:00100000:0.0:1651532073.158128:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468033280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532073.158135:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.158139:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.158140:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532073.158140:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.158144:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.265975:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793225 is committed
00010000:00010000:0.0:1651532073.266007:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.266011:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.266035:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468031744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 840092us (840146us total) trans 158913793225 rc 0/0
00010000:00010000:1.0:1651532073.266039:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.266039:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3371
00010000:00010000:1.0:1651532073.266044:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532073.266045:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.266059:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.266065:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532073.266066:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532073.266066:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.266069:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.266089:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.266092:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b38a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9977855] (req 581632->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.266103:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.266108:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.266317:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532073.266397:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468033472
00000100:00100000:0.0:1651532073.266413:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3381
00000100:00100000:0.0:1651532073.266415:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468033472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532073.266423:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.266427:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532073.266428:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.266431:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532073.266432:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.266436:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.266440:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.324412:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793226 is committed
00010000:00010000:0.0:1651532073.324440:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324445:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.324467:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468031936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 832814us (832849us total) trans 158913793226 rc 0/0
00000100:00100000:0.0:1651532073.324470:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3372
00010000:00010000:0.0:1651532073.324485:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324489:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532073.324490:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324493:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324497:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.324498:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.324499:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324502:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324508:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324511:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b391 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->5255167] (req 24576->5255167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.324515:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.324520:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.324680:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532073.324726:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468033664
00000100:00100000:0.0:1651532073.324740:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3382
00000100:00100000:0.0:1651532073.324742:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468033664:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532073.324749:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324763:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532073.324764:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324767:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532073.324768:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324772:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.324775:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.430210:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793227 is committed
00010000:00010000:1.0:1651532073.430226:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.430240:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.430264:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468032128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 789119us (789148us total) trans 158913793227 rc 0/0
00010000:00010000:0.0:1651532073.430264:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.430267:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3373
00010000:00010000:0.0:1651532073.430269:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532073.430270:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.430273:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.430279:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.430280:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.430281:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.430305:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.430317:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.430322:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b398 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->9068543] (req 1667072->9068543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.430331:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.430335:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.430830:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532073.430848:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468033856
00000100:00100000:1.0:1651532073.430859:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3383
00000100:00100000:1.0:1651532073.430861:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468033856:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532073.430868:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.430873:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532073.430874:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.430877:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532073.430877:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.430882:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.430885:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.472644:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793228 is committed
00010000:00010000:0.0:1651532073.472673:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.472677:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.472697:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468032320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 722802us (722846us total) trans 158913793228 rc 0/0
00010000:00010000:1.0:1651532073.472700:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.472701:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3374
00010000:00010000:1.0:1651532073.472704:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532073.472706:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472709:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472714:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532073.472715:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532073.472716:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472719:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472727:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472730:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b39f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9187327] (req 3903488->9187327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.472737:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.472751:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.472922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532073.472930:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468034048
00000100:00100000:1.0:1651532073.472949:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3384
00000100:00100000:1.0:1651532073.472952:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468034048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532073.472975:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472979:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532073.472980:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472983:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472985:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532073.472986:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472990:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472993:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.472996:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.566167:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793229 is committed
00010000:00010000:0.0:1651532073.566198:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566203:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.566220:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468032512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716512us (716582us total) trans 158913793229 rc 0/0
00000100:00100000:0.0:1651532073.566223:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3375
00010000:00010000:0.0:1651532073.566230:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566234:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532073.566235:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566238:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566243:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.566243:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.566244:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566256:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566264:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566267:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b3a6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10366975] (req 1388544->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566272:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566275:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.566847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532073.566855:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468034240
00000100:00100000:0.0:1651532073.566866:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3385
00000100:00100000:0.0:1651532073.566868:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468034240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532073.566875:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566879:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.566880:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566883:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532073.566892:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566897:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.566901:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.656578:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793230 is committed
00002000:00010000:0.0:1651532073.656609:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532071 -> 1651532072
00010000:00010000:0.0:1651532073.656612:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.656616:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.656633:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468032640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 806920us (806959us total) trans 158913793230 rc 0/0
00000100:00100000:0.0:1651532073.656636:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3376
00010000:00010000:0.0:1651532073.656643:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.656647:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532073.656648:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.656651:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.656667:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.656668:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.656669:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.656672:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.656679:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.656682:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3ad lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8761344->8765439] (req 8761344->8765439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.656687:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.656690:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.657007:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532073.657015:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468034432
00000100:00100000:0.0:1651532073.657025:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3386
00000100:00100000:0.0:1651532073.657027:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468034432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532073.657034:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.657039:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532073.657048:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.657051:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532073.657052:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.657057:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.657060:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.731617:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793231 is committed
00010000:00010000:0.0:1651532073.731654:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.731658:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.731680:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.731681:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468032960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 706888us (706932us total) trans 158913793231 rc 0/0
00000100:00100000:0.0:1651532073.731684:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3378
00010000:00010000:1.0:1651532073.731694:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532073.731696:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.731699:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.731704:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532073.731705:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532073.731706:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.731709:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.731712:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532073.731712:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532073.731713:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.731723:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.731737:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.731740:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b3bb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9383935] (req 278528->9383935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.731749:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.731753:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.731761:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.731764:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.732203:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532073.732233:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468034560
00000100:00100000:0.0:1651532073.732244:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3387
00000100:00100000:0.0:1651532073.732246:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468034560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532073.732253:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.732258:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532073.732258:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.732261:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532073.732262:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.732266:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.732270:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.848320:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793233 is committed
00002000:00010000:1.0:1651532073.848341:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532072 -> 1651532073
00002000:00010000:1.0:1651532073.848342:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532072 -> 1651532073
00010000:00010000:1.0:1651532073.848345:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848349:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848369:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.848370:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468033088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 823456us (823495us total) trans 158913793233 rc 0/0
00000100:00100000:1.0:1651532073.848373:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3379
00010000:00010000:0.0:1651532073.848374:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.848391:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468033280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 690262us (690309us total) trans 158913793232 rc 0/0
00000100:00100000:0.0:1651532073.848394:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3380
00010000:00010000:0.0:1651532073.848412:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848416:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532073.848417:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848420:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848425:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.848426:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.848427:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848430:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848433:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848437:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532073.848437:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848439:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848440:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b3c2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4935680->9953279] (req 4935680->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848442:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848445:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848448:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848456:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848459:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b3c9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10072064->10076159] (req 10072064->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.848646:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532073.848711:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468034752
00000100:00100000:0.0:1651532073.848727:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3388
00000100:00100000:0.0:1651532073.848729:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468034752:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532073.848744:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848749:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532073.848750:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848753:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532073.848753:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848774:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.848778:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.848817:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532073.848845:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468034880
00000100:00100000:1.0:1651532073.848859:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3389
00000100:00100000:1.0:1651532073.848861:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468034880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532073.848868:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848872:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532073.848873:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848876:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532073.848877:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848881:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532073.848885:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532073.914988:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793234 is committed
00010000:00010000:0.0:1651532073.915019:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915023:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532073.915056:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468033472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 648640us (648740us total) trans 158913793234 rc 0/0
00000100:00100000:0.0:1651532073.915060:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3381
00010000:00010000:0.0:1651532073.915068:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915071:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532073.915072:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915075:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915080:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.915081:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532073.915082:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915085:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915092:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915095:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b3d0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8314879] (req 1052672->8314879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915110:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915113:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532073.915417:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532073.915436:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468035072
00000100:00100000:0.0:1651532073.915454:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3390
00000100:00100000:0.0:1651532073.915455:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468035072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532073.915463:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915467:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532073.915468:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915471:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532073.915472:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915476:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532073.915479:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532074.023393:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793235 is committed
00010000:00010000:0.0:1651532074.023424:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.023437:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.023459:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.023461:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468033664:12345-10.240.43.64@tcp:4:fio.0 Request processed in 698718us (698781us total) trans 158913793235 rc 0/0
00010000:00010000:1.0:1651532074.023464:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532074.023464:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3382
00010000:00010000:1.0:1651532074.023465:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.023468:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.023474:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.023475:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.023475:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.023479:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.023486:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.023489:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b3d7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->7880703] (req 4333568->7880703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.023504:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.023515:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.023680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532074.023689:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468035264
00000100:00100000:0.0:1651532074.023700:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3391
00000100:00100000:0.0:1651532074.023701:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468035264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532074.023708:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.023713:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532074.023714:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.023717:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532074.023718:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.023722:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.023726:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532074.123394:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793236 is committed
00010000:00010000:1.0:1651532074.123410:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123413:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.123437:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468033856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 692575us (692607us total) trans 158913793236 rc 0/0
00000100:00100000:1.0:1651532074.123441:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3383
00010000:00010000:1.0:1651532074.123449:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123452:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532074.123454:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123456:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123461:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.123462:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.123463:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123483:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123491:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123494:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b3de lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9981951] (req 2129920->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123500:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123503:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.123664:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532074.123689:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468035456
00000100:00100000:1.0:1651532074.123709:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3392
00000100:00100000:1.0:1651532074.123711:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468035456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532074.123718:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123722:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532074.123723:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123726:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532074.123726:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123739:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.123743:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.208110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532074.208119:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230400
00000100:00100000:0.0:1651532074.208128:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 51
00000100:00100000:0.0:1651532074.208130:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230400:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532074.208136:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1318912 granted 356454976 pending 458752 free 81138851840 avail 76966764544
00000100:00100000:0.0:1651532074.208154:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230400:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (45us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532074.208157:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 51
00000001:00080000:1.0:1651532074.223433:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793237 is committed
00010000:00010000:1.0:1651532074.223448:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.223452:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.223474:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468034048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 750521us (750552us total) trans 158913793237 rc 0/0
00000100:00100000:1.0:1651532074.223477:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3384
00010000:00010000:0.0:1651532074.223479:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.223484:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532074.223486:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.223489:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.223495:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532074.223495:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532074.223496:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.223499:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.223518:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.223521:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b3e5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->10432511] (req 540672->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.223527:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.223530:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.224054:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532074.224082:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468035648
00000100:00100000:1.0:1651532074.224096:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3393
00000100:00100000:1.0:1651532074.224098:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468035648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532074.224105:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.224110:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532074.224111:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.224124:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532074.224125:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.224130:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.224133:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532074.331774:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793238 is committed
00010000:00010000:0.0:1651532074.331814:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.331818:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.331840:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468034240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 764971us (764993us total) trans 158913793238 rc 0/0
00010000:00010000:1.0:1651532074.331842:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.331844:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3385
00010000:00010000:1.0:1651532074.331846:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532074.331847:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.331851:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.331856:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.331857:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.331858:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.331861:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.331886:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.331887:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.331889:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b3ec lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [634880->4014079] (req 634880->4014079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.331891:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.332049:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532074.332057:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468035840
00000100:00100000:0.0:1651532074.332068:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3394
00000100:00100000:0.0:1651532074.332070:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468035840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532074.332098:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.332103:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532074.332104:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.332107:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532074.332108:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.332112:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.332115:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532074.398472:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793239 is committed
00010000:00010000:0.0:1651532074.398505:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.398510:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.398543:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.398543:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468034432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 741515us (741536us total) trans 158913793239 rc 0/0
00010000:00010000:1.0:1651532074.398547:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532074.398547:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3386
00010000:00010000:1.0:1651532074.398549:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.398552:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.398558:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.398558:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.398559:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.398562:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.398571:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.398581:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.398585:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.398589:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b3f3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9256959] (req 1429504->9256959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.399055:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532074.399070:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468036032
00000100:00100000:0.0:1651532074.399083:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3395
00000100:00100000:0.0:1651532074.399084:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468036032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532074.399091:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.399096:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532074.399097:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.399100:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532074.399100:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.399105:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.399108:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532074.473507:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793240 is committed
00010000:00010000:0.0:1651532074.473545:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.473549:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.473566:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468034560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 741319us (741363us total) trans 158913793240 rc 0/0
00000100:00100000:0.0:1651532074.473569:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3387
00010000:00010000:0.0:1651532074.473576:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.473580:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532074.473581:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.473584:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.473588:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532074.473589:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532074.473590:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.473593:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.473612:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.473615:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b3fa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5099520->5103615] (req 5099520->5103615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.473620:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.473623:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.473992:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532074.474002:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468036224
00000100:00100000:0.0:1651532074.474012:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3396
00000100:00100000:0.0:1651532074.474014:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468036224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532074.474022:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.474026:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532074.474027:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.474030:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532074.474031:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.474035:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.474047:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532074.623546:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793241 is committed
00010000:00010000:0.0:1651532074.623578:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.623583:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.623604:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468034752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774874us (774958us total) trans 158913793241 rc 0/0
00010000:00010000:1.0:1651532074.623606:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.623607:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3388
00010000:00010000:1.0:1651532074.623611:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532074.623612:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.623616:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.623621:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.623622:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.623623:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.623626:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.623634:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.623637:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b401 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->8835071] (req 638976->8835071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.623644:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.623648:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.624143:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532074.624152:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468036352
00000100:00100000:0.0:1651532074.624163:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3397
00000100:00100000:0.0:1651532074.624165:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468036352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532074.624172:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.624177:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532074.624185:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.624188:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532074.624189:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.624194:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.624197:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.684867:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1651532074.684875:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000986e2009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966863296:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651532074.685123:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000986e2009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966863296:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:1.0:1651532074.715220:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793242 is committed
00010000:00010000:0.0:1651532074.715251:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.715263:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.715294:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.715298:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532074.715299:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.715302:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468034880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866423us (866468us total) trans 158913793242 rc 0/0
00010000:00010000:1.0:1651532074.715303:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.715308:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.715308:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532074.715308:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3389
00010000:00010000:1.0:1651532074.715309:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.715312:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.715322:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.715325:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b408 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9420799] (req 843776->9420799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.715335:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.715348:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532074.715587:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532074.715595:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468036544
00000100:00100000:0.0:1651532074.715606:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3398
00000100:00100000:0.0:1651532074.715616:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468036544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532074.715624:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.715628:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532074.715629:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.715632:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532074.715633:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.715638:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.715641:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532074.798605:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793243 is committed
00010000:00010000:1.0:1651532074.798620:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.798623:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.798645:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468035072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 883189us (883228us total) trans 158913793243 rc 0/0
00010000:00010000:0.0:1651532074.798648:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.798649:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3390
00010000:00010000:0.0:1651532074.798652:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532074.798653:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.798656:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.798661:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532074.798669:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532074.798670:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.798673:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.798681:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.798684:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b40f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6930432->6934527] (req 6930432->6934527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.798695:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.798699:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.798933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532074.798953:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468036800
00000100:00100000:1.0:1651532074.798967:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3399
00000100:00100000:1.0:1651532074.798969:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468036800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532074.798977:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.798991:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532074.798992:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.798995:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532074.798996:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.799000:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.799004:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532074.890255:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793244 is committed
00010000:00010000:1.0:1651532074.890277:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890281:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.890309:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468035264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866606us (866630us total) trans 158913793244 rc 0/0
00000100:00100000:1.0:1651532074.890313:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3391
00010000:00010000:1.0:1651532074.890320:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890323:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532074.890333:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890336:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890341:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.890342:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532074.890343:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890346:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890353:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890356:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b416 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9990143] (req 1126400->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890361:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890364:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.890709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532074.890732:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468036928
00000100:00100000:1.0:1651532074.890749:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3400
00000100:00100000:1.0:1651532074.890751:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468036928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532074.890765:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890770:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532074.890771:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532074.890771:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.890774:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532074.990308:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793245 is committed
00002000:00010000:1.0:1651532074.990322:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532073 -> 1651532074
00010000:00010000:1.0:1651532074.990325:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.990328:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.990351:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468035456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866639us (866687us total) trans 158913793245 rc 0/0
00010000:00010000:0.0:1651532074.990353:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.990354:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3392
00010000:00010000:0.0:1651532074.990358:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532074.990360:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.990363:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.990369:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532074.990369:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532074.990370:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.990373:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.990391:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532074.990394:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b41d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9129983] (req 647168->9129983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.990407:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.990411:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532074.990597:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532074.990694:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468037184
00000100:00100000:1.0:1651532074.990711:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3401
00000100:00100000:1.0:1651532074.990713:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468037184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532074.990720:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.990725:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532074.990725:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.990728:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.990731:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532074.990732:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.990736:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.990739:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532074.990742:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532075.081988:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793246 is committed
00010000:00010000:1.0:1651532075.082002:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082016:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532075.082034:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468035648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 857935us (857980us total) trans 158913793246 rc 0/0
00000100:00100000:1.0:1651532075.082037:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3393
00010000:00010000:1.0:1651532075.082044:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082048:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532075.082049:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082051:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082056:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.082057:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.082058:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082061:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082073:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082076:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b424 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.082088:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.082093:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532075.082337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532075.082345:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468037376
00000100:00100000:1.0:1651532075.082360:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3402
00000100:00100000:1.0:1651532075.082362:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468037376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532075.082369:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082373:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532075.082374:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082377:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532075.082378:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082382:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.082385:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532075.198665:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793247 is committed
00010000:00010000:0.0:1651532075.198702:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.198707:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.198729:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468035840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866658us (866681us total) trans 158913793247 rc 0/0
00010000:00010000:1.0:1651532075.198731:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.198733:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3394
00010000:00010000:1.0:1651532075.198736:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532075.198737:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.198747:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.198753:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.198753:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.198754:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.198757:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.198767:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.198775:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.198778:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b42b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->10420223] (req 204800->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.198779:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.199313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532075.199392:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468037568
00000100:00100000:0.0:1651532075.199409:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3403
00000100:00100000:0.0:1651532075.199412:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468037568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532075.199419:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.199424:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532075.199425:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.199428:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532075.199429:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.199434:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.199437:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532075.298727:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793248 is committed
00010000:00010000:0.0:1651532075.298761:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.298766:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.298801:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468036032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 899716us (899746us total) trans 158913793248 rc 0/0
00000100:00100000:0.0:1651532075.298816:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3395
00010000:00010000:0.0:1651532075.298824:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.298828:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532075.298829:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.298832:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.298837:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532075.298838:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532075.298839:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.298842:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.298849:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.298852:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b432 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5988352->7208959] (req 5988352->7208959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.298857:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.298868:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532075.299043:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532075.299088:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468037760
00000100:00100000:0.0:1651532075.299104:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3404
00000100:00100000:0.0:1651532075.299106:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468037760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532075.299113:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.299117:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532075.299119:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.299121:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532075.299122:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.299126:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.299130:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532075.415400:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793249 is committed
00010000:00010000:0.0:1651532075.415435:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.415439:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.415472:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468036224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 941457us (941480us total) trans 158913793249 rc 0/0
00010000:00010000:1.0:1651532075.415473:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.415476:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3396
00010000:00010000:1.0:1651532075.415478:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532075.415479:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.415482:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.415502:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.415502:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.415503:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.415506:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.415527:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.415530:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b439 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9994239] (req 172032->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.415540:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.415544:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.415997:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532075.416007:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468037952
00000100:00100000:0.0:1651532075.416020:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3405
00000100:00100000:0.0:1651532075.416023:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468037952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532075.416030:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.416034:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532075.416035:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.416038:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532075.416039:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.416043:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.416058:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532075.498730:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793250 is committed
00010000:00010000:0.0:1651532075.498764:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.498776:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.498797:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.498797:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468036352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 874631us (874655us total) trans 158913793250 rc 0/0
00010000:00010000:1.0:1651532075.498801:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532075.498801:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3397
00010000:00010000:1.0:1651532075.498811:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.498814:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.498819:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.498820:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.498820:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.498831:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.498848:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.498849:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.498851:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b440 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->1437695] (req 1433600->1437695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.498854:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.499052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532075.499061:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468038144
00000100:00100000:1.0:1651532075.499080:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3406
00000100:00100000:1.0:1651532075.499082:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468038144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532075.499090:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.499095:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532075.499096:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.499106:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532075.499106:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.499111:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.499114:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532075.623875:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793251 is committed
00010000:00010000:0.0:1651532075.623907:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.623912:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.623930:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468036544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 908313us (908344us total) trans 158913793251 rc 0/0
00000100:00100000:0.0:1651532075.623943:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3398
00010000:00010000:0.0:1651532075.623951:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.623955:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532075.623956:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.623959:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.623964:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532075.623965:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532075.623966:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.623969:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.623972:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532075.623973:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532075.623973:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.623976:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.623988:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.623996:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.624000:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.624000:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b447 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->10403839] (req 294912->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.624024:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.624028:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.624522:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532075.624531:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468038272
00000100:00100000:0.0:1651532075.624542:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3407
00000100:00100000:0.0:1651532075.624544:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468038272:12345-10.240.43.64@tcp:4:fio
00010000:00010000:0.0:1651532075.624551:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.624556:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532075.624557:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.624560:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532075.624560:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.624565:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.624568:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532075.765394:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793253 is committed
00010000:00010000:1.0:1651532075.765410:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765414:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532075.765437:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468036928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 874684us (874728us total) trans 158913793252 rc 0/0
00000100:00100000:1.0:1651532075.765440:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3400
00010000:00010000:1.0:1651532075.765448:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765452:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532075.765461:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765464:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765470:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765481:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b455 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3219456->3223551] (req 3219456->3223551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.765485:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.765502:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765522:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765525:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532075.765525:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468036800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 966555us (966593us total) trans 158913793253 rc 0/0
00010000:00010000:1.0:1651532075.765526:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765529:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.765529:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3399
00010000:00010000:1.0:1651532075.765534:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.765534:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.765535:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765538:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.765560:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765562:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.765564:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765565:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b44e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4161536->9191423] (req 4161536->9191423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.765724:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532075.765732:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468038464
00000100:00100000:0.0:1651532075.765762:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3408
00000100:00100000:0.0:1651532075.765764:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468038464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532075.765771:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.765776:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532075.765777:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532075.765778:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.765781:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.765875:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532075.765884:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468038592
00000100:00100000:1.0:1651532075.765899:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3409
00000100:00100000:1.0:1651532075.765901:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468038592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532075.765908:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765912:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532075.765913:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532075.765914:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.765917:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532075.857128:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793254 is committed
00010000:00010000:0.0:1651532075.857161:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857167:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.857186:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468037184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866472us (866588us total) trans 158913793254 rc 0/0
00000100:00100000:0.0:1651532075.857189:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3401
00010000:00010000:0.0:1651532075.857196:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857200:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532075.857201:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857204:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857209:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532075.857210:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532075.857211:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857214:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857238:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857241:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b45c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->8851455] (req 790528->8851455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.857251:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.857256:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.857614:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532075.857649:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468038848
00000100:00100000:0.0:1651532075.857670:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3410
00000100:00100000:0.0:1651532075.857674:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468038848:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532075.857685:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857691:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532075.857692:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857695:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532075.857695:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857700:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.857703:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532075.957129:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793255 is committed
00010000:00010000:1.0:1651532075.957152:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957156:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532075.957180:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468037376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 874817us (874843us total) trans 158913793255 rc 0/0
00000100:00100000:1.0:1651532075.957183:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3402
00010000:00010000:1.0:1651532075.957191:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957195:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532075.957196:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957199:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957204:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.957205:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532075.957206:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957209:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957219:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.957225:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532075.957230:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957240:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b463 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10170367] (req 659456->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532075.957467:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532075.957478:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468039104
00000100:00100000:1.0:1651532075.957490:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3411
00000100:00100000:1.0:1651532075.957492:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468039104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532075.957499:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957503:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532075.957504:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957507:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957510:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957512:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532075.957513:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957517:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957520:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957532:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532075.957535:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532076.065456:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793256 is committed
00002000:00010000:0.0:1651532076.065490:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532074 -> 1651532075
00010000:00010000:0.0:1651532076.065494:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.065498:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.065517:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468037568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866104us (866205us total) trans 158913793256 rc 0/0
00000100:00100000:0.0:1651532076.065520:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3403
00010000:00010000:0.0:1651532076.065528:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.065531:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532076.065532:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.065535:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.065552:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.065553:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.065554:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.065557:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.065565:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.065567:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b46a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6623232->10178559] (req 6623232->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.065573:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.065576:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.065951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.065960:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468039296
00000100:00100000:0.0:1651532076.065975:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3412
00000100:00100000:0.0:1651532076.065977:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468039296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532076.065985:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.065989:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532076.066000:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.066005:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532076.066006:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.066014:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.066020:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532076.207907:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793257 is committed
00010000:00010000:0.0:1651532076.207939:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.207944:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.207967:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.207967:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468037760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 908860us (908924us total) trans 158913793257 rc 0/0
00000100:00100000:0.0:1651532076.207971:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3404
00010000:00010000:1.0:1651532076.207972:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532076.207974:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.207977:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.207982:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.207983:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.207984:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.207987:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.207997:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.208005:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.208009:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.208013:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b471 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->8019967] (req 782336->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.208542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.208617:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468039488
00000100:00100000:0.0:1651532076.208635:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3413
00000100:00100000:0.0:1651532076.208637:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468039488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532076.208644:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.208649:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.208650:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532076.208650:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.208654:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532076.323816:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793258 is committed
00010000:00010000:0.0:1651532076.323854:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.323859:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.323883:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.323883:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468037952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 907860us (907886us total) trans 158913793258 rc 0/0
00000100:00100000:0.0:1651532076.323887:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3405
00010000:00010000:1.0:1651532076.323889:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532076.323890:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.323894:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.323901:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.323901:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.323902:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.323906:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.323914:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.323920:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.323924:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.323925:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b478 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3756032->6606847] (req 3756032->6606847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.324179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.324187:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468039680
00000100:00100000:1.0:1651532076.324209:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3414
00000100:00100000:1.0:1651532076.324212:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468039680:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532076.324226:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.324231:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532076.324232:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.324235:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.324238:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532076.324238:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.324243:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.324245:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.324249:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532076.432142:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793259 is committed
00010000:00010000:0.0:1651532076.432177:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432183:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.432202:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468038144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 933119us (933149us total) trans 158913793259 rc 0/0
00000100:00100000:0.0:1651532076.432205:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3406
00010000:00010000:0.0:1651532076.432212:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432216:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532076.432217:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432220:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432225:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.432226:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.432227:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432230:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432243:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.432244:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.432245:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432248:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432250:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.432251:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.432252:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432254:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432268:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432271:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b47f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->8581119] (req 1454080->8581119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.432277:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432277:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432280:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.432313:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432318:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432330:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532076.432933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.432952:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468039872
00000100:00100000:0.0:1651532076.432965:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3415
00000100:00100000:0.0:1651532076.432967:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468039872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532076.432975:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432980:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532076.432981:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432984:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532076.432985:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432989:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.432992:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532076.620354:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793262 is committed
00010000:00010000:1.0:1651532076.620383:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.620388:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620394:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620399:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532076.620404:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468038592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 854502us (854530us total) trans 158913793260 rc 0/0
00000100:00100000:1.0:1651532076.620408:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3409
00010000:00010000:1.0:1651532076.620423:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.620427:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532076.620427:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468038272:12345-10.240.43.64@tcp:4:fio Request processed in 995882us (995906us total) trans 158913793261 rc 0/0
00010000:00010000:1.0:1651532076.620428:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.620431:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.620431:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3407
00010000:00010000:1.0:1651532076.620437:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620446:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620450:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.620451:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b494 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7200768->7204863] (req 7200768->7204863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.620455:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.620457:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532076.620458:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.620461:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.620462:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754468038464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 854698us (854739us total) trans 158913793262 rc 0/0
00010000:00010000:1.0:1651532076.620465:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.620465:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3408
00010000:00010000:1.0:1651532076.620468:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b486 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7958528->7962623] (req 7958528->7962623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620471:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620474:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532076.620475:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620478:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620483:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.620484:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.620485:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620498:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620506:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620509:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b48d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [667648->6873087] (req 667648->6873087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620515:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620518:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532076.620931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.620943:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468040320
00000100:00100000:1.0:1651532076.620949:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532076.620965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.620965:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468040064
00000100:00100000:0.0:1651532076.620978:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468040192
00000100:00100000:1.0:1651532076.620984:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3416
00000100:00100000:1.0:1651532076.620986:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468040320:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532076.620987:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3417
00000100:00100000:0.0:1651532076.620989:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468040064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532076.620996:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.620997:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.621001:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532076.621002:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.621005:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532076.621014:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.621020:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.621021:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.621025:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532076.621025:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.621029:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.621030:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.621033:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.621034:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.621042:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3418
00000100:00100000:0.0:1651532076.621044:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468040192:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532076.621049:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.621052:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532076.621053:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.621056:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532076.621057:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.621060:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.621063:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532076.723834:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793263 is committed
00010000:00010000:0.0:1651532076.723866:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.723878:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.723900:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468038848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866226us (866287us total) trans 158913793263 rc 0/0
00010000:00010000:1.0:1651532076.723903:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.723904:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3410
00010000:00010000:1.0:1651532076.723908:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532076.723909:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.723912:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.723918:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.723919:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.723920:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.723930:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.723939:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.723942:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.723946:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.723949:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b49b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [847872->4300799] (req 847872->4300799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.724214:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.724330:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468040640
00000100:00100000:0.0:1651532076.724347:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3419
00000100:00100000:0.0:1651532076.724349:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468040640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532076.724356:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.724361:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532076.724362:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.724365:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532076.724365:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.724381:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.724385:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532076.807114:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793264 is committed
00010000:00010000:0.0:1651532076.807146:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.807150:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.807172:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468039104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849679us (849705us total) trans 158913793264 rc 0/0
00010000:00010000:1.0:1651532076.807174:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.807175:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3411
00010000:00010000:1.0:1651532076.807179:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532076.807180:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.807183:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.807189:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.807189:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.807190:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.807193:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.807207:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.807208:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.807209:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.807220:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.807233:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.807236:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4a2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10350591] (req 299008->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.807246:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.807246:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.807249:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.807251:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.807564:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.807607:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468040896
00000100:00100000:0.0:1651532076.807621:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3420
00000100:00100000:0.0:1651532076.807623:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468040896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532076.807630:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.807643:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532076.807644:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.807647:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532076.807648:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.807652:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.807656:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532076.915520:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793266 is committed
00002000:00010000:1.0:1651532076.915540:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532075 -> 1651532076
00010000:00010000:1.0:1651532076.915543:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.915547:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.915563:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.915573:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532076.915580:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468039296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849602us (849629us total) trans 158913793265 rc 0/0
00000100:00100000:1.0:1651532076.915590:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3412
00000100:00100000:0.0:1651532076.915598:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468039488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 706960us (707057us total) trans 158913793266 rc 0/0
00010000:00010000:1.0:1651532076.915599:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.915602:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532076.915602:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3413
00010000:00010000:1.0:1651532076.915603:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.915606:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.915610:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.915612:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.915614:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532076.915615:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b4a9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2293760->10362879] (req 2293760->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.915624:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.915628:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.915633:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.915634:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532076.915635:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.915638:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.915648:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.915653:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4b0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->962559] (req 671744->962559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.915662:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.915666:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.916138:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.916157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.916168:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468041280
00000100:00100000:0.0:1651532076.916181:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468041408
00000100:00100000:0.0:1651532076.916189:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3421
00000100:00100000:0.0:1651532076.916191:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468041280:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532076.916196:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3422
00000100:00100000:1.0:1651532076.916198:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468041408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532076.916198:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.916202:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532076.916212:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.916215:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532076.916216:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.916220:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.916220:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.916224:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532076.916224:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.916225:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.916228:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532076.916229:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.916234:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.916237:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532076.998884:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793267 is committed
00010000:00010000:0.0:1651532076.998917:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.998922:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.998944:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468039680:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674732us (674766us total) trans 158913793267 rc 0/0
00010000:00010000:1.0:1651532076.998945:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.998948:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3414
00010000:00010000:1.0:1651532076.998949:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532076.998950:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.998954:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.998959:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.998968:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532076.998969:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.998972:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.998989:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.998991:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.998993:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532076.998994:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4b7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->10010623] (req 630784->10010623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532076.999528:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532076.999546:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468041600
00000100:00100000:0.0:1651532076.999565:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3423
00000100:00100000:0.0:1651532076.999567:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468041600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532076.999575:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.999579:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532076.999580:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.999583:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532076.999584:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.999588:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532076.999592:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532077.132172:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793268 is committed
00010000:00010000:1.0:1651532077.132189:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.132194:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532077.132218:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468039872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699250us (699285us total) trans 158913793268 rc 0/0
00000100:00100000:1.0:1651532077.132222:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3415
00010000:00010000:0.0:1651532077.132223:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.132228:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532077.132229:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.132233:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.132249:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532077.132250:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532077.132251:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.132254:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.132262:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.132265:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b4be lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->6856703] (req 106496->6856703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.132271:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.132274:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532077.132639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532077.132691:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468041792
00000100:00100000:1.0:1651532077.132707:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3424
00000100:00100000:1.0:1651532077.132709:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468041792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532077.132718:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.132734:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532077.132736:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.132739:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532077.132740:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.132744:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.132748:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532077.290465:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793269 is committed
00010000:00010000:0.0:1651532077.290500:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.290506:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.290531:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468040064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 669541us (669581us total) trans 158913793269 rc 0/0
00010000:00010000:1.0:1651532077.290532:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.290537:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532077.290538:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.290541:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.290544:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3417
00010000:00010000:1.0:1651532077.290547:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.290548:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.290549:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.290560:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.290569:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.290571:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b4cc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9977855] (req 262144->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.290577:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.290580:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532077.291143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532077.291169:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468041984
00000100:00100000:0.0:1651532077.291184:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3425
00000100:00100000:0.0:1651532077.291186:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468041984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532077.291200:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.291205:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532077.291206:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.291209:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532077.291210:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.291214:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.291218:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532077.357433:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793270 is committed
00002000:00010000:1.0:1651532077.357447:0:330054:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532073 -> 1651532076
00010000:00010000:1.0:1651532077.357450:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357454:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532077.357477:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468040320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 736490us (736548us total) trans 158913793270 rc 0/0
00000100:00100000:1.0:1651532077.357481:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3416
00010000:00010000:1.0:1651532077.357497:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357501:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532077.357502:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357505:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357510:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.357511:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.357512:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357515:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357536:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357539:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b4c5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7778304->7782399] (req 7778304->7782399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.357550:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.357554:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532077.357802:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532077.357823:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468042176
00000100:00100000:1.0:1651532077.357835:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3426
00000100:00100000:1.0:1651532077.357837:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468042176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532077.357844:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357855:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.357856:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357859:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532077.357860:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357864:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.357868:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532077.455982:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793271 is committed
00010000:00010000:0.0:1651532077.456021:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456034:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.456054:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468040192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 835009us (835088us total) trans 158913793271 rc 0/0
00000100:00100000:0.0:1651532077.456057:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3418
00010000:00010000:0.0:1651532077.456065:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456068:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532077.456070:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456073:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456077:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532077.456078:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532077.456079:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456082:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456089:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456092:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b4d3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->9981951] (req 2064384->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456105:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456109:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.456486:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532077.456494:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468042304
00000100:00100000:0.0:1651532077.456509:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3427
00000100:00100000:0.0:1651532077.456511:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468042304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532077.456519:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456524:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532077.456525:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532077.456525:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.456529:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532077.556012:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793272 is committed
00010000:00010000:0.0:1651532077.556046:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.556051:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.556073:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468040640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 831723us (831859us total) trans 158913793272 rc 0/0
00010000:00010000:1.0:1651532077.556075:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.556080:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532077.556081:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.556085:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.556085:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3419
00010000:00010000:1.0:1651532077.556090:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.556091:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.556099:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.556103:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.556112:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.556115:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b4da lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9445375] (req 102400->9445375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.556123:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.556128:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.556569:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532077.556579:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468042496
00000100:00100000:0.0:1651532077.556593:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3428
00000100:00100000:0.0:1651532077.556595:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468042496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532077.556603:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.556607:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532077.556608:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.556611:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.556614:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532077.556614:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.556618:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.556633:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.556637:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532077.664372:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793273 is committed
00010000:00010000:0.0:1651532077.664404:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.664409:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.664433:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.664433:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468040896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 856809us (856869us total) trans 158913793273 rc 0/0
00000100:00100000:0.0:1651532077.664436:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3420
00010000:00010000:1.0:1651532077.664439:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532077.664440:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.664444:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.664450:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.664451:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.664452:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.664455:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.664486:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.664490:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b4e1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->10366975] (req 2621440->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.664496:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.664500:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.664732:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532077.664753:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468042688
00000100:00100000:0.0:1651532077.664768:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3429
00000100:00100000:0.0:1651532077.664770:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468042688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532077.664777:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.664790:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532077.664791:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532077.664792:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.664795:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532077.731117:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793274 is committed
00010000:00010000:0.0:1651532077.731151:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731155:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.731173:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468041280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 814981us (815036us total) trans 158913793274 rc 0/0
00000100:00100000:0.0:1651532077.731176:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3421
00010000:00010000:0.0:1651532077.731184:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731187:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532077.731188:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731191:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731196:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532077.731205:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532077.731206:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731210:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731222:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731225:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b4e8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3915776->10387455] (req 3915776->10387455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.731235:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.731239:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.731489:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532077.731498:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468042880
00000100:00100000:0.0:1651532077.731512:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3430
00000100:00100000:0.0:1651532077.731514:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468042880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532077.731522:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731527:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532077.731528:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731530:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532077.731531:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731536:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.731549:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532077.797844:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793275 is committed
00010000:00010000:1.0:1651532077.797861:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.797865:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532077.797890:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468041408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 881690us (881731us total) trans 158913793275 rc 0/0
00000100:00100000:1.0:1651532077.797893:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3422
00010000:00010000:1.0:1651532077.797902:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.797905:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532077.797914:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.797918:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.797923:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.797933:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532077.797934:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.797937:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.797949:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.797952:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b4ef lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->8052735] (req 1449984->8052735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.797963:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.797968:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.798328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532077.798350:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468043072
00000100:00100000:1.0:1651532077.798363:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3431
00000100:00100000:1.0:1651532077.798365:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468043072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532077.798372:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.798376:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532077.798377:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.798403:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.798406:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532077.798407:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.798412:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.798415:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.798418:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532077.964433:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793276 is committed
00010000:00010000:0.0:1651532077.964469:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964474:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.964493:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468041600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 964924us (964965us total) trans 158913793276 rc 0/0
00000100:00100000:0.0:1651532077.964496:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3423
00010000:00010000:0.0:1651532077.964504:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964507:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532077.964509:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964512:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964527:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532077.964527:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532077.964528:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964532:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964543:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964546:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b4f6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->8736767] (req 909312->8736767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.964555:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532077.964560:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532077.964863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532077.964873:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468043264
00000100:00100000:0.0:1651532077.964886:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3432
00000100:00100000:0.0:1651532077.964888:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468043264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532077.964895:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964900:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532077.964901:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964904:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532077.964905:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964919:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532077.964923:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532078.081136:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793277 is committed
00002000:00010000:1.0:1651532078.081151:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532076 -> 1651532077
00002000:00010000:1.0:1651532078.081152:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532076 -> 1651532077
00010000:00010000:1.0:1651532078.081155:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081167:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532078.081192:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468041792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 948481us (948568us total) trans 158913793277 rc 0/0
00000100:00100000:1.0:1651532078.081196:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3424
00010000:00010000:1.0:1651532078.081203:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081207:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532078.081208:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081211:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081217:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.081217:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.081219:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081222:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081231:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081234:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b4fd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5607424->7213055] (req 5607424->7213055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.081246:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.081251:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.081523:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532078.081544:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468043456
00000100:00100000:1.0:1651532078.081556:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3433
00000100:00100000:1.0:1651532078.081558:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468043456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532078.081573:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081578:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532078.081579:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081582:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532078.081582:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081592:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.081595:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532078.147858:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793278 is committed
00010000:00010000:0.0:1651532078.147892:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.147897:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.147920:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.147921:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468041984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 856734us (856778us total) trans 158913793278 rc 0/0
00000100:00100000:0.0:1651532078.147924:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3425
00010000:00010000:1.0:1651532078.147926:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532078.147927:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.147942:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.147948:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.147949:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.147949:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.147953:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.147965:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.147965:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.147966:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.147969:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.147983:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.147986:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b504 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->9289727] (req 724992->9289727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.147992:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.147994:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.147995:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.147999:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.148462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532078.148555:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468043648
00000100:00100000:0.0:1651532078.148572:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3434
00000100:00100000:0.0:1651532078.148574:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468043648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532078.148581:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.148586:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532078.148587:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.148590:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532078.148591:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.148595:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.148599:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532078.247887:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793280 is committed
00010000:00010000:1.0:1651532078.247911:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.247917:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.247922:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.247933:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532078.247940:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468042176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 890102us (890138us total) trans 158913793279 rc 0/0
00000100:00100000:1.0:1651532078.247944:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3426
00010000:00010000:1.0:1651532078.247964:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.247967:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468042304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791454us (791482us total) trans 158913793280 rc 0/0
00010000:00010000:1.0:1651532078.247968:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532078.247969:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.247970:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3427
00010000:00010000:1.0:1651532078.247973:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.247979:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.247982:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b50b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->1466367] (req 1462272->1466367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.247985:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.247997:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532078.247998:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248001:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248013:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.248014:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.248014:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248018:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248021:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.248022:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.248022:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248025:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248038:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248041:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b512 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1544192->8843263] (req 1544192->8843263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.248052:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.248056:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248066:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248069:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.248402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532078.248414:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532078.248426:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468043840
00000100:00100000:0.0:1651532078.248441:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468043968
00000100:00100000:1.0:1651532078.248444:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3435
00000100:00100000:1.0:1651532078.248446:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468043840:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532078.248455:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3436
00000100:00100000:0.0:1651532078.248457:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468043968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532078.248459:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248464:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532078.248465:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.248465:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248468:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532078.248468:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.248473:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532078.248474:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.248478:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532078.248478:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248482:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.248483:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.248486:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.248498:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532078.347919:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793282 is committed
00010000:00010000:1.0:1651532078.347949:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.347953:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.347963:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.347968:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532078.347976:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468042496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791380us (791407us total) trans 158913793282 rc 0/0
00000100:00100000:1.0:1651532078.347980:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3428
00010000:00010000:1.0:1651532078.347988:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.347992:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532078.347993:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.347993:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468042688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 683222us (683262us total) trans 158913793281 rc 0/0
00010000:00010000:1.0:1651532078.347996:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.347997:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3429
00010000:00010000:1.0:1651532078.348001:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.348002:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.348002:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.348005:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.348006:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.348009:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532078.348011:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.348015:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.348020:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.348026:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.348027:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b519 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8196095] (req 110592->8196095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.348029:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b520 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10100736->10391551] (req 10100736->10391551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.348044:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.348047:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.348388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532078.348404:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532078.348417:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468044096
00000100:00100000:1.0:1651532078.348422:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468044224
00000100:00100000:0.0:1651532078.348431:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3437
00000100:00100000:0.0:1651532078.348433:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468044096:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532078.348441:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3438
00010000:00010000:0.0:1651532078.348441:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532078.348443:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468044224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532078.348445:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532078.348446:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.348449:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532078.348450:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.348451:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.348454:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.348455:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.348456:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532078.348457:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.348462:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.348462:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532078.456252:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793283 is committed
00010000:00010000:0.0:1651532078.456284:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.456300:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.456320:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468042880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724805us (724832us total) trans 158913793283 rc 0/0
00010000:00010000:1.0:1651532078.456323:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.456324:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3430
00010000:00010000:1.0:1651532078.456328:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532078.456329:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.456332:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.456349:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.456349:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.456350:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.456354:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.456371:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.456374:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b527 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7352320->7356415] (req 7352320->7356415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.456380:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.456383:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.456638:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532078.456673:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468044416
00000100:00100000:0.0:1651532078.456686:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3439
00000100:00100000:0.0:1651532078.456688:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468044416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532078.456696:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.456700:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532078.456701:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.456704:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.456707:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532078.456707:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.456722:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.456725:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.456729:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532078.581262:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793284 is committed
00010000:00010000:1.0:1651532078.581278:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581282:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532078.581319:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468043072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 782953us (782992us total) trans 158913793284 rc 0/0
00000100:00100000:1.0:1651532078.581331:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3431
00010000:00010000:1.0:1651532078.581340:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581343:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532078.581344:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581348:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581353:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.581353:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.581354:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581358:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581379:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581382:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b52e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->10334207] (req 3260416->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.581393:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.581397:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.581699:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532078.581720:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468044544
00000100:00100000:1.0:1651532078.581732:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3440
00000100:00100000:1.0:1651532078.581734:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468044544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532078.581741:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581745:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.581746:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581749:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532078.581749:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581754:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.581757:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532078.689612:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793285 is committed
00010000:00010000:0.0:1651532078.689651:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.689655:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.689674:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468043264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724785us (724812us total) trans 158913793285 rc 0/0
00000100:00100000:0.0:1651532078.689678:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3432
00010000:00010000:0.0:1651532078.689685:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.689698:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532078.689699:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.689702:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.689708:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532078.689708:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532078.689709:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.689712:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.689724:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.689727:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b535 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10412031] (req 1474560->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.689737:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.689742:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.690142:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532078.690150:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468044864
00000100:00100000:0.0:1651532078.690166:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3441
00000100:00100000:0.0:1651532078.690168:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468044864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532078.690194:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.690210:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532078.690211:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.690214:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532078.690215:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.690219:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.690223:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532078.756345:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793286 is committed
00010000:00010000:1.0:1651532078.756361:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756366:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532078.756399:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468043456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674839us (674876us total) trans 158913793286 rc 0/0
00000100:00100000:1.0:1651532078.756403:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3433
00010000:00010000:1.0:1651532078.756411:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756414:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532078.756415:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756418:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756423:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.756424:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.756425:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756428:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756438:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.756448:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756449:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b53c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->10018815] (req 913408->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.756453:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.756675:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532078.756699:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468045056
00000100:00100000:1.0:1651532078.756711:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3442
00000100:00100000:1.0:1651532078.756713:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468045056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532078.756720:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756724:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532078.756725:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756728:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532078.756729:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756733:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.756737:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532078.848037:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793287 is committed
00002000:00010000:0.0:1651532078.848070:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532077 -> 1651532078
00010000:00010000:0.0:1651532078.848074:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.848078:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.848113:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.848113:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468043648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699538us (699651us total) trans 158913793287 rc 0/0
00010000:00010000:1.0:1651532078.848117:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532078.848117:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3434
00010000:00010000:1.0:1651532078.848119:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.848132:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.848138:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.848138:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.848139:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.848142:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.848158:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.848161:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b543 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.848167:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.848170:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.848429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532078.848437:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468045248
00000100:00100000:0.0:1651532078.848450:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3443
00000100:00100000:0.0:1651532078.848452:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468045248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532078.848475:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.848480:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532078.848481:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.848484:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532078.848485:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.848489:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.848493:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532078.973014:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793288 is committed
00010000:00010000:1.0:1651532078.973030:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973035:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532078.973067:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468043840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724620us (724665us total) trans 158913793288 rc 0/0
00000100:00100000:1.0:1651532078.973071:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3435
00010000:00010000:1.0:1651532078.973078:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973082:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532078.973083:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973086:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973091:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.973092:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532078.973093:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973096:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973117:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973120:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b54a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10149887] (req 1470464->10149887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.973130:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532078.973145:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532078.973601:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532078.973623:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468045440
00000100:00100000:1.0:1651532078.973635:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3444
00000100:00100000:1.0:1651532078.973637:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468045440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532078.973644:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973648:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532078.973649:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973652:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532078.973653:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973657:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532078.973660:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532079.073038:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793289 is committed
00002000:00010000:0.0:1651532079.073073:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532077 -> 1651532078
00010000:00010000:0.0:1651532079.073077:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.073081:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.073104:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.073105:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468043968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824647us (824690us total) trans 158913793289 rc 0/0
00010000:00010000:1.0:1651532079.073108:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532079.073109:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.073109:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3436
00010000:00010000:1.0:1651532079.073123:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.073128:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.073129:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.073130:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.073133:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.073136:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.073137:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.073137:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.073148:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.073162:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.073165:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b551 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4591616->8081407] (req 4591616->8081407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.073172:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.073174:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.073176:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.073181:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.073415:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532079.073424:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468045632
00000100:00100000:0.0:1651532079.073438:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3445
00000100:00100000:0.0:1651532079.073440:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468045632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532079.073448:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.073464:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532079.073465:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.073468:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532079.073469:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.073473:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.073477:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532079.164761:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793291 is committed
00010000:00010000:1.0:1651532079.164783:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.164787:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.164799:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.164813:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532079.164821:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468044224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816376us (816415us total) trans 158913793290 rc 0/0
00000100:00100000:1.0:1651532079.164829:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3438
00010000:00010000:1.0:1651532079.164837:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.164837:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468044096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816403us (816450us total) trans 158913793291 rc 0/0
00010000:00010000:1.0:1651532079.164841:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532079.164841:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3437
00010000:00010000:1.0:1651532079.164842:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.164845:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.164850:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.164850:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.164853:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b55f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5644288->5648383] (req 5644288->5648383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.164853:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532079.164863:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.164866:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.164872:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532079.164873:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532079.164873:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.164877:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.164884:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.164887:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b558 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5881856->5885951] (req 5881856->5885951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.164902:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.164914:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532079.165169:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532079.165199:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532079.165212:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468045888
00000100:00100000:1.0:1651532079.165228:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468046016
00000100:00100000:0.0:1651532079.165231:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3446
00000100:00100000:0.0:1651532079.165233:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468045888:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532079.165236:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3447
00000100:00100000:1.0:1651532079.165238:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468046016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532079.165242:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.165245:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.165246:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532079.165247:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.165261:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532079.165262:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.165266:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532079.165268:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.165271:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532079.165271:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.165275:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.165276:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.165279:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.165280:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532079.231493:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793292 is committed
00010000:00010000:1.0:1651532079.231509:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231521:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532079.231540:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468044416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774851us (774902us total) trans 158913793292 rc 0/0
00000100:00100000:1.0:1651532079.231544:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3439
00010000:00010000:1.0:1651532079.231551:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231555:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532079.231556:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231559:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231564:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.231564:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.231565:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231568:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231575:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231578:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b566 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->10006527] (req 389120->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231583:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231586:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.231911:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532079.231923:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468046144
00000100:00100000:1.0:1651532079.231939:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3448
00000100:00100000:1.0:1651532079.231941:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468046144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532079.231948:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231952:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.231953:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532079.231954:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.231957:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532079.328107:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532079.328133:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230528
00000100:00100000:0.0:1651532079.328146:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 52
00000100:00100000:0.0:1651532079.328148:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230528:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532079.328154:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1634304 granted 356909632 pending 28672 free 81138851840 avail 76964040704
00000100:00100000:0.0:1651532079.328169:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230528:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 21us (62us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532079.328172:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 52
00000001:00080000:1.0:1651532079.339841:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793293 is committed
00010000:00010000:1.0:1651532079.339856:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.339859:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532079.339888:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468044544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 758153us (758189us total) trans 158913793293 rc 0/0
00000100:00100000:1.0:1651532079.339891:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3440
00010000:00010000:1.0:1651532079.339899:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.339902:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532079.339903:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.339906:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.339911:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.339911:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.339912:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.339915:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.339928:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.339931:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b56d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.339944:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.339949:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.340256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532079.340278:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468046336
00000100:00100000:1.0:1651532079.340319:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3449
00000100:00100000:1.0:1651532079.340321:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468046336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532079.340328:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.340333:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532079.340334:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.340337:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.340339:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532079.340340:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.340344:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.340347:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.340350:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532079.448150:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793294 is committed
00010000:00010000:0.0:1651532079.448182:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448195:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.448220:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468044864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 758051us (758078us total) trans 158913793294 rc 0/0
00000100:00100000:0.0:1651532079.448223:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3441
00010000:00010000:0.0:1651532079.448231:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448235:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532079.448236:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448239:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448245:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532079.448245:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532079.448246:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448249:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448259:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448262:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b574 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10407935] (req 671744->10407935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.448272:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.448287:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.448605:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532079.448634:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468046464
00000100:00100000:0.0:1651532079.448646:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3450
00000100:00100000:0.0:1651532079.448648:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468046464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532079.448655:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448659:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532079.448660:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448663:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532079.448664:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448668:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.448672:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532079.570563:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793295 is committed
00010000:00010000:1.0:1651532079.570579:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.570584:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532079.570602:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468045056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 813888us (813927us total) trans 158913793295 rc 0/0
00000100:00100000:1.0:1651532079.570605:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3442
00010000:00010000:1.0:1651532079.570612:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.570616:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532079.570617:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.570620:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.570625:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.570625:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.570626:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.570641:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.570654:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.570657:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b57b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9195519] (req 856064->9195519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.570669:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.570674:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532079.571090:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532079.571098:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468046720
00000100:00100000:1.0:1651532079.571116:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3451
00000100:00100000:1.0:1651532079.571117:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468046720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532079.571125:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.571129:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532079.571130:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532079.571131:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.571134:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532079.681510:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793296 is committed
00010000:00010000:0.0:1651532079.681543:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.681547:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.681569:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468045248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 833116us (833141us total) trans 158913793296 rc 0/0
00010000:00010000:1.0:1651532079.681572:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.681573:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3443
00010000:00010000:1.0:1651532079.681587:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532079.681588:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.681591:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.681597:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.681597:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.681598:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.681601:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.681619:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.681623:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b582 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10256383] (req 1351680->10256383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.681629:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.681631:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.681850:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532079.681872:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468046912
00000100:00100000:0.0:1651532079.681884:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3452
00000100:00100000:0.0:1651532079.681886:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468046912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532079.681893:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.681898:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532079.681899:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.681902:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532079.681902:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.681907:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.681922:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532079.773267:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793297 is committed
00010000:00010000:1.0:1651532079.773303:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.773307:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532079.773332:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468045440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799694us (799754us total) trans 158913793297 rc 0/0
00010000:00010000:0.0:1651532079.773334:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532079.773336:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3444
00010000:00010000:0.0:1651532079.773339:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532079.773340:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.773343:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.773349:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532079.773350:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532079.773351:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.773354:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.773361:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.773364:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b589 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7798784->8855551] (req 7798784->8855551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.773370:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.773382:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532079.773632:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532079.773642:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468047104
00000100:00100000:1.0:1651532079.773653:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3453
00000100:00100000:1.0:1651532079.773654:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468047104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532079.773662:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.773667:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532079.773668:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.773671:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532079.773671:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.773676:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.773688:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532079.839930:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793298 is committed
00010000:00010000:0.0:1651532079.839963:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.839967:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.839989:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468045632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766548us (766574us total) trans 158913793298 rc 0/0
00010000:00010000:1.0:1651532079.839992:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.839993:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3445
00010000:00010000:1.0:1651532079.839997:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532079.839998:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.840002:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.840007:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.840008:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.840008:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.840012:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.840021:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.840024:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b590 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10162175] (req 339968->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.840031:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.840035:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.840571:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532079.840580:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468047296
00000100:00100000:0.0:1651532079.840597:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3454
00000100:00100000:0.0:1651532079.840599:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468047296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532079.840607:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.840611:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532079.840621:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.840624:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532079.840625:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.840629:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.840633:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532079.939977:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793299 is committed
00002000:00010000:0.0:1651532079.940007:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532078 -> 1651532079
00010000:00010000:0.0:1651532079.940011:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.940014:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940038:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.940038:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468045888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774804us (774870us total) trans 158913793299 rc 0/0
00000100:00100000:0.0:1651532079.940041:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3446
00010000:00010000:1.0:1651532079.940052:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532079.940054:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940057:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940063:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.940063:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.940064:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940067:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940078:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.940079:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532079.940080:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940083:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940091:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940094:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b597 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->10010623] (req 1576960->10010623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940109:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940112:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940169:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532079.940173:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532079.940342:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532079.940353:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468047488
00000100:00100000:0.0:1651532079.940371:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3455
00000100:00100000:0.0:1651532079.940374:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468047488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532079.940384:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.940398:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532079.940399:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.940402:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532079.940402:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.940407:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532079.940411:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532080.031688:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793301 is committed
00002000:00010000:1.0:1651532080.031703:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532078 -> 1651532079
00010000:00010000:1.0:1651532080.031706:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031710:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.031733:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468046016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866494us (866534us total) trans 158913793301 rc 0/0
00000100:00100000:1.0:1651532080.031737:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3447
00010000:00010000:1.0:1651532080.031750:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031753:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.031777:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.031782:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532080.031783:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.031788:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468046144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799847us (799878us total) trans 158913793300 rc 0/0
00000100:00100000:1.0:1651532080.031792:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3448
00010000:00010000:0.0:1651532080.031793:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031798:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.031799:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.031802:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b59e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7503872->7507967] (req 7503872->7507967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031812:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532080.031814:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031817:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031822:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532080.031823:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532080.031824:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031827:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031834:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031837:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5a5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2445312->2449407] (req 2445312->2449407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031842:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.031858:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532080.032047:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532080.032059:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468047744
00000100:00100000:1.0:1651532080.032071:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3456
00000100:00100000:1.0:1651532080.032073:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468047744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532080.032080:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.032084:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532080.032085:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.032088:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532080.032088:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.032093:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.032104:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532080.032125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532080.032196:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468047872
00000100:00100000:1.0:1651532080.032207:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3457
00000100:00100000:1.0:1651532080.032209:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468047872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532080.032228:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.032235:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532080.032237:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.032242:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532080.032243:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.032251:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.032257:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532080.098414:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793302 is committed
00010000:00010000:1.0:1651532080.098430:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.098434:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.098457:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468046336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 758136us (758202us total) trans 158913793302 rc 0/0
00010000:00010000:0.0:1651532080.098459:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.098461:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3449
00010000:00010000:0.0:1651532080.098465:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532080.098466:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.098470:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.098475:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.098476:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.098477:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.098480:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.098484:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.098484:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.098485:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.098487:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.098498:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.098509:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b5ac lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.098511:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.098515:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.098516:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.098518:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.098983:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532080.099048:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468048064
00000100:00100000:1.0:1651532080.099059:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3458
00000100:00100000:1.0:1651532080.099061:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468048064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532080.099069:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.099073:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 2/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.099077:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532080.099078:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.099080:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532080.099081:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.099085:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.099088:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.099106:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532080.217609:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793304 is committed
00010000:00010000:1.0:1651532080.217631:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.217635:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.217649:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.217657:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468046720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 646538us (646567us total) trans 158913793304 rc 0/0
00010000:00010000:0.0:1651532080.217659:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.217660:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3451
00000100:00100000:0.0:1651532080.217679:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468046464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 769030us (769074us total) trans 158913793303 rc 0/0
00010000:00010000:1.0:1651532080.217680:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.217683:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532080.217683:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3450
00010000:00010000:1.0:1651532080.217685:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.217688:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.217693:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532080.217694:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532080.217694:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.217708:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.217724:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.217727:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5ba lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [864256->8318975] (req 864256->8318975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.217727:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.217731:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532080.217732:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.217735:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.217737:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.217740:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.217750:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.217753:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b5b3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10412032->10416127] (req 10412032->10416127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.218047:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532080.218058:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468048256
00000100:00100000:0.0:1651532080.218074:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3459
00000100:00100000:0.0:1651532080.218076:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468048256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532080.218084:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.218088:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532080.218089:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.218092:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532080.218093:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.218097:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.218100:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532080.400870:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793305 is committed
00010000:00010000:1.0:1651532080.400886:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.400891:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.400916:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468046912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 719029us (719066us total) trans 158913793305 rc 0/0
00000100:00100000:1.0:1651532080.400919:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3452
00010000:00010000:0.0:1651532080.400923:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.400936:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532080.400937:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.400941:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.400947:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.400947:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.400948:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.400951:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.400958:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.400961:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b5c1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9232383] (req 872448->9232383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.400975:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.400987:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.401474:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532080.401486:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468048448
00000100:00100000:1.0:1651532080.401498:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3460
00000100:00100000:1.0:1651532080.401501:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468048448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532080.401509:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.401539:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532080.401540:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.401543:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532080.401544:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.401549:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.401552:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532080.509219:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793306 is committed
00010000:00010000:1.0:1651532080.509236:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.509252:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.509272:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468047104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 735616us (735640us total) trans 158913793306 rc 0/0
00000100:00100000:1.0:1651532080.509275:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3453
00010000:00010000:1.0:1651532080.509283:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.509286:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532080.509287:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.509301:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.509306:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532080.509307:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532080.509308:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.509311:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.509323:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.509326:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b5c8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10190847] (req 212992->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.509342:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.509347:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.509973:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532080.509984:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468048640
00000100:00100000:1.0:1651532080.509996:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3461
00000100:00100000:1.0:1651532080.509998:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468048640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532080.510016:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.510021:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532080.510022:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.510026:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532080.510026:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.510031:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.510034:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532080.643603:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793307 is committed
00010000:00010000:0.0:1651532080.643634:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.643647:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532080.643672:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468047296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 803072us (803101us total) trans 158913793307 rc 0/0
00000100:00100000:0.0:1651532080.643676:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3454
00010000:00010000:0.0:1651532080.643684:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.643688:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532080.643689:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.643692:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.643697:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.643697:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.643698:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.643702:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.643709:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.643712:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b5cf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->8425471] (req 876544->8425471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.643725:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.643728:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.644024:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532080.644065:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468048832
00000100:00100000:0.0:1651532080.644081:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3462
00000100:00100000:0.0:1651532080.644083:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468048832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532080.644090:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.644094:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532080.644095:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.644098:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532080.644099:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.644104:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.644107:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532080.709264:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793308 is committed
00010000:00010000:0.0:1651532080.709306:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709318:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532080.709343:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468047488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 768969us (769002us total) trans 158913793308 rc 0/0
00000100:00100000:0.0:1651532080.709347:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3455
00010000:00010000:0.0:1651532080.709355:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709358:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532080.709359:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709362:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709367:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.709368:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.709369:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709372:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709381:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709384:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b5d6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10379263] (req 114688->10379263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.709394:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.709410:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.709888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532080.709912:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468049024
00000100:00100000:0.0:1651532080.709927:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3463
00000100:00100000:0.0:1651532080.709929:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468049024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532080.709936:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709941:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532080.709942:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709945:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532080.709945:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709950:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.709953:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532080.809320:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793309 is committed
00010000:00010000:1.0:1651532080.809336:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809340:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.809357:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468047744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 777283us (777310us total) trans 158913793309 rc 0/0
00000100:00100000:1.0:1651532080.809361:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3456
00010000:00010000:1.0:1651532080.809368:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809371:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532080.809373:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809375:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809380:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532080.809381:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532080.809382:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809394:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809402:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809405:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b5dd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->6672383] (req 3092480->6672383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809410:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809413:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.809795:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532080.809831:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468049216
00000100:00100000:1.0:1651532080.809842:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3464
00000100:00100000:1.0:1651532080.809844:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468049216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532080.809852:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809856:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532080.809857:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809860:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532080.809869:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809874:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.809878:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532080.900969:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793310 is committed
00002000:00010000:1.0:1651532080.900982:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532079 -> 1651532080
00002000:00010000:1.0:1651532080.900983:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532079 -> 1651532080
00010000:00010000:1.0:1651532080.900986:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.900989:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.901011:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468047872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 868801us (868886us total) trans 158913793310 rc 0/0
00000100:00100000:1.0:1651532080.901014:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3457
00010000:00010000:0.0:1651532080.901016:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.901021:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532080.901022:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.901036:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.901042:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.901043:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532080.901043:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.901046:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.901057:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532080.901060:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b5e4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7528447] (req 991232->7528447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.901062:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.901067:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532080.901305:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532080.901314:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468049408
00000100:00100000:1.0:1651532080.901348:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3465
00000100:00100000:1.0:1651532080.901350:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468049408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532080.901357:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.901361:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532080.901362:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.901365:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532080.901366:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.901370:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532080.901374:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532081.042627:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793311 is committed
00010000:00010000:1.0:1651532081.042642:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.042646:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.042663:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468048064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 943601us (943681us total) trans 158913793311 rc 0/0
00000100:00100000:1.0:1651532081.042666:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3458
00010000:00010000:1.0:1651532081.042682:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.042686:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532081.042687:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.042690:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.042695:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532081.042696:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532081.042697:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.042700:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.042712:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.042715:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b5eb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10473471] (req 1613824->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.042724:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.042729:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.043236:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532081.043253:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468049600
00000100:00100000:1.0:1651532081.043268:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3466
00000100:00100000:1.0:1651532081.043270:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468049600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532081.043277:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.043299:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532081.043300:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.043303:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532081.043304:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.043309:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.043312:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532081.159319:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793312 is committed
00010000:00010000:0.0:1651532081.159351:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159356:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532081.159392:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468048256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 941314us (941345us total) trans 158913793312 rc 0/0
00000100:00100000:0.0:1651532081.159396:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3459
00010000:00010000:0.0:1651532081.159404:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159407:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532081.159408:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159411:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159416:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.159417:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.159418:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159421:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159431:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159434:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b5f2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->8404991] (req 995328->8404991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.159441:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.159445:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.159857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532081.159867:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468049792
00000100:00100000:1.0:1651532081.159878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532081.159895:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468049984
00000100:00100000:0.0:1651532081.159901:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3467
00000100:00100000:0.0:1651532081.159903:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468049792:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532081.159904:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3468
00000100:00100000:1.0:1651532081.159907:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468049984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532081.159910:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159915:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532081.159916:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159916:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159919:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532081.159919:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.159923:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532081.159925:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.159927:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532081.159928:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159932:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.159933:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.159936:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.159936:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532081.217700:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793313 is committed
00010000:00010000:1.0:1651532081.217715:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.217718:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.217741:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468048448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816239us (816276us total) trans 158913793313 rc 0/0
00000100:00100000:1.0:1651532081.217744:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3460
00010000:00010000:0.0:1651532081.217746:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.217750:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532081.217752:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.217755:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.217770:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.217771:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.217772:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.217775:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.217785:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.217788:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b5f9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->7696383] (req 999424->7696383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.217798:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.217810:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.218226:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532081.218244:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468050112
00000100:00100000:1.0:1651532081.218255:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3469
00000100:00100000:1.0:1651532081.218257:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468050112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532081.218264:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.218269:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532081.218270:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.218306:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532081.218307:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.218312:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.218315:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532081.284433:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793314 is committed
00010000:00010000:1.0:1651532081.284448:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.284452:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.284480:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468048640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774480us (774515us total) trans 158913793314 rc 0/0
00000100:00100000:1.0:1651532081.284483:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3461
00010000:00010000:1.0:1651532081.284490:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.284493:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532081.284494:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.284497:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.284502:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532081.284503:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532081.284503:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.284506:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.284519:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.284522:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b600 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.284531:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.284536:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.284833:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532081.284846:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468050304
00000100:00100000:1.0:1651532081.284857:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3470
00000100:00100000:1.0:1651532081.284859:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468050304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532081.284866:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.284870:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532081.284871:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532081.284871:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.284875:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532081.398401:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793315 is committed
00010000:00010000:0.0:1651532081.398436:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398440:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532081.398465:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468048832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 754381us (754441us total) trans 158913793315 rc 0/0
00000100:00100000:0.0:1651532081.398478:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3462
00010000:00010000:0.0:1651532081.398487:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398490:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532081.398492:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398494:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398500:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.398500:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.398501:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398505:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398512:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398515:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b607 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->4382719] (req 2539520->4382719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398520:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398523:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.398694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532081.398726:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468050432
00000100:00100000:0.0:1651532081.398740:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3471
00000100:00100000:0.0:1651532081.398742:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468050432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532081.398750:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398754:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532081.398755:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398758:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398761:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532081.398761:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398765:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398768:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.398779:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532081.451174:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793316 is committed
00010000:00010000:0.0:1651532081.451205:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451217:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532081.451242:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468049024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 741311us (741353us total) trans 158913793316 rc 0/0
00000100:00100000:0.0:1651532081.451245:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3463
00010000:00010000:0.0:1651532081.451253:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451256:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532081.451258:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451260:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451265:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.451266:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.451267:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451270:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451279:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451282:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b60e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->10092543] (req 368640->10092543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.451288:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.451318:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.451509:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532081.451529:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468050624
00000100:00100000:0.0:1651532081.451544:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3472
00000100:00100000:0.0:1651532081.451546:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468050624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532081.451553:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451558:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532081.451559:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451562:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532081.451562:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451567:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.451570:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532081.567891:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793317 is committed
00010000:00010000:1.0:1651532081.567906:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.567910:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.567936:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468049216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 758091us (758142us total) trans 158913793317 rc 0/0
00000100:00100000:1.0:1651532081.567940:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3464
00010000:00010000:1.0:1651532081.567947:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.567951:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532081.567952:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.567955:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.567960:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532081.567960:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532081.567961:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.567964:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.567971:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.567974:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b615 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6135807] (req 737280->6135807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.567979:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.567989:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.568343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532081.568359:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468050816
00000100:00100000:1.0:1651532081.568376:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3473
00000100:00100000:1.0:1651532081.568378:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468050816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532081.568386:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.568390:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532081.568391:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.568394:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532081.568395:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.568399:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.568403:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532081.676216:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793318 is committed
00010000:00010000:1.0:1651532081.676229:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.676243:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.676265:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468049408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774915us (774961us total) trans 158913793318 rc 0/0
00010000:00010000:0.0:1651532081.676267:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.676269:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3465
00010000:00010000:0.0:1651532081.676272:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532081.676273:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.676286:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.676303:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.676304:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.676305:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.676310:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.676320:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.676325:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.676325:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b61c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4554752->5033983] (req 4554752->5033983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.676329:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.676579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532081.676697:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468051008
00000100:00100000:1.0:1651532081.676713:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3474
00000100:00100000:1.0:1651532081.676715:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468051008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532081.676722:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.676727:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532081.676728:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.676730:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532081.676731:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.676746:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.676749:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532081.742913:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793319 is committed
00002000:00010000:1.0:1651532081.742926:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532080 -> 1651532081
00002000:00010000:1.0:1651532081.742927:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532080 -> 1651532081
00010000:00010000:1.0:1651532081.742930:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.742933:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.742956:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468049600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699686us (699721us total) trans 158913793319 rc 0/0
00010000:00010000:0.0:1651532081.742959:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.742960:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3466
00010000:00010000:0.0:1651532081.742964:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532081.742965:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.742968:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.742974:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.742982:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532081.742983:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.742986:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.742995:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.742998:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b623 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9416703] (req 528384->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.743004:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.743006:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.743392:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532081.743439:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468051200
00000100:00100000:1.0:1651532081.743453:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3475
00000100:00100000:1.0:1651532081.743455:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468051200:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532081.743462:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.743467:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532081.743475:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.743478:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532081.743479:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.743484:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.743487:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532081.909594:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793320 is committed
00010000:00010000:0.0:1651532081.909629:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.909634:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532081.909656:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468049792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749752us (749805us total) trans 158913793320 rc 0/0
00010000:00010000:1.0:1651532081.909658:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532081.909660:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3467
00010000:00010000:1.0:1651532081.909662:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532081.909663:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.909666:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.909672:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532081.909672:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532081.909673:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.909676:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.909692:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.909698:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532081.909703:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40b62a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8208383] (req 1003520->8208383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.909711:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532081.909987:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532081.910015:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468051392
00000100:00100000:0.0:1651532081.910030:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3476
00000100:00100000:0.0:1651532081.910032:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468051392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532081.910040:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.910044:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532081.910045:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.910048:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532081.910049:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.910053:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532081.910057:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532082.017876:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793321 is committed
00010000:00010000:0.0:1651532082.017907:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.017912:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.017938:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468049984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 858030us (858059us total) trans 158913793321 rc 0/0
00000100:00100000:0.0:1651532082.017941:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3468
00010000:00010000:0.0:1651532082.017949:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.017952:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532082.017953:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.017956:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.017961:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.017962:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.017963:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.017966:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.017969:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.017970:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.017970:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.017973:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.017995:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.017998:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b631 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4689920->4694015] (req 4689920->4694015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.018008:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.018012:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.018031:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.018035:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.018240:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532082.018250:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468051712
00000100:00100000:0.0:1651532082.018263:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3477
00000100:00100000:0.0:1651532082.018265:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468051712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532082.018273:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.018278:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532082.018279:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.018282:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532082.018282:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.018286:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.018311:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532082.076332:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793323 is committed
00010000:00010000:1.0:1651532082.076354:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.076358:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076363:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076367:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.076379:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468050112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 858121us (858153us total) trans 158913793323 rc 0/0
00000100:00100000:1.0:1651532082.076382:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3469
00010000:00010000:1.0:1651532082.076390:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.076390:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468050304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791530us (791557us total) trans 158913793322 rc 0/0
00000100:00100000:0.0:1651532082.076393:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3470
00010000:00010000:1.0:1651532082.076396:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532082.076398:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.076401:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076401:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076405:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532082.076407:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076407:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.076409:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b638 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->7233535] (req 1175552->7233535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076410:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076415:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.076415:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.076416:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076431:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076440:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076443:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b63f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8200192->8204287] (req 8200192->8204287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.076455:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.076459:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.076690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532082.076709:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468051840
00000100:00100000:0.0:1651532082.076725:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3478
00000100:00100000:0.0:1651532082.076727:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468051840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532082.076734:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076738:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532082.076739:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532082.076740:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.076743:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.076952:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532082.076967:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468051968
00000100:00100000:1.0:1651532082.076979:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3479
00000100:00100000:1.0:1651532082.076981:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468051968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532082.077008:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.077024:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532082.077025:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.077028:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532082.077029:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.077033:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.077037:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532082.159687:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793324 is committed
00010000:00010000:1.0:1651532082.159702:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.159706:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.159729:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468050432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 760986us (761035us total) trans 158913793324 rc 0/0
00000100:00100000:1.0:1651532082.159732:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3471
00010000:00010000:0.0:1651532082.159732:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.159737:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532082.159745:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.159748:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.159754:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.159755:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.159756:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.159759:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.159767:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.159770:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b646 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9400319] (req 221184->9400319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.159775:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.159778:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.160272:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532082.160308:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468052160
00000100:00100000:1.0:1651532082.160320:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3480
00000100:00100000:1.0:1651532082.160321:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468052160:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532082.160337:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.160341:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532082.160342:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.160345:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532082.160346:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.160351:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.160354:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532082.251375:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793325 is committed
00010000:00010000:0.0:1651532082.251406:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.251411:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.251441:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468050624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799894us (799940us total) trans 158913793325 rc 0/0
00010000:00010000:1.0:1651532082.251443:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.251445:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3472
00010000:00010000:1.0:1651532082.251447:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532082.251449:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.251452:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.251457:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532082.251465:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532082.251466:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.251469:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.251477:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.251482:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.251486:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.251488:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b64d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2711552->3268607] (req 2711552->3268607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.251777:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532082.251801:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468052352
00000100:00100000:0.0:1651532082.251830:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3481
00000100:00100000:0.0:1651532082.251832:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468052352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532082.251840:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.251844:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532082.251845:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.251848:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532082.251849:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.251853:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.251857:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532082.326442:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793326 is committed
00010000:00010000:0.0:1651532082.326475:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.326480:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.326498:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468050816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 758118us (758155us total) trans 158913793326 rc 0/0
00000100:00100000:0.0:1651532082.326501:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3473
00010000:00010000:0.0:1651532082.326508:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.326512:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532082.326513:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.326516:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.326521:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.326521:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.326522:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.326525:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.326549:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.326552:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b654 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10100735] (req 122880->10100735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.326562:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.326566:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.327104:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532082.327129:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468052544
00000100:00100000:0.0:1651532082.327146:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3482
00000100:00100000:0.0:1651532082.327149:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468052544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532082.327156:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.327161:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532082.327162:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.327165:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.327167:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532082.327168:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.327172:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.327175:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.327187:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532082.517068:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793327 is committed
00010000:00010000:1.0:1651532082.517083:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.517087:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.517111:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468051008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 840395us (840533us total) trans 158913793327 rc 0/0
00010000:00010000:0.0:1651532082.517121:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.517123:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3474
00010000:00010000:0.0:1651532082.517126:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532082.517128:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.517131:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.517137:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.517138:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.517138:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.517141:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.517152:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.517155:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b65b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6119424->8945663] (req 6119424->8945663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.517168:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.517172:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.517485:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532082.517558:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468052736
00000100:00100000:1.0:1651532082.517569:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3483
00000100:00100000:1.0:1651532082.517571:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468052736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532082.517578:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.517583:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532082.517584:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.517587:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532082.517587:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.517592:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.517595:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532082.634694:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793328 is committed
00010000:00010000:1.0:1651532082.634708:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.634712:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.634729:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468051200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 891273us (891337us total) trans 158913793328 rc 0/0
00000100:00100000:1.0:1651532082.634732:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3475
00010000:00010000:1.0:1651532082.634738:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.634742:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532082.634743:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.634746:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.634750:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532082.634751:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532082.634752:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.634755:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.634778:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.634782:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b662 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7176191] (req 2904064->7176191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.634791:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.634810:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.635092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532082.635107:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468052928
00000100:00100000:1.0:1651532082.635117:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3484
00000100:00100000:1.0:1651532082.635120:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468052928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532082.635126:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.635131:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532082.635132:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.635135:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532082.635135:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.635140:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.635143:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532082.759690:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793329 is committed
00010000:00010000:0.0:1651532082.759746:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759752:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.759792:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468051392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849758us (849804us total) trans 158913793329 rc 0/0
00000100:00100000:0.0:1651532082.759796:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3476
00010000:00010000:0.0:1651532082.759819:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759823:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532082.759825:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759828:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759836:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.759837:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.759838:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759842:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759856:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.759856:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.759857:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759860:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759870:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759873:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b669 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9613311] (req 856064->9613311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759880:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759883:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759969:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.759973:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.760453:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532082.760489:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468053120
00000100:00100000:0.0:1651532082.760512:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3485
00000100:00100000:0.0:1651532082.760523:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468053120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532082.760534:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.760539:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532082.760540:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.760543:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532082.760543:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.760548:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.760552:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532082.826451:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793331 is committed
00010000:00010000:0.0:1651532082.826497:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.826503:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.826541:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468051840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749812us (749850us total) trans 158913793330 rc 0/0
00000100:00100000:0.0:1651532082.826546:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3478
00010000:00010000:0.0:1651532082.826565:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.826579:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.826598:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468051712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 808332us (808359us total) trans 158913793331 rc 0/0
00000100:00100000:0.0:1651532082.826601:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3477
00010000:00010000:1.0:1651532082.826608:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826613:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532082.826615:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826618:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826628:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826631:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b677 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826635:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826644:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532082.826645:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826648:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826660:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532082.826661:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532082.826663:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826666:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826676:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826679:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b670 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->9310207] (req 1191936->9310207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826686:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.826689:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.827126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532082.827137:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468053312
00000100:00100000:0.0:1651532082.827152:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3486
00000100:00100000:0.0:1651532082.827154:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468053312:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532082.827159:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532082.827172:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.827177:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532082.827179:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.827181:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532082.827182:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.827187:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.827191:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532082.827211:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468053376
00000100:00100000:0.0:1651532082.827223:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3487
00000100:00100000:0.0:1651532082.827225:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468053376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532082.827231:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.827235:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532082.827236:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.827238:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532082.827239:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.827243:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.827246:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532082.943140:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793332 is committed
00002000:00010000:1.0:1651532082.943173:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532081 -> 1651532082
00002000:00010000:1.0:1651532082.943175:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532081 -> 1651532082
00010000:00010000:1.0:1651532082.943180:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.943185:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.943226:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.943232:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532082.943233:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.943243:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468051968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866260us (866290us total) trans 158913793332 rc 0/0
00000100:00100000:1.0:1651532082.943248:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3479
00010000:00010000:0.0:1651532082.943252:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.943263:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.943264:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532082.943265:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.943269:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.943283:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.943286:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b67e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->8876031] (req 1212416->8876031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.943311:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532082.943317:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532082.943951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532082.943985:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468053568
00000100:00100000:1.0:1651532082.944007:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3488
00000100:00100000:1.0:1651532082.944009:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468053568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532082.944021:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.944028:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532082.944029:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.944032:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532082.944033:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.944039:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532082.944042:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532083.043158:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793333 is committed
00010000:00010000:0.0:1651532083.043223:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.043230:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532083.043308:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468052160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 882983us (883034us total) trans 158913793333 rc 0/0
00000100:00100000:0.0:1651532083.043317:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3480
00010000:00010000:0.0:1651532083.043337:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.043343:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532083.043345:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.043350:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.043363:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.043365:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.043366:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.043373:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.043388:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.043392:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b685 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10162175] (req 933888->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.043412:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.043415:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.044138:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532083.044165:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468053760
00000100:00100000:0.0:1651532083.044185:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3489
00000100:00100000:0.0:1651532083.044188:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468053760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532083.044200:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.044205:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532083.044207:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.044210:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532083.044210:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.044216:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.044219:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532083.134820:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793334 is committed
00010000:00010000:1.0:1651532083.134846:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.134851:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.134877:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468052352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 883044us (883100us total) trans 158913793334 rc 0/0
00010000:00010000:0.0:1651532083.134878:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.134881:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3481
00010000:00010000:0.0:1651532083.134891:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532083.134892:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.134896:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.134902:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.134902:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.134903:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.134908:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.134921:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.134927:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b68c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4427776->6373375] (req 4427776->6373375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.134937:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.134941:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.135261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532083.135277:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468053952
00000100:00100000:1.0:1651532083.135301:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3490
00000100:00100000:1.0:1651532083.135303:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468053952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532083.135311:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.135316:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532083.135317:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.135320:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532083.135321:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.135326:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.135329:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532083.257826:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793335 is committed
00010000:00010000:0.0:1651532083.257859:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.257872:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532083.257896:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468052544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 930747us (930793us total) trans 158913793335 rc 0/0
00000100:00100000:0.0:1651532083.257900:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3482
00010000:00010000:0.0:1651532083.257909:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.257912:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532083.257914:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.257917:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.257923:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.257924:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.257925:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.257930:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.257945:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.257949:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b693 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9584639] (req 385024->9584639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.257957:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.257961:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.258456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532083.258491:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468054144
00000100:00100000:0.0:1651532083.258504:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3491
00000100:00100000:0.0:1651532083.258506:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468054144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532083.258513:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.258518:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532083.258519:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.258522:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532083.258523:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.258527:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.258530:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532083.418127:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793336 is committed
00010000:00010000:1.0:1651532083.418142:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418146:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.418163:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468052736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 900591us (900678us total) trans 158913793336 rc 0/0
00000100:00100000:1.0:1651532083.418167:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3483
00010000:00010000:1.0:1651532083.418174:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418178:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532083.418179:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418182:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418197:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532083.418198:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532083.418199:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418202:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418210:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418212:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b69a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418218:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418221:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.418599:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532083.418615:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468054336
00000100:00100000:1.0:1651532083.418632:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3492
00000100:00100000:1.0:1651532083.418634:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468054336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532083.418642:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418646:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532083.418655:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418658:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532083.418659:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418664:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.418667:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532083.543125:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793337 is committed
00010000:00010000:1.0:1651532083.543139:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.543143:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.543165:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468052928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 908045us (908074us total) trans 158913793337 rc 0/0
00010000:00010000:0.0:1651532083.543167:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.543169:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3484
00010000:00010000:0.0:1651532083.543172:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532083.543173:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.543187:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.543193:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.543193:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.543195:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.543200:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.543212:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.543217:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b6a1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->6844415] (req 1429504->6844415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.543226:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.543229:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.543534:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532083.543573:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468054464
00000100:00100000:1.0:1651532083.543587:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3493
00000100:00100000:1.0:1651532083.543589:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468054464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532083.543596:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.543607:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532083.543609:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532083.543609:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.543613:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532083.630712:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793338 is committed
00010000:00010000:0.0:1651532083.630746:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.630751:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532083.630787:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468053120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 870263us (870334us total) trans 158913793338 rc 0/0
00000100:00100000:0.0:1651532083.630791:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3485
00010000:00010000:0.0:1651532083.630799:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.630814:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532083.630815:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.630818:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.630824:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.630825:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.630827:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.630831:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.630844:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.630848:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6a8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->10420223] (req 507904->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.630855:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.630867:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.631240:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532083.631288:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468054656
00000100:00100000:0.0:1651532083.631319:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3494
00000100:00100000:0.0:1651532083.631329:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468054656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532083.631339:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.631346:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532083.631347:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.631352:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532083.631353:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.631360:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.631365:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532083.684901:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793339 is committed
00010000:00010000:0.0:1651532083.684935:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.684940:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532083.684971:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468053312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 857816us (857845us total) trans 158913793339 rc 0/0
00010000:00010000:1.0:1651532083.684972:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532083.684974:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3486
00010000:00010000:1.0:1651532083.684977:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532083.684978:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.684981:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.684987:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532083.684987:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532083.684988:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.684991:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.685011:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.685014:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b6af lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->7761919] (req 315392->7761919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.685026:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.685031:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.685283:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532083.685313:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468054848
00000100:00100000:0.0:1651532083.685333:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3495
00000100:00100000:0.0:1651532083.685336:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468054848:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532083.685346:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.685352:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532083.685354:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.685359:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532083.685360:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.685366:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.685370:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532083.726881:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793340 is committed
00010000:00010000:0.0:1651532083.726915:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.726919:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532083.726937:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468053376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 899711us (899784us total) trans 158913793340 rc 0/0
00000100:00100000:0.0:1651532083.726940:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3487
00010000:00010000:0.0:1651532083.726947:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.726951:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532083.726952:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.726954:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.726959:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.726960:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.726961:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.726963:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.726986:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.726990:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b6b6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6144000->6148095] (req 6144000->6148095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.727000:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.727004:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532083.727260:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532083.727270:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468055040
00000100:00100000:0.0:1651532083.727284:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3496
00000100:00100000:0.0:1651532083.727286:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468055040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532083.727303:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.727310:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532083.727311:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.727316:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532083.727317:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.727324:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.727330:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532083.793392:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793341 is committed
00010000:00010000:1.0:1651532083.793407:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.793411:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.793433:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468053568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849423us (849483us total) trans 158913793341 rc 0/0
00010000:00010000:0.0:1651532083.793436:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.793437:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3488
00010000:00010000:0.0:1651532083.793441:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532083.793442:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.793445:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.793450:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.793451:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532083.793452:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.793455:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.793462:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532083.793467:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b6bd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8884223] (req 1445888->8884223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.793473:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.793493:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.793771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532083.793780:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468055168
00000100:00100000:1.0:1651532083.793791:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3497
00000100:00100000:1.0:1651532083.793793:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468055168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532083.793800:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.793821:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532083.793822:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.793825:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532083.793825:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.793835:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.793838:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532083.927815:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793342 is committed
00002000:00010000:1.0:1651532083.927829:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532082 -> 1651532083
00002000:00010000:1.0:1651532083.927830:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532082 -> 1651532083
00010000:00010000:1.0:1651532083.927841:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.927845:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.927863:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468053760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 883674us (883733us total) trans 158913793342 rc 0/0
00000100:00100000:1.0:1651532083.927866:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3489
00010000:00010000:1.0:1651532083.927873:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.927877:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532083.927878:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.927881:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.927886:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532083.927886:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532083.927887:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.927890:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.927897:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.927910:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b6c4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10178559] (req 225280->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.927916:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.927919:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532083.928197:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532083.928217:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468055424
00000100:00100000:1.0:1651532083.928234:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3498
00000100:00100000:1.0:1651532083.928236:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468055424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532083.928251:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.928255:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532083.928256:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.928259:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532083.928260:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.928264:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532083.928276:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532084.044477:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793343 is committed
00010000:00010000:1.0:1651532084.044491:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.044495:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.044514:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.044517:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468053952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 909213us (909256us total) trans 158913793343 rc 0/0
00000100:00100000:1.0:1651532084.044520:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3490
00010000:00010000:0.0:1651532084.044520:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532084.044529:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.044533:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.044540:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532084.044540:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532084.044541:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.044545:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.044553:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.044556:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b6cb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7360511] (req 7102464->7360511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.044562:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.044565:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.044864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532084.044873:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468055616
00000100:00100000:1.0:1651532084.044887:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3499
00000100:00100000:1.0:1651532084.044888:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468055616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532084.044896:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.044900:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532084.044901:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.044904:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.044917:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532084.044918:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.044923:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.044926:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.044929:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532084.111184:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793344 is committed
00010000:00010000:0.0:1651532084.111220:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.111225:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.111256:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468054144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 852749us (852801us total) trans 158913793344 rc 0/0
00010000:00010000:1.0:1651532084.111258:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.111260:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3491
00010000:00010000:1.0:1651532084.111262:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532084.111263:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111266:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111272:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.111272:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.111273:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111286:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111289:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.111290:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.111291:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111302:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111319:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111322:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b6d2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->8749055] (req 266240->8749055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111328:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111331:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111390:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.111393:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.111518:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532084.111554:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468055808
00000100:00100000:0.0:1651532084.111569:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3500
00000100:00100000:0.0:1651532084.111571:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468055808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532084.111579:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.111584:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532084.111585:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.111588:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532084.111588:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.111593:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.111596:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532084.202903:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793346 is committed
00010000:00010000:1.0:1651532084.202918:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.202922:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.202943:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468054464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 659353us (659409us total) trans 158913793345 rc 0/0
00000100:00100000:1.0:1651532084.202946:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3493
00010000:00010000:0.0:1651532084.202947:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.202959:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.202963:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.202966:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532084.202967:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.202976:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.202977:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468054336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 784342us (784379us total) trans 158913793346 rc 0/0
00000100:00100000:1.0:1651532084.202979:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3492
00010000:00010000:0.0:1651532084.202982:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.202985:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b6e0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.202989:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.202992:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532084.202992:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.202995:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.202999:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532084.202999:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532084.203000:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.203012:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.203020:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.203022:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b6d9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6987776->9052159] (req 6987776->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.203028:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.203031:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.203314:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532084.203346:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532084.203369:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468056000
00000100:00100000:1.0:1651532084.203382:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468056128
00000100:00100000:1.0:1651532084.203391:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3501
00000100:00100000:1.0:1651532084.203392:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468056000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532084.203400:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.203411:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532084.203412:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.203415:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532084.203416:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.203420:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.203424:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.203432:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3502
00000100:00100000:1.0:1651532084.203434:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468056128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532084.203439:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.203442:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.203443:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.203445:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532084.203446:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.203449:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.203459:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532084.286271:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793347 is committed
00010000:00010000:0.0:1651532084.286310:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.286314:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.286337:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468054656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 655015us (655097us total) trans 158913793347 rc 0/0
00010000:00010000:1.0:1651532084.286339:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.286340:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3494
00010000:00010000:1.0:1651532084.286344:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532084.286345:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.286348:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.286354:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.286354:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.286355:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.286358:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.286368:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.286371:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b6e7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7200768->9097215] (req 7200768->9097215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.286379:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.286394:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.286637:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532084.286666:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468056384
00000100:00100000:0.0:1651532084.286678:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3503
00000100:00100000:0.0:1651532084.286680:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468056384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532084.286688:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.286692:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532084.286693:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532084.286694:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.286697:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532084.444609:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793348 is committed
00010000:00010000:0.0:1651532084.444641:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.444646:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.444668:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.444669:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468054848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 759332us (759386us total) trans 158913793348 rc 0/0
00010000:00010000:1.0:1651532084.444672:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532084.444672:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3495
00010000:00010000:1.0:1651532084.444673:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.444677:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.444683:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.444683:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.444684:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.444687:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.444697:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.444700:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b6ee lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->10280959] (req 1507328->10280959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.444710:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.444731:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.445159:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532084.445169:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468056576
00000100:00100000:0.0:1651532084.445180:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3504
00000100:00100000:0.0:1651532084.445182:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468056576:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532084.445189:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.445194:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532084.445195:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.445198:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532084.445199:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.445203:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.445207:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.448110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532084.448120:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230656
00000100:00100000:0.0:1651532084.448129:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 53
00000100:00100000:0.0:1651532084.448131:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951230656:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532084.448138:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1634304 granted 356938304 pending 172032 free 81138851840 avail 76965961728
00000100:00100000:0.0:1651532084.448157:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951230656:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 25us (47us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532084.448170:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 53
00000001:00080000:1.0:1651532084.540569:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793349 is committed
00010000:00010000:1.0:1651532084.540584:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.540588:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.540611:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468055040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 813324us (813351us total) trans 158913793349 rc 0/0
00010000:00010000:0.0:1651532084.540613:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.540615:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3496
00010000:00010000:0.0:1651532084.540618:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532084.540619:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.540622:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.540628:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532084.540628:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532084.540629:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.540632:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.540641:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.540645:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b6f5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1560576->9056255] (req 1560576->9056255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.540659:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.540663:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.540968:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532084.540984:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468056768
00000100:00100000:1.0:1651532084.541001:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3505
00000100:00100000:1.0:1651532084.541003:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468056768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532084.541011:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.541025:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532084.541026:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.541029:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532084.541030:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.541034:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.541038:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532084.627961:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793350 is committed
00010000:00010000:1.0:1651532084.627976:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.627979:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.627996:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468055168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 834202us (834225us total) trans 158913793350 rc 0/0
00000100:00100000:1.0:1651532084.627999:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3497
00010000:00010000:1.0:1651532084.628006:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628009:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532084.628018:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628022:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628027:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.628028:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.628029:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628032:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628039:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628042:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b6fc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7995392->7999487] (req 7995392->7999487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628047:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628050:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.628384:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532084.628401:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468057088
00000100:00100000:1.0:1651532084.628418:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3506
00000100:00100000:1.0:1651532084.628420:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468057088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532084.628435:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628439:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532084.628440:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628443:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532084.628444:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628448:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.628451:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532084.744646:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793351 is committed
00010000:00010000:1.0:1651532084.744661:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.744665:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.744683:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468055424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816446us (816494us total) trans 158913793351 rc 0/0
00000100:00100000:1.0:1651532084.744687:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3498
00010000:00010000:1.0:1651532084.744693:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.744705:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532084.744706:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.744709:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.744714:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.744715:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.744716:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.744719:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.744726:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.744729:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b703 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9719807] (req 1576960->9719807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.744734:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.744737:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.745323:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532084.745337:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468057216
00000100:00100000:1.0:1651532084.745353:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3507
00000100:00100000:1.0:1651532084.745355:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468057216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532084.745362:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.745366:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532084.745367:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.745370:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532084.745371:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.745375:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.745379:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532084.811393:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793352 is committed
00010000:00010000:1.0:1651532084.811407:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.811411:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.811434:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468055616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766544us (766570us total) trans 158913793352 rc 0/0
00010000:00010000:0.0:1651532084.811438:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.811443:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532084.811449:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3499
00010000:00010000:0.0:1651532084.811457:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.811461:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.811467:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532084.811467:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532084.811468:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.811471:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.811480:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.811483:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b70a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->10186751] (req 237568->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.811488:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.811491:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532084.812049:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532084.812065:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468057472
00000100:00100000:1.0:1651532084.812079:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3508
00000100:00100000:1.0:1651532084.812081:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468057472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532084.812088:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.812093:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532084.812094:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.812097:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532084.812098:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.812102:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.812105:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532084.926078:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793353 is committed
00002000:00010000:0.0:1651532084.926109:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532083 -> 1651532084
00010000:00010000:0.0:1651532084.926112:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.926127:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.926150:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468055808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 814578us (814632us total) trans 158913793353 rc 0/0
00010000:00010000:1.0:1651532084.926152:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.926154:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3500
00010000:00010000:1.0:1651532084.926156:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532084.926164:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.926167:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.926173:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.926173:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532084.926174:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.926177:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.926185:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532084.926188:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b711 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1605632->7815167] (req 1605632->7815167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.926191:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.926196:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532084.926473:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532084.926483:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468057664
00000100:00100000:0.0:1651532084.926514:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3509
00000100:00100000:0.0:1651532084.926516:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468057664:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532084.926525:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.926529:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532084.926530:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.926533:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.926536:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532084.926545:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.926550:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.926553:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532084.926556:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532085.036419:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793354 is committed
00010000:00010000:0.0:1651532085.036451:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.036456:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.036480:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532085.036480:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468056000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 833086us (833172us total) trans 158913793354 rc 0/0
00010000:00010000:1.0:1651532085.036484:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532085.036484:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3501
00010000:00010000:1.0:1651532085.036485:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.036489:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.036504:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.036505:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.036506:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.036509:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.036512:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.036513:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.036513:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.036524:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.036538:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.036541:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b718 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1785856->9535487] (req 1785856->9535487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.036546:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.036547:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.036550:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.036551:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532085.036760:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532085.036771:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468057984
00000100:00100000:0.0:1651532085.036796:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3510
00000100:00100000:0.0:1651532085.036798:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468057984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532085.036820:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.036825:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532085.036826:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.036829:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532085.036830:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.036834:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.036838:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532085.136437:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793356 is committed
00010000:00010000:1.0:1651532085.136464:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136469:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.136489:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468056128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 933054us (933143us total) trans 158913793355 rc 0/0
00000100:00100000:1.0:1651532085.136493:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3502
00010000:00010000:0.0:1651532085.136498:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136501:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.136506:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136513:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532085.136514:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136517:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136528:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.136529:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.136530:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136533:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532085.136538:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468056384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849855us (849900us total) trans 158913793356 rc 0/0
00010000:00010000:1.0:1651532085.136542:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532085.136552:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3503
00010000:00010000:1.0:1651532085.136555:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b71f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9420800->9424895] (req 9420800->9424895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136559:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136561:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532085.136561:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136562:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136565:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136569:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.136572:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40b726 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->2240511] (req 741376->2240511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.136574:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.136966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532085.136978:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468058176
00000100:00100000:1.0:1651532085.136987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532085.137003:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468058304
00000100:00100000:1.0:1651532085.137009:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3511
00000100:00100000:1.0:1651532085.137011:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468058176:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532085.137012:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3512
00000100:00100000:0.0:1651532085.137014:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468058304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532085.137020:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.137022:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.137024:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532085.137033:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.137037:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532085.137037:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.137041:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532085.137043:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.137046:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532085.137046:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.137050:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.137051:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.137054:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.137054:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532085.228120:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793357 is committed
00010000:00010000:0.0:1651532085.228152:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228168:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532085.228194:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468056576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783010us (783035us total) trans 158913793357 rc 0/0
00000100:00100000:0.0:1651532085.228197:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3504
00010000:00010000:0.0:1651532085.228205:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228209:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532085.228210:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228213:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228218:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532085.228219:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532085.228220:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228223:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228232:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.228242:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228245:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b72d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8060928->9617407] (req 8060928->9617407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.228246:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.228586:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532085.228605:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468058496
00000100:00100000:0.0:1651532085.228618:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3513
00000100:00100000:0.0:1651532085.228620:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468058496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532085.228626:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228631:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532085.228632:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228635:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532085.228636:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228640:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.228643:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532085.294877:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793358 is committed
00010000:00010000:1.0:1651532085.294894:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.294898:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.294916:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468056768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 753911us (753949us total) trans 158913793358 rc 0/0
00000100:00100000:1.0:1651532085.294929:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3505
00010000:00010000:1.0:1651532085.294937:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.294940:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532085.294942:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.294944:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.294950:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.294950:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.294951:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.294954:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.294961:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.294964:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b734 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2277376->10289151] (req 2277376->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.294969:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.294981:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.295268:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532085.295277:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468058624
00000100:00100000:1.0:1651532085.295301:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3514
00000100:00100000:1.0:1651532085.295303:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468058624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532085.295311:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.295315:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532085.295316:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532085.295331:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.295335:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532085.411523:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793359 is committed
00010000:00010000:1.0:1651532085.411538:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.411541:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.411559:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468057088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783138us (783175us total) trans 158913793359 rc 0/0
00000100:00100000:1.0:1651532085.411572:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3506
00010000:00010000:1.0:1651532085.411580:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.411583:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532085.411585:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.411588:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.411593:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.411594:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.411594:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.411598:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.411605:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.411608:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b73b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10297343] (req 2691072->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.411613:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.411625:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.412010:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532085.412018:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468058816
00000100:00100000:1.0:1651532085.412036:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3515
00000100:00100000:1.0:1651532085.412038:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468058816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532085.412045:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.412049:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.412050:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.412053:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532085.412054:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.412058:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.412062:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532085.511556:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793360 is committed
00010000:00010000:1.0:1651532085.511572:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.511587:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.511611:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468057216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766255us (766289us total) trans 158913793360 rc 0/0
00010000:00010000:0.0:1651532085.511612:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.511615:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3507
00010000:00010000:0.0:1651532085.511618:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532085.511627:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.511631:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.511637:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532085.511638:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532085.511638:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.511642:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.511649:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.511652:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b742 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->4943871] (req 4939776->4943871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.511668:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.511672:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.511895:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532085.511985:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468059072
00000100:00100000:1.0:1651532085.512001:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3516
00000100:00100000:1.0:1651532085.512003:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468059072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532085.512011:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.512016:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532085.512017:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.512020:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.512022:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532085.512031:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.512036:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.512039:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.512043:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532085.611590:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793361 is committed
00010000:00010000:1.0:1651532085.611606:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.611610:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.611628:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468057472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799546us (799579us total) trans 158913793361 rc 0/0
00000100:00100000:1.0:1651532085.611631:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3508
00010000:00010000:1.0:1651532085.611638:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.611642:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532085.611643:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.611657:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.611663:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.611663:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.611664:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.611668:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.611679:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.611683:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b749 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10194943] (req 2699264->10194943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.611693:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.611697:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.612003:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532085.612012:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468059200
00000100:00100000:1.0:1651532085.612026:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3517
00000100:00100000:1.0:1651532085.612027:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468059200:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532085.612035:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.612039:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532085.612040:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.612046:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532085.612047:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.612051:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.612054:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532085.686628:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793362 is committed
00010000:00010000:0.0:1651532085.686660:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.686664:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532085.686696:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468057664:12345-10.240.43.64@tcp:4:fio.0 Request processed in 760178us (760222us total) trans 158913793362 rc 0/0
00010000:00010000:1.0:1651532085.686697:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532085.686700:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3509
00010000:00010000:1.0:1651532085.686701:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532085.686702:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.686705:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.686710:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.686711:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.686712:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.686715:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.686735:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.686744:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.686746:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40b750 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [942080->10207231] (req 942080->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.686748:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532085.687264:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532085.687280:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468059520
00000100:00100000:1.0:1651532085.687305:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3518
00000100:00100000:1.0:1651532085.687307:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468059520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532085.687314:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.687318:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532085.687319:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.687322:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532085.687323:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.687327:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.687330:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532085.819980:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793363 is committed
00010000:00010000:0.0:1651532085.820018:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820023:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532085.820047:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468057984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 783248us (783288us total) trans 158913793363 rc 0/0
00000100:00100000:0.0:1651532085.820051:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3510
00010000:00010000:0.0:1651532085.820059:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820062:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532085.820063:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820077:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820083:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532085.820084:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532085.820084:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820087:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820094:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820097:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b757 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6258688->7540735] (req 6258688->7540735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.820102:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.820107:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.820267:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532085.820322:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468059712
00000100:00100000:0.0:1651532085.820341:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3519
00000100:00100000:0.0:1651532085.820344:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468059712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532085.820354:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820359:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532085.820360:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820363:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532085.820372:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820377:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.820381:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532085.986607:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793364 is committed
00002000:00010000:1.0:1651532085.986622:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532084 -> 1651532085
00010000:00010000:1.0:1651532085.986625:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.986629:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532085.986647:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468058176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 849636us (849682us total) trans 158913793364 rc 0/0
00000100:00100000:1.0:1651532085.986651:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3511
00010000:00010000:1.0:1651532085.986658:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.986662:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532085.986663:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.986666:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.986671:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.986680:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532085.986681:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.986684:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.986696:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.986700:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b75e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->10104831] (req 2248704->10104831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.986712:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532085.986717:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532085.987226:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532085.987238:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468059904
00000100:00100000:1.0:1651532085.987250:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3520
00000100:00100000:1.0:1651532085.987252:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468059904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532085.987259:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.987264:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532085.987265:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.987268:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532085.987268:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.987273:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532085.987288:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532086.103230:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793365 is committed
00002000:00010000:0.0:1651532086.103258:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532083 -> 1651532085
00010000:00010000:0.0:1651532086.103261:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.103265:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.103287:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468058304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 966272us (966299us total) trans 158913793365 rc 0/0
00010000:00010000:1.0:1651532086.103289:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.103290:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3512
00010000:00010000:1.0:1651532086.103302:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532086.103303:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.103307:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.103312:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.103313:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.103314:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.103317:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.103320:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.103321:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.103321:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.103324:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.103350:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.103354:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40b765 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3162112->10108927] (req 3162112->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.103355:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.103364:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.103367:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.103376:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.103595:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532086.103604:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468060096
00000100:00100000:0.0:1651532086.103618:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3521
00000100:00100000:0.0:1651532086.103620:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468060096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532086.103628:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.103633:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532086.103634:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.103637:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532086.103637:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.103642:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.103645:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532086.161661:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793367 is committed
00010000:00010000:1.0:1651532086.161683:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161687:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.161701:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.161708:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468058496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 933087us (933123us total) trans 158913793366 rc 0/0
00000100:00100000:1.0:1651532086.161712:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3513
00010000:00010000:1.0:1651532086.161719:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.161723:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161727:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532086.161728:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161742:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.161742:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468058624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866438us (866474us total) trans 158913793367 rc 0/0
00000100:00100000:0.0:1651532086.161745:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3514
00010000:00010000:1.0:1651532086.161748:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.161748:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.161749:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161752:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161758:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161761:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40b76c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6262784->6266879] (req 6262784->6266879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161765:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161767:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532086.161768:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161771:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161775:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.161785:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.161790:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b773 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.161790:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.162016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532086.162056:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532086.162067:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468060288
00000100:00100000:1.0:1651532086.162078:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468060416
00000100:00100000:1.0:1651532086.162084:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3522
00000100:00100000:1.0:1651532086.162086:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468060288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532086.162092:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.162096:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.162097:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.162100:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532086.162101:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.162105:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.162108:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.162115:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3523
00000100:00100000:1.0:1651532086.162117:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468060416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532086.162121:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.162133:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.162134:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532086.162135:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.162138:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532086.228363:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793368 is committed
00010000:00010000:0.0:1651532086.228395:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.228400:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.228419:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468058816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816380us (816409us total) trans 158913793368 rc 0/0
00000100:00100000:0.0:1651532086.228422:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3515
00010000:00010000:0.0:1651532086.228430:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.228451:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532086.228453:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.228456:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.228461:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.228462:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.228462:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.228466:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.228477:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.228481:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b77a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6172672->10477567] (req 6172672->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.228489:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.228493:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.228958:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532086.228966:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468060544
00000100:00100000:0.0:1651532086.228977:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3524
00000100:00100000:0.0:1651532086.228979:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468060544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532086.228986:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.229000:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.229001:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532086.229002:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.229005:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532086.336707:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793369 is committed
00010000:00010000:1.0:1651532086.336723:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.336727:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.336750:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468059072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 824745us (824855us total) trans 158913793369 rc 0/0
00000100:00100000:1.0:1651532086.336753:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3516
00010000:00010000:0.0:1651532086.336754:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.336759:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532086.336760:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.336764:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.336769:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.336770:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.336771:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.336774:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.336784:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.336793:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.336797:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b781 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->6397951] (req 2805760->6397951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.336828:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.337079:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532086.337105:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468060736
00000100:00100000:1.0:1651532086.337121:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3525
00000100:00100000:1.0:1651532086.337123:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468060736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532086.337130:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.337135:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532086.337136:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.337139:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.337141:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.337144:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532086.337145:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.337149:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.337152:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.337163:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.337166:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532086.445083:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793370 is committed
00010000:00010000:1.0:1651532086.445097:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445101:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.445118:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468059200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 833089us (833115us total) trans 158913793370 rc 0/0
00000100:00100000:1.0:1651532086.445121:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3517
00010000:00010000:1.0:1651532086.445128:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445131:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532086.445133:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445135:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445141:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.445149:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.445150:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445153:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445161:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445164:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b788 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->2936831] (req 2932736->2936831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445169:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445172:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.445538:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532086.445548:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468060992
00000100:00100000:1.0:1651532086.445565:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3526
00000100:00100000:1.0:1651532086.445566:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468060992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532086.445574:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445578:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532086.445579:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445592:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532086.445593:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445598:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.445601:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532086.504778:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793371 is committed
00010000:00010000:1.0:1651532086.504793:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.504797:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.504827:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.504833:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468059520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 817525us (817570us total) trans 158913793371 rc 0/0
00000100:00100000:1.0:1651532086.504837:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3518
00010000:00010000:0.0:1651532086.504837:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532086.504838:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.504841:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.504847:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.504848:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.504849:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.504852:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.504860:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.504863:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b78f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8888319] (req 1155072->8888319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.504880:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.504885:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.505426:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532086.505535:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468061120
00000100:00100000:1.0:1651532086.505552:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3527
00000100:00100000:1.0:1651532086.505553:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468061120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532086.505561:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.505565:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532086.505567:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.505569:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532086.505570:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.505574:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.505578:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532086.596451:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793372 is committed
00010000:00010000:1.0:1651532086.596465:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.596469:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.596492:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468059712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 776147us (776225us total) trans 158913793372 rc 0/0
00010000:00010000:0.0:1651532086.596492:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.596497:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532086.596499:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.596502:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.596505:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3519
00010000:00010000:0.0:1651532086.596508:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.596508:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.596509:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.596512:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.596522:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.596525:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b796 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10395647] (req 294912->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.596535:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.596538:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.597092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532086.597109:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468061376
00000100:00100000:1.0:1651532086.597123:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3528
00000100:00100000:1.0:1651532086.597125:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468061376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532086.597132:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.597136:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532086.597137:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.597140:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532086.597141:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.597145:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.597149:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532086.715402:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793373 is committed
00010000:00010000:0.0:1651532086.715432:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.715437:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.715458:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468059904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 728204us (728232us total) trans 158913793373 rc 0/0
00010000:00010000:1.0:1651532086.715460:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.715462:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3520
00010000:00010000:1.0:1651532086.715464:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532086.715465:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.715476:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.715481:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.715482:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.715482:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.715485:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.715495:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.715499:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b79d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5173248->6631423] (req 5173248->6631423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.715505:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.715509:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.715746:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532086.715755:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468061568
00000100:00100000:0.0:1651532086.715766:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3529
00000100:00100000:0.0:1651532086.715768:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468061568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532086.715775:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.715818:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532086.715820:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.715823:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532086.715831:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.715836:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.715840:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532086.823801:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793374 is committed
00010000:00010000:0.0:1651532086.823844:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823848:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.823866:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468060096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 720245us (720272us total) trans 158913793374 rc 0/0
00000100:00100000:0.0:1651532086.823870:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3521
00010000:00010000:0.0:1651532086.823877:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823880:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532086.823881:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823884:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823889:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.823899:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.823900:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823903:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823907:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.823907:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.823908:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823910:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823913:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.823913:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.823914:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823917:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823930:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823933:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7a4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8949759] (req 393216->8949759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823938:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.823941:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.823945:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.823949:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.824002:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.824006:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.824557:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532086.824585:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468061760
00000100:00100000:1.0:1651532086.824602:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3530
00000100:00100000:1.0:1651532086.824604:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468061760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532086.824611:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.824616:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532086.824617:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.824619:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532086.824620:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.824624:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.824628:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532086.957088:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793377 is committed
00002000:00010000:1.0:1651532086.957109:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532085 -> 1651532086
00010000:00010000:1.0:1651532086.957113:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957116:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957131:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957142:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.957147:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468060416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 795029us (795092us total) trans 158913793376 rc 0/0
00000100:00100000:1.0:1651532086.957157:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3523
00000100:00100000:0.0:1651532086.957162:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468060544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 728182us (728204us total) trans 158913793375 rc 0/0
00010000:00010000:1.0:1651532086.957165:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.957165:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3524
00010000:00010000:1.0:1651532086.957168:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532086.957169:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957172:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957174:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957178:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957178:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532086.957179:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957181:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7b2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2973696->2977791] (req 2973696->2977791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957182:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957188:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957191:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b7b9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7221248->7225343] (req 7221248->7225343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957212:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957215:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.957231:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754468060288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 795144us (795216us total) trans 158913793377 rc 0/0
00000100:00100000:0.0:1651532086.957234:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3522
00010000:00010000:0.0:1651532086.957240:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957243:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532086.957244:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957247:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957251:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.957252:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532086.957252:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957255:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957268:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957277:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957278:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b7ab lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->2945023] (req 393216->2945023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957281:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.957446:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532086.957455:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468061952
00000100:00100000:0.0:1651532086.957493:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3531
00000100:00100000:0.0:1651532086.957495:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468061952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532086.957503:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957507:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532086.957508:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957511:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532086.957512:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957516:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957520:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532086.957639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532086.957663:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532086.957680:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468062080
00000100:00100000:1.0:1651532086.957687:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468062272
00000100:00100000:0.0:1651532086.957700:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3532
00000100:00100000:0.0:1651532086.957702:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468062080:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532086.957703:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3533
00010000:00010000:0.0:1651532086.957709:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957713:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532086.957714:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532086.957715:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468062272:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532086.957717:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532086.957717:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957722:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532086.957725:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957741:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957747:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532086.957748:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957752:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532086.957753:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957757:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532086.957761:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532087.023823:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793378 is committed
00010000:00010000:1.0:1651532087.023838:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.023843:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.023861:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468060736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 686736us (686782us total) trans 158913793378 rc 0/0
00000100:00100000:1.0:1651532087.023864:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3525
00010000:00010000:1.0:1651532087.023881:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.023885:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532087.023886:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.023889:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.023894:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532087.023895:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532087.023896:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.023899:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.023906:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.023909:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b7c0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10018815] (req 2297856->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.023914:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.023917:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.024485:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532087.024502:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468062464
00000100:00100000:1.0:1651532087.024519:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3534
00000100:00100000:1.0:1651532087.024522:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468062464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532087.024529:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.024534:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532087.024535:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.024538:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532087.024538:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.024543:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.024546:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532087.132174:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793379 is committed
00010000:00010000:1.0:1651532087.132189:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.132193:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.132224:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.132229:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468060992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 686661us (686699us total) trans 158913793379 rc 0/0
00000100:00100000:1.0:1651532087.132232:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3526
00010000:00010000:0.0:1651532087.132234:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532087.132235:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.132238:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.132256:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.132256:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.132257:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.132260:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.132270:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.132273:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b7c7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2985984->8335359] (req 2985984->8335359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.132306:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.132310:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.132608:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532087.132626:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468062656
00000100:00100000:1.0:1651532087.132643:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3535
00000100:00100000:1.0:1651532087.132645:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468062656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532087.132660:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.132665:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532087.132666:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.132669:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532087.132669:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.132674:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.132685:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532087.240503:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793380 is committed
00010000:00010000:1.0:1651532087.240518:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240521:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.240537:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468061120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 734983us (735111us total) trans 158913793380 rc 0/0
00000100:00100000:1.0:1651532087.240541:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3527
00010000:00010000:1.0:1651532087.240547:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240551:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532087.240552:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240555:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240560:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532087.240560:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532087.240561:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240575:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240583:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240586:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b7ce lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4542464->4546559] (req 4542464->4546559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240591:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240594:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.240919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532087.240927:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468062912
00000100:00100000:1.0:1651532087.240943:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3536
00000100:00100000:1.0:1651532087.240945:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468062912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532087.240952:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240957:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532087.240958:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240960:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532087.240969:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240974:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.240978:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532087.340517:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793381 is committed
00010000:00010000:1.0:1651532087.340532:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.340535:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.340558:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468061376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 743432us (743466us total) trans 158913793381 rc 0/0
00000100:00100000:1.0:1651532087.340561:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3528
00010000:00010000:0.0:1651532087.340565:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.340570:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532087.340571:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.340575:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.340580:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.340581:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.340582:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.340596:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.340604:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.340607:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b7d5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->9252863] (req 3018752->9252863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.340613:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.340616:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.340918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532087.340963:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468063040
00000100:00100000:1.0:1651532087.340977:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3537
00000100:00100000:1.0:1651532087.340979:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468063040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532087.340986:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.340991:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532087.340992:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.340997:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532087.340998:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.341002:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.341006:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532087.407306:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793382 is committed
00010000:00010000:0.0:1651532087.407344:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407349:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532087.407374:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468061568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691604us (691628us total) trans 158913793382 rc 0/0
00000100:00100000:0.0:1651532087.407377:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3529
00010000:00010000:0.0:1651532087.407385:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407400:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532087.407401:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407405:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407410:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.407411:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.407412:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407415:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407424:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407427:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b7dc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->10362879] (req 663552->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.407430:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.407434:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.407906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532087.407921:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468063296
00000100:00100000:0.0:1651532087.407936:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3538
00000100:00100000:0.0:1651532087.407938:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468063296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532087.407946:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407960:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.407961:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407964:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532087.407965:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407969:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.407972:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532087.498941:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793383 is committed
00010000:00010000:1.0:1651532087.498956:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.498960:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.498977:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468061760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674372us (674421us total) trans 158913793383 rc 0/0
00000100:00100000:1.0:1651532087.498990:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3530
00010000:00010000:1.0:1651532087.498998:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.499002:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532087.499003:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.499006:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.499011:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532087.499011:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532087.499012:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.499016:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.499028:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.499031:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b7e3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->3121151] (req 3043328->3121151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.499042:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.499047:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.499248:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532087.499257:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468063488
00000100:00100000:1.0:1651532087.499268:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3539
00000100:00100000:1.0:1651532087.499276:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468063488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532087.499308:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.499313:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532087.499314:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.499317:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532087.499317:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.499322:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.499325:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532087.590670:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793384 is committed
00010000:00010000:0.0:1651532087.590703:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.590708:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532087.590732:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468061952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 633236us (633286us total) trans 158913793384 rc 0/0
00000100:00100000:0.0:1651532087.590745:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3531
00010000:00010000:0.0:1651532087.590754:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.590757:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532087.590758:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.590762:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.590767:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.590768:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.590768:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.590772:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.590779:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.590782:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b7ea lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->9285631] (req 409600->9285631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.590787:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.590790:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.591264:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532087.591287:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468063680
00000100:00100000:0.0:1651532087.591316:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3540
00000100:00100000:0.0:1651532087.591320:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468063680:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532087.591330:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.591336:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532087.591337:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.591342:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532087.591343:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.591350:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.591355:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532087.698986:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793385 is committed
00010000:00010000:0.0:1651532087.699017:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699022:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532087.699045:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468062080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 741342us (741406us total) trans 158913793385 rc 0/0
00000100:00100000:0.0:1651532087.699057:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3532
00010000:00010000:0.0:1651532087.699065:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699069:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532087.699070:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699073:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699078:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.699078:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.699079:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699082:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699092:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699095:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b7f1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->9367551] (req 3129344->9367551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.699099:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.699103:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.699371:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532087.699397:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468063872
00000100:00100000:0.0:1651532087.699414:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3541
00000100:00100000:0.0:1651532087.699416:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468063872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532087.699431:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699435:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532087.699436:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699439:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532087.699440:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699444:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.699447:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532087.799049:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793386 is committed
00002000:00010000:1.0:1651532087.799070:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532085 -> 1651532086
00010000:00010000:1.0:1651532087.799073:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799077:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.799093:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468062272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841378us (841431us total) trans 158913793386 rc 0/0
00000100:00100000:1.0:1651532087.799097:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3533
00010000:00010000:1.0:1651532087.799104:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799107:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532087.799108:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799111:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799116:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532087.799117:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532087.799117:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799120:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799127:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799138:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b7f8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5468159] (req 2400256->5468159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799144:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799147:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.799487:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532087.799503:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468064064
00000100:00100000:1.0:1651532087.799514:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3542
00000100:00100000:1.0:1651532087.799516:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468064064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532087.799523:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799527:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532087.799529:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799531:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532087.799532:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799536:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.799552:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532087.887650:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793387 is committed
00002000:00010000:1.0:1651532087.887663:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532086 -> 1651532087
00002000:00010000:1.0:1651532087.887665:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532086 -> 1651532087
00010000:00010000:1.0:1651532087.887667:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.887671:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.887693:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468062464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 863170us (863208us total) trans 158913793387 rc 0/0
00000100:00100000:1.0:1651532087.887696:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3534
00010000:00010000:0.0:1651532087.887698:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.887703:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532087.887704:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.887708:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.887714:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.887714:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532087.887723:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.887726:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.887736:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532087.887740:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b7ff lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->10313727] (req 999424->10313727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.887752:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.887756:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532087.888187:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532087.888204:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468064256
00000100:00100000:1.0:1651532087.888216:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3543
00000100:00100000:1.0:1651532087.888217:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000058b025c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468064256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532087.888224:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.888238:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532087.888239:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.888242:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532087.888243:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.888247:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532087.888251:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.022909:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793388 is committed
00010000:00010000:1.0:1651532088.022925:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.022930:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.022955:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468062656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 890308us (890347us total) trans 158913793388 rc 0/0
00000100:00100000:1.0:1651532088.022958:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3535
00010000:00010000:0.0:1651532088.022959:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.022964:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532088.022965:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.022969:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.022974:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.022975:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.022976:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.022979:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.022996:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.023000:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b806 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3158016->7139327] (req 3158016->7139327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.023008:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.023013:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.023308:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532088.023381:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468064448
00000100:00100000:1.0:1651532088.023393:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3544
00000100:00100000:1.0:1651532088.023395:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468064448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532088.023402:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.023407:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532088.023408:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.023411:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532088.023412:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.023416:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.023420:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.117079:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793389 is committed
00010000:00010000:1.0:1651532088.117095:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117099:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.117128:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468062912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 876182us (876210us total) trans 158913793389 rc 0/0
00000100:00100000:1.0:1651532088.117132:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3536
00010000:00010000:1.0:1651532088.117139:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117143:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532088.117144:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117147:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117152:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532088.117152:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532088.117153:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117156:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117163:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117166:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b80d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10317823] (req 405504->10317823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117182:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117185:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.117560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532088.117578:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468064640
00000100:00100000:1.0:1651532088.117589:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3545
00000100:00100000:1.0:1651532088.117591:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468064640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532088.117599:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117603:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532088.117604:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117607:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532088.117608:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117612:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.117615:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.238950:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793390 is committed
00010000:00010000:1.0:1651532088.238965:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.238969:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.238991:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468063040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 898011us (898073us total) trans 158913793390 rc 0/0
00010000:00010000:0.0:1651532088.238993:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.238994:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3537
00010000:00010000:0.0:1651532088.238999:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532088.239000:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.239004:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.239010:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.239010:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.239011:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.239014:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.239022:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.239025:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b814 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9109504->9113599] (req 9109504->9113599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.239035:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.239039:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.239341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532088.239349:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468064832
00000100:00100000:1.0:1651532088.239360:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3546
00000100:00100000:1.0:1651532088.239362:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468064832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532088.239369:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.239373:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532088.239374:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.239389:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532088.239390:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.239395:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.239398:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.300494:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793391 is committed
00010000:00010000:1.0:1651532088.300508:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.300512:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.300529:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468063296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 892590us (892623us total) trans 158913793391 rc 0/0
00000100:00100000:1.0:1651532088.300532:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3538
00010000:00010000:1.0:1651532088.300539:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.300543:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532088.300544:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.300549:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.300555:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532088.300555:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532088.300556:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.300559:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.300566:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.300569:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40b81b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3174400->9117695] (req 3174400->9117695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.300574:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.300577:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.301092:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532088.301100:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468064960
00000100:00100000:1.0:1651532088.301111:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3547
00000100:00100000:1.0:1651532088.301113:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468064960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532088.301132:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.301136:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532088.301137:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.301140:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532088.301141:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.301146:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.301149:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.400497:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793392 is committed
00010000:00010000:1.0:1651532088.400512:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.400516:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.400539:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468063488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 901261us (901290us total) trans 158913793392 rc 0/0
00010000:00010000:0.0:1651532088.400540:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.400542:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3539
00010000:00010000:0.0:1651532088.400546:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532088.400547:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.400551:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.400557:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.400558:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.400559:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.400562:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.400570:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.400573:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b822 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->10440703] (req 3096576->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.400574:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.400594:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.400834:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532088.400901:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468065152
00000100:00100000:1.0:1651532088.400912:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3548
00000100:00100000:1.0:1651532088.400914:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468065152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532088.400922:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.400926:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532088.400927:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.400930:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532088.400931:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.400935:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.400939:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.500508:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793393 is committed
00010000:00010000:1.0:1651532088.500522:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.500537:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.500560:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468063680:12345-10.240.43.64@tcp:4:fio.0 Request processed in 909240us (909296us total) trans 158913793393 rc 0/0
00000100:00100000:1.0:1651532088.500564:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3540
00010000:00010000:0.0:1651532088.500565:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.500570:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532088.500585:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.500589:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.500595:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.500595:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.500596:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.500600:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.500608:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.500611:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b829 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4874240->7426047] (req 4874240->7426047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.500617:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.500620:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.500878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532088.500886:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468065344
00000100:00100000:1.0:1651532088.500896:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3549
00000100:00100000:1.0:1651532088.500898:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468065344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532088.500906:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.500910:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532088.500911:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.500914:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532088.500914:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.500919:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.500922:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.558904:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793394 is committed
00010000:00010000:0.0:1651532088.558939:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.558944:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532088.558975:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468063872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 859558us (859604us total) trans 158913793394 rc 0/0
00010000:00010000:1.0:1651532088.558976:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532088.558979:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3541
00010000:00010000:1.0:1651532088.558980:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532088.558981:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.558984:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.558990:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532088.558991:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532088.558991:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.558995:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.559002:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.559005:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40b830 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->9265151] (req 2228224->9265151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.559011:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.559029:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.559531:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532088.559554:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468065536
00000100:00100000:0.0:1651532088.559571:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3550
00000100:00100000:0.0:1651532088.559573:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468065536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532088.559581:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.559586:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532088.559587:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.559590:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532088.559591:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.559595:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.559599:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.658942:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793395 is committed
00010000:00010000:1.0:1651532088.658957:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.658961:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.658982:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468064064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 859466us (859496us total) trans 158913793395 rc 0/0
00010000:00010000:0.0:1651532088.658985:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.658986:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3542
00010000:00010000:0.0:1651532088.658989:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532088.658998:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.659002:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.659007:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.659008:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.659009:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.659012:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.659021:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.659025:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b837 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4878336->10326015] (req 4878336->10326015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.659046:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.659050:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.659265:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532088.659362:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468065728
00000100:00100000:1.0:1651532088.659374:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3551
00000100:00100000:1.0:1651532088.659376:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468065728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532088.659383:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.659398:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532088.659399:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.659402:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532088.659403:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.659408:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.659411:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.750622:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793396 is committed
00010000:00010000:1.0:1651532088.750636:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.750639:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.750662:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000058b025c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468064256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 862444us (862476us total) trans 158913793396 rc 0/0
00010000:00010000:0.0:1651532088.750663:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532088.750665:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3543
00010000:00010000:0.0:1651532088.750668:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532088.750669:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.750672:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.750688:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.750688:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.750689:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.750692:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.750702:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.750705:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b83e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2428928->9441279] (req 2428928->9441279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.750741:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.750745:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532088.751041:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532088.751064:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468065920
00000100:00100000:1.0:1651532088.751076:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3552
00000100:00100000:1.0:1651532088.751077:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468065920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532088.751093:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.751098:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532088.751099:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.751101:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532088.751102:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.751106:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.751110:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.817369:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793397 is committed
00010000:00010000:0.0:1651532088.817399:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.817403:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532088.817425:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468064448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 794029us (794117us total) trans 158913793397 rc 0/0
00010000:00010000:1.0:1651532088.817426:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.817430:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532088.817431:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.817434:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532088.817437:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3544
00010000:00010000:1.0:1651532088.817439:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532088.817447:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532088.817448:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.817451:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.817459:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.817462:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b845 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.817469:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.817474:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532088.817901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532088.817910:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468066176
00000100:00100000:0.0:1651532088.817924:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3553
00000100:00100000:0.0:1651532088.817926:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468066176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532088.817934:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.817938:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532088.817939:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.817942:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532088.817943:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.817947:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.817950:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532088.909053:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793398 is committed
00002000:00010000:0.0:1651532088.909083:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532087 -> 1651532088
00010000:00010000:0.0:1651532088.909086:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909090:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532088.909108:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468064640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 791516us (791549us total) trans 158913793398 rc 0/0
00000100:00100000:0.0:1651532088.909112:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3545
00010000:00010000:0.0:1651532088.909119:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909122:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532088.909124:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909126:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909131:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.909132:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532088.909133:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909136:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909159:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909162:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b84c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3387392->7888895] (req 3387392->7888895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.909172:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532088.909176:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532088.909464:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532088.909473:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468066368
00000100:00100000:0.0:1651532088.909487:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3554
00000100:00100000:0.0:1651532088.909489:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468066368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532088.909496:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909501:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532088.909502:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909505:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532088.909505:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909510:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532088.909513:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532089.034059:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793399 is committed
00010000:00010000:1.0:1651532089.034074:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.034078:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.034100:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468064832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 794737us (794759us total) trans 158913793399 rc 0/0
00000100:00100000:1.0:1651532089.034104:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3546
00010000:00010000:0.0:1651532089.034111:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.034116:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532089.034117:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.034120:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.034126:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.034127:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.034127:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.034130:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.034140:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.034143:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b853 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5001216->7831551] (req 5001216->7831551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.034150:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.034154:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532089.034454:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532089.034478:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468066560
00000100:00100000:1.0:1651532089.034491:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3555
00000100:00100000:1.0:1651532089.034493:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468066560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532089.034500:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.034505:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532089.034506:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.034509:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532089.034509:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.034514:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.034517:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532089.142402:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793400 is committed
00010000:00010000:1.0:1651532089.142417:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142430:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.142448:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468064960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 841334us (841357us total) trans 158913793400 rc 0/0
00000100:00100000:1.0:1651532089.142452:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3547
00010000:00010000:1.0:1651532089.142458:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142462:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532089.142463:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142466:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142471:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532089.142471:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532089.142472:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142475:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142482:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142485:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b85a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6418432->6422527] (req 6418432->6422527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142498:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142501:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.142836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532089.142854:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468066752
00000100:00100000:1.0:1651532089.142865:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3556
00000100:00100000:1.0:1651532089.142867:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468066752:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532089.142875:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142879:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532089.142880:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142883:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532089.142884:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142888:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.142891:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532089.200838:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793401 is committed
00010000:00010000:1.0:1651532089.200852:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.200856:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.200878:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468065152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799962us (800044us total) trans 158913793401 rc 0/0
00000100:00100000:1.0:1651532089.200881:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3548
00010000:00010000:0.0:1651532089.200884:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.200900:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532089.200901:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.200904:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.200910:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.200911:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.200912:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.200915:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.200922:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.200925:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40b861 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->7942143] (req 3411968->7942143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.200936:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.200940:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.201419:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532089.201519:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468066880
00000100:00100000:1.0:1651532089.201530:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3557
00000100:00100000:1.0:1651532089.201532:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468066880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532089.201539:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.201543:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532089.201544:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.201559:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532089.201559:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.201564:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.201568:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532089.267541:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793402 is committed
00010000:00010000:1.0:1651532089.267556:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.267560:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.267576:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468065344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 766677us (766699us total) trans 158913793402 rc 0/0
00000100:00100000:1.0:1651532089.267580:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3549
00010000:00010000:1.0:1651532089.267586:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.267590:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532089.267591:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.267605:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.267610:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532089.267610:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532089.267611:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.267615:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.267626:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.267629:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b868 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->8941567] (req 688128->8941567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.267644:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.267649:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.267932:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532089.267947:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468067136
00000100:00100000:1.0:1651532089.267958:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3558
00000100:00100000:1.0:1651532089.267960:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468067136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532089.267967:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.267971:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532089.267972:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.267996:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532089.267997:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.268002:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.268005:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532089.386295:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793403 is committed
00010000:00010000:0.0:1651532089.386347:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386360:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532089.386385:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468065536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 826810us (826854us total) trans 158913793403 rc 0/0
00000100:00100000:0.0:1651532089.386388:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3550
00010000:00010000:0.0:1651532089.386397:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386400:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532089.386401:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386404:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386410:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.386410:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.386411:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386414:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386424:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386436:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b86f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->4968447] (req 3420160->4968447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.386437:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.386442:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.386700:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532089.386740:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468067328
00000100:00100000:0.0:1651532089.386754:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3559
00000100:00100000:0.0:1651532089.386756:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468067328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532089.386763:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386767:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532089.386769:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386771:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532089.386772:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386776:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.386780:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532089.559167:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793404 is committed
00010000:00010000:1.0:1651532089.559182:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.559187:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.559211:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468065728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 899834us (899946us total) trans 158913793404 rc 0/0
00010000:00010000:0.0:1651532089.559217:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.559222:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532089.559224:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3551
00010000:00010000:0.0:1651532089.559231:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.559234:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.559240:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.559241:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.559242:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.559245:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.559255:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.559258:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40b876 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->10321919] (req 2240512->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.559270:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.559275:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.559836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532089.559852:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468067520
00000100:00100000:1.0:1651532089.559863:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3560
00000100:00100000:1.0:1651532089.559865:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468067520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532089.559872:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.559877:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532089.559878:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.559880:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532089.559881:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.559886:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.559889:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.568129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532089.568154:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230784
00000100:00100000:0.0:1651532089.568165:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 54
00000100:00100000:0.0:1651532089.568167:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230784:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532089.568173:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1662976 granted 357282368 pending 57344 free 81138851840 avail 76967739392
00000100:00100000:0.0:1651532089.568192:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230784:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 24us (63us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532089.568195:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 54
00000001:00080000:1.0:1651532089.617618:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793405 is committed
00010000:00010000:1.0:1651532089.617634:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.617638:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.617665:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468065920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866586us (866624us total) trans 158913793405 rc 0/0
00000100:00100000:1.0:1651532089.617668:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3552
00010000:00010000:1.0:1651532089.617675:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.617679:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532089.617680:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.617683:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.617688:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532089.617689:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532089.617690:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.617693:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.617712:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.617716:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b87d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->5677055] (req 3272704->5677055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.617729:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.617741:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.618018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532089.618036:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468067712
00000100:00100000:1.0:1651532089.618047:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3561
00000100:00100000:1.0:1651532089.618049:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468067712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532089.618056:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.618060:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532089.618061:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.618064:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532089.618065:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.618069:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.618072:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532089.684369:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793406 is committed
00010000:00010000:0.0:1651532089.684403:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684408:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532089.684439:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468066176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 866512us (866538us total) trans 158913793406 rc 0/0
00000100:00100000:0.0:1651532089.684443:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3553
00010000:00010000:0.0:1651532089.684451:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684455:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532089.684456:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684459:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684464:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.684464:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.684465:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684469:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684484:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684487:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b884 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->5722111] (req 434176->5722111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684493:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684496:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.684754:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532089.684798:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468067904
00000100:00100000:0.0:1651532089.684825:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3562
00000100:00100000:0.0:1651532089.684827:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468067904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532089.684834:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684839:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532089.684846:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684849:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532089.684850:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684854:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.684867:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532089.746347:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793407 is committed
00010000:00010000:0.0:1651532089.746385:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746390:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532089.746414:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468066368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 836923us (836950us total) trans 158913793407 rc 0/0
00000100:00100000:0.0:1651532089.746417:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3554
00010000:00010000:0.0:1651532089.746425:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746429:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532089.746430:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746433:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746438:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.746438:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.746439:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746453:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746460:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746462:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b88b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10371071] (req 499712->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.746470:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.746476:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.746905:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532089.746936:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468068096
00000100:00100000:0.0:1651532089.746951:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3563
00000100:00100000:0.0:1651532089.746953:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468068096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532089.746960:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746964:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532089.746965:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746968:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532089.746968:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746973:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.746976:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532089.838052:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793408 is committed
00010000:00010000:1.0:1651532089.838067:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838072:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.838089:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468066560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 803595us (803635us total) trans 158913793408 rc 0/0
00000100:00100000:1.0:1651532089.838093:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3555
00010000:00010000:1.0:1651532089.838100:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838103:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532089.838105:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838110:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838116:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532089.838116:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532089.838117:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838120:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838128:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838130:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b892 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->3440639] (req 3424256->3440639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838136:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838139:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.838439:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532089.838455:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468068288
00000100:00100000:1.0:1651532089.838483:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3564
00000100:00100000:1.0:1651532089.838485:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468068288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532089.838492:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838505:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532089.838506:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838509:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532089.838510:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838515:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.838518:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532089.971355:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793409 is committed
00002000:00010000:1.0:1651532089.971368:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532088 -> 1651532089
00010000:00010000:1.0:1651532089.971371:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.971375:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.971398:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468066752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 828530us (828562us total) trans 158913793409 rc 0/0
00000100:00100000:1.0:1651532089.971402:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3556
00010000:00010000:0.0:1651532089.971402:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.971408:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532089.971409:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.971412:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.971418:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.971419:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532089.971420:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.971423:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.971432:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532089.971436:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b899 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7565311] (req 0->7565311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.971448:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.971463:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532089.971747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532089.971756:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468068480
00000100:00100000:1.0:1651532089.971772:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3565
00000100:00100000:1.0:1651532089.971774:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468068480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532089.971781:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.971786:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532089.971787:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.971790:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532089.971790:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.971795:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532089.971798:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532090.054749:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793410 is committed
00010000:00010000:1.0:1651532090.054763:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.054778:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.054801:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468066880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 853268us (853382us total) trans 158913793410 rc 0/0
00010000:00010000:0.0:1651532090.054809:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.054814:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532090.054815:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3557
00010000:00010000:0.0:1651532090.054823:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.054826:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.054832:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.054833:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.054834:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.054837:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.054846:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.054849:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b8a0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->3444735] (req 3440640->3444735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.054863:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.054868:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.055072:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532090.055080:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468068672
00000100:00100000:1.0:1651532090.055108:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3566
00000100:00100000:1.0:1651532090.055110:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468068672:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532090.055118:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.055122:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532090.055123:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.055126:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532090.055127:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.055141:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.055145:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532090.214003:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793411 is committed
00010000:00010000:1.0:1651532090.214019:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214023:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.214040:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468067136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 946079us (946108us total) trans 158913793411 rc 0/0
00000100:00100000:1.0:1651532090.214043:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3558
00010000:00010000:1.0:1651532090.214050:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214054:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532090.214055:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214058:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214063:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532090.214072:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532090.214073:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214076:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214088:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214091:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8a7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->9215999] (req 761856->9215999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.214106:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.214110:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.214418:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532090.214426:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468068800
00000100:00100000:1.0:1651532090.214441:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3567
00000100:00100000:1.0:1651532090.214443:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468068800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532090.214450:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214454:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532090.214455:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214458:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532090.214459:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214463:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.214477:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532090.335817:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793412 is committed
00010000:00010000:0.0:1651532090.335850:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.335854:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532090.335888:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468067328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 949130us (949188us total) trans 158913793412 rc 0/0
00000100:00100000:0.0:1651532090.335892:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3559
00010000:00010000:0.0:1651532090.335900:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.335904:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532090.335905:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.335908:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.335913:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.335914:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.335914:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.335918:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.335924:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.335927:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b8ae lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8044543] (req 774144->8044543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.335939:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.335943:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.336418:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532090.336438:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468068992
00000100:00100000:0.0:1651532090.336459:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3568
00000100:00100000:0.0:1651532090.336461:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468068992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532090.336468:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.336472:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532090.336473:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.336476:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532090.336476:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.336481:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.336484:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532090.428208:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793413 is committed
00010000:00010000:1.0:1651532090.428221:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428225:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.428242:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468067520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 868376us (868407us total) trans 158913793413 rc 0/0
00000100:00100000:1.0:1651532090.428246:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3560
00010000:00010000:1.0:1651532090.428253:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428256:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532090.428257:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428269:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428274:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532090.428275:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532090.428276:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428279:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428286:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428289:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8b5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4972543] (req 3473408->4972543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428294:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428308:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.428644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532090.428653:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468069184
00000100:00100000:1.0:1651532090.428670:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3569
00000100:00100000:1.0:1651532090.428672:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468069184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532090.428688:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428692:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532090.428693:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428696:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532090.428697:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428701:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.428705:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532090.488132:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793414 is committed
00010000:00010000:1.0:1651532090.488154:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.488158:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.488180:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468067712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 870130us (870162us total) trans 158913793414 rc 0/0
00000100:00100000:1.0:1651532090.488183:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3561
00010000:00010000:0.0:1651532090.488183:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.488189:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532090.488190:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.488194:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.488211:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.488211:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.488212:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.488216:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.488224:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.488229:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b8bc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->10186751] (req 622592->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.488239:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.488245:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.488479:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532090.488487:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468069376
00000100:00100000:1.0:1651532090.488509:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3570
00000100:00100000:1.0:1651532090.488511:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468069376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532090.488518:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.488523:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532090.488524:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.488526:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532090.488527:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.488531:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.488535:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532090.546556:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793415 is committed
00010000:00010000:0.0:1651532090.546587:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546592:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532090.546617:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468067904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 861788us (861863us total) trans 158913793415 rc 0/0
00000100:00100000:0.0:1651532090.546630:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3562
00010000:00010000:0.0:1651532090.546639:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546642:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532090.546643:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546646:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546651:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.546652:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.546653:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546656:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546663:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546666:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b8c3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4972544->7573503] (req 4972544->7573503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546671:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546674:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.546908:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532090.546917:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468069568
00000100:00100000:0.0:1651532090.546936:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3571
00000100:00100000:0.0:1651532090.546938:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468069568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532090.546953:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546957:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532090.546958:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546961:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532090.546962:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546966:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.546970:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532090.667078:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793416 is committed
00010000:00010000:0.0:1651532090.667104:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.667109:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532090.667135:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468068096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 920181us (920231us total) trans 158913793416 rc 0/0
00010000:00010000:1.0:1651532090.667136:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.667140:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532090.667141:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532090.667147:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3563
00010000:00010000:1.0:1651532090.667155:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.667160:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532090.667161:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532090.667162:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.667165:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.667172:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.667175:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40b8ca lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2408448->9465855] (req 2408448->9465855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.667181:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.667191:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532090.667456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532090.667465:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468069760
00000100:00100000:0.0:1651532090.667499:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3572
00000100:00100000:0.0:1651532090.667501:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468069760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532090.667508:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.667513:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532090.667514:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.667517:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532090.667518:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.667522:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.667526:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532090.763260:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793417 is committed
00010000:00010000:1.0:1651532090.763275:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.763280:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.763320:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468068288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 924834us (924881us total) trans 158913793417 rc 0/0
00010000:00010000:0.0:1651532090.763320:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.763324:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3564
00010000:00010000:0.0:1651532090.763325:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532090.763327:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.763338:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.763344:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.763345:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.763346:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.763349:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.763358:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.763362:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b8d1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9670655] (req 548864->9670655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.763367:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.763378:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.763778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532090.763787:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468070016
00000100:00100000:1.0:1651532090.763798:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3573
00000100:00100000:1.0:1651532090.763800:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468070016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532090.763823:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.763828:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532090.763829:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.763832:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532090.763833:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.763837:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.763852:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532090.871603:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793418 is committed
00010000:00010000:1.0:1651532090.871618:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.871621:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.871643:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468068480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 899868us (899897us total) trans 158913793418 rc 0/0
00010000:00010000:0.0:1651532090.871644:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.871647:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3565
00010000:00010000:0.0:1651532090.871648:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532090.871649:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.871652:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.871657:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.871658:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.871659:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.871662:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.871671:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.871674:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b8d8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5115904->5128191] (req 5115904->5128191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.871684:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.871687:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.871869:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532090.871877:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468070208
00000100:00100000:1.0:1651532090.871890:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3574
00000100:00100000:1.0:1651532090.871892:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468070208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532090.871900:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.871904:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532090.871905:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.871908:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532090.871909:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.871922:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.871925:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532090.954987:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793419 is committed
00010000:00010000:0.0:1651532090.955018:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.955023:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532090.955044:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468068672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 899933us (899972us total) trans 158913793419 rc 0/0
00010000:00010000:1.0:1651532090.955046:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532090.955048:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3566
00010000:00010000:1.0:1651532090.955050:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532090.955052:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.955055:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.955060:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532090.955061:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532090.955062:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.955065:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.955073:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.955084:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532090.955094:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b8df lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->7921663] (req 929792->7921663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.955097:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532090.955369:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532090.955393:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468070400
00000100:00100000:0.0:1651532090.955406:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3575
00000100:00100000:0.0:1651532090.955408:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468070400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532090.955416:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.955420:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532090.955422:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.955425:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532090.955425:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.955430:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532090.955433:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532091.063317:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793420 is committed
00002000:00010000:0.0:1651532091.063346:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532089 -> 1651532090
00010000:00010000:0.0:1651532091.063349:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063364:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.063381:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468068800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 848938us (848964us total) trans 158913793420 rc 0/0
00000100:00100000:0.0:1651532091.063385:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3567
00010000:00010000:0.0:1651532091.063392:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063396:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532091.063397:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063400:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063405:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.063405:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.063406:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063409:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063415:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063418:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b8e6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5128192->5132287] (req 5128192->5132287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063432:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063435:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.063775:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532091.063783:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468070592
00000100:00100000:0.0:1651532091.063794:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3576
00000100:00100000:0.0:1651532091.063796:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468070592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532091.063822:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063827:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532091.063828:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063831:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532091.063832:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063836:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.063840:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.068865:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c04a7846 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966863360:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651532091.069113:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c04a7846 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966863360:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:1.0:1651532091.130056:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793421 is committed
00010000:00010000:0.0:1651532091.130087:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130099:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.130128:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468068992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 793666us (793709us total) trans 158913793421 rc 0/0
00000100:00100000:0.0:1651532091.130131:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3568
00010000:00010000:0.0:1651532091.130139:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130142:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532091.130143:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130146:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130151:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.130152:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.130153:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130165:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130172:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130175:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b8ed lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4403200->7577599] (req 4403200->7577599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.130182:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.130188:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.130507:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532091.130540:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468070720
00000100:00100000:0.0:1651532091.130554:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3577
00000100:00100000:0.0:1651532091.130556:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468070720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532091.130564:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130568:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532091.130569:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130572:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532091.130573:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130577:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.130580:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532091.205102:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793422 is committed
00010000:00010000:1.0:1651532091.205119:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205123:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.205142:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468069184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 776468us (776505us total) trans 158913793422 rc 0/0
00000100:00100000:1.0:1651532091.205145:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3569
00010000:00010000:1.0:1651532091.205152:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205156:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532091.205157:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205169:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205175:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532091.205175:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532091.205176:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205179:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205187:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205190:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b8f4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->8863743] (req 786432->8863743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205195:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205198:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.205822:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532091.205841:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468071040
00000100:00100000:1.0:1651532091.205859:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3578
00000100:00100000:1.0:1651532091.205861:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468071040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532091.205868:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205880:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532091.205882:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532091.205882:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.205886:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532091.288466:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793423 is committed
00010000:00010000:1.0:1651532091.288480:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.288484:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.288506:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468069376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 799994us (800027us total) trans 158913793423 rc 0/0
00010000:00010000:0.0:1651532091.288506:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.288509:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3570
00010000:00010000:0.0:1651532091.288511:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532091.288512:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.288515:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.288521:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.288521:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.288522:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.288525:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.288533:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.288536:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b8fb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5185536->5193727] (req 5185536->5193727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.288550:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.288554:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.288773:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532091.288781:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468071232
00000100:00100000:1.0:1651532091.288795:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3579
00000100:00100000:1.0:1651532091.288797:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468071232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532091.288830:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.288834:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532091.288835:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.288838:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.288841:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532091.288841:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.288846:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.288848:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.288852:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532091.405158:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793424 is committed
00010000:00010000:1.0:1651532091.405176:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405181:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.405219:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468069568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 858280us (858317us total) trans 158913793424 rc 0/0
00000100:00100000:1.0:1651532091.405223:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3571
00010000:00010000:1.0:1651532091.405232:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405236:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532091.405237:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405241:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405246:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532091.405247:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532091.405248:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405251:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405273:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405276:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40b902 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10309631] (req 413696->10309631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.405286:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.405327:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.405518:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532091.405550:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468071424
00000100:00100000:1.0:1651532091.405565:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3580
00000100:00100000:1.0:1651532091.405567:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468071424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532091.405575:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405579:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532091.405580:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405583:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532091.405584:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405588:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.405592:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532091.498192:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793425 is committed
00010000:00010000:0.0:1651532091.498225:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498230:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.498247:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468069760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 830746us (830792us total) trans 158913793425 rc 0/0
00000100:00100000:0.0:1651532091.498251:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3572
00010000:00010000:0.0:1651532091.498258:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498262:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532091.498263:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498266:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498270:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.498271:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.498272:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498286:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498308:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498313:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b909 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->5242879] (req 2457600->5242879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.498316:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.498321:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.498660:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532091.498678:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468071616
00000100:00100000:0.0:1651532091.498694:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3581
00000100:00100000:0.0:1651532091.498696:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468071616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532091.498703:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498707:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532091.498708:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498711:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532091.498712:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498716:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.498720:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532091.589843:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793426 is committed
00010000:00010000:1.0:1651532091.589859:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.589864:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.589887:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468070016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 826086us (826110us total) trans 158913793426 rc 0/0
00010000:00010000:0.0:1651532091.589890:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.589891:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3573
00010000:00010000:0.0:1651532091.589895:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532091.589896:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.589899:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.589904:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.589905:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.589906:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.589909:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.589918:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.589921:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40b910 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->7585791] (req 2461696->7585791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.589936:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.589941:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.590266:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532091.590275:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468071808
00000100:00100000:1.0:1651532091.590287:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3582
00000100:00100000:1.0:1651532091.590289:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468071808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532091.590306:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.590311:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532091.590312:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.590338:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532091.590339:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.590344:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.590347:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532091.706551:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793427 is committed
00010000:00010000:1.0:1651532091.706567:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.706571:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.706590:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468070208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 834696us (834721us total) trans 158913793427 rc 0/0
00000100:00100000:1.0:1651532091.706593:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3574
00010000:00010000:1.0:1651532091.706601:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.706604:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532091.706605:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.706620:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.706626:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532091.706626:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532091.706627:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.706630:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.706643:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.706646:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b917 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9695231] (req 552960->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.706666:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.706674:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.707145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532091.707155:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468072128
00000100:00100000:1.0:1651532091.707167:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3583
00000100:00100000:1.0:1651532091.707169:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468072128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532091.707176:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.707181:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532091.707182:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.707197:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532091.707198:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.707203:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.707206:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532091.798214:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793428 is committed
00010000:00010000:0.0:1651532091.798257:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798262:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.798286:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468070400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 842877us (842918us total) trans 158913793428 rc 0/0
00000100:00100000:0.0:1651532091.798290:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3575
00010000:00010000:0.0:1651532091.798320:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798326:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532091.798328:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798333:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798341:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.798342:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.798343:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798348:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798364:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798369:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b91e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->8892415] (req 5292032->8892415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798377:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798383:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.798568:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532091.798665:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468072320
00000100:00100000:0.0:1651532091.798683:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3584
00000100:00100000:0.0:1651532091.798685:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468072320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532091.798693:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798697:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532091.798698:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798701:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532091.798702:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798706:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.798730:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532091.889921:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793429 is committed
00010000:00010000:0.0:1651532091.889956:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.889961:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.889984:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468070592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 826187us (826209us total) trans 158913793429 rc 0/0
00000100:00100000:0.0:1651532091.889987:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3576
00010000:00010000:0.0:1651532091.889995:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.889999:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532091.890000:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890003:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890008:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.890008:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.890009:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890023:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890027:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.890028:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.890028:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890031:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890041:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890044:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b925 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7655423] (req 557056->7655423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.890045:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890050:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.890051:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890053:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.890327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532091.890348:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468072512
00000100:00100000:0.0:1651532091.890367:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3585
00000100:00100000:0.0:1651532091.890369:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468072512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532091.890377:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890390:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532091.890391:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890394:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532091.890394:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890399:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.890402:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532091.981634:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793431 is committed
00002000:00010000:1.0:1651532091.981657:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532090 -> 1651532091
00010000:00010000:1.0:1651532091.981661:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.981665:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.981683:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.981688:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.981697:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468071040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 775835us (775876us total) trans 158913793431 rc 0/0
00000100:00100000:1.0:1651532091.981701:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3578
00000100:00100000:0.0:1651532091.981705:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468070720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 851147us (851198us total) trans 158913793430 rc 0/0
00000100:00100000:0.0:1651532091.981708:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3577
00010000:00010000:1.0:1651532091.981709:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.981713:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532091.981714:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.981716:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.981717:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.981719:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532091.981723:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.981726:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b933 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5300224->8314879] (req 5300224->8314879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.981729:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.981733:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.981738:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.981739:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532091.981739:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.981742:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.981752:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.981755:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b92c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5296128->5300223] (req 5296128->5300223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.981762:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.981774:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532091.982130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532091.982151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532091.982164:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468072704
00000100:00100000:0.0:1651532091.982233:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468072832
00000100:00100000:1.0:1651532091.982250:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3586
00000100:00100000:1.0:1651532091.982252:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468072704:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532091.982261:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532091.982266:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532091.982267:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532091.982268:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.982269:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3587
00010000:00010000:1.0:1651532091.982271:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532091.982273:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468072832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532091.982326:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.982334:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532091.982335:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532091.982336:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532091.982372:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532092.085355:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793432 is committed
00010000:00010000:1.0:1651532092.085371:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.085375:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.085398:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468071232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 796600us (796631us total) trans 158913793432 rc 0/0
00010000:00010000:0.0:1651532092.085399:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.085402:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3579
00010000:00010000:0.0:1651532092.085404:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532092.085405:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.085409:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.085415:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.085415:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.085416:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.085419:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.085429:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.085433:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40b93a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->8876031] (req 1007616->8876031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.085442:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.085447:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.085966:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532092.085984:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468073024
00000100:00100000:1.0:1651532092.085995:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3588
00000100:00100000:1.0:1651532092.085997:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468073024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532092.086004:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.086008:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532092.086009:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532092.086010:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.086014:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532092.169400:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793433 is committed
00010000:00010000:1.0:1651532092.169415:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.169419:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.169437:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468071424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 763869us (763919us total) trans 158913793433 rc 0/0
00000100:00100000:1.0:1651532092.169441:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3580
00010000:00010000:1.0:1651532092.169447:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.169454:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532092.169455:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.169458:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.169463:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.169464:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.169465:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.169468:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.169481:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.169484:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b941 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6656000->8011775] (req 6656000->8011775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.169494:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.169507:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.169792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532092.169800:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468073216
00000100:00100000:1.0:1651532092.169824:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3589
00000100:00100000:1.0:1651532092.169826:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468073216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532092.169833:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.169848:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532092.169849:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532092.169850:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.169853:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532092.290693:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793434 is committed
00010000:00010000:0.0:1651532092.290724:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.290729:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532092.290753:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468071616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 792056us (792093us total) trans 158913793434 rc 0/0
00000100:00100000:0.0:1651532092.290756:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3581
00010000:00010000:0.0:1651532092.290764:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.290768:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532092.290769:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.290772:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.290777:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.290778:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.290779:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.290793:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.290800:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.290813:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b948 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->10383359] (req 417792->10383359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.290814:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.290818:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.291019:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532092.291047:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468073408
00000100:00100000:0.0:1651532092.291067:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3590
00000100:00100000:0.0:1651532092.291070:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468073408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532092.291081:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.291088:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532092.291090:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.291094:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532092.291095:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.291102:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.291108:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532092.333154:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793435 is committed
00010000:00010000:1.0:1651532092.333176:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333180:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.333196:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468071808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 742906us (742931us total) trans 158913793435 rc 0/0
00000100:00100000:1.0:1651532092.333200:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3582
00010000:00010000:1.0:1651532092.333206:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333218:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532092.333220:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333223:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333228:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.333229:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.333229:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333232:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333240:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333243:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b94f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->7745535] (req 6684672->7745535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333248:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333251:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.333620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532092.333639:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468073600
00000100:00100000:1.0:1651532092.333649:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3591
00000100:00100000:1.0:1651532092.333651:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468073600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532092.333659:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333664:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532092.333664:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333667:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333670:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333672:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532092.333673:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333677:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333680:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333683:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.333697:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532092.433866:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793436 is committed
00010000:00010000:1.0:1651532092.433881:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.433884:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.433904:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.433907:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468072128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 726737us (726768us total) trans 158913793436 rc 0/0
00000100:00100000:1.0:1651532092.433910:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3583
00010000:00010000:0.0:1651532092.433910:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532092.433911:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.433914:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.433921:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.433921:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.433922:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.433925:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.433933:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.433936:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40b956 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3055616->7749631] (req 3055616->7749631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.433949:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.433954:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.434244:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532092.434262:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468073792
00000100:00100000:1.0:1651532092.434274:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3592
00000100:00100000:1.0:1651532092.434275:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468073792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532092.434283:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.434315:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532092.434317:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.434320:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.434322:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532092.434323:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.434327:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.434330:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.434333:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532092.548216:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793437 is committed
00010000:00010000:1.0:1651532092.548232:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548236:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.548259:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468072320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 749573us (749692us total) trans 158913793437 rc 0/0
00010000:00010000:0.0:1651532092.548263:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548268:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532092.548271:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3584
00010000:00010000:0.0:1651532092.548277:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548280:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548286:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.548287:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.548288:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548291:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548294:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.548295:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.548295:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548312:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548318:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.548319:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.548320:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548324:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548329:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.548337:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.548338:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548343:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548348:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.548349:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.548350:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548355:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548375:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548379:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b95d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9838591] (req 589824->9838591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548385:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548385:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548388:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548389:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548417:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.548420:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548421:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548425:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548440:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548443:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.548760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532092.548867:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468074048
00000100:00100000:1.0:1651532092.548878:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3593
00000100:00100000:1.0:1651532092.548880:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468074048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532092.548888:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548892:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532092.548901:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548905:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532092.548905:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548922:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.548926:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532092.664874:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793442 is committed
00002000:00010000:1.0:1651532092.664897:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532091 -> 1651532092
00010000:00010000:1.0:1651532092.664900:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.664903:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.664914:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.664919:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.664924:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468073024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 578926us (578958us total) trans 158913793441 rc 0/0
00000100:00100000:1.0:1651532092.664928:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3588
00010000:00010000:1.0:1651532092.664939:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.664942:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532092.664944:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532092.664953:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468072512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 774582us (774625us total) trans 158913793440 rc 0/0
00010000:00010000:1.0:1651532092.664954:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.664960:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.664960:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532092.664960:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3585
00010000:00010000:1.0:1651532092.664961:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.664964:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.664973:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.664976:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b979 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->9236479] (req 6803456->9236479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.664981:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.664987:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532092.664989:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.664992:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.664995:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665004:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.665007:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468072704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 682754us (682877us total) trans 158913793439 rc 0/0
00000100:00100000:1.0:1651532092.665010:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3586
00010000:00010000:0.0:1651532092.665011:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665014:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40b964 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6705152->6750207] (req 6705152->6750207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665018:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.665021:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.665034:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665037:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532092.665038:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665041:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.665045:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754468073216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 495219us (495254us total) trans 158913793442 rc 0/0
00010000:00010000:0.0:1651532092.665045:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.665048:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3589
00010000:00010000:0.0:1651532092.665048:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40b96b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [614400->966655] (req 614400->966655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665051:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665054:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532092.665055:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665057:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665061:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665064:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40b980 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3379200->4329471] (req 3379200->4329471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.665065:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.665069:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665074:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665077:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532092.665078:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.665079:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754468072832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 682807us (682929us total) trans 158913793438 rc 0/0
00010000:00010000:0.0:1651532092.665081:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.665082:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3587
00010000:00010000:0.0:1651532092.665084:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.665085:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.665086:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665088:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665098:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665101:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b972 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3375104->3379199] (req 3375104->3379199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665107:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665110:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.665127:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.665153:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.665830:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532092.665864:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468074240
00000100:00100000:1.0:1651532092.665870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532092.665880:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532092.665898:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532092.665899:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468074368
00000100:00100000:1.0:1651532092.665907:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532092.665917:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468074496
00000100:00100000:1.0:1651532092.665926:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468074432
00000100:00100000:0.0:1651532092.665931:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468074560
00000100:00100000:0.0:1651532092.665942:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3594
00000100:00100000:0.0:1651532092.665945:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468074240:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532092.665946:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3595
00000100:00100000:1.0:1651532092.665948:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468074368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532092.665955:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665957:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.665960:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532092.665961:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.665964:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532092.665964:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665972:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532092.665974:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532092.665975:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.665981:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.665981:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.665985:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.665993:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3596
00000100:00100000:1.0:1651532092.665995:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468074496:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532092.665997:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3597
00010000:00010000:1.0:1651532092.666000:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532092.666000:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468074560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532092.666003:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532092.666004:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532092.666004:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.666010:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.666018:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532092.666019:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532092.666020:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.666025:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.666026:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.666033:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3598
00000100:00100000:1.0:1651532092.666035:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468074432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532092.666039:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.666043:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532092.666044:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532092.666044:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.666047:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532092.806488:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793444 is committed
00010000:00010000:1.0:1651532092.806510:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.806513:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806524:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806529:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.806534:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468073600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 472882us (472915us total) trans 158913793444 rc 0/0
00000100:00100000:1.0:1651532092.806537:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3591
00010000:00010000:1.0:1651532092.806545:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532092.806552:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468073408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 515482us (515541us total) trans 158913793443 rc 0/0
00010000:00010000:1.0:1651532092.806556:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532092.806556:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3590
00010000:00010000:1.0:1651532092.806558:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.806561:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806564:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.806567:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806567:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532092.806568:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.806569:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b98e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3059712->7331839] (req 3059712->7331839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806571:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806576:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.806577:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.806578:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806581:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806603:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806606:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b987 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7368704->9269247] (req 7368704->9269247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.806618:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.806622:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.806898:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532092.806925:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468074816
00000100:00100000:0.0:1651532092.806953:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3599
00000100:00100000:0.0:1651532092.806956:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468074816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532092.806968:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806975:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532092.806976:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806981:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806985:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806990:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.806994:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.807014:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532092.807016:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 8/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.807024:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.807028:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.807033:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.807038:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.807043:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.807048:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.807352:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532092.807359:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468074944
00000100:00100000:1.0:1651532092.807376:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3600
00000100:00100000:1.0:1651532092.807378:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468074944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532092.807385:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.807400:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532092.807401:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.807404:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532092.807405:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.807409:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.807413:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532092.864941:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793445 is committed
00010000:00010000:1.0:1651532092.864980:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.864986:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.865016:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.865023:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532092.865025:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.865035:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468073792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 430757us (430789us total) trans 158913793445 rc 0/0
00010000:00010000:0.0:1651532092.865038:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.865040:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3592
00010000:00010000:0.0:1651532092.865050:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.865051:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532092.865053:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.865057:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.865072:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.865075:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40b995 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7376895] (req 974848->7376895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.865089:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.865093:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532092.865591:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532092.865609:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468075136
00000100:00100000:1.0:1651532092.865631:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3601
00000100:00100000:1.0:1651532092.865634:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468075136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532092.865653:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.865658:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532092.865660:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.865663:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532092.865664:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.865669:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.865672:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532092.937741:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793446 is committed
00010000:00010000:0.0:1651532092.937777:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.937782:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937817:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937821:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532092.937822:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937826:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532092.937832:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468074048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 388950us (389080us total) trans 158913793446 rc 0/0
00000100:00100000:0.0:1651532092.937837:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3593
00010000:00010000:1.0:1651532092.937838:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.937846:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.937847:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937851:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937854:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.937855:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.937856:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937859:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937861:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.937862:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.937862:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937865:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937868:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.937868:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.937869:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937871:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937874:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.937886:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532092.937887:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937891:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937908:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937911:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b99c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->6361087] (req 995328->6361087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937918:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937921:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.937921:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.937926:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.937990:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937991:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532092.937995:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.937996:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.938061:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.938067:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532092.938242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532092.938255:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468075328
00000100:00100000:0.0:1651532092.938267:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3602
00000100:00100000:0.0:1651532092.938269:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754468075328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532092.938277:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.938295:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532092.938296:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.938312:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532092.938314:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.938322:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532092.938328:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532093.145650:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793451 is committed
00010000:00010000:1.0:1651532093.145674:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145678:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145698:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145703:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532093.145708:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468074496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 479712us (479828us total) trans 158913793449 rc 0/0
00000100:00100000:1.0:1651532093.145712:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3596
00000100:00100000:0.0:1651532093.145725:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468074368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 479776us (479854us total) trans 158913793450 rc 0/0
00010000:00010000:1.0:1651532093.145726:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532093.145729:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3595
00010000:00010000:1.0:1651532093.145730:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532093.145741:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468074432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 479706us (479843us total) trans 158913793448 rc 0/0
00010000:00010000:0.0:1651532093.145743:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532093.145744:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3598
00010000:00010000:0.0:1651532093.145746:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145750:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145760:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532093.145761:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145764:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532093.145768:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754468074560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 479768us (479861us total) trans 158913793447 rc 0/0
00010000:00010000:1.0:1651532093.145770:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145772:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40b9b1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4333568->4337663] (req 4333568->4337663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532093.145772:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3597
00010000:00010000:0.0:1651532093.145779:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145783:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145783:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532093.145784:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145786:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532093.145787:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145787:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145792:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145793:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145796:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145796:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40b9a3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5206016->5210111] (req 5206016->5210111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145799:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40b9bf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4329472->4333567] (req 4329472->4333567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145800:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145818:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532093.145819:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145822:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145830:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.145834:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145839:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145842:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9b8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [4337664->4341759] (req 4337664->4341759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145845:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532093.145848:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754468074240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 479903us (480019us total) trans 158913793451 rc 0/0
00010000:00010000:0.0:1651532093.145848:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532093.145848:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532093.145851:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3594
00010000:00010000:0.0:1651532093.145851:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145854:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532093.145855:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532093.145856:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145859:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145866:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145869:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9aa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1007616->3534847] (req 1007616->3534847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145882:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.145886:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532093.146640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532093.146649:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468075520
00000100:00100000:1.0:1651532093.146671:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3603
00000100:00100000:1.0:1651532093.146674:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468075520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532093.146681:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.146685:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532093.146686:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532093.146687:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.146690:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532093.264904:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793452 is committed
00010000:00010000:0.0:1651532093.264942:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.264947:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532093.264969:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754468074816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 458013us (458071us total) trans 158913793452 rc 0/0
00010000:00010000:1.0:1651532093.264971:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532093.264973:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3599
00010000:00010000:1.0:1651532093.264976:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532093.264977:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.264980:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.264986:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532093.264986:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532093.264987:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.264990:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.265007:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.265010:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40b9c6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2617344->8462335] (req 2617344->8462335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.265012:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.265016:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532093.265658:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532093.265682:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468075712
00000100:00100000:0.0:1651532093.265696:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3604
00000100:00100000:0.0:1651532093.265698:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468075712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532093.265723:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.265740:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532093.265741:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532093.265742:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [8052736->8552447] (req 8052736->8552447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.265746:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [8052736->8552447] (req 8052736->8552447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532093.381567:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793454 is committed
00002000:00010000:0.0:1651532093.381602:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532092 -> 1651532093
00002000:00010000:0.0:1651532093.381604:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532087 -> 1651532093
00010000:00010000:0.0:1651532093.381607:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.381612:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381635:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532093.381637:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754468074944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574257us (574284us total) trans 158913793453 rc 0/0
00010000:00010000:1.0:1651532093.381640:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532093.381640:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3600
00010000:00010000:1.0:1651532093.381641:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381645:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381651:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532093.381652:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532093.381653:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381656:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.381661:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [8052736->8552447] (req 8052736->8552447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.381665:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [8052736->8552447] (req 8052736->8552447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381675:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532093.381678:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754468075712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 115980us (116021us total) trans 158913793454 rc 0/0
00010000:00010000:1.0:1651532093.381690:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9cd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3100672->8019967] (req 3100672->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532093.381692:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3604
00010000:00010000:1.0:1651532093.381693:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [8052736->8552447] (req 8052736->8552447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381696:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532093.381697:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [8052736->8552447] (req 8052736->8552447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381700:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9e9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [8052736->8552447] (req 8052736->8552447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381704:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9e9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [8052736->8552447] (req 8052736->8552447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381707:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40b9e9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [8052736->8552447] (req 8052736->8552447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381712:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.381715:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532093.464930:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793455 is committed
00010000:00010000:1.0:1651532093.464944:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.464956:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532093.464978:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754468075136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599343us (599387us total) trans 158913793455 rc 0/0
00000100:00100000:1.0:1651532093.464982:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3601
00010000:00010000:0.0:1651532093.464983:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.464989:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532093.464990:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.464993:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.464999:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532093.465000:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532093.465001:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.465004:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.465008:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532093.465008:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532093.465009:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.465011:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.465019:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.465032:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.465033:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40b9d4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2682880->8036351] (req 2682880->8036351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.465036:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.465040:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.465043:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532093.548283:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793457 is committed
00010000:00010000:1.0:1651532093.548313:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.548317:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532093.548331:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532093.548338:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754468075520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 401663us (401698us total) trans 158913793457 rc 0/0
00000100:00100000:1.0:1651532093.548341:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3603
00010000:00010000:0.0:1651532093.548345:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.548349:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.548352:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532093.548361:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.548364:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532093.548369:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754468075328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 610098us (610127us total) trans 158913793456 rc 0/0
00010000:00010000:1.0:1651532093.548370:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.548372:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9e2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3534848->3600383] (req 3534848->3600383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532093.548374:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3602
00010000:00010000:1.0:1651532093.548376:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.548379:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532093.548379:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.548382:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.548385:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532093.548388:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40b9db lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [2686976->2699263] (req 2686976->2699263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532094.688247:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532094.688316:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231040
00000100:00100000:0.0:1651532094.688383:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 55
00000100:00100000:0.0:1651532094.688387:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231040:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532094.688402:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1691648 granted 358044224 pending 0 free 81138851840 avail 76967825408
00000100:00100000:0.0:1651532094.688430:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231040:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 43us (187us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532094.688434:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 55
00000100:00100000:1.0:1651532095.050668:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.050689:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468076096
00000100:00100000:1.0:1651532095.050729:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1799
00000100:00100000:1.0:1651532095.050731:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754468076096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.050741:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.050755:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447210 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532095.050768:0:323275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d2f:0x0] initial LVB size: 41943040, mtime: 0x6270613c, atime: 0x0, ctime: 0x6270613c, blocks: 0x14000
00010000:00010000:1.0:1651532095.050779:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.050780:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.050784:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9f0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447210 expref: 6 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.050792:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9f0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447210 expref: 6 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.050798:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532095.050842:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754468076096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 110us (178us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532095.050846:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1799
00000100:00100000:1.0:1651532095.227407:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.227424:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.227434:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468076928
00000100:00100000:0.0:1651532095.227434:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468076992
00000100:00100000:1.0:1651532095.227451:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3605
00000100:00100000:1.0:1651532095.227453:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754468076928:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532095.227455:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3606
00000100:00100000:0.0:1651532095.227457:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754468076992:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532095.227464:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.227468:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.227474:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.227475:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.227476:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.227482:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.227484:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9f0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447210 expref: 7 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.227488:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 2/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.227491:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.227492:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.227492:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.227499:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.227509:0:323282:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9f0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447210 expref: 8 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.227515:0:323282:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9f0 lrc: 4/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447210 expref: 8 pid: 323275 timeout: 15844 lvb_type: 1
00000100:00100000:1.0:1651532095.227521:0:323282:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000035758393 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:323282:1731745966863424:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532095.227541:0:323282:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8c8ad9f going to sleep for 6 seconds
00010000:00010000:0.0:1651532095.228006:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228011:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.228035:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754468076992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 577us (628us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532095.228038:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3606
00010000:00010000:0.0:1651532095.228047:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228051:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.228052:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228068:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228076:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228079:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40b9fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1318912->10264575] (req 1318912->10264575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.228201:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.228214:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.228216:0:323282:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000035758393 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:323282:1731745966863424:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532095.228222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532095.228223:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.228232:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468077440
00000100:00100000:0.0:1651532095.228241:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468077312
00000100:00100000:0.0:1651532095.228248:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3607
00000100:00100000:0.0:1651532095.228249:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754468077440:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532095.228255:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468077376
00010000:00010000:0.0:1651532095.228264:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.228267:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9f0 lrc: 4/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447210 expref: 9 pid: 323275 timeout: 15844 lvb_type: 1
00010000:00010000:0.0:1651532095.228269:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.228270:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228273:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532095.228274:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.228280:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 292
00000100:00100000:1.0:1651532095.228282:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f2d66b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754468077376:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651532095.228285:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.228286:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532095.228289:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.228291:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9f0 lrc: 4/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447210 expref: 9 pid: 323275 timeout: 15844 lvb_type: 1
00010000:00010000:1.0:1651532095.228296:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9f0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447210 expref: 9 pid: 323275 timeout: 15844 lvb_type: 1
00000100:00100000:0.0:1651532095.228311:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3608
00010000:00010000:1.0:1651532095.228312:0:323259:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40b9f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447210 expref: 9 pid: 323275 timeout: 15844 lvb_type: 1
00000100:00100000:0.0:1651532095.228313:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754468077312:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532095.228316:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.228317:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.228318:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228320:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.228321:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228325:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532095.228326:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228329:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532095.228330:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228333:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.228336:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532095.228336:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.228346:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f2d66b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754468077376:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 64us (146us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532095.228357:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 292
00010000:00010000:1.0:1651532095.228376:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.228379:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.228457:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.228466:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.228479:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468077824
00000100:00100000:1.0:1651532095.228486:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468077760
00000100:00100000:0.0:1651532095.228489:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3609
00000100:00100000:0.0:1651532095.228491:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754468077824:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532095.228498:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1800
00000100:00100000:1.0:1651532095.228500:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754468077760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.228503:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.228504:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.228507:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ba1a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447233 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228508:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532095.228509:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532095.228509:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228512:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.228516:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ba1a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447233 expref: 11 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.228521:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ba1a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447233 expref: 11 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.228524:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532095.228534:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754468077760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.228537:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1800
00000100:00100000:0.0:1651532095.228743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.228784:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468078016
00000100:00100000:1.0:1651532095.228819:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1801
00000100:00100000:1.0:1651532095.228829:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754468078016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.228832:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.228836:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ba21 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44723a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.228848:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532095.228849:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ba21 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44723a expref: 11 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.228860:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ba21 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44723a expref: 11 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.228864:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:0.0:1651532095.228874:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468078208
00000100:00100000:1.0:1651532095.228882:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754468078016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.228885:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1801
00000100:00100000:0.0:1651532095.228916:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3610
00000100:00100000:0.0:1651532095.228917:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754468078208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532095.228925:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228929:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532095.228930:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228933:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228935:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532095.228936:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228952:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228955:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.228958:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.228975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.229005:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.229012:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468078464
00000100:00100000:0.0:1651532095.229026:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3611
00000100:00100000:0.0:1651532095.229028:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754468078464:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532095.229035:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.229039:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.229040:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532095.229041:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.229044:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.229057:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468078400
00000100:00100000:1.0:1651532095.229068:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1802
00000100:00100000:1.0:1651532095.229070:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468078400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.229074:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.229077:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ba36 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447241 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229085:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ba36 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447241 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.229089:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ba36 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447241 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.229102:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532095.229112:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468078400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.229115:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1802
00000100:00100000:1.0:1651532095.229132:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.229139:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468078528
00000100:00100000:0.0:1651532095.229151:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1803
00000100:00100000:0.0:1651532095.229160:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468078528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.229164:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.229168:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ba3d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447248 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.229176:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ba3d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447248 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.229181:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ba3d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447248 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.229184:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532095.229198:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468078528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.229201:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1803
00000100:00100000:0.0:1651532095.229280:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.229289:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.229319:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468078720
00000100:00100000:0.0:1651532095.229323:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468078656
00000100:00100000:0.0:1651532095.229337:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1804
00000100:00100000:1.0:1651532095.229338:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3612
00000100:00100000:0.0:1651532095.229339:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f16ebf6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468078656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532095.229340:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468078720:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532095.229343:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.229346:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ba44 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44724f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.229354:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ba44 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44724f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.229361:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ba4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229365:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.229366:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.229367:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ba4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10170368->10174463] (req 10170368->10174463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229371:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ba4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10170368->10174463] (req 10170368->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.229372:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ba44 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44724f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.229376:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532095.229386:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ba4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [10170368->10174463] (req 10170368->10174463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.229389:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f16ebf6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468078656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.229392:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1804
00010000:00010000:1.0:1651532095.229395:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ba4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [10170368->10174463] (req 10170368->10174463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.229415:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468078720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 74us (126us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532095.229424:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3612
00010000:00010000:1.0:1651532095.229433:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ba4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [10170368->10174463] (req 10170368->10174463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229437:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532095.229438:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ba4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [10170368->10174463] (req 10170368->10174463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229441:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ba4b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [10170368->10174463] (req 10170368->10174463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229446:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ba4b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [10170368->10174463] (req 10170368->10174463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229449:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ba4b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [10170368->10174463] (req 10170368->10174463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.229580:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.229598:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468078848
00000100:00100000:1.0:1651532095.229599:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.229610:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468078912
00000100:00100000:1.0:1651532095.229612:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.229617:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1805
00000100:00100000:0.0:1651532095.229623:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468078848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.229627:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532095.229630:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532095.229630:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ba52 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447256 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.229638:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1806
00010000:00010000:0.0:1651532095.229638:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ba52 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447256 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532095.229640:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468078912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.229642:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ba52 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447256 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.229644:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.229646:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532095.229649:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ba59 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44725d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.229656:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468078848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.229659:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1805
00010000:00010000:1.0:1651532095.229668:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ba59 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44725d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.229673:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ba59 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44725d expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.229676:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:0.0:1651532095.229676:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468079040
00000100:00100000:0.0:1651532095.229688:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468078976
00000100:00100000:1.0:1651532095.229691:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468078912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.229696:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3613
00000100:00100000:0.0:1651532095.229698:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468079040:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532095.229699:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1806
00010000:00010000:0.0:1651532095.229704:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.229708:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3614
00010000:00010000:0.0:1651532095.229708:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532095.229709:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.229710:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468078976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532095.229712:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532095.229712:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229717:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.229717:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.229720:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229721:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.229722:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229725:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532095.229726:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229730:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229744:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.229779:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.229789:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.229797:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468079296
00000100:00100000:1.0:1651532095.229832:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3615
00000100:00100000:1.0:1651532095.229834:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468079296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532095.229840:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229844:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.229845:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229848:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532095.229848:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229853:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229856:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.229863:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468079232
00000100:00100000:1.0:1651532095.229869:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1807
00000100:00100000:1.0:1651532095.229871:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468079232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.229882:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.229886:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ba75 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447264 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.229893:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ba75 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447264 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.229897:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ba75 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447264 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.229900:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532095.229915:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468079232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (132us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.229918:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1807
00000100:00100000:1.0:1651532095.229963:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.229971:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468079360
00000100:00100000:1.0:1651532095.229984:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3616
00000100:00100000:1.0:1651532095.229985:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468079360:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532095.229986:0:330054:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 80
00000100:00100000:0.0:1651532095.229989:0:330054:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_012'
00010000:00010000:1.0:1651532095.230008:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ba7c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.230013:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.230014:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.230015:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ba7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.230019:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ba7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.230038:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ba7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.230041:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ba7c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.230053:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ba7c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.230057:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532095.230060:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468079360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 74us (97us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532095.230063:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3616
00010000:00010000:0.0:1651532095.230063:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ba7c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.230073:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ba7c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.230092:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ba7c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.230095:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ba7c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.230124:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.230153:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.230219:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468079552
00000100:00100000:1.0:1651532095.230227:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468079744
00000100:00100000:1.0:1651532095.230233:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1808
00000100:00100000:1.0:1651532095.230235:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468079552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.230239:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.230242:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ba83 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44726b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.230243:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1809
00000100:00100000:0.0:1651532095.230245:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468079744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.230250:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ba83 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44726b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.230254:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ba83 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44726b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.230257:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00010000:00010000:0.0:1651532095.230261:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532095.230265:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468079552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (142us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532095.230265:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ba8a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447272 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.230273:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ba8a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447272 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532095.230277:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1808
00010000:00010000:0.0:1651532095.230277:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ba8a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447272 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.230281:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532095.230289:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468079744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.230312:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1809
00000100:00100000:0.0:1651532095.230340:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.230363:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468079936
00000100:00100000:0.0:1651532095.230374:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1810
00000100:00100000:0.0:1651532095.230376:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468079936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.230379:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.230383:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ba91 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447279 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.230390:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ba91 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447279 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.230394:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ba91 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447279 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.230397:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532095.230406:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468079936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.230409:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1810
00000100:00100000:1.0:1651532095.230917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.230939:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.230957:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468080128
00000100:00100000:1.0:1651532095.230965:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468080256
00000100:00100000:1.0:1651532095.230974:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1811
00000100:00100000:1.0:1651532095.230975:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468080128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.230979:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.230984:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ba98 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447280 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.230992:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ba98 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447280 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.230996:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ba98 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447280 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.230999:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532095.231010:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468080128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.231013:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1811
00000100:00100000:1.0:1651532095.231017:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1812
00000100:00100000:1.0:1651532095.231019:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468080256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.231021:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.231024:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ba9f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447287 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.231038:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ba9f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447287 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.231042:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ba9f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447287 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.231045:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532095.231052:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468080256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.231054:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1812
00000100:00100000:1.0:1651532095.231278:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.231285:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468080448
00000100:00100000:1.0:1651532095.231292:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1813
00000100:00100000:1.0:1651532095.231293:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468080448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.231297:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.231311:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40baa6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44728e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.231319:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40baa6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44728e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.231323:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40baa6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44728e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.231326:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532095.231344:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468080448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.231347:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1813
00000100:00100000:1.0:1651532095.231389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.231397:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468080576
00000100:00100000:1.0:1651532095.231403:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1814
00000100:00100000:1.0:1651532095.231405:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468080576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.231408:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.231411:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40baad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447295 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.231418:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40baad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447295 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.231422:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40baad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447295 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.231425:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532095.231434:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468080576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.231436:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1814
00000100:00100000:1.0:1651532095.231678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.231688:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468080832
00000100:00100000:0.0:1651532095.231699:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1815
00000100:00100000:0.0:1651532095.231701:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468080832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.231704:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.231708:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bab4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44729c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.231717:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bab4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44729c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.231721:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bab4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44729c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.231725:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532095.231735:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468080832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.231738:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1815
00000100:00100000:1.0:1651532095.231987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.231998:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468081024
00000100:00100000:0.0:1651532095.232008:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1816
00000100:00100000:0.0:1651532095.232010:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468081024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.232013:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.232016:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40babb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472a3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.232023:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40babb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472a3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.232027:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40babb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472a3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.232030:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532095.232040:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468081024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.232051:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1816
00000001:00080000:0.0:1651532095.343292:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793458 is committed
00002000:00010000:1.0:1651532095.343327:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532092 -> 1651532095
00002000:00010000:1.0:1651532095.343330:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532092 -> 1651532095
00010000:00010000:1.0:1651532095.343333:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.343346:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343369:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.343370:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468076928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 115916us (115946us total) trans 158913793458 rc 0/0
00000100:00100000:1.0:1651532095.343374:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3605
00010000:00010000:0.0:1651532095.343374:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.343375:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343378:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343384:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.343385:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.343386:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343389:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343397:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343400:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40b9f7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->8073215] (req 1236992->8073215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343406:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343420:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.343790:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.343834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.343844:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468081216
00000100:00100000:1.0:1651532095.343852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.343860:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468081280
00000100:00100000:1.0:1651532095.343876:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3617
00000100:00100000:1.0:1651532095.343879:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468081216:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532095.343879:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3618
00000100:00100000:0.0:1651532095.343881:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468081280:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532095.343888:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343889:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.343893:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.343894:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.343897:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532095.343898:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343902:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.343904:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343907:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532095.343907:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.343912:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343912:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.343916:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343916:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.343924:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468081408
00000100:00100000:0.0:1651532095.343933:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1817
00000100:00100000:0.0:1651532095.343935:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468081408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.343945:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.343948:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bad0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472aa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343954:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.343956:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bad0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472aa expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.343960:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bad0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472aa expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.343964:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532095.343975:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468081408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.343978:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1817
00010000:00010000:0.0:1651532095.343991:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.343995:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.344008:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.344009:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468077440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 115759us (115795us total) trans 0 rc 40960/40960
00010000:00010000:1.0:1651532095.344011:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532095.344012:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.344012:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3607
00010000:00010000:1.0:1651532095.344015:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.344020:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.344021:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.344022:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.344025:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.344028:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.344028:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.344029:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.344032:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.344040:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.344048:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.344061:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ba05 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [630784->8843263] (req 630784->8843263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.344062:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.344071:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.344074:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.344330:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.344338:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468081536
00000100:00100000:0.0:1651532095.344373:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1818
00000100:00100000:0.0:1651532095.344375:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468081536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.344378:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.344391:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bad7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472b1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.344399:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bad7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472b1 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.344403:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bad7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472b1 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.344407:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532095.344425:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468081536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.344428:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1818
00000100:00100000:1.0:1651532095.344552:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.344564:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468081728
00000100:00100000:0.0:1651532095.344575:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1819
00000100:00100000:0.0:1651532095.344577:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468081728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.344580:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.344592:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bade lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472b8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.344599:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bade lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472b8 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.344603:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bade lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472b8 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.344607:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532095.344618:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468081728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.344620:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1819
00000100:00100000:0.0:1651532095.344691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.344699:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468081920
00000100:00100000:0.0:1651532095.344708:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1820
00000100:00100000:0.0:1651532095.344710:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468081920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.344713:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.344717:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bae5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472bf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.344724:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bae5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472bf expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.344728:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bae5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472bf expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.344741:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532095.344755:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468081920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.344758:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1820
00000100:00100000:0.0:1651532095.344956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.344963:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468082048
00000100:00100000:0.0:1651532095.344976:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1821
00000100:00100000:0.0:1651532095.344978:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468082048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.344981:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.344985:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40baec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472c6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.344993:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40baec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472c6 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.344997:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40baec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472c6 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.345000:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532095.345012:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468082048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.345014:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1821
00000100:00100000:0.0:1651532095.345171:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.345178:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468082240
00000100:00100000:0.0:1651532095.345190:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1822
00000100:00100000:0.0:1651532095.345199:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468082240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.345203:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.345206:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40baf3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472cd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.345213:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40baf3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472cd expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.345217:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40baf3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472cd expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.345220:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532095.345232:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468082240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.345234:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1822
00000001:00080000:1.0:1651532095.477253:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793460 is committed
00010000:00010000:1.0:1651532095.477271:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477275:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477297:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.477310:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468077824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 248818us (248853us total) trans 158913793459 rc 0/0
00000100:00100000:1.0:1651532095.477314:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3609
00010000:00010000:0.0:1651532095.477315:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.477316:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477320:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477326:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477329:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477333:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477341:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ba13 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->3596287] (req 1589248->3596287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.477345:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468077312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 249031us (249123us total) trans 158913793460 rc 0/0
00010000:00010000:0.0:1651532095.477345:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477347:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.477348:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477351:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477355:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.477355:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.477356:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.477357:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3608
00010000:00010000:0.0:1651532095.477359:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477362:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.477363:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.477364:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477366:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477382:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477385:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ba0c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3706880->9740287] (req 3706880->9740287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477391:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477394:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477404:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477409:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477409:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477412:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.477433:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468078464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 248405us (248428us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532095.477437:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3611
00010000:00010000:0.0:1651532095.477444:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477448:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.477449:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477461:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477479:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477482:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ba2f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9478144->9482239] (req 9478144->9482239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.477610:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.477629:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468082688
00000100:00100000:0.0:1651532095.477644:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3619
00000100:00100000:0.0:1651532095.477646:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468082688:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532095.477654:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.477656:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532095.477658:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532095.477659:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477662:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.477726:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468082624
00000100:00100000:1.0:1651532095.477742:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3620
00000100:00100000:1.0:1651532095.477743:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468082624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532095.477758:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477769:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.477771:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477774:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477776:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532095.477777:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477782:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477820:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477824:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.477841:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.477857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.477866:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468082752
00000100:00100000:0.0:1651532095.477879:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468082880
00000100:00100000:1.0:1651532095.477882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.477887:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1823
00000100:00100000:0.0:1651532095.477890:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468082752:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532095.477893:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1824
00010000:00010000:0.0:1651532095.477894:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532095.477896:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468082880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.477907:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb08 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472d4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477910:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.477914:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb0f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472db expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.477916:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb08 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472d4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.477922:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb08 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472d4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.477923:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb0f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472db expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.477926:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532095.477927:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb0f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472db expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.477931:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532095.477941:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468082752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.477945:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1823
00000100:00100000:1.0:1651532095.477947:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468082880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.477950:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1824
00000100:00100000:1.0:1651532095.477966:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468082944
00000100:00100000:1.0:1651532095.477979:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3621
00000100:00100000:1.0:1651532095.477980:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468082944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532095.477986:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477991:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.477992:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.477995:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532095.477995:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.478000:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.478003:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.478317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.478325:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468083072
00000100:00100000:1.0:1651532095.478338:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1825
00000100:00100000:1.0:1651532095.478340:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468083072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.478343:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.478347:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb1d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472e2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.478355:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb1d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472e2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.478367:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb1d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472e2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.478371:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532095.478382:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468083072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.478385:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1825
00000001:00080000:1.0:1651532095.561378:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793461 is committed
00010000:00010000:1.0:1651532095.561393:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561397:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.561413:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468078208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 332495us (332614us total) trans 158913793461 rc 0/0
00000100:00100000:1.0:1651532095.561416:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3610
00010000:00010000:1.0:1651532095.561444:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561455:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532095.561457:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561460:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561474:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.561475:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.561475:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561479:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561490:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561493:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ba28 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8589311] (req 1028096->8589311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561508:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561529:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.561623:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.561631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.561644:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468083264
00000100:00100000:0.0:1651532095.561650:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468083328
00000100:00100000:1.0:1651532095.561655:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3622
00000100:00100000:1.0:1651532095.561656:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468083264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532095.561663:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561668:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.561669:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561672:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532095.561672:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.561679:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3623
00000100:00100000:0.0:1651532095.561681:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468083328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532095.561685:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561689:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561690:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561694:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.561696:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561712:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532095.561713:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561718:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561721:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.561778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.561798:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468083392
00000100:00100000:1.0:1651532095.561819:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1826
00000100:00100000:1.0:1651532095.561821:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468083392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.561822:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561824:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.561827:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561828:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb32 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472e9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.561833:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.561836:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb32 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472e9 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.561840:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb32 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472e9 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.561844:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532095.561849:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468079040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 332150us (332241us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532095.561853:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3613
00000100:00100000:1.0:1651532095.561859:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468083392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.561861:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1826
00010000:00010000:0.0:1651532095.561862:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561866:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.561867:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561870:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561884:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.561884:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.561885:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561889:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561898:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561901:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ba60 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2207744->2674687] (req 2207744->2674687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561911:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.561914:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.562129:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.562160:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468083456
00000100:00100000:1.0:1651532095.562168:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1827
00000100:00100000:1.0:1651532095.562170:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468083456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.562173:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.562177:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bb39 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472f0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.562184:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bb39 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472f0 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.562188:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bb39 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472f0 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.562192:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532095.562201:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468083456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.562204:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1827
00000100:00100000:1.0:1651532095.562284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.562291:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468083648
00000100:00100000:1.0:1651532095.562297:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1828
00000100:00100000:1.0:1651532095.562298:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468083648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.562313:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.562316:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bb40 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472f7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.562323:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bb40 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472f7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.562338:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bb40 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472f7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.562341:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532095.562352:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468083648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.562354:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1828
00000001:00080000:1.0:1651532095.603786:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793462 is committed
00010000:00010000:0.0:1651532095.603822:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.603827:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.603852:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468078976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 374141us (374221us total) trans 158913793462 rc 0/0
00000100:00100000:0.0:1651532095.603865:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3614
00010000:00010000:0.0:1651532095.603874:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.603877:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.603878:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.603881:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.603887:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.603887:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.603888:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.603891:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.603901:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.603904:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ba67 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->6471679] (req 409600->6471679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.603908:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.603913:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.604146:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.604159:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.604172:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468083904
00000100:00100000:1.0:1651532095.604177:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.604186:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468083968
00000100:00100000:0.0:1651532095.604195:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3624
00000100:00100000:1.0:1651532095.604196:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468084032
00000100:00100000:0.0:1651532095.604197:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468083904:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532095.604205:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1829
00000100:00100000:1.0:1651532095.604207:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468084032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.604210:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.604211:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.604214:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bb4e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4472fe expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.604216:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532095.604217:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532095.604217:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.604222:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.604223:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bb4e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472fe expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532095.604230:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3625
00000100:00100000:0.0:1651532095.604232:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468083968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532095.604236:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bb4e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4472fe expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.604236:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.604240:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532095.604240:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532095.604241:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.604243:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532095.604244:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.604248:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.604251:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468084032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (74us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532095.604251:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.604254:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1829
00000100:00100000:1.0:1651532095.604535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.604543:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468084160
00000100:00100000:1.0:1651532095.604549:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1830
00000100:00100000:1.0:1651532095.604551:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468084160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.604555:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.604558:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bb5c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447305 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.604565:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bb5c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447305 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.604569:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bb5c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447305 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.604573:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532095.604582:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468084160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.604596:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1830
00000100:00100000:1.0:1651532095.604845:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.604852:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468084352
00000100:00100000:1.0:1651532095.604859:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1831
00000100:00100000:1.0:1651532095.604861:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468084352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.604864:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.604867:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb63 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44730c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.604875:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb63 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44730c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.604879:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb63 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44730c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.604882:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532095.604891:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468084352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.604894:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1831
00000001:00080000:1.0:1651532095.700092:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793463 is committed
00010000:00010000:1.0:1651532095.700106:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.700110:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.700136:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468079296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 470301us (470357us total) trans 158913793463 rc 0/0
00000100:00100000:1.0:1651532095.700139:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3615
00010000:00010000:1.0:1651532095.700146:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.700149:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532095.700151:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.700153:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.700158:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.700159:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.700160:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.700163:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.700169:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.700172:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ba6e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->4059135] (req 4055040->4059135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.700177:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.700187:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.700544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.700552:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468084480
00000100:00100000:1.0:1651532095.700560:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1832
00000100:00100000:1.0:1651532095.700561:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468084480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.700565:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.700568:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb6a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447313 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.700576:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb6a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447313 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.700581:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb6a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447313 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.700584:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532095.700593:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468084480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.700596:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1832
00000001:00080000:1.0:1651532095.817434:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793464 is committed
00010000:00010000:1.0:1651532095.817449:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.817453:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.817482:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468081216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 473603us (473693us total) trans 158913793464 rc 0/0
00010000:00010000:0.0:1651532095.817484:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.817486:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3617
00010000:00010000:0.0:1651532095.817489:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.817490:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817494:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817500:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.817500:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.817501:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817504:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817507:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.817508:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.817509:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817511:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817520:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817533:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bac2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->8220671] (req 655360->8220671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817539:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817542:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817573:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.817592:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.818031:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.818039:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.818046:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.818052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.818057:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.818080:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468084672
00010000:00010000:0.0:1651532095.818083:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.818087:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.818091:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468084608
00000100:00100000:1.0:1651532095.818096:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3626
00000100:00100000:1.0:1651532095.818098:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468084672:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532095.818108:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468082688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 340461us (340498us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532095.818110:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.818112:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3619
00010000:00010000:1.0:1651532095.818115:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.818116:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532095.818116:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818119:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.818119:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3627
00000100:00100000:0.0:1651532095.818121:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468084608:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532095.818127:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468084736
00000100:00100000:1.0:1651532095.818137:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468084800
00000100:00100000:1.0:1651532095.818139:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468084864
00000100:00100000:1.0:1651532095.818142:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1833
00010000:00010000:0.0:1651532095.818144:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.818148:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532095.818149:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.818151:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468084736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.818152:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818154:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.818155:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532095.818155:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818157:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bb7f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44731a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.818160:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818162:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.818164:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818165:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bb7f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44731a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.818167:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818169:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bb7f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44731a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.818173:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532095.818174:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.818177:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.818178:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.818181:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468084736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (135us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.818183:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1833
00000100:00100000:1.0:1651532095.818188:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1834
00000100:00100000:1.0:1651532095.818189:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468084800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.818191:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.818191:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818193:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bb86 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447321 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.818196:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818198:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.818199:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bb86 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447321 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.818199:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bafa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1470464->8429567] (req 1470464->8429567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818203:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bb86 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447321 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532095.818207:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1835
00000100:00100000:0.0:1651532095.818209:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468084864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.818213:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.818214:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532095.818215:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bb8d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447328 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.818220:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468084800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (168us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532095.818221:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532095.818223:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1834
00010000:00010000:0.0:1651532095.818224:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bb8d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447328 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.818228:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bb8d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447328 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.818231:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532095.818240:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468084864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (182us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.818243:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1835
00010000:00010000:0.0:1651532095.818263:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.818267:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.818285:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468081280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474403us (474451us total) trans 0 rc 49152/49152
00000100:00100000:0.0:1651532095.818287:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3618
00010000:00010000:1.0:1651532095.818293:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818297:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532095.818298:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818312:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818318:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.818318:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532095.818319:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818322:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818330:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818333:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bac9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->10239999] (req 1245184->10239999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818349:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.818352:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.818695:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.818709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.818718:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.818722:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468084992
00000100:00100000:0.0:1651532095.818734:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468085056
00000100:00100000:0.0:1651532095.818737:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468085120
00000100:00100000:0.0:1651532095.818740:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1836
00000100:00100000:0.0:1651532095.818742:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468084992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.818745:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.818749:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bb94 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44732f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.818757:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bb94 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44732f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.818761:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bb94 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44732f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.818764:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532095.818800:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468084992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.818814:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1836
00000100:00100000:0.0:1651532095.818827:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1837
00000100:00100000:0.0:1651532095.818828:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468085056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.818832:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532095.818834:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1838
00010000:00010000:0.0:1651532095.818835:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bb9b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447336 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.818836:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468085120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.818840:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.818844:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bba2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44733d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.818847:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bb9b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447336 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.818852:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bba2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44733d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.818854:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bb9b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447336 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.818856:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bba2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44733d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.818859:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532095.818861:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532095.818867:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468085120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (149us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.818870:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1838
00000100:00100000:0.0:1651532095.818888:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468085056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (178us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.818892:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1837
00000100:00100000:1.0:1651532095.818896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.818910:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468085312
00000100:00100000:1.0:1651532095.818913:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.818922:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1839
00000100:00100000:0.0:1651532095.818925:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468085312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.818929:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532095.818933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532095.818934:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bba9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447344 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.818943:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bba9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447344 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.818959:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bba9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447344 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.818962:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532095.818975:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468085312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.818978:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1839
00000100:00100000:1.0:1651532095.818988:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468085504
00000100:00100000:0.0:1651532095.818988:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468085440
00000100:00100000:0.0:1651532095.818999:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3628
00000100:00100000:1.0:1651532095.819016:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3629
00000100:00100000:0.0:1651532095.819016:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468085440:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532095.819018:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468085504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532095.819023:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.819025:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.819027:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532095.819028:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.819031:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532095.819032:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.819035:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.819037:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.819039:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532095.819040:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.819044:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.819045:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.819048:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.819048:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.819254:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.819262:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.819269:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468085632
00000100:00100000:0.0:1651532095.819282:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468085696
00000100:00100000:0.0:1651532095.819287:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1840
00000100:00100000:0.0:1651532095.819289:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468085632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.819292:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532095.819293:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1841
00000100:00100000:1.0:1651532095.819295:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468085696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.819295:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bbbe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44734b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.819299:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.819311:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bbc5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447352 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.819325:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bbbe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44734b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.819330:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bbbe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44734b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.819331:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bbc5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447352 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.819334:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532095.819336:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bbc5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447352 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.819339:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532095.819345:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468085632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.819347:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1840
00000100:00100000:1.0:1651532095.819348:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468085696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.819350:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1841
00000100:00100000:0.0:1651532095.819387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.819404:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468085888
00000100:00100000:1.0:1651532095.819412:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1842
00000100:00100000:1.0:1651532095.819413:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468085888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.819416:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.819420:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bbcc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447359 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.819426:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bbcc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447359 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.819430:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bbcc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447359 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.819434:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532095.819441:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468085888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.819452:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1842
00000100:00100000:0.0:1651532095.819519:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.819538:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468086016
00000100:00100000:1.0:1651532095.819546:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1843
00000100:00100000:1.0:1651532095.819548:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468086016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.819551:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.819554:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bbd3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447360 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.819561:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bbd3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447360 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.819565:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bbd3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447360 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.819568:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532095.819577:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468086016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.819579:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1843
00000100:00100000:0.0:1651532095.819710:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.819728:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468086208
00000100:00100000:1.0:1651532095.819735:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1844
00000100:00100000:1.0:1651532095.819737:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468086208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.819740:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.819743:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bbda lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447367 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.819750:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bbda lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447367 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.819763:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bbda lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447367 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.819767:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532095.819777:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468086208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.819780:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1844
00000100:00100000:0.0:1651532095.819895:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.819905:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468086528
00000100:00100000:1.0:1651532095.819913:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1845
00000100:00100000:1.0:1651532095.819915:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468086528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.819918:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.819921:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bbe1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44736e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.819928:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bbe1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44736e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.819932:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bbe1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44736e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.819935:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532095.819944:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468086528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.819947:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1845
00000001:00080000:1.0:1651532095.868220:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793465 is committed
00010000:00010000:1.0:1651532095.868235:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.868239:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.868260:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468082624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 390515us (390603us total) trans 158913793465 rc 0/0
00000100:00100000:1.0:1651532095.868263:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3620
00010000:00010000:0.0:1651532095.868265:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.868276:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.868278:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.868281:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.868287:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.868287:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.868288:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.868291:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.868298:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.868310:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bb01 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10354687] (req 40960->10354687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.868323:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.868328:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.868598:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.868607:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.868613:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468086912
00000100:00100000:1.0:1651532095.868625:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468086976
00000100:00100000:1.0:1651532095.868629:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1846
00000100:00100000:1.0:1651532095.868631:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468086912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.868634:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532095.868636:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1847
00010000:00010000:1.0:1651532095.868638:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bbe8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447375 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532095.868638:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468086976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532095.868642:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.868646:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bbe8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447375 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.868646:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bbef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44737c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.868662:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bbe8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447375 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.868664:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bbef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44737c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.868666:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532095.868668:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bbef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44737c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.868672:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532095.868677:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468086912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.868679:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1846
00000100:00100000:0.0:1651532095.868681:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468086976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.868684:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1847
00000100:00100000:1.0:1651532095.868931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.868942:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532095.868942:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468087168
00000100:00100000:0.0:1651532095.868957:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468087232
00000100:00100000:1.0:1651532095.868961:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1848
00000100:00100000:1.0:1651532095.868968:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468087168:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532095.868968:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1849
00000100:00100000:0.0:1651532095.868970:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468087232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.868972:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532095.868973:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.868975:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bbf6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447383 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.868977:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bbfd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44738a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.868983:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bbf6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447383 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.868985:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bbfd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44738a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.868987:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bbf6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447383 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532095.868989:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bbfd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44738a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.868990:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532095.868992:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532095.869000:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468087168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.869008:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468087232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532095.869011:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1849
00000100:00100000:1.0:1651532095.869013:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1848
00000100:00100000:1.0:1651532095.869257:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.869264:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468087424
00000100:00100000:1.0:1651532095.869271:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1850
00000100:00100000:1.0:1651532095.869273:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468087424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.869276:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.869292:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc04 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447391 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.869307:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc04 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447391 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.869311:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc04 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447391 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.869315:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532095.869325:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468087424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.869328:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1850
00000100:00100000:1.0:1651532095.869354:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.869393:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468087616
00000100:00100000:1.0:1651532095.869400:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1851
00000100:00100000:1.0:1651532095.869402:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3b03404 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468087616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.869405:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.869408:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc0b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447398 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.869423:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc0b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447398 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.869427:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc0b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447398 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.869431:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532095.869441:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3b03404 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468087616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.869443:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1851
00000100:00100000:1.0:1651532095.869608:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.869616:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468087744
00000100:00100000:1.0:1651532095.869622:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1852
00000100:00100000:1.0:1651532095.869624:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468087744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.869627:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.869630:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc12 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44739f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.869637:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc12 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44739f expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.869641:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc12 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44739f expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.869644:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532095.869661:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468087744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.869664:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1852
00000001:00080000:1.0:1651532095.985607:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793466 is committed
00010000:00010000:1.0:1651532095.985621:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.985625:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.985646:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468082944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507664us (507769us total) trans 158913793466 rc 0/0
00000100:00100000:1.0:1651532095.985649:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3621
00010000:00010000:0.0:1651532095.985651:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.985656:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532095.985657:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.985660:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.985666:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.985666:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532095.985667:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.985670:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.985680:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532095.985683:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bb16 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7639040->7643135] (req 7639040->7643135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.985701:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.985705:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.985973:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.985994:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.986001:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532095.986008:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468088064
00000100:00100000:1.0:1651532095.986037:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468088000
00000100:00100000:1.0:1651532095.986045:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3630
00000100:00100000:1.0:1651532095.986047:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468088064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532095.986054:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986070:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.986071:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532095.986071:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986075:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.986082:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3631
00000100:00100000:1.0:1651532095.986084:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468088000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532095.986089:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986092:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532095.986093:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986096:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986098:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986101:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532095.986101:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986106:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986115:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986118:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986121:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532095.986130:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468088128
00000100:00100000:1.0:1651532095.986136:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1853
00000100:00100000:1.0:1651532095.986138:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468088128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532095.986140:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532095.986143:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc27 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473a6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532095.986149:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473a6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.986154:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473a6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532095.986157:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532095.986167:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468088128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (195us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532095.986179:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1853
00000001:00080000:1.0:1651532096.069664:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793467 is committed
00010000:00010000:1.0:1651532096.069679:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069683:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.069699:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468083264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 508041us (508076us total) trans 158913793467 rc 0/0
00000100:00100000:1.0:1651532096.069702:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3622
00010000:00010000:1.0:1651532096.069708:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069711:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532096.069713:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069716:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069720:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.069721:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.069722:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069725:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069739:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.069740:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.069741:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069744:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069756:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069759:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bb24 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->10428415] (req 761856->10428415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.069772:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.069787:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069789:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.069801:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.070083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532096.070092:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.070097:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.070118:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468083328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508436us (508486us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532096.070122:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3623
00010000:00010000:0.0:1651532096.070129:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.070133:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.070134:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.070137:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.070142:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.070145:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bb2b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8437760->10084351] (req 8437760->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.070165:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468088320
00000100:00100000:1.0:1651532096.070174:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1854
00000100:00100000:1.0:1651532096.070176:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468088320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.070179:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.070191:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc2e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473ad expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.070220:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc2e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473ad expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.070224:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc2e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473ad expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.070227:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532096.070244:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468088320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (162us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.070247:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1854
00000100:00100000:1.0:1651532096.070398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.070410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.070410:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468088512
00000100:00100000:1.0:1651532096.070417:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468088448
00000100:00100000:0.0:1651532096.070424:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3632
00000100:00100000:0.0:1651532096.070426:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468088512:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532096.070432:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3633
00000100:00100000:1.0:1651532096.070434:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468088448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532096.070435:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.070439:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.070440:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.070441:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.070443:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532096.070444:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.070450:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532096.070451:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532096.070451:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.070474:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.070478:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.070480:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.070496:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.070509:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468088576
00000100:00100000:1.0:1651532096.070519:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1855
00000100:00100000:1.0:1651532096.070521:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468088576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.070524:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.070526:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc43 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473b4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.070534:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc43 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473b4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.070538:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc43 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473b4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.070541:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532096.070559:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468088576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.070562:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1855
00000100:00100000:0.0:1651532096.070568:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.070607:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468088704
00000100:00100000:1.0:1651532096.070617:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1856
00000100:00100000:1.0:1651532096.070619:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468088704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.070622:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.070625:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc4a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473bb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.070632:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc4a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473bb expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.070644:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc4a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473bb expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.070647:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532096.070659:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468088704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.070662:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1856
00000100:00100000:1.0:1651532096.070979:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.070986:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468088896
00000100:00100000:1.0:1651532096.070996:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1857
00000100:00100000:1.0:1651532096.070998:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468088896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.071002:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.071005:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bc51 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473c2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.071012:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bc51 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473c2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.071016:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bc51 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473c2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.071019:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532096.071030:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468088896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.071041:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1857
00000001:00080000:1.0:1651532096.141026:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793468 is committed
00010000:00010000:1.0:1651532096.141041:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.141045:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141064:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.141068:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468083904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 536870us (536923us total) trans 158913793468 rc 0/0
00010000:00010000:0.0:1651532096.141069:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.141070:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.141071:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3624
00010000:00010000:0.0:1651532096.141082:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141088:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.141089:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.141089:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141093:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141096:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.141096:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.141097:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141099:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141108:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141111:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bb47 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2187264->4231167] (req 2187264->4231167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141116:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.141118:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141119:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.141122:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.141464:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532096.141489:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.141493:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141496:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141501:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.141510:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468084672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 323411us (323479us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532096.141513:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3626
00000100:00100000:0.0:1651532096.141522:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468083968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 537289us (537362us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532096.141526:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3625
00000100:00100000:1.0:1651532096.141529:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468089088
00010000:00010000:0.0:1651532096.141533:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.141538:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1858
00000100:00100000:1.0:1651532096.141540:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468089088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.141543:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.141543:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.141544:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.141547:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bc58 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473c9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141547:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.141553:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.141553:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.141555:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bc58 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473c9 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.141555:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bb71 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1957888->8474623] (req 1957888->8474623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.141559:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bc58 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473c9 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.141559:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.141563:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532096.141570:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468089088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.141572:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1858
00010000:00010000:0.0:1651532096.141572:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.141573:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141576:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141580:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.141580:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.141581:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141584:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141591:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141594:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bb55 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3661824->9809919] (req 3661824->9809919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141599:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.141602:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.142130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.142142:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.142152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.142153:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468089280
00000100:00100000:0.0:1651532096.142162:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.142172:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468089216
00000100:00100000:0.0:1651532096.142174:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3634
00000100:00100000:0.0:1651532096.142176:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468089280:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532096.142179:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3635
00000100:00100000:1.0:1651532096.142180:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468089216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532096.142185:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.142187:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.142190:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532096.142191:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.142194:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532096.142195:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.142199:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532096.142200:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532096.142201:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.142212:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.142212:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.142216:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.142222:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468089408
00000100:00100000:1.0:1651532096.142230:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468089600
00000100:00100000:1.0:1651532096.142234:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1859
00000100:00100000:1.0:1651532096.142236:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468089408:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532096.142238:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1860
00010000:00010000:1.0:1651532096.142239:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532096.142240:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468089600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.142241:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc6d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473d0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.142243:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.142246:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc74 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473d7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.142248:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc6d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473d0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.142252:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc6d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473d0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.142256:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532096.142265:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc74 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473d7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532096.142266:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468089408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.142269:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1859
00010000:00010000:0.0:1651532096.142269:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc74 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473d7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.142273:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532096.142283:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468089600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (120us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.142286:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1860
00000001:00080000:1.0:1651532096.183465:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793469 is committed
00010000:00010000:0.0:1651532096.183497:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183503:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.183523:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468084608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 365401us (365483us total) trans 158913793469 rc 0/0
00000100:00100000:0.0:1651532096.183527:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3627
00010000:00010000:0.0:1651532096.183534:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183538:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.183539:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183555:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183561:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.183562:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.183563:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183566:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183573:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183576:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bb78 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->6905855] (req 3051520->6905855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183605:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183609:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.183919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.183934:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.183940:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468089984
00000100:00100000:1.0:1651532096.183941:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468089920
00000100:00100000:0.0:1651532096.183969:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3636
00000100:00100000:0.0:1651532096.183971:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468089984:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532096.183975:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3637
00010000:00010000:0.0:1651532096.183979:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.183984:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468089920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532096.183992:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183993:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532096.183995:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.183997:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532096.183998:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.184002:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532096.184003:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.184006:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.184009:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532096.184009:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.184013:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.184014:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.184017:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.184017:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.184020:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532096.289108:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793470 is committed
00010000:00010000:0.0:1651532096.289138:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289142:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289166:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.289166:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468085440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 470149us (470232us total) trans 158913793470 rc 0/0
00000100:00100000:0.0:1651532096.289169:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3628
00010000:00010000:1.0:1651532096.289170:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532096.289178:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289181:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289187:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.289188:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.289188:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289191:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289194:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.289195:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.289196:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289198:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289215:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289218:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bbb0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->5771263] (req 274432->5771263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289223:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289236:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289264:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289268:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.289591:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.289599:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.289631:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468090240
00010000:00010000:1.0:1651532096.289636:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.289639:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468090304
00010000:00010000:1.0:1651532096.289641:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.289646:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1861
00000100:00100000:0.0:1651532096.289660:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468090240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.289664:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532096.289665:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468088064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 303617us (303670us total) trans 0 rc 69632/69632
00000100:00100000:1.0:1651532096.289668:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3630
00010000:00010000:0.0:1651532096.289668:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bc89 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473de expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289674:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532096.289676:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1862
00010000:00010000:0.0:1651532096.289677:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bc89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473de expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532096.289678:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468090304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.289682:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.289682:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40bc89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473de expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.289685:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bc90 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473e5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289685:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532096.289690:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.289693:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bc90 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473e5 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532096.289694:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468090240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (104us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532096.289697:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bc90 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473e5 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532096.289697:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1861
00010000:00010000:1.0:1651532096.289701:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532096.289704:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.289707:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468090304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (108us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532096.289708:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.289709:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.289710:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1862
00010000:00010000:0.0:1651532096.289712:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289717:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289719:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.289723:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289734:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bc19 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->10067967] (req 106496->10067967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.289737:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468085504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 470718us (470824us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532096.289739:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.289740:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3629
00010000:00010000:0.0:1651532096.289741:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.289742:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289745:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289749:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.289749:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.289750:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289753:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289763:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289765:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bbb7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4038656->10334207] (req 4038656->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289777:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.289787:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.290107:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.290118:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.290127:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.290135:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468090560
00000100:00100000:1.0:1651532096.290148:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468090496
00000100:00100000:0.0:1651532096.290149:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1863
00000100:00100000:0.0:1651532096.290151:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468090560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.290155:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532096.290161:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468090432
00010000:00010000:0.0:1651532096.290164:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bc97 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473ec expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.290167:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3638
00000100:00100000:1.0:1651532096.290169:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468090496:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532096.290173:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bc97 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473ec expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.290177:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bc97 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473ec expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.290180:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532096.290188:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.290190:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468090560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (63us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532096.290192:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532096.290193:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00000100:00100000:0.0:1651532096.290193:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1863
00010000:00010000:1.0:1651532096.290199:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290202:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.290210:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3639
00000100:00100000:1.0:1651532096.290211:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468090432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532096.290216:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290219:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532096.290220:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290223:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290225:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290228:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532096.290228:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290233:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290235:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290244:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290248:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.290284:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.290325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.290326:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468090688
00000100:00100000:1.0:1651532096.290333:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.290333:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468090880
00000100:00100000:0.0:1651532096.290336:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468090944
00000100:00100000:1.0:1651532096.290340:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1864
00000100:00100000:1.0:1651532096.290341:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468090688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.290345:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.290348:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bcac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473f3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.290349:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1865
00000100:00100000:0.0:1651532096.290351:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468090880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.290354:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.290356:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bcac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473f3 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.290358:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bcb3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4473fa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290360:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bcac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473f3 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.290364:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532096.290367:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bcb3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473fa expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.290371:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bcb3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4473fa expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532096.290373:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468090688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (89us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532096.290374:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532096.290375:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1864
00000100:00100000:0.0:1651532096.290383:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468090880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.290386:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1865
00000100:00100000:1.0:1651532096.290390:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1866
00000100:00100000:1.0:1651532096.290392:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468090944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.290395:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.290398:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bcba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447401 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290404:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bcba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447401 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.290408:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bcba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447401 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.290411:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532096.290418:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468090944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.290441:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1866
00000100:00100000:0.0:1651532096.290614:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.290624:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468091136
00000100:00100000:1.0:1651532096.290635:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1867
00000100:00100000:1.0:1651532096.290636:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468091136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.290639:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.290642:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bcc1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447408 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290649:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bcc1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447408 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.290656:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bcc1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447408 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.290659:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532096.290669:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468091136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.290671:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1867
00000100:00100000:0.0:1651532096.290734:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.290744:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468091328
00000100:00100000:0.0:1651532096.290746:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.290754:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468091392
00000100:00100000:1.0:1651532096.290761:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1868
00000100:00100000:1.0:1651532096.290763:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468091328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.290766:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532096.290766:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1869
00010000:00010000:1.0:1651532096.290769:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bcc8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44740f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.290769:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468091392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.290773:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.290776:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bcc8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44740f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.290776:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bccf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447416 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.290780:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bcc8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44740f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.290783:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532096.290784:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bccf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447416 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532096.290793:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468091328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.290795:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1868
00010000:00010000:0.0:1651532096.290800:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bccf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447416 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.290815:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532096.290824:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468091392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.290827:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1869
00000100:00100000:0.0:1651532096.290961:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.290968:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.290974:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468091584
00000100:00100000:0.0:1651532096.290980:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468091712
00000100:00100000:0.0:1651532096.290989:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1870
00000100:00100000:0.0:1651532096.290990:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468091584:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532096.290992:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1871
00000100:00100000:1.0:1651532096.290994:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468091712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.290994:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.290997:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.290997:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bcd6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44741d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.291001:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bcdd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447424 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.291005:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bcd6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44741d expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.291007:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bcdd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447424 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.291008:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bcd6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44741d expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.291011:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bcdd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447424 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.291012:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532096.291015:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532096.291024:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468091584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.291029:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468091712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.291032:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1871
00000100:00100000:0.0:1651532096.291034:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1870
00000100:00100000:0.0:1651532096.291086:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.291092:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468091904
00000100:00100000:0.0:1651532096.291099:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1872
00000100:00100000:0.0:1651532096.291100:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468091904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.291103:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.291106:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bce4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44742b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.291113:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bce4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44742b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.291117:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bce4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44742b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.291121:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532096.291134:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468091904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.291136:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1872
00000100:00100000:0.0:1651532096.291289:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.291295:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468092160
00000100:00100000:0.0:1651532096.291310:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1873
00000100:00100000:0.0:1651532096.291312:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468092160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.291315:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.291319:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bceb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447432 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.291333:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bceb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447432 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.291337:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bceb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447432 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.291341:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532096.291355:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468092160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.291358:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1873
00000001:00080000:1.0:1651532096.372012:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793471 is committed
00010000:00010000:0.0:1651532096.372042:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372047:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.372068:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468088000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 385983us (386066us total) trans 158913793471 rc 0/0
00010000:00010000:1.0:1651532096.372069:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.372071:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3631
00010000:00010000:1.0:1651532096.372074:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532096.372075:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372078:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372099:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.372100:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.372101:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372104:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372115:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.372116:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.372116:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372119:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372133:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372136:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bc20 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->10027007] (req 151552->10027007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372142:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372145:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372145:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372150:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372165:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372190:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.372207:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468088512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 301780us (301809us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532096.372210:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3632
00010000:00010000:0.0:1651532096.372217:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372220:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.372221:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372224:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372230:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372232:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bc35 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9900032->9904127] (req 9900032->9904127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.372529:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.372537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.372544:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.372550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.372564:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.372577:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468092480
00000100:00100000:0.0:1651532096.372579:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468092544
00000100:00100000:0.0:1651532096.372591:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468092416
00000100:00100000:0.0:1651532096.372600:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3640
00000100:00100000:0.0:1651532096.372601:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468092544:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532096.372604:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468092672
00000100:00100000:1.0:1651532096.372608:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468092736
00010000:00010000:0.0:1651532096.372609:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372613:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532096.372614:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372617:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532096.372618:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.372621:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1874
00010000:00010000:0.0:1651532096.372622:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.372623:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468092480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.372626:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372627:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.372631:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bcf9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447439 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.372633:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3641
00000100:00100000:0.0:1651532096.372635:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468092416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532096.372638:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bcf9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447439 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.372642:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bcf9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447439 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.372646:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532096.372647:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372651:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532096.372651:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.372657:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468092480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.372659:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1874
00000100:00100000:1.0:1651532096.372664:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1875
00000100:00100000:1.0:1651532096.372666:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468092672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.372668:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.372670:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd07 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447440 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372674:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532096.372675:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372682:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.372683:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd07 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447440 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.372685:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.372693:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1876
00000100:00100000:0.0:1651532096.372695:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468092736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.372697:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd07 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447440 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.372698:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.372700:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532096.372700:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bd0e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447447 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.372707:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468092672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (157us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532096.372707:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bd0e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447447 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532096.372710:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1875
00010000:00010000:0.0:1651532096.372712:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bd0e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447447 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.372715:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532096.372724:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468092736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (160us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.372726:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1876
00000100:00100000:1.0:1651532096.372729:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.372741:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468092928
00000100:00100000:0.0:1651532096.372750:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1877
00000100:00100000:0.0:1651532096.372752:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468092928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.372755:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.372758:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bd15 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44744e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.372764:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bd15 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44744e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.372768:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bd15 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44744e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.372771:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532096.372784:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468092928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.372787:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1877
00000100:00100000:0.0:1651532096.373097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.373105:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.373119:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.373128:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468093120
00000100:00100000:1.0:1651532096.373130:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468093184
00000100:00100000:0.0:1651532096.373137:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468093376
00000100:00100000:0.0:1651532096.373140:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1878
00000100:00100000:0.0:1651532096.373142:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468093120:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532096.373143:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1879
00000100:00100000:1.0:1651532096.373145:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468093184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.373145:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.373148:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.373149:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd1c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447455 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.373152:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd23 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44745c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.373159:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd23 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44745c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.373163:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd23 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44745c expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.373166:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532096.373167:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd1c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447455 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.373171:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd1c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447455 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.373174:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532096.373177:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468093184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.373183:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468093120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.373186:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1878
00000100:00100000:1.0:1651532096.373190:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1879
00000100:00100000:0.0:1651532096.373191:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1880
00000100:00100000:0.0:1651532096.373193:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468093376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.373195:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.373198:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd2a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447463 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.373203:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd2a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447463 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.373207:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd2a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447463 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.373210:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532096.373215:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468093376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.373225:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1880
00000001:00080000:1.0:1651532096.488667:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793472 is committed
00002000:00010000:1.0:1651532096.488681:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532095 -> 1651532096
00002000:00010000:1.0:1651532096.488682:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532095 -> 1651532096
00010000:00010000:1.0:1651532096.488684:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488688:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.488710:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468088448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 418275us (418300us total) trans 158913793472 rc 0/0
00000100:00100000:1.0:1651532096.488714:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3633
00010000:00010000:1.0:1651532096.488721:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488724:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532096.488725:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488728:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488733:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.488734:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.488735:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488754:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488758:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.488759:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.488759:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488762:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488775:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488778:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bc3c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->2789375] (req 2629632->2789375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488784:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.488787:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.488788:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.488793:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.489088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.489096:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532096.489118:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489123:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.489139:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468089280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 346962us (347029us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532096.489142:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3634
00000100:00100000:0.0:1651532096.489147:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468093760
00000100:00100000:0.0:1651532096.489159:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468093824
00000100:00100000:0.0:1651532096.489165:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3642
00000100:00100000:0.0:1651532096.489167:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468093760:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532096.489170:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3643
00000100:00100000:1.0:1651532096.489173:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468093824:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532096.489173:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489178:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532096.489179:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489181:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532096.489190:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.489193:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489195:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.489197:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532096.489199:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.489202:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532096.489202:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489205:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489212:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489215:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.489216:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.489218:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489219:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.489224:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489224:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489227:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bc5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->3579903] (req 303104->3579903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.489496:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.489508:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468094016
00000100:00100000:1.0:1651532096.489509:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.489519:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468094080
00000100:00100000:1.0:1651532096.489530:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1881
00000100:00100000:1.0:1651532096.489532:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468094016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532096.489532:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1882
00000100:00100000:0.0:1651532096.489534:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468094080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.489536:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.489539:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd3f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44746a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489546:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.489547:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd3f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44746a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.489550:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd46 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447471 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.489557:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd46 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447471 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.489561:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd46 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447471 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.489562:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd3f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44746a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.489565:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532096.489566:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532096.489576:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468094016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.489576:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468094080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.489579:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1882
00000100:00100000:1.0:1651532096.489580:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1881
00000100:00100000:1.0:1651532096.489849:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.489857:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468094208
00000100:00100000:1.0:1651532096.489864:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1883
00000100:00100000:1.0:1651532096.489865:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468094208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.489869:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.489872:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd4d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447478 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.489879:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd4d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447478 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.489883:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd4d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447478 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.489886:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532096.489900:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468094208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.489911:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1883
00000001:00080000:1.0:1651532096.588723:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793473 is committed
00010000:00010000:1.0:1651532096.588739:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.588743:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.588767:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468089216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 446586us (446624us total) trans 158913793473 rc 0/0
00010000:00010000:0.0:1651532096.588767:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.588770:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3635
00010000:00010000:0.0:1651532096.588772:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.588773:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.588776:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.588782:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.588782:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.588783:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.588789:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.588797:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.588799:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bc66 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3825664->9887743] (req 3825664->9887743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.588823:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.588827:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.589106:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.589114:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.589124:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468094528
00000100:00100000:1.0:1651532096.589128:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468094464
00000100:00100000:0.0:1651532096.589139:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3644
00000100:00100000:0.0:1651532096.589141:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468094528:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532096.589145:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3645
00000100:00100000:1.0:1651532096.589147:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468094464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532096.589147:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.589151:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.589152:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589154:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.589155:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589159:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532096.589160:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589171:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589174:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532096.589175:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589179:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589182:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589185:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589197:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589200:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.589218:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468089984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 405246us (405299us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532096.589221:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3636
00010000:00010000:1.0:1651532096.589228:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589235:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532096.589236:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589239:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589252:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.589253:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.589253:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589257:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589260:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.589260:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.589261:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589263:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589270:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589273:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40bc7b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->6238207] (req 1626112->6238207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589289:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589292:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589315:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589319:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.589338:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.589339:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468090496:12345-10.240.43.64@tcp:3:fio.0 Request processed in 299169us (299232us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532096.589342:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3638
00010000:00010000:0.0:1651532096.589342:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.589343:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589348:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589352:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.589355:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.589360:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.589363:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bc9e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6897664->6901759] (req 6897664->6901759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.589453:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.589473:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468094784
00000100:00100000:1.0:1651532096.589481:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1884
00000100:00100000:1.0:1651532096.589483:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468094784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.589487:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.589490:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd62 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44747f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589512:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd62 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44747f expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.589516:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd62 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44747f expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.589519:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532096.589533:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468094784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.589536:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1884
00000100:00100000:1.0:1651532096.589596:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.589661:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468094848
00000100:00100000:1.0:1651532096.589672:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3646
00000100:00100000:1.0:1651532096.589673:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468094848:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532096.589680:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589685:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532096.589686:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589688:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532096.589689:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589693:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589706:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.589765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.589781:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468094976
00000100:00100000:1.0:1651532096.589789:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1885
00000100:00100000:1.0:1651532096.589791:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468094976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.589794:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.589797:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd70 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447486 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.589822:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd70 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447486 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.589826:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd70 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447486 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.589830:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532096.589841:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468094976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.589843:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1885
00000001:00080000:1.0:1651532096.655467:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793474 is committed
00010000:00010000:1.0:1651532096.655483:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.655487:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.655513:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468089920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 471528us (471579us total) trans 158913793474 rc 0/0
00010000:00010000:0.0:1651532096.655514:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.655516:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3637
00010000:00010000:0.0:1651532096.655519:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.655520:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.655523:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.655528:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.655529:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.655530:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.655532:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.655550:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.655553:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bc82 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->6053887] (req 192512->6053887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.655560:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.655565:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.655947:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.655956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.655963:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.655969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.655975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.655982:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468095168
00000100:00100000:1.0:1651532096.655996:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468095232
00000100:00100000:0.0:1651532096.656006:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3647
00000100:00100000:1.0:1651532096.656009:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3648
00000100:00100000:0.0:1651532096.656009:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468095168:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532096.656011:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468095232:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532096.656017:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.656018:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.656021:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532096.656022:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532096.656022:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.656028:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532096.656029:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.656032:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532096.656040:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.656043:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.656045:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.656048:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.656058:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468095360
00000100:00100000:0.0:1651532096.656058:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468095296
00000100:00100000:1.0:1651532096.656067:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468095424
00000100:00100000:1.0:1651532096.656071:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1886
00000100:00100000:1.0:1651532096.656072:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468095360:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532096.656073:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1887
00010000:00010000:1.0:1651532096.656075:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532096.656075:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468095296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.656078:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd85 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447494 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.656078:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.656081:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bd8c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44748d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.656085:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd85 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447494 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.656089:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bd85 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447494 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.656089:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bd8c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44748d expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.656093:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532096.656102:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bd8c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44748d expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532096.656103:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468095360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (135us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.656106:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1886
00010000:00010000:0.0:1651532096.656106:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532096.656111:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1888
00000100:00100000:0.0:1651532096.656116:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468095296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (153us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.656120:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468095424:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532096.656120:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1887
00010000:00010000:1.0:1651532096.656123:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.656126:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bd93 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44749b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.656132:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bd93 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44749b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.656136:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bd93 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44749b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.656139:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532096.656145:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468095424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (170us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.656148:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1888
00000001:00080000:1.0:1651532096.722199:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793475 is committed
00010000:00010000:1.0:1651532096.722214:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.722218:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.722235:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468090432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432022us (432116us total) trans 158913793475 rc 0/0
00000100:00100000:1.0:1651532096.722238:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3639
00010000:00010000:1.0:1651532096.722244:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.722250:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532096.722251:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.722254:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.722259:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.722260:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.722261:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.722264:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.722277:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.722280:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bca5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1728512->10072063] (req 1728512->10072063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722289:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722293:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722497:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722502:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.722518:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468092544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 349916us (349990us total) trans 0 rc 49152/49152
00000100:00100000:0.0:1651532096.722521:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3640
00010000:00010000:0.0:1651532096.722528:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722531:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.722541:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722544:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722549:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.722550:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.722551:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722554:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722561:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722564:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40bcf2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->10412031] (req 241664->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722569:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.722572:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.722639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.722648:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468095744
00000100:00100000:1.0:1651532096.722670:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1889
00000100:00100000:1.0:1651532096.722672:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468095744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.722676:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.722679:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bd9a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474a2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.722694:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bd9a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474a2 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.722698:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bd9a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474a2 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.722701:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532096.722716:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468095744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.722719:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1889
00000100:00100000:1.0:1651532096.723045:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.723054:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.723060:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468095872
00000100:00100000:1.0:1651532096.723062:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.723069:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468095936
00000100:00100000:0.0:1651532096.723073:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3649
00000100:00100000:0.0:1651532096.723075:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468095872:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532096.723082:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3650
00000100:00100000:1.0:1651532096.723083:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468095936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532096.723090:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.723095:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532096.723095:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.723096:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.723099:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532096.723099:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.723113:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532096.723114:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.723117:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532096.723118:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.723136:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.723137:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.723140:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.723141:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.723147:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468096000
00000100:00100000:1.0:1651532096.723156:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1890
00000100:00100000:1.0:1651532096.723158:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468096000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.723161:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.723163:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bdaf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474a9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.723166:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532096.723170:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bdaf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474a9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532096.723173:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468096256
00010000:00010000:1.0:1651532096.723174:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bdaf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474a9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.723178:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532096.723180:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1891
00000100:00100000:0.0:1651532096.723182:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468096256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.723185:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532096.723188:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468096000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (125us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532096.723189:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bdb6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474b0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.723190:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1890
00010000:00010000:0.0:1651532096.723197:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bdb6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474b0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.723213:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bdb6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474b0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.723217:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532096.723228:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468096256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.723231:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1891
00000100:00100000:1.0:1651532096.723559:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.723570:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468096512
00000100:00100000:0.0:1651532096.723578:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1892
00000100:00100000:0.0:1651532096.723580:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468096512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.723583:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.723587:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bdbd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474b7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.723594:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bdbd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474b7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.723598:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bdbd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474b7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.723601:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532096.723612:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468096512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.723614:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1892
00000001:00080000:1.0:1651532096.852470:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793476 is committed
00010000:00010000:0.0:1651532096.852510:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.852514:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.852537:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468092416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 479901us (479999us total) trans 158913793476 rc 0/0
00000100:00100000:0.0:1651532096.852540:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3641
00010000:00010000:0.0:1651532096.852548:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.852551:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.852552:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.852555:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.852560:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.852561:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.852562:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.852565:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.852572:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.852586:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bd00 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9306111] (req 4096->9306111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.852592:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.852595:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.853055:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.853063:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.853069:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.853080:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.853090:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468096704
00000100:00100000:1.0:1651532096.853093:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468096832
00000100:00100000:0.0:1651532096.853098:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468096896
00000100:00100000:0.0:1651532096.853101:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468097024
00000100:00100000:1.0:1651532096.853104:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1893
00000100:00100000:1.0:1651532096.853106:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468096704:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532096.853108:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1894
00010000:00010000:1.0:1651532096.853110:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532096.853110:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468096832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.853114:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.853115:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bdc4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474be expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.853118:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bdcb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474c5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.853125:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bdc4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474be expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.853128:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bdcb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474c5 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.853130:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bdc4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474be expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.853132:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40bdcb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474c5 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.853134:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532096.853147:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468096704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (93us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532096.853147:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532096.853150:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1893
00000100:00100000:1.0:1651532096.853155:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1895
00000100:00100000:1.0:1651532096.853157:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468096896:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532096.853157:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468096832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (94us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532096.853160:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532096.853160:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1894
00010000:00010000:1.0:1651532096.853162:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bdd2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474cc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.853166:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1896
00000100:00100000:0.0:1651532096.853168:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468097024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.853169:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bdd2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474cc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.853171:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.853173:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bdd9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474d3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.853179:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bdd9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474d3 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.853183:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40bdd9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474d3 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.853186:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40bdd2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474cc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.853186:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532096.853190:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532096.853191:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468097024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.853194:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1896
00000100:00100000:1.0:1651532096.853198:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468096896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (128us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.853201:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1895
00000100:00100000:0.0:1651532096.853521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.853541:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468097152
00000100:00100000:1.0:1651532096.853553:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1897
00000100:00100000:1.0:1651532096.853555:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468097152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.853559:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.853562:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bde0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474da expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.853570:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bde0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474da expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.853574:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bde0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474da expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.853577:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532096.853588:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468097152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.853590:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1897
00000100:00100000:0.0:1651532096.853614:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.853661:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468097472
00000100:00100000:1.0:1651532096.853672:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1898
00000100:00100000:1.0:1651532096.853673:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000815fffb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468097472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.853677:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.853680:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bde7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474e1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.853687:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bde7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474e1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.853691:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bde7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474e1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.853694:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532096.853705:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000815fffb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468097472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.853708:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1898
00000100:00100000:1.0:1651532096.853941:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.853950:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468097664
00000100:00100000:1.0:1651532096.853960:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1899
00000100:00100000:1.0:1651532096.853962:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468097664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532096.853965:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532096.853969:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bdee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474e8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.853976:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bdee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474e8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.853991:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bdee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474e8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.853995:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532096.854006:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468097664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.854009:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1899
00000001:00080000:1.0:1651532096.960774:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793477 is committed
00010000:00010000:0.0:1651532096.960814:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.960829:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.960850:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468093760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 471683us (471768us total) trans 158913793477 rc 0/0
00010000:00010000:1.0:1651532096.960854:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.960854:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3642
00010000:00010000:1.0:1651532096.960859:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532096.960860:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.960864:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.960870:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.960870:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.960871:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.960874:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.960878:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.960886:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.960887:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.960904:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.960920:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.960924:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bd31 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->10190847] (req 1015808->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.960929:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.960930:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.960933:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.960933:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.961269:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.961277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.961284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.961294:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.961310:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468097984
00000100:00100000:0.0:1651532096.961323:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532096.961327:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468098112
00000100:00100000:1.0:1651532096.961331:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468098240
00000100:00100000:1.0:1651532096.961335:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1900
00000100:00100000:1.0:1651532096.961337:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468097984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.961339:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961341:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.961343:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961345:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bdf5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474ef expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961350:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.961353:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bdf5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474ef expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532096.961362:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468094528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 372220us (372256us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532096.961365:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3644
00010000:00010000:1.0:1651532096.961370:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bdf5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474ef expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.961373:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532096.961379:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468097792
00000100:00100000:1.0:1651532096.961383:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468097984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.961386:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1900
00000100:00100000:0.0:1651532096.961388:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468097856
00000100:00100000:1.0:1651532096.961391:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1901
00000100:00100000:1.0:1651532096.961393:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468098112:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532096.961393:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3651
00010000:00010000:1.0:1651532096.961395:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532096.961395:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468097792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532096.961398:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bdfc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474f6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961403:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.961404:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bdfc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474f6 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.961408:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bdfc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474f6 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.961408:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961411:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532096.961413:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532096.961414:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.961416:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468098112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (122us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532096.961417:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.961419:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1901
00010000:00010000:0.0:1651532096.961419:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532096.961420:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.961422:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1902
00000100:00100000:1.0:1651532096.961424:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468098240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.961424:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961426:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.961427:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961428:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be0a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4474fd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961430:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961432:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532096.961433:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be0a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474fd expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532096.961437:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be0a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4474fd expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.961437:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961440:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532096.961444:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468098240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 19us (121us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532096.961446:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1902
00010000:00010000:0.0:1651532096.961448:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.961449:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961452:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961457:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961458:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961460:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bd54 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->8761343] (req 2498560->8761343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961462:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.961467:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3652
00000100:00100000:0.0:1651532096.961469:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468097856:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532096.961479:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468093824:12345-10.240.43.64@tcp:3:fio.0 Request processed in 472306us (472382us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532096.961481:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.961482:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3643
00010000:00010000:0.0:1651532096.961484:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.961485:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961488:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532096.961488:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961492:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961502:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961509:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961511:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532096.961512:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961515:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961519:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.961520:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532096.961520:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961523:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961532:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961535:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bd38 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9076735] (req 253952->9076735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961554:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532096.961566:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532096.961910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.961921:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468098304
00000100:00100000:1.0:1651532096.961923:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.961946:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3653
00000100:00100000:0.0:1651532096.961947:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468098304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532096.961954:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961958:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532096.961959:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961962:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532096.961963:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961967:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.961970:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532096.962002:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468098560
00000100:00100000:0.0:1651532096.962010:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1903
00000100:00100000:0.0:1651532096.962012:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468098560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.962015:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.962018:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40be1f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447504 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.962026:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40be1f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447504 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.962041:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40be1f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447504 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.962045:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532096.962058:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468098560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.962061:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1903
00000100:00100000:1.0:1651532096.962069:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.962099:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468098752
00000100:00100000:0.0:1651532096.962106:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1904
00000100:00100000:0.0:1651532096.962108:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468098752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.962111:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532096.962112:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532096.962115:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40be26 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44750b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.962128:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40be26 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44750b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.962132:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40be26 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44750b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.962135:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532096.962144:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468098752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.962147:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1904
00000100:00100000:0.0:1651532096.962160:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468098880
00000100:00100000:0.0:1651532096.962168:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1905
00000100:00100000:0.0:1651532096.962169:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468098880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.962172:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.962175:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be2d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447512 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.962182:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447512 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.962186:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447512 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.962189:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532096.962195:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468098880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.962198:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1905
00000100:00100000:1.0:1651532096.962479:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532096.962491:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468099136
00000100:00100000:0.0:1651532096.962499:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1906
00000100:00100000:0.0:1651532096.962501:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468099136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532096.962504:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532096.962507:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40be34 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447519 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532096.962514:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40be34 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447519 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.962530:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40be34 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447519 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532096.962533:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532096.962544:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468099136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532096.962547:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1906
00000001:00080000:1.0:1651532097.085788:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793478 is committed
00010000:00010000:1.0:1651532097.085817:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085822:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.085840:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468094464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 496692us (496726us total) trans 158913793478 rc 0/0
00000100:00100000:1.0:1651532097.085844:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3645
00010000:00010000:1.0:1651532097.085854:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085857:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532097.085859:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085862:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085876:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.085877:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.085878:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085881:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085884:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.085885:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.085886:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085888:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085902:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085905:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40bd5b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->9596927] (req 1015808->9596927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085911:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.085913:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.085914:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.085918:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.086271:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.086293:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.086312:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.086323:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.086331:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468099520
00000100:00100000:1.0:1651532097.086333:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468099456
00000100:00100000:0.0:1651532097.086340:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468099584
00000100:00100000:1.0:1651532097.086346:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468099392
00000100:00100000:0.0:1651532097.086354:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1907
00000100:00100000:0.0:1651532097.086356:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468099520:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532097.086358:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3654
00000100:00100000:1.0:1651532097.086360:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468099456:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532097.086360:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.086364:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40be3b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447520 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.086367:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.086372:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532097.086372:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40be3b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447520 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.086373:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.086376:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532097.086377:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.086381:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.086381:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40be3b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447520 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.086385:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.086385:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532097.086392:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3655
00000100:00100000:1.0:1651532097.086394:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468099392:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532097.086396:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468099520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (95us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532097.086398:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.086399:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1907
00000100:00100000:0.0:1651532097.086404:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1908
00000100:00100000:0.0:1651532097.086405:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468099584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.086408:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.086410:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be50 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447527 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.086414:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532097.086415:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.086417:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532097.086418:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.086423:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.086423:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be50 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447527 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.086426:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.086427:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be50 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447527 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.086430:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532097.086435:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468099584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.086438:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1908
00000001:00080000:1.0:1651532097.210731:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793480 is committed
00010000:00010000:1.0:1651532097.210752:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210756:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.210767:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.210771:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.210777:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468094848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 621102us (621181us total) trans 158913793480 rc 0/0
00000100:00100000:1.0:1651532097.210780:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3646
00000100:00100000:0.0:1651532097.210797:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468095168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 554788us (554851us total) trans 158913793479 rc 0/0
00000100:00100000:0.0:1651532097.210801:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3647
00010000:00010000:0.0:1651532097.210819:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.210823:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532097.210824:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.210827:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.210832:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.210833:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.210833:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.210837:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.210846:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.210849:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bd69 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->9211903] (req 4141056->9211903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210859:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210863:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532097.210869:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210872:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.210872:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210876:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210881:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.210882:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.210883:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210886:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210894:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210896:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bd77 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2334720->2338815] (req 2334720->2338815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210902:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.210905:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.211140:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.211156:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468099904
00000100:00100000:1.0:1651532097.211162:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.211172:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468099968
00000100:00100000:1.0:1651532097.211175:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.211185:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3656
00000100:00100000:0.0:1651532097.211187:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468099904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532097.211198:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.211201:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3657
00010000:00010000:0.0:1651532097.211203:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532097.211204:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211207:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532097.211207:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.211210:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468099968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532097.211219:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211224:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.211225:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532097.211226:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211230:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211230:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211234:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211241:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211244:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211256:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.211259:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468095936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 488175us (488205us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532097.211259:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.211262:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3650
00010000:00010000:1.0:1651532097.211269:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211272:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532097.211273:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.211274:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468095232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 555263us (555318us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532097.211276:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.211278:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3648
00010000:00010000:0.0:1651532097.211284:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211289:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532097.211290:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.211290:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.211291:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211294:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211298:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211313:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211316:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bda1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [241664->8224767] (req 241664->8224767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211316:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211322:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211325:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bd7e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6422528->8921087] (req 6422528->8921087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211331:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.211332:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532097.211344:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.211354:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.211367:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468100032
00000100:00100000:0.0:1651532097.211378:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468100096
00000100:00100000:0.0:1651532097.211381:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468100160
00000100:00100000:0.0:1651532097.211384:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1909
00000100:00100000:0.0:1651532097.211385:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468100032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.211388:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.211392:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40be65 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44752e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211399:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40be65 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44752e expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.211403:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40be65 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44752e expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.211406:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532097.211410:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1910
00000100:00100000:1.0:1651532097.211412:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468100096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532097.211418:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468100032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (242us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.211420:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1909
00010000:00010000:1.0:1651532097.211421:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.211425:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40be6c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447535 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.211425:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1911
00000100:00100000:0.0:1651532097.211427:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468100160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.211429:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.211434:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40be6c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447535 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.211438:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40be6c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447535 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.211439:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40be73 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44753c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211446:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40be73 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44753c expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.211449:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40be73 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44753c expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.211452:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532097.211461:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468100096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.211464:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1910
00010000:00010000:0.0:1651532097.211469:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532097.211477:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468100160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.211491:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1911
00000100:00100000:0.0:1651532097.211848:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.211856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.211866:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468100416
00000100:00100000:0.0:1651532097.211868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.211877:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468100288
00000100:00100000:1.0:1651532097.211886:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3658
00000100:00100000:1.0:1651532097.211888:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468100416:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532097.211892:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468100352
00000100:00100000:0.0:1651532097.211899:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1912
00000100:00100000:0.0:1651532097.211900:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468100288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.211903:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211904:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.211908:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532097.211908:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40be81 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447543 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211909:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211912:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532097.211912:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211919:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211920:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40be81 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447543 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.211923:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.211924:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40be81 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447543 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532097.211930:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1913
00000100:00100000:1.0:1651532097.211932:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468100352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.211935:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532097.211943:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532097.211948:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468100288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.211951:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1912
00010000:00010000:1.0:1651532097.211953:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40be88 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44754a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.211961:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40be88 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44754a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.211965:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40be88 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44754a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.211968:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532097.211977:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468100352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.211979:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1913
00000100:00100000:0.0:1651532097.212219:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.212233:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.212244:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468100800
00000100:00100000:1.0:1651532097.212252:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468100864
00000100:00100000:1.0:1651532097.212261:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1914
00000100:00100000:1.0:1651532097.212263:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468100800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.212266:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.212270:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40be8f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447551 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.212270:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1915
00000100:00100000:0.0:1651532097.212273:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468100864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.212276:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.212277:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40be8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447551 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.212280:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40be96 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447558 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.212281:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40be8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447551 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.212288:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40be96 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447558 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.212292:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532097.212292:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40be96 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447558 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.212295:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532097.212311:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468100800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.212312:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468100864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.212314:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1914
00000100:00100000:0.0:1651532097.212316:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1915
00000100:00100000:0.0:1651532097.212565:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.212585:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468101120
00000100:00100000:1.0:1651532097.212597:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1916
00000100:00100000:1.0:1651532097.212599:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468101120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.212602:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.212605:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40be9d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44755f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.212613:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40be9d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44755f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.212617:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40be9d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44755f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.212620:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532097.212630:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468101120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.212632:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1916
00000001:00080000:1.0:1651532097.310779:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793481 is committed
00010000:00010000:0.0:1651532097.310817:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.310829:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.310851:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468095872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 587775us (587806us total) trans 158913793481 rc 0/0
00010000:00010000:1.0:1651532097.310852:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.310854:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3649
00010000:00010000:1.0:1651532097.310870:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532097.310871:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.310874:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.310880:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.310881:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.310881:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.310884:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.310905:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.310908:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bda8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->5119999] (req 4096->5119999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.310919:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.310923:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.311218:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.311236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.311251:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468101248
00000100:00100000:0.0:1651532097.311255:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468101312
00000100:00100000:1.0:1651532097.311262:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3659
00000100:00100000:1.0:1651532097.311264:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468101248:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532097.311272:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3660
00000100:00100000:0.0:1651532097.311273:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468101312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532097.311277:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.311280:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.311285:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532097.311286:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532097.311286:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.311291:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532097.311292:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.311295:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.311298:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.311300:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532097.311310:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.311315:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.311315:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.311318:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.311321:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.311324:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532097.427442:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793482 is committed
00010000:00010000:0.0:1651532097.427473:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.427485:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.427508:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468097792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466112us (466240us total) trans 158913793482 rc 0/0
00000100:00100000:0.0:1651532097.427512:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3651
00010000:00010000:0.0:1651532097.427519:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.427523:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532097.427524:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.427527:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.427532:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.427532:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.427533:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.427536:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.427543:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.427556:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.427556:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40be03 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1064960->10326015] (req 1064960->10326015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.427569:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.427927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.427935:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.427944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.427947:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468101568
00000100:00100000:0.0:1651532097.427959:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468101632
00000100:00100000:0.0:1651532097.427962:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468101760
00000100:00100000:0.0:1651532097.427965:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1917
00000100:00100000:0.0:1651532097.427967:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468101568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.427970:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.427974:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40beb2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447566 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.427979:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.427981:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.427982:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40beb2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447566 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.427986:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.427990:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40beb2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447566 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.427993:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532097.428005:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468097856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466535us (466728us total) trans 0 rc 45056/45056
00000100:00100000:1.0:1651532097.428009:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3652
00000100:00100000:0.0:1651532097.428010:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468101568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.428013:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1917
00010000:00010000:1.0:1651532097.428017:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.428018:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1918
00010000:00010000:1.0:1651532097.428020:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532097.428020:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468101632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.428021:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428024:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.428024:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.428026:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40beb9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44756d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428030:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.428030:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.428039:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428042:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.428048:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40beb9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44756d expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.428052:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428055:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40be11 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [389120->4718591] (req 389120->4718591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.428057:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40beb9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44756d expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.428061:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532097.428063:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1919
00000100:00100000:1.0:1651532097.428066:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468101760:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532097.428067:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468101632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (131us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532097.428069:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532097.428069:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1918
00010000:00010000:1.0:1651532097.428072:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bec0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447574 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.428076:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.428079:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428080:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bec0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447574 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.428084:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bec0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447574 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.428087:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532097.428095:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468101760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (151us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.428098:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1919
00000100:00100000:0.0:1651532097.428587:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.428594:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.428595:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468101952
00000100:00100000:0.0:1651532097.428602:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.428612:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468102016
00000100:00100000:0.0:1651532097.428612:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.428620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.428627:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3661
00000100:00100000:1.0:1651532097.428629:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468101952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532097.428636:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.428636:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532097.428640:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532097.428641:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428644:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00000100:00100000:0.0:1651532097.428644:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3662
00010000:00010000:1.0:1651532097.428645:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428649:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428652:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.428652:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468102016:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532097.428661:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468102080
00010000:00010000:0.0:1651532097.428661:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bece lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.428666:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468102208
00010000:00010000:0.0:1651532097.428666:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.428667:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532097.428668:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1920
00010000:00010000:0.0:1651532097.428668:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bece lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9629696->9633791] (req 9629696->9633791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.428670:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468102080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.428672:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.428672:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bece lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9629696->9633791] (req 9629696->9633791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428675:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bed5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44757b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.428684:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bece lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [9629696->9633791] (req 9629696->9633791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.428687:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bece lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [9629696->9633791] (req 9629696->9633791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428694:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bed5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44757b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.428704:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bed5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44757b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532097.428707:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468102016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (113us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532097.428710:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3662
00010000:00010000:1.0:1651532097.428712:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532097.428719:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468102336
00000100:00100000:1.0:1651532097.428726:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468102080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (124us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.428729:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1920
00000100:00100000:0.0:1651532097.428730:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468102400
00000100:00100000:0.0:1651532097.428734:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1921
00000100:00100000:1.0:1651532097.428736:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1922
00000100:00100000:0.0:1651532097.428736:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468102208:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532097.428738:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468102336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.428739:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.428741:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.428742:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bedc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447582 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428743:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bee3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447589 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428750:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bee3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447589 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.428753:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bee3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447589 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.428757:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532097.428760:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bedc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447582 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532097.428762:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468102336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (142us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532097.428765:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40bedc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447582 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.428768:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532097.428772:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1922
00000100:00100000:0.0:1651532097.428776:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468102208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (164us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.428777:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1923
00000100:00100000:1.0:1651532097.428778:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468102400:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532097.428779:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1921
00010000:00010000:1.0:1651532097.428781:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.428783:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40beea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447590 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428789:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40beea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447590 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.428793:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40beea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447590 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.428796:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532097.428824:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468102400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (167us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.428827:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1923
00010000:00010000:1.0:1651532097.428834:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bece lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9629696->9633791] (req 9629696->9633791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428838:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532097.428839:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bece lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9629696->9633791] (req 9629696->9633791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428861:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bece lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9629696->9633791] (req 9629696->9633791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428881:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bece lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9629696->9633791] (req 9629696->9633791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.428884:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40bece lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9629696->9633791] (req 9629696->9633791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.429155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.429166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.429167:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468102592
00000100:00100000:0.0:1651532097.429174:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.429188:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468102656
00000100:00100000:0.0:1651532097.429188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.429191:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468102848
00000100:00100000:1.0:1651532097.429193:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468102912
00000100:00100000:0.0:1651532097.429195:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1924
00000100:00100000:0.0:1651532097.429197:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468102592:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532097.429198:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1925
00000100:00100000:1.0:1651532097.429200:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468102656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.429201:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.429203:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.429204:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40bef1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447597 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.429206:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bef8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44759e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.429213:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40bef1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447597 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.429214:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bef8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44759e expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.429217:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40bef1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447597 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.429218:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bef8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44759e expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.429221:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532097.429234:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468102656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.429237:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1925
00010000:00010000:0.0:1651532097.429237:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532097.429246:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468102592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.429249:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1926
00000100:00100000:1.0:1651532097.429250:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468102848:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532097.429251:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1924
00010000:00010000:1.0:1651532097.429253:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.429256:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40beff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475a5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.429257:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1927
00000100:00100000:0.0:1651532097.429258:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468102912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.429261:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.429262:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40beff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475a5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.429266:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40beff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475a5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.429269:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532097.429270:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bf06 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475ac expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.429275:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468102848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.429277:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1926
00010000:00010000:0.0:1651532097.429277:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bf06 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475ac expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.429281:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bf06 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475ac expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.429284:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532097.429291:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468102912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.429293:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1927
00000100:00100000:0.0:1651532097.429674:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.429682:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.429695:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.429704:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468103232
00000100:00100000:1.0:1651532097.429706:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468103296
00000100:00100000:1.0:1651532097.429713:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468103488
00000100:00100000:1.0:1651532097.429717:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1928
00000100:00100000:1.0:1651532097.429718:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468103296:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532097.429719:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1929
00000100:00100000:0.0:1651532097.429720:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468103488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.429721:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.429724:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf0d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475ba expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.429724:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.429728:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bf14 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475c1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.429731:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf0d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475ba expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.429735:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bf14 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475c1 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.429739:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bf14 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475c1 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.429742:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532097.429747:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf0d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475ba expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.429750:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532097.429752:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468103488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.429754:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1929
00000100:00100000:1.0:1651532097.429758:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468103296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.429759:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1930
00000100:00100000:1.0:1651532097.429761:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1928
00000100:00100000:0.0:1651532097.429761:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468103232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.429763:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.429765:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf1b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475b3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.429771:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf1b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475b3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.429774:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf1b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475b3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.429778:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532097.429783:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468103232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.429785:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1930
00000100:00100000:0.0:1651532097.430087:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.430094:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468103680
00000100:00100000:0.0:1651532097.430107:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1931
00000100:00100000:0.0:1651532097.430109:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468103680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.430113:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.430116:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf22 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475c8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.430123:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf22 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475c8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.430127:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf22 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475c8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.430130:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532097.430140:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468103680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.430142:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1931
00000001:00080000:1.0:1651532097.552444:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793483 is committed
00010000:00010000:0.0:1651532097.552475:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.552489:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.552506:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468098304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 590558us (590603us total) trans 158913793483 rc 0/0
00000100:00100000:0.0:1651532097.552509:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3653
00010000:00010000:0.0:1651532097.552516:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.552519:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532097.552520:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.552523:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.552528:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.552529:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.552530:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.552533:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.552545:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.552548:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40be18 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->5316607] (req 1613824->5316607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552556:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552561:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552758:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552763:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.552782:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468099456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466421us (466511us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532097.552785:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3654
00010000:00010000:1.0:1651532097.552792:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552828:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532097.552830:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552833:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552838:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.552839:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.552840:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552843:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552850:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552853:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40be42 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [491520->10166271] (req 491520->10166271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552859:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.552862:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.552951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.552961:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468104000
00000100:00100000:1.0:1651532097.552982:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3663
00000100:00100000:1.0:1651532097.552984:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468104000:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532097.552992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.553000:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532097.553003:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.553006:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532097.553007:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532097.553008:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.553017:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00000100:00100000:0.0:1651532097.553017:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532097.553018:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.553027:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.553031:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.553038:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468104064
00000100:00100000:1.0:1651532097.553044:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468104128
00000100:00100000:1.0:1651532097.553046:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468104192
00000100:00100000:1.0:1651532097.553057:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1932
00000100:00100000:1.0:1651532097.553058:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468104064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.553066:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532097.553068:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468103936
00010000:00010000:1.0:1651532097.553069:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bf30 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475cf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.553076:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bf30 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475cf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.553080:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bf30 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475cf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532097.553080:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3664
00000100:00100000:0.0:1651532097.553081:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468103936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532097.553084:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532097.553088:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.553093:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532097.553097:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468104064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.553100:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1932
00010000:00010000:0.0:1651532097.553100:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.553104:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:1.0:1651532097.553105:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1933
00010000:00010000:0.0:1651532097.553105:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.553107:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468104128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.553109:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.553109:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.553112:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bf3e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475d6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.553113:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.553118:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bf3e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475d6 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532097.553121:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1934
00010000:00010000:1.0:1651532097.553122:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bf3e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475d6 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532097.553122:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468104192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.553125:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532097.553130:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468104128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (123us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.553132:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1933
00010000:00010000:0.0:1651532097.553134:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.553137:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf45 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475dd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.553144:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf45 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475dd expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.553148:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf45 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475dd expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.553152:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532097.553160:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468104192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.553163:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1934
00000100:00100000:0.0:1651532097.553508:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.553526:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468104448
00000100:00100000:1.0:1651532097.553545:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1935
00000100:00100000:1.0:1651532097.553546:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468104448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.553550:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.553553:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bf4c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475e4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.553561:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bf4c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475e4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.553565:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bf4c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475e4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.553568:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532097.553585:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468104448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.553587:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1935
00000100:00100000:0.0:1651532097.553858:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.553868:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468104576
00000100:00100000:1.0:1651532097.553877:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1936
00000100:00100000:1.0:1651532097.553878:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468104576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.553882:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.553885:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf53 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475eb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.553892:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf53 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475eb expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.553895:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf53 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475eb expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.553908:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532097.553922:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468104576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.553925:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1936
00000001:00080000:1.0:1651532097.619176:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793484 is committed
00010000:00010000:1.0:1651532097.619191:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619195:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.619218:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468099392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532823us (532925us total) trans 158913793484 rc 0/0
00000100:00100000:1.0:1651532097.619221:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3655
00010000:00010000:1.0:1651532097.619228:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619232:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532097.619233:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619236:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619240:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.619241:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.619249:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619261:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619265:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.619266:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.619266:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619269:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619282:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619285:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40be49 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->8888319] (req 290816->8888319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619291:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619294:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.619295:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.619300:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.619618:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.619629:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468104832
00000100:00100000:0.0:1651532097.619629:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.619635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.619649:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468104768
00000100:00100000:0.0:1651532097.619652:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3665
00000100:00100000:0.0:1651532097.619654:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468104832:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532097.619656:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3666
00000100:00100000:1.0:1651532097.619658:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468104768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532097.619670:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619674:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.619674:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532097.619675:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.619678:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532097.619679:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619683:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532097.619684:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619687:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532097.619688:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619692:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619695:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.619698:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.619702:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619708:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619711:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.619715:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.619733:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468099968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408523us (408571us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532097.619736:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3657
00000100:00100000:1.0:1651532097.619744:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468104896
00000100:00100000:1.0:1651532097.619753:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468105024
00000100:00100000:0.0:1651532097.619764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.619766:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468105088
00000100:00100000:0.0:1651532097.619771:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532097.619775:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.619777:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468105152
00010000:00010000:0.0:1651532097.619779:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532097.619780:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1937
00010000:00010000:0.0:1651532097.619780:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.619781:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468104896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.619783:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619785:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.619788:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bf68 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475f2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619795:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bf68 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475f2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.619800:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bf68 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475f2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.619800:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.619815:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40be5e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5525504->9912319] (req 5525504->9912319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.619818:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532097.619823:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1938
00000100:00100000:0.0:1651532097.619825:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468105024:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532097.619830:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468104896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (194us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.619832:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1937
00010000:00010000:0.0:1651532097.619833:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532097.619837:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1939
00010000:00010000:0.0:1651532097.619837:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bf6f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4475f9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.619839:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468105088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.619842:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.619844:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bf76 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447600 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.619844:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bf6f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475f9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.619848:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bf6f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4475f9 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.619851:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bf76 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447600 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.619852:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532097.619855:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bf76 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447600 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532097.619860:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468105024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.619863:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1938
00010000:00010000:1.0:1651532097.619865:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532097.619869:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1940
00000100:00100000:0.0:1651532097.619870:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468105152:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532097.619872:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468105088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (109us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532097.619872:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532097.619875:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1939
00010000:00010000:0.0:1651532097.619884:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bf7d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447607 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.619890:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bf7d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447607 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.619894:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bf7d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447607 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.619897:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532097.619904:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468105152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (133us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.619906:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1940
00000100:00100000:0.0:1651532097.620261:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.620268:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.620282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.620291:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468105280
00000100:00100000:1.0:1651532097.620293:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468105344
00000100:00100000:0.0:1651532097.620308:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468105536
00000100:00100000:0.0:1651532097.620312:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1941
00000100:00100000:0.0:1651532097.620314:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468105280:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532097.620315:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1942
00000100:00100000:1.0:1651532097.620317:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468105344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.620317:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.620320:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.620321:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bf84 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44760e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.620323:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bf8b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447615 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.620329:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bf84 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44760e expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.620331:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bf8b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447615 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.620333:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bf84 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44760e expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.620335:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bf8b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447615 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.620338:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532097.620345:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532097.620352:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468105344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.620354:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1942
00000100:00100000:1.0:1651532097.620359:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1943
00000100:00100000:1.0:1651532097.620361:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468105536:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532097.620361:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468105280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (101us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532097.620363:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532097.620364:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1941
00010000:00010000:1.0:1651532097.620373:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bf92 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44761c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.620380:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bf92 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44761c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.620383:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bf92 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44761c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.620386:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532097.620404:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468105536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.620407:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1943
00000100:00100000:0.0:1651532097.620670:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.620689:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468105856
00000100:00100000:1.0:1651532097.620696:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1944
00000100:00100000:1.0:1651532097.620697:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468105856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.620700:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.620703:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bf99 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447623 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.620710:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bf99 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447623 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.620714:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bf99 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447623 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.620717:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532097.620737:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468105856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.620740:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1944
00000001:00080000:1.0:1651532097.710896:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793485 is committed
00010000:00010000:0.0:1651532097.710927:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.710932:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.710953:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468099904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499765us (499813us total) trans 158913793485 rc 0/0
00010000:00010000:1.0:1651532097.710954:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.710956:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3656
00010000:00010000:1.0:1651532097.710959:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532097.710960:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.710963:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.710969:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.710970:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.710970:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.710974:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.710977:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.710977:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.710978:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.710981:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711010:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711013:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40be57 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->3653631] (req 1007616->3653631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711019:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711022:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711022:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711026:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.711354:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.711387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.711398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.711415:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468106048
00010000:00010000:0.0:1651532097.711422:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.711425:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468106112
00000100:00100000:1.0:1651532097.711431:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3667
00000100:00100000:1.0:1651532097.711433:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468106048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532097.711437:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711440:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711450:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532097.711451:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711454:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532097.711455:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.711455:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468101312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 400181us (400218us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532097.711458:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3660
00010000:00010000:1.0:1651532097.711460:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.711464:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3668
00000100:00100000:0.0:1651532097.711466:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468106112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532097.711471:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711473:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711477:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.711478:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.711481:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468106240
00010000:00010000:0.0:1651532097.711481:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532097.711481:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711486:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.711487:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1945
00000100:00100000:1.0:1651532097.711489:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000577063a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468106240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.711489:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711492:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.711494:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bfae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44762a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711500:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.711502:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bfae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44762a expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.711506:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40bfae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44762a expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.711510:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532097.711524:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.711532:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000577063a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468106240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.711535:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1945
00010000:00010000:0.0:1651532097.711539:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532097.711540:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711543:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711549:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711551:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40beab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3969024->9687039] (req 3969024->9687039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711571:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711582:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711602:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711606:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532097.711607:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.711609:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468100416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499721us (499753us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532097.711613:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3658
00010000:00010000:0.0:1651532097.711614:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711619:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.711619:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.711620:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711633:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711644:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.711647:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40be7a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->4886527] (req 606208->4886527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711654:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711658:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.711838:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.711849:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468106368
00000100:00100000:0.0:1651532097.711861:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.711866:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1946
00000100:00100000:1.0:1651532097.711867:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468106368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.711875:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532097.711876:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468106432
00010000:00010000:1.0:1651532097.711878:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bfb5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447631 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.711884:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1947
00010000:00010000:1.0:1651532097.711886:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bfb5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447631 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532097.711886:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468106432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.711889:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.711890:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40bfb5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447631 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.711893:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfbc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447638 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.711894:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532097.711900:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfbc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447638 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532097.711906:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468106368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (103us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532097.711911:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfbc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447638 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.711915:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532097.711918:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1946
00000100:00100000:0.0:1651532097.711945:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468106432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.711966:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1947
00000100:00100000:0.0:1651532097.711982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.711999:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468106496
00000100:00100000:0.0:1651532097.712000:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.712009:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468106624
00000100:00100000:1.0:1651532097.712014:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3669
00000100:00100000:1.0:1651532097.712016:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468106496:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532097.712024:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.712035:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3670
00000100:00100000:0.0:1651532097.712037:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468106624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532097.712045:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712046:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.712049:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.712050:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712055:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532097.712056:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712059:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712062:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532097.712062:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.712066:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712067:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712070:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712073:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.712091:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468106688
00000100:00100000:1.0:1651532097.712101:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1948
00000100:00100000:1.0:1651532097.712102:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468106688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.712105:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.712108:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bfd1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44763f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712114:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bfd1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44763f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.712118:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40bfd1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44763f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.712122:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532097.712134:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468106688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.712137:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1948
00000100:00100000:0.0:1651532097.712243:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.712261:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468106816
00000100:00100000:1.0:1651532097.712271:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1949
00000100:00100000:1.0:1651532097.712273:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468106816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.712276:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.712279:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bfd8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447646 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712286:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bfd8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447646 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.712297:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40bfd8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447646 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.712308:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532097.712321:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468106816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.712324:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1949
00000100:00100000:0.0:1651532097.712387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.712396:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468107008
00000100:00100000:1.0:1651532097.712405:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1950
00000100:00100000:1.0:1651532097.712407:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468107008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.712410:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.712413:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bfdf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44764d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712420:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bfdf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44764d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.712423:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40bfdf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44764d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.712427:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532097.712440:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468107008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.712443:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1950
00000100:00100000:0.0:1651532097.712590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.712607:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468107136
00000100:00100000:1.0:1651532097.712617:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1951
00000100:00100000:1.0:1651532097.712618:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468107136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.712622:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.712625:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bfe6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447654 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.712631:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bfe6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447654 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.712635:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40bfe6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447654 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.712638:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532097.712649:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468107136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.712652:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1951
00000001:00080000:1.0:1651532097.810923:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793486 is committed
00010000:00010000:1.0:1651532097.810937:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.810941:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.810963:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468101248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499697us (499745us total) trans 158913793486 rc 0/0
00000100:00100000:1.0:1651532097.810966:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3659
00010000:00010000:1.0:1651532097.810980:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.810984:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532097.810985:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.810988:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.810993:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.810994:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.810995:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.811006:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.811014:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.811017:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bea4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4235264->7225343] (req 4235264->7225343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.811022:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.811025:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532097.927564:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793487 is committed
00002000:00010000:1.0:1651532097.927584:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532096 -> 1651532097
00002000:00010000:1.0:1651532097.927586:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532096 -> 1651532097
00010000:00010000:1.0:1651532097.927588:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.927592:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.927613:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468101952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 498983us (499026us total) trans 158913793487 rc 0/0
00000100:00100000:1.0:1651532097.927616:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3661
00010000:00010000:0.0:1651532097.927616:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.927622:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532097.927623:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.927626:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.927640:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.927641:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.927642:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.927645:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.927651:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.927654:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40bec7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4243456->9478143] (req 4243456->9478143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.927668:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.927672:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.928032:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.928041:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.928048:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.928058:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468107520
00000100:00100000:1.0:1651532097.928072:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468107584
00000100:00100000:0.0:1651532097.928083:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3671
00000100:00100000:1.0:1651532097.928085:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3672
00000100:00100000:0.0:1651532097.928085:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468107520:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532097.928087:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468107584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532097.928094:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.928094:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.928098:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532097.928099:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.928102:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532097.928102:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928106:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.928107:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928110:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532097.928111:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928115:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.928115:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928119:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.928126:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928130:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928134:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.928139:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468107648
00000100:00100000:1.0:1651532097.928153:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468104000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375169us (375203us total) trans 0 rc 57344/57344
00000100:00100000:1.0:1651532097.928156:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3663
00000100:00100000:0.0:1651532097.928157:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1952
00000100:00100000:0.0:1651532097.928159:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468107648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.928162:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.928165:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bffb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44765b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928169:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.928170:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.928172:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532097.928173:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bffb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44765b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.928178:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40bffb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44765b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.928181:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.928181:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532097.928184:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928189:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.928189:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.928190:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.928190:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468107648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (143us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532097.928193:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.928193:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1952
00010000:00010000:1.0:1651532097.928202:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928205:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40bf29 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1241088->9551871] (req 1241088->9551871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928215:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928218:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.928534:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.928544:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.928556:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468107904
00000100:00100000:0.0:1651532097.928556:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468107840
00000100:00100000:1.0:1651532097.928566:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1953
00000100:00100000:1.0:1651532097.928579:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468107904:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532097.928580:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1954
00000100:00100000:0.0:1651532097.928582:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468107840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.928583:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.928585:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.928602:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c009 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447662 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928608:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c002 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447669 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.928610:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c009 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447662 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.928614:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c009 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447662 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.928617:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c002 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447669 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.928618:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532097.928622:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c002 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447669 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.928625:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532097.928629:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468107840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.928631:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1954
00000100:00100000:1.0:1651532097.928634:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468107904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.928637:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1953
00000100:00100000:0.0:1651532097.928680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.928720:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468107968
00000100:00100000:0.0:1651532097.928720:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.928732:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468108096
00000100:00100000:0.0:1651532097.928734:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1955
00000100:00100000:0.0:1651532097.928736:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468107968:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532097.928741:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1956
00000100:00100000:1.0:1651532097.928743:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468108096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.928744:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.928746:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.928748:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c010 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447670 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.928750:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c017 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447677 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.928755:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c010 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447670 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.928757:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c017 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447677 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.928759:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c010 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447670 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.928761:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c017 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447677 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.928772:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532097.928774:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532097.928783:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468108096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.928783:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468107968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.928786:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1956
00000100:00100000:0.0:1651532097.928787:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1955
00000100:00100000:0.0:1651532097.929019:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.929028:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.929034:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468108288
00000100:00100000:0.0:1651532097.929046:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468108352
00000100:00100000:0.0:1651532097.929051:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1957
00000100:00100000:0.0:1651532097.929052:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468108288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.929056:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532097.929057:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1958
00000100:00100000:1.0:1651532097.929059:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468108352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.929059:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c01e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44767e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.929063:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.929066:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c025 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447685 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.929066:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c01e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44767e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.929070:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c01e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44767e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.929073:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c025 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447685 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.929074:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532097.929077:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c025 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447685 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.929081:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532097.929086:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468108288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.929089:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1957
00000100:00100000:1.0:1651532097.929095:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468108352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.929098:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1958
00000100:00100000:0.0:1651532097.929153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.929179:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468108608
00000100:00100000:1.0:1651532097.929187:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1959
00000100:00100000:1.0:1651532097.929188:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468108608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.929192:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.929203:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c02c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44768c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.929210:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c02c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44768c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.929214:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c02c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44768c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.929217:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532097.929227:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468108608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.929229:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1959
00000100:00100000:0.0:1651532097.929318:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.929336:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468108736
00000100:00100000:1.0:1651532097.929343:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1960
00000100:00100000:1.0:1651532097.929345:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468108736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.929348:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.929351:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c033 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447693 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.929358:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c033 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447693 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.929362:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c033 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447693 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.929365:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532097.929383:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468108736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.929386:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1960
00000100:00100000:0.0:1651532097.929625:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.929642:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468109056
00000100:00100000:1.0:1651532097.929650:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1961
00000100:00100000:1.0:1651532097.929651:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468109056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.929654:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.929658:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c03a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44769a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.929664:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c03a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44769a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.929668:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c03a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44769a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.929672:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532097.929681:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468109056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.929683:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1961
00000001:00080000:1.0:1651532097.994354:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793488 is committed
00010000:00010000:1.0:1651532097.994369:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994372:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.994405:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468103936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 441323us (441412us total) trans 158913793488 rc 0/0
00000100:00100000:1.0:1651532097.994408:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3664
00010000:00010000:1.0:1651532097.994416:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994419:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532097.994420:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994423:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994428:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.994429:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.994430:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994433:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994453:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.994454:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994456:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40bf37 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->10088447] (req 647168->10088447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.994459:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.994769:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.994788:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468109248
00000100:00100000:1.0:1651532097.994799:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3673
00000100:00100000:1.0:1651532097.994801:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468109248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532097.994835:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994840:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532097.994841:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994843:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532097.994844:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994848:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994852:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.994865:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.994885:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532097.994887:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.994891:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468109312
00010000:00010000:0.0:1651532097.994891:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.994900:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3674
00000100:00100000:1.0:1651532097.994901:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468109312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532097.994907:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532097.994908:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468104832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375253us (375290us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532097.994911:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3665
00010000:00010000:0.0:1651532097.994918:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994919:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532097.994920:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994923:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532097.994923:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994929:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.994929:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532097.994930:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994932:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.994933:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.994939:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532097.994940:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468109632
00000100:00100000:1.0:1651532097.994947:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1962
00010000:00010000:0.0:1651532097.994947:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532097.994948:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.994949:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468109632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.994951:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.994951:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994954:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c04f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476a1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.994961:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.994964:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40bf5a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1040384->9949183] (req 1040384->9949183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.994967:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c04f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476a1 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.994972:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c04f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476a1 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.994984:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532097.994998:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.995002:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532097.995003:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468109632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.995006:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1962
00000100:00100000:1.0:1651532097.995256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532097.995274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.995285:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468109696
00000100:00100000:1.0:1651532097.995289:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468109760
00000100:00100000:0.0:1651532097.995295:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1963
00000100:00100000:0.0:1651532097.995297:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468109696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532097.995318:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1964
00000100:00100000:1.0:1651532097.995320:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468109760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532097.995324:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.995327:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c056 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476af expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.995331:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532097.995334:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c056 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476af expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.995335:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c05d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476a8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532097.995338:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c056 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476af expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532097.995342:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532097.995344:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c05d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476a8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532097.995353:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468109760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532097.995356:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1964
00010000:00010000:0.0:1651532097.995358:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c05d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476a8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.995362:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532097.995371:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468109696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 73us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.995391:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1963
00000100:00100000:1.0:1651532097.995402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.995432:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468109888
00000100:00100000:0.0:1651532097.995442:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1965
00000100:00100000:0.0:1651532097.995444:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468109888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.995447:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.995450:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c064 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476b6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.995458:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c064 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476b6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.995462:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c064 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476b6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.995465:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532097.995479:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468109888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.995481:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1965
00000100:00100000:0.0:1651532097.995759:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.995766:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468110144
00000100:00100000:0.0:1651532097.995779:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1966
00000100:00100000:0.0:1651532097.995781:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468110144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.995785:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.995788:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c06b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476bd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.995795:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c06b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476bd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.995799:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c06b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476bd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.995818:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532097.995830:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468110144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.995833:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1966
00000100:00100000:0.0:1651532097.996042:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.996049:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468110336
00000100:00100000:0.0:1651532097.996062:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1967
00000100:00100000:0.0:1651532097.996064:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468110336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.996067:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.996071:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c072 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476c4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.996078:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c072 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476c4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.996090:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c072 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476c4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.996093:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532097.996107:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468110336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.996110:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1967
00000100:00100000:0.0:1651532097.996317:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.996325:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468110464
00000100:00100000:0.0:1651532097.996336:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1968
00000100:00100000:0.0:1651532097.996338:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468110464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.996341:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.996344:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c079 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476cb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.996351:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c079 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476cb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.996355:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c079 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476cb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.996358:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532097.996371:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468110464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.996383:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1968
00000100:00100000:0.0:1651532097.996567:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532097.996574:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468110592
00000100:00100000:0.0:1651532097.996586:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1969
00000100:00100000:0.0:1651532097.996587:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468110592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532097.996591:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532097.996594:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c080 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476d2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532097.996601:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c080 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476d2 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.996605:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c080 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476d2 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532097.996608:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532097.996619:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468110592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532097.996621:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1969
00000001:00080000:1.0:1651532098.110958:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793489 is committed
00010000:00010000:0.0:1651532098.110997:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.111002:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.111024:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468104768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491365us (491395us total) trans 158913793489 rc 0/0
00010000:00010000:1.0:1651532098.111026:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111030:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532098.111031:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111035:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.111036:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3666
00010000:00010000:1.0:1651532098.111040:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.111041:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.111042:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111045:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111053:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111056:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40bf61 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9363455] (req 1830912->9363455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111061:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111064:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.111429:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.111440:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.111461:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468110784
00000100:00100000:1.0:1651532098.111465:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.111477:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.111477:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468110720
00000100:00100000:0.0:1651532098.111484:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3675
00000100:00100000:1.0:1651532098.111486:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3676
00000100:00100000:0.0:1651532098.111486:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468110784:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532098.111489:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468110720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532098.111493:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111497:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.111497:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532098.111498:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532098.111499:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111503:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532098.111504:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111508:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111510:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532098.111511:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.111514:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111515:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111518:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111521:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.111523:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468110912
00000100:00100000:0.0:1651532098.111532:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468110976
00000100:00100000:0.0:1651532098.111538:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1970
00000100:00100000:0.0:1651532098.111540:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468110912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532098.111542:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.111545:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c095 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476d9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.111547:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1971
00000100:00100000:1.0:1651532098.111549:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468110976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.111552:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.111552:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c095 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476d9 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.111555:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c09c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476e0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.111562:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c09c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476e0 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.111567:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c09c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476e0 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.111567:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c095 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476d9 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.111570:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532098.111571:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532098.111584:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468110976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.111587:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1971
00000100:00100000:0.0:1651532098.111589:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468110912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (131us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.111592:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1970
00000001:00080000:1.0:1651532098.250624:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793490 is committed
00010000:00010000:1.0:1651532098.250639:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250644:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.250661:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468106048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 539227us (539307us total) trans 158913793490 rc 0/0
00000100:00100000:1.0:1651532098.250674:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3667
00010000:00010000:1.0:1651532098.250681:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250685:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532098.250686:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250689:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250694:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.250695:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.250695:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250699:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250702:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.250702:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.250703:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250705:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250718:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250730:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40bfa0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->10129407] (req 1646592->10129407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.250733:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.250738:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250762:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250773:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250787:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250791:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.250818:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.250822:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532098.250823:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.250826:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.250831:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468106624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 538793us (538830us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651532098.250832:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.250834:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3670
00010000:00010000:0.0:1651532098.250859:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40bfc3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->2469887] (req 2465792->2469887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.250923:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.250927:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250952:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.250952:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468106112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 539485us (539565us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532098.250955:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3668
00010000:00010000:1.0:1651532098.250957:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532098.250958:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250962:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250977:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.250978:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.250979:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250982:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250989:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250992:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40bfa7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->10387455] (req 696320->10387455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.250997:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.251000:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.251244:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.251257:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.251262:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468111296
00000100:00100000:1.0:1651532098.251265:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.251274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.251281:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468111360
00000100:00100000:1.0:1651532098.251287:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468111424
00000100:00100000:0.0:1651532098.251288:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3677
00000100:00100000:0.0:1651532098.251290:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468111296:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532098.251295:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468111552
00010000:00010000:0.0:1651532098.251297:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.251299:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1972
00000100:00100000:1.0:1651532098.251301:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468111424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.251321:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.251324:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532098.251325:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c0aa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476e7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.251325:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.251329:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532098.251329:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.251346:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.251347:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c0aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476e7 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.251350:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.251351:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c0aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476e7 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.251355:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532098.251359:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3678
00000100:00100000:0.0:1651532098.251361:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468111360:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532098.251366:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468111424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (100us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532098.251366:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.251369:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1972
00010000:00010000:0.0:1651532098.251370:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532098.251371:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.251374:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1973
00010000:00010000:0.0:1651532098.251374:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532098.251374:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.251375:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468111552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.251378:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.251378:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.251380:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c0b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476ee expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.251381:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.251386:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c0b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476ee expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.251389:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c0b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476ee expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532098.251397:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532098.251403:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532098.251414:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468111552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (140us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.251417:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1973
00000100:00100000:0.0:1651532098.251425:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.251430:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468111616
00000100:00100000:1.0:1651532098.251434:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468111680
00000100:00100000:1.0:1651532098.251437:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1974
00000100:00100000:1.0:1651532098.251439:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468111616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.251441:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.251444:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c0bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476f5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.251453:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1975
00000100:00100000:0.0:1651532098.251455:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468111680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.251457:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c0bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476f5 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.251459:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.251461:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c0bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476f5 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.251463:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c0c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4476fc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.251464:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532098.251470:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c0c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476fc expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532098.251477:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468111616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.251479:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1974
00010000:00010000:0.0:1651532098.251482:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c0c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4476fc expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.251486:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532098.251494:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468111680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.251497:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1975
00000100:00100000:0.0:1651532098.251882:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.251889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.251900:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468111808
00000100:00100000:0.0:1651532098.251901:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468111936
00000100:00100000:0.0:1651532098.251911:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1976
00000100:00100000:0.0:1651532098.251913:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468111936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532098.251916:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532098.251917:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1977
00000100:00100000:1.0:1651532098.251919:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468111808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532098.251920:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c0cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44770a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.251927:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c0cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44770a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.251930:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.251934:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c0d4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447703 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.251942:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c0d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447703 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.251943:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c0cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44770a expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.251946:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c0d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447703 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.251946:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532098.251949:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532098.251959:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468111936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.251962:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1976
00000100:00100000:1.0:1651532098.251965:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468111808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.251967:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1977
00000100:00100000:1.0:1651532098.252022:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.252030:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468112064
00000100:00100000:1.0:1651532098.252036:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1978
00000100:00100000:1.0:1651532098.252038:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468112064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.252041:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.252044:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c0db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447711 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.252052:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c0db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447711 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.252056:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c0db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447711 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.252069:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532098.252083:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468112064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.252086:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1978
00000100:00100000:1.0:1651532098.252332:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.252340:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.252345:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468112256
00000100:00100000:1.0:1651532098.252351:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468112384
00000100:00100000:1.0:1651532098.252359:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1979
00000100:00100000:1.0:1651532098.252361:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468112256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.252364:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532098.252364:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1980
00000100:00100000:0.0:1651532098.252366:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468112384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.252367:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447718 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.252370:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.252374:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44771f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.252375:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447718 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.252379:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447718 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.252381:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44771f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.252382:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532098.252385:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44771f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.252388:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532098.252393:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468112256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.252396:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1979
00000100:00100000:0.0:1651532098.252403:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468112384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.252406:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1980
00000001:00080000:1.0:1651532098.344329:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793491 is committed
00010000:00010000:1.0:1651532098.344351:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.344355:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.344372:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468106496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 632355us (632389us total) trans 158913793491 rc 0/0
00000100:00100000:1.0:1651532098.344375:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3669
00010000:00010000:1.0:1651532098.344381:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.344384:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532098.344386:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.344389:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.344393:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.344394:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.344395:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.344398:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.344411:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.344423:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40bfca lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->8187903] (req 1826816->8187903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.344423:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.344435:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.344832:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.344841:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468112768
00000100:00100000:0.0:1651532098.344843:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.344850:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468112832
00000100:00100000:1.0:1651532098.344853:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3679
00000100:00100000:1.0:1651532098.344855:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468112768:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532098.344861:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3680
00010000:00010000:1.0:1651532098.344862:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.344863:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468112832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532098.344866:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532098.344867:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532098.344868:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.344870:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.344871:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.344875:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532098.344876:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.344879:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532098.344879:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.344884:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.344887:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532098.452673:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793492 is committed
00010000:00010000:0.0:1651532098.452702:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.452717:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.452738:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468107520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524653us (524713us total) trans 158913793492 rc 0/0
00010000:00010000:1.0:1651532098.452740:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.452742:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3671
00010000:00010000:1.0:1651532098.452744:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532098.452746:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.452749:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.452764:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.452765:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.452766:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.452769:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.452777:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.452787:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40bfed lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9207807] (req 978944->9207807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.452793:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.452797:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.453043:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.453070:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468113088
00000100:00100000:0.0:1651532098.453080:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1981
00000100:00100000:0.0:1651532098.453082:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468113088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532098.453086:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.453090:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.453090:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c0fe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447726 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453095:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.453099:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.453102:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c0fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447726 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.453106:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c0fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447726 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.453110:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532098.453115:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468107584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 525026us (525073us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532098.453127:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3672
00010000:00010000:1.0:1651532098.453135:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453138:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532098.453139:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.453140:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468113088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (98us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532098.453142:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.453143:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1981
00010000:00010000:1.0:1651532098.453147:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.453147:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.453148:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453151:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453158:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.453158:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532098.453161:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40bff4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->10485759] (req 2314240->10485759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453166:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453169:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.453183:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.453205:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468113152
00000100:00100000:0.0:1651532098.453214:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468113216
00000100:00100000:0.0:1651532098.453217:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1982
00000100:00100000:0.0:1651532098.453219:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468113152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532098.453228:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532098.453229:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1983
00000100:00100000:1.0:1651532098.453231:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468113216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.453235:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.453238:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c10c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447734 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.453238:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c105 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44772d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453248:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c10c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447734 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.453248:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c105 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44772d expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.453252:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c105 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44772d expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.453253:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c10c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447734 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.453255:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532098.453256:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532098.453264:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468113216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.453264:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468113152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.453266:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1982
00000100:00100000:1.0:1651532098.453268:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1983
00000100:00100000:0.0:1651532098.453490:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.453509:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468113280
00000100:00100000:1.0:1651532098.453524:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3681
00000100:00100000:1.0:1651532098.453525:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468113280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532098.453532:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453537:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532098.453538:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453550:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453553:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532098.453554:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453566:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453575:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453578:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.453684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.453694:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468113536
00000100:00100000:0.0:1651532098.453694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.453706:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468113600
00000100:00100000:1.0:1651532098.453714:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1984
00000100:00100000:1.0:1651532098.453716:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468113536:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532098.453718:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1985
00010000:00010000:1.0:1651532098.453719:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532098.453721:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468113600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.453723:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c11a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44773b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.453724:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.453728:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c121 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447742 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.453730:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c11a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44773b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.453745:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c11a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44773b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.453745:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c121 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447742 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.453749:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532098.453749:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c121 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447742 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.453752:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532098.453762:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468113536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.453765:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1984
00000100:00100000:0.0:1651532098.453768:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468113600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.453770:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1985
00000100:00100000:0.0:1651532098.454001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.454020:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468113856
00000100:00100000:1.0:1651532098.454028:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1986
00000100:00100000:1.0:1651532098.454029:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468113856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.454033:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.454036:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c128 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447749 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.454044:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c128 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447749 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.454048:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c128 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447749 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.454051:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532098.454064:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468113856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.454067:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1986
00000001:00080000:1.0:1651532098.561013:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793493 is committed
00010000:00010000:1.0:1651532098.561028:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561032:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.561053:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468109248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566251us (566284us total) trans 158913793493 rc 0/0
00000100:00100000:1.0:1651532098.561056:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3673
00010000:00010000:0.0:1651532098.561057:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561061:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532098.561063:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561066:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561072:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.561072:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.561073:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561076:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561087:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.561088:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.561089:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561091:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561103:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561106:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c041 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->10452991] (req 319488->10452991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561112:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561115:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561116:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561121:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.561573:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.561593:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.561604:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.561605:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468114112
00000100:00100000:0.0:1651532098.561624:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468114048
00000100:00100000:0.0:1651532098.561633:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3682
00010000:00010000:1.0:1651532098.561634:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.561634:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468114112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532098.561638:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561642:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561646:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532098.561656:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468109312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566754us (566791us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532098.561659:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3674
00010000:00010000:0.0:1651532098.561659:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561663:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532098.561663:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561668:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.561672:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3683
00010000:00010000:0.0:1651532098.561672:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.561673:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468114048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532098.561680:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561683:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561686:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561690:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532098.561691:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561700:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532098.561701:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.561704:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468110784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 450218us (450277us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532098.561706:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.561708:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3675
00010000:00010000:1.0:1651532098.561709:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561716:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561719:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532098.561721:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561723:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.561744:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468114304
00010000:00010000:1.0:1651532098.561745:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561748:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c048 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9875455] (req 655360->9875455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.561755:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1987
00010000:00010000:1.0:1651532098.561756:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.561757:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468114304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.561759:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532098.561760:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561760:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.561763:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c13d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447750 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561764:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561767:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.561768:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.561769:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561771:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561777:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561780:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c087 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->7462911] (req 208896->7462911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.561781:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c13d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447750 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.561785:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c13d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447750 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.561789:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532098.561792:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.561795:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.561801:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468114304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (197us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.561817:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1987
00000100:00100000:0.0:1651532098.562145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.562153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.562159:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.562165:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.562172:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468114432
00000100:00100000:0.0:1651532098.562181:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3684
00000100:00100000:0.0:1651532098.562183:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468114432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532098.562190:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.562194:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532098.562195:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.562198:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532098.562198:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.562212:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.562215:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468114560
00010000:00010000:0.0:1651532098.562215:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.562223:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468114624
00000100:00100000:0.0:1651532098.562224:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468114752
00000100:00100000:1.0:1651532098.562227:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1988
00000100:00100000:1.0:1651532098.562228:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468114560:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532098.562230:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1989
00000100:00100000:0.0:1651532098.562231:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468114624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.562232:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.562234:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.562236:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c14b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447757 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.562237:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c152 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44775e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.562245:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c14b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447757 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.562245:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c152 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44775e expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.562249:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c14b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447757 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.562249:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c152 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44775e expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.562253:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532098.562253:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532098.562263:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468114560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.562266:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1988
00000100:00100000:1.0:1651532098.562270:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1990
00000100:00100000:1.0:1651532098.562272:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468114752:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532098.562278:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468114624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.562281:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1989
00010000:00010000:1.0:1651532098.562283:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532098.562297:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532098.562300:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c159 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447765 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.562317:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c159 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447765 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.562321:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c159 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447765 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.562324:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532098.562339:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468114880
00000100:00100000:1.0:1651532098.562344:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468114752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (171us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.562347:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1990
00000100:00100000:0.0:1651532098.562359:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1991
00000100:00100000:0.0:1651532098.562361:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468114880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532098.562364:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.562368:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c160 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44776c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.562375:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c160 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44776c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.562379:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c160 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44776c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.562382:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532098.562394:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468114880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.562397:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1991
00000100:00100000:0.0:1651532098.562688:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.562696:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.562709:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.562718:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468115072
00000100:00100000:1.0:1651532098.562720:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468115200
00000100:00100000:0.0:1651532098.562724:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468115328
00000100:00100000:1.0:1651532098.562727:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1992
00000100:00100000:1.0:1651532098.562729:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b29f8e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468115072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.562732:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532098.562732:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1993
00000100:00100000:0.0:1651532098.562733:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468115200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.562735:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c167 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447773 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.562737:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.562740:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c16e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44777a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.562742:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c167 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447773 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.562746:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c167 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447773 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.562758:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c16e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44777a expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.562761:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532098.562762:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c16e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44777a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.562765:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532098.562772:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b29f8e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468115072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.562773:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468115200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.562775:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1992
00000100:00100000:0.0:1651532098.562776:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1993
00000100:00100000:1.0:1651532098.562801:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1994
00000100:00100000:1.0:1651532098.562825:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468115328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.562828:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532098.562830:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532098.562831:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c175 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447781 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.562838:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c175 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447781 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.562842:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c175 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447781 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.562845:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532098.562852:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468115328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (142us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.562859:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468115520
00000100:00100000:1.0:1651532098.562874:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1994
00000100:00100000:0.0:1651532098.562879:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1995
00000100:00100000:0.0:1651532098.562881:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468115520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532098.562884:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.562888:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c17c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447788 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.562895:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c17c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447788 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.562899:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c17c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447788 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.562902:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532098.562935:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468115520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.562938:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1995
00000100:00100000:1.0:1651532098.563135:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.563153:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468115712
00000100:00100000:0.0:1651532098.563161:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1996
00000100:00100000:0.0:1651532098.563163:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468115712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532098.563166:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.563169:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c183 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44778f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.563176:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c183 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44778f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.563180:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c183 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44778f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.563183:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532098.563193:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468115712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.563195:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1996
00000001:00080000:1.0:1651532098.711004:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793494 is committed
00010000:00010000:1.0:1651532098.711019:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.711025:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.711048:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468110720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599558us (599607us total) trans 158913793494 rc 0/0
00010000:00010000:0.0:1651532098.711049:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.711051:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3676
00010000:00010000:0.0:1651532098.711053:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532098.711054:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711067:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711073:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.711074:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.711074:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711077:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711085:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711088:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c08e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->7794687] (req 1142784->7794687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711094:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711097:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.711469:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.711500:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468116032
00000100:00100000:0.0:1651532098.711506:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.711515:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.711518:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468116096
00000100:00100000:0.0:1651532098.711520:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.711528:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3685
00000100:00100000:1.0:1651532098.711530:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468116032:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532098.711532:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532098.711538:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.711542:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532098.711548:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.711552:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:0.0:1651532098.711552:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3686
00010000:00010000:1.0:1651532098.711553:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.711554:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468116096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532098.711557:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.711561:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711563:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711567:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532098.711568:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711571:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532098.711572:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711576:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711580:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.711581:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468116288
00000100:00100000:1.0:1651532098.711587:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468116352
00000100:00100000:0.0:1651532098.711587:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468116416
00000100:00100000:1.0:1651532098.711590:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1997
00000100:00100000:1.0:1651532098.711592:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468116288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.711594:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532098.711594:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1998
00000100:00100000:0.0:1651532098.711596:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468116352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.711597:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c198 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447796 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.711598:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.711601:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c19f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44779d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.711604:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c198 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447796 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.711608:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c198 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447796 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.711608:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c19f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44779d expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.711612:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532098.711622:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468116288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (107us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532098.711622:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c19f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44779d expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532098.711625:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1997
00010000:00010000:0.0:1651532098.711626:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532098.711629:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1999
00000100:00100000:1.0:1651532098.711631:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468116416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.711633:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532098.711635:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468116352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (115us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532098.711636:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477a4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.711638:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1998
00010000:00010000:1.0:1651532098.711641:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477a4 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.711653:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477a4 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.711656:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532098.711663:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468116416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (131us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.711666:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1999
00000001:00080000:1.0:1651532098.844294:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793495 is committed
00002000:00010000:0.0:1651532098.844330:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532097 -> 1651532098
00010000:00010000:0.0:1651532098.844333:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.844337:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844358:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.844358:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468111296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 593067us (593114us total) trans 158913793495 rc 0/0
00000100:00100000:0.0:1651532098.844361:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3677
00010000:00010000:1.0:1651532098.844363:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532098.844364:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844367:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844373:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.844373:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.844374:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844377:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844381:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.844399:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.844400:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844403:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844417:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844420:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c0a3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->10088447] (req 2195456->10088447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844427:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844430:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.844431:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.844435:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.844649:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.844668:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468116736
00000100:00100000:1.0:1651532098.844684:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2000
00000100:00100000:1.0:1651532098.844686:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468116736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.844689:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.844692:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477ab expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844700:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477ab expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.844725:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477ab expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.844734:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532098.844743:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468116736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.844745:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.844746:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2000
00010000:00010000:0.0:1651532098.844785:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.844789:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.844819:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468111360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 593457us (593561us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532098.844827:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3678
00010000:00010000:0.0:1651532098.844834:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.844836:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468116864
00010000:00010000:0.0:1651532098.844837:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532098.844838:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.844841:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.844848:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2001
00000100:00100000:1.0:1651532098.844849:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468116864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532098.844852:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844853:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.844855:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c0b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7598080->9437183] (req 7598080->9437183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844856:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477b2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.844863:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477b2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.844867:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477b2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.844870:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532098.844878:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468116864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.844913:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2001
00000100:00100000:0.0:1651532098.845134:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.845142:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.845149:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.845159:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468117120
00000100:00100000:0.0:1651532098.845159:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468117056
00000100:00100000:1.0:1651532098.845169:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2002
00000100:00100000:1.0:1651532098.845171:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468117120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.845175:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.845178:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c1bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477b9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.845180:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468116992
00010000:00010000:1.0:1651532098.845185:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c1bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477b9 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532098.845189:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3687
00000100:00100000:0.0:1651532098.845191:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468117056:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532098.845195:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c1bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477b9 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.845198:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.845199:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532098.845202:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532098.845203:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532098.845204:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.845207:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.845208:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468117120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.845211:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2002
00000100:00100000:0.0:1651532098.845214:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3688
00000100:00100000:0.0:1651532098.845216:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468116992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532098.845220:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.845223:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532098.845224:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.845226:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.845229:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532098.845229:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.845243:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.845246:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.845250:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532098.944347:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793496 is committed
00010000:00010000:1.0:1651532098.944362:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944366:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.944387:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468112768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599531us (599555us total) trans 158913793496 rc 0/0
00000100:00100000:1.0:1651532098.944390:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3679
00010000:00010000:0.0:1651532098.944390:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.944394:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532098.944395:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.944398:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.944404:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.944404:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.944405:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.944408:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.944416:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.944426:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c0f0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->7585791] (req 1617920->7585791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944441:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944446:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.944723:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.944733:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.944734:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468117376
00000100:00100000:0.0:1651532098.944742:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468117440
00000100:00100000:1.0:1651532098.944745:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.944747:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468117504
00000100:00100000:0.0:1651532098.944750:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2003
00000100:00100000:0.0:1651532098.944752:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468117376:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532098.944753:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2004
00000100:00100000:1.0:1651532098.944755:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468117440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532098.944755:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.944758:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.944759:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c1d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477c0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944762:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c1d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477c7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.944764:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.944767:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c1d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477c0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.944768:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.944771:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c1d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477c7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.944772:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c1d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477c0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.944775:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c1d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477c7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.944775:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532098.944778:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532098.944790:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468117376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.944793:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2003
00000100:00100000:1.0:1651532098.944795:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468117440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.944797:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2004
00000100:00100000:0.0:1651532098.944799:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2005
00000100:00100000:0.0:1651532098.944801:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468117504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.944820:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.944825:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.944828:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c1de lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477ce expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944832:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.944836:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532098.944839:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c1de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477ce expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.944843:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c1de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477ce expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532098.944846:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468112832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 599982us (600003us total) trans 0 rc 36864/36864
00010000:00010000:0.0:1651532098.944846:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532098.944849:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3680
00000100:00100000:0.0:1651532098.944854:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468117504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (109us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532098.944855:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532098.944856:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2005
00010000:00010000:1.0:1651532098.944858:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532098.944859:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944862:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944867:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.944868:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532098.944868:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944871:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944878:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944881:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c0f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1486848->9105407] (req 1486848->9105407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944894:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.944897:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.945452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.945468:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.945475:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.945488:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.945498:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532098.945498:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468117760
00000100:00100000:1.0:1651532098.945507:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468117568
00000100:00100000:0.0:1651532098.945513:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468117888
00000100:00100000:0.0:1651532098.945516:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468118080
00000100:00100000:0.0:1651532098.945519:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2006
00000100:00100000:0.0:1651532098.945521:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468117760:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532098.945523:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468117696
00010000:00010000:0.0:1651532098.945524:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532098.945527:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c1e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477d5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532098.945528:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3689
00000100:00100000:1.0:1651532098.945530:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468117568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532098.945535:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c1e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477d5 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.945537:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.945541:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532098.945542:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532098.945543:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.945546:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.945550:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c1e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477d5 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532098.945553:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3690
00010000:00010000:0.0:1651532098.945553:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532098.945566:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468117760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532098.945569:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2006
00000100:00100000:1.0:1651532098.945570:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468117696:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532098.945574:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2007
00000100:00100000:0.0:1651532098.945575:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468117888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.945576:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.945578:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.945579:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532098.945580:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.945580:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c1fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477dc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.945583:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532098.945583:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.945588:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.945588:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c1fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477dc expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.945591:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532098.945591:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c1fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477dc expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532098.945595:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532098.945599:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2008
00000100:00100000:0.0:1651532098.945600:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468117888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.945601:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468118080:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532098.945602:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2007
00010000:00010000:1.0:1651532098.945603:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.945612:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c201 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477e3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.945619:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c201 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477e3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.945623:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c201 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477e3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.945632:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532098.945641:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468118080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (143us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.945644:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2008
00000100:00100000:1.0:1651532098.945960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532098.945968:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468118464
00000100:00100000:1.0:1651532098.945979:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2009
00000100:00100000:1.0:1651532098.945981:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468118464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532098.945984:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532098.945988:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c208 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477ea expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532098.945995:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c208 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477ea expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.945999:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c208 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477ea expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532098.946002:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532098.946011:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468118464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532098.946014:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2009
00000001:00080000:1.0:1651532099.036045:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793497 is committed
00010000:00010000:1.0:1651532099.036060:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.036074:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036093:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.036097:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468113280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582570us (582606us total) trans 158913793497 rc 0/0
00000100:00100000:1.0:1651532099.036100:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3681
00010000:00010000:0.0:1651532099.036106:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.036107:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036110:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036116:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.036117:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.036117:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036120:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036129:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036132:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c113 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->9863167] (req 512000->9863167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036137:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036140:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.036417:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532099.036442:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.036448:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532099.036459:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.036464:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468118592
00000100:00100000:1.0:1651532099.036475:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468118720
00000100:00100000:0.0:1651532099.036485:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468114112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474850us (474912us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532099.036486:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2010
00000100:00100000:1.0:1651532099.036488:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468118592:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532099.036489:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3682
00010000:00010000:1.0:1651532099.036491:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.036495:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c20f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477f1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036496:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036500:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532099.036501:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.036502:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.036504:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c20f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477f1 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.036505:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.036508:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c20f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477f1 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.036510:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.036511:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532099.036511:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.036511:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036515:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.036519:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468118592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (103us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532099.036525:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036528:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c12f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->6483967] (req 8192->6483967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.036531:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2010
00000100:00100000:1.0:1651532099.036536:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2011
00000100:00100000:1.0:1651532099.036537:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468118720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.036540:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.036542:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c216 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477f8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036546:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.036548:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c216 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477f8 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.036549:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.036552:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c216 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477f8 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.036555:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532099.036560:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468118720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.036563:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2011
00000100:00100000:1.0:1651532099.036917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.036927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.036928:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468118848
00000100:00100000:1.0:1651532099.036937:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468118784
00000100:00100000:1.0:1651532099.036950:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3691
00000100:00100000:1.0:1651532099.036951:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468118784:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532099.036969:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3692
00000100:00100000:0.0:1651532099.036971:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468118848:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532099.036974:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036979:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.036982:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532099.036983:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.036985:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.036988:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532099.036989:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036993:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532099.036995:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.036998:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532099.036998:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.037002:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.037003:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.037005:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.037006:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.037008:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.037021:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.037030:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.037038:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468118976
00000100:00100000:0.0:1651532099.037039:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468119040
00000100:00100000:1.0:1651532099.037047:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2012
00000100:00100000:1.0:1651532099.037048:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468118976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.037051:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.037054:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c22b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4477ff expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.037057:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2013
00000100:00100000:0.0:1651532099.037058:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468119040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.037062:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.037065:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c232 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447806 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.037069:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c22b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477ff expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.037073:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c22b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4477ff expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.037076:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532099.037092:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468118976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.037095:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2012
00010000:00010000:0.0:1651532099.037101:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c232 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447806 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.037106:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c232 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447806 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532099.037109:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532099.037109:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532099.037118:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468119040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.037121:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2013
00000100:00100000:0.0:1651532099.037127:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468119232
00000100:00100000:0.0:1651532099.037131:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2014
00000100:00100000:0.0:1651532099.037132:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468119232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.037135:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.037138:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c239 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44780d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.037144:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c239 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44780d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.037148:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c239 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44780d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.037160:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532099.037171:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468119232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.037174:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2014
00000001:00080000:1.0:1651532099.136107:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793498 is committed
00002000:00010000:0.0:1651532099.136131:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532097 -> 1651532098
00010000:00010000:0.0:1651532099.136135:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.136138:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.136159:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468114048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574485us (574566us total) trans 158913793498 rc 0/0
00010000:00010000:1.0:1651532099.136161:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.136163:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3683
00010000:00010000:1.0:1651532099.136165:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532099.136167:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.136170:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.136175:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.136176:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.136177:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.136189:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.136197:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.136199:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.136203:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.136207:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c136 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->10223615] (req 1335296->10223615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.136519:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.136541:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468119616
00000100:00100000:0.0:1651532099.136553:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2015
00000100:00100000:0.0:1651532099.136555:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468119616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.136558:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.136562:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c240 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447814 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.136590:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c240 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447814 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.136594:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c240 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447814 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.136598:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532099.136609:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468119616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.136612:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2015
00000100:00100000:1.0:1651532099.136857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.136868:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468119744
00000100:00100000:0.0:1651532099.136879:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2016
00000100:00100000:0.0:1651532099.136881:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468119744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.136884:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.136887:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c247 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44781b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.136895:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c247 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44781b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.136899:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c247 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44781b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.136902:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532099.136913:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468119744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.136916:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2016
00000001:00080000:1.0:1651532099.227816:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793499 is committed
00010000:00010000:0.0:1651532099.227845:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.227850:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.227871:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468114432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 665687us (665727us total) trans 158913793499 rc 0/0
00000100:00100000:0.0:1651532099.227874:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3684
00010000:00010000:0.0:1651532099.227882:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.227885:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.227886:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.227889:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.227894:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.227894:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.227895:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.227898:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.227918:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.227921:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c144 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9584639] (req 1650688->9584639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.227924:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.227929:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.228232:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.228249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.228270:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468119872
00000100:00100000:0.0:1651532099.228283:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468119936
00000100:00100000:0.0:1651532099.228290:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3693
00000100:00100000:0.0:1651532099.228291:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468119872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532099.228298:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.228312:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532099.228313:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.228316:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532099.228317:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.228322:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.228325:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.228333:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3694
00000100:00100000:0.0:1651532099.228343:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468119936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532099.228349:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.228353:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532099.228354:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.228356:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532099.228357:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.228360:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.228363:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.228431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.228442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.228443:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468120192
00000100:00100000:1.0:1651532099.228450:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468120320
00000100:00100000:0.0:1651532099.228454:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2017
00000100:00100000:0.0:1651532099.228456:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468120192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.228459:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.228462:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c25c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447822 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.228464:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2018
00000100:00100000:1.0:1651532099.228465:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468120320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.228469:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.228470:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c25c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447822 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.228482:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c263 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447829 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.228485:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c25c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447822 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.228489:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532099.228491:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c263 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447829 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532099.228500:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468120192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.228503:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2017
00010000:00010000:1.0:1651532099.228513:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c263 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447829 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.228516:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532099.228526:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468120320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.228529:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2018
00000001:00080000:1.0:1651532099.344475:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793500 is committed
00010000:00010000:1.0:1651532099.344491:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.344495:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.344518:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468116032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 632987us (633049us total) trans 158913793500 rc 0/0
00010000:00010000:0.0:1651532099.344518:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.344521:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3685
00010000:00010000:0.0:1651532099.344523:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.344524:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344528:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344533:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.344534:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.344535:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344538:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344541:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.344542:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.344549:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344552:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344561:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344564:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c18a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8982527] (req 258048->8982527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344569:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344573:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344596:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.344599:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.344973:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.344987:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532099.345000:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.345003:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468120640
00010000:00010000:0.0:1651532099.345005:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.345012:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468120832
00000100:00100000:1.0:1651532099.345016:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2019
00000100:00100000:1.0:1651532099.345031:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468120640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.345035:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532099.345037:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468117056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499845us (499903us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532099.345039:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c26a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447830 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.345041:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3687
00010000:00010000:1.0:1651532099.345045:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.345047:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c26a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447830 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.345051:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345052:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c26a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447830 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.345055:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532099.345055:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.345063:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468120640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.345065:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468116096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 633511us (633559us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532099.345066:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2019
00000100:00100000:0.0:1651532099.345068:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3686
00000100:00100000:1.0:1651532099.345071:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2020
00000100:00100000:1.0:1651532099.345073:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468120832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.345073:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345075:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.345076:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532099.345077:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c271 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447837 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345077:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345080:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345081:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.345083:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c271 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447837 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.345086:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345087:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c271 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447837 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.345088:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c1c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1789952->8896511] (req 1789952->8896511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345099:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532099.345100:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345103:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.345104:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345106:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345109:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.345110:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532099.345111:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468120832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (123us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532099.345111:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.345113:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2020
00010000:00010000:0.0:1651532099.345114:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345117:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.345117:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.345118:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345120:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345131:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345137:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345141:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345141:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c191 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2330624->9191423] (req 2330624->9191423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345147:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345150:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.345627:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.345656:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.345667:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.345682:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468121152
00000100:00100000:0.0:1651532099.345687:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.345697:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468121280
00000100:00100000:0.0:1651532099.345699:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.345701:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468121344
00000100:00100000:1.0:1651532099.345705:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2021
00000100:00100000:0.0:1651532099.345705:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.345707:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468121152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.345710:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532099.345712:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468121024
00010000:00010000:1.0:1651532099.345714:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c278 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44783e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.345725:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468120960
00010000:00010000:1.0:1651532099.345728:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c278 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44783e expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532099.345733:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3695
00000100:00100000:0.0:1651532099.345735:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754468121024:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532099.345737:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c278 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44783e expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.345740:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532099.345743:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345747:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.345748:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345751:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.345758:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468121152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.345761:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2021
00000100:00100000:1.0:1651532099.345766:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468121472
00000100:00100000:0.0:1651532099.345767:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3696
00000100:00100000:0.0:1651532099.345769:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468120960:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532099.345770:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2022
00000100:00100000:1.0:1651532099.345772:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468121280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.345774:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.345774:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345777:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c28d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447845 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345778:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532099.345779:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345781:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345784:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532099.345784:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345789:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c28d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447845 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.345789:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345792:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345793:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c28d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447845 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.345795:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.345796:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532099.345801:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468121280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.345819:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2022
00000100:00100000:0.0:1651532099.345821:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2023
00000100:00100000:1.0:1651532099.345823:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2024
00000100:00100000:0.0:1651532099.345823:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468121344:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532099.345825:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468121472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.345828:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.345830:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c294 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447853 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345832:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.345836:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c29b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44784c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.345844:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c29b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44784c expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.345846:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c294 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447853 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.345848:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c29b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44784c expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.345851:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c294 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447853 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.345851:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532099.345854:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532099.345861:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468121472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (156us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.345861:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468121344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (162us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.345864:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2023
00000100:00100000:1.0:1651532099.345865:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2024
00000100:00100000:0.0:1651532099.346220:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.346227:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.346234:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.346247:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468121600
00000100:00100000:1.0:1651532099.346252:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468121792
00000100:00100000:0.0:1651532099.346254:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468121856
00000100:00100000:0.0:1651532099.346258:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2025
00000100:00100000:0.0:1651532099.346259:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468121600:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532099.346260:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2026
00000100:00100000:1.0:1651532099.346261:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468121856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.346263:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.346265:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.346266:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c2a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44785a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.346268:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447868 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.346274:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c2a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44785a expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.346275:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447868 expref: 23 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.346279:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447868 expref: 23 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.346282:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532099.346289:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c2a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44785a expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532099.346292:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754468121856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (58us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532099.346293:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532099.346301:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468121600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.346312:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2025
00000100:00100000:1.0:1651532099.346314:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2026
00000100:00100000:0.0:1651532099.346317:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2027
00000100:00100000:0.0:1651532099.346319:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468121792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.346322:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.346324:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447861 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.346331:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447861 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.346334:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447861 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.346337:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532099.346346:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468121792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.346348:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2027
00000100:00100000:1.0:1651532099.346675:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.346693:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468122176
00000100:00100000:0.0:1651532099.346710:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2028
00000100:00100000:0.0:1651532099.346712:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468122176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.346715:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.346719:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c2b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44786f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.346726:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c2b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44786f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.346730:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c2b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44786f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.346733:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532099.346743:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468122176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.346746:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2028
00000100:00100000:1.0:1651532099.347001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.347012:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468122368
00000100:00100000:0.0:1651532099.347020:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2029
00000100:00100000:0.0:1651532099.347022:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468122368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.347025:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.347028:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2be lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447876 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.347035:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447876 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.347039:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447876 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.347051:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532099.347063:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468122368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.347066:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2029
00000001:00080000:1.0:1651532099.411164:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793502 is committed
00010000:00010000:1.0:1651532099.411185:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411189:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411200:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411205:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.411208:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468117568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 465677us (465757us total) trans 158913793501 rc 0/0
00000100:00100000:1.0:1651532099.411211:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3689
00010000:00010000:1.0:1651532099.411224:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.411224:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468116992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566007us (566081us total) trans 158913793502 rc 0/0
00000100:00100000:0.0:1651532099.411227:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3688
00010000:00010000:1.0:1651532099.411228:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532099.411229:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411232:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411235:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411238:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411238:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.411239:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411241:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c1ec lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411242:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411247:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.411248:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.411248:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411260:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411270:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411273:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c1c9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4128768->10244095] (req 4128768->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411283:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411286:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411455:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411460:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.411475:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754468117696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 465904us (466007us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532099.411479:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3690
00010000:00010000:0.0:1651532099.411485:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411500:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.411501:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411504:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411509:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.411510:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.411511:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411514:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411525:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411528:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c1f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5861376->9998335] (req 5861376->9998335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411534:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411538:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.411626:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.411637:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.411652:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468122624
00000100:00100000:1.0:1651532099.411670:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468122560
00000100:00100000:0.0:1651532099.411680:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3697
00000100:00100000:1.0:1651532099.411682:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3698
00000100:00100000:0.0:1651532099.411682:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468122624:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532099.411684:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468122560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532099.411689:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411691:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411693:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532099.411717:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411720:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532099.411721:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411725:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532099.411727:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411730:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532099.411730:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411734:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411735:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411738:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.411739:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.411751:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.411769:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.411793:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468122752
00000100:00100000:1.0:1651532099.411823:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468122816
00000100:00100000:1.0:1651532099.411828:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2030
00000100:00100000:1.0:1651532099.411830:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468122752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.411833:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532099.411834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532099.411836:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c2d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44787d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.411847:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2031
00010000:00010000:1.0:1651532099.411849:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c2d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44787d expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532099.411850:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468122816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.411854:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c2d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44787d expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.411854:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.411857:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532099.411857:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c2da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447884 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411865:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c2da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447884 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532099.411867:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468122752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (116us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532099.411869:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c2da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447884 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532099.411870:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2030
00010000:00010000:0.0:1651532099.411872:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532099.411904:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468122816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.411907:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2031
00000100:00100000:0.0:1651532099.411923:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.411936:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.411938:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468122944
00000100:00100000:1.0:1651532099.411945:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468123008
00000100:00100000:1.0:1651532099.411949:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2032
00000100:00100000:1.0:1651532099.411950:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468122944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.411953:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532099.411960:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2033
00000100:00100000:0.0:1651532099.411962:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468123008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.411965:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44788b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411965:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.411969:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447892 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.411976:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447892 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.411981:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447892 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.411982:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44788b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.411984:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532099.411986:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44788b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.411990:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532099.411993:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468123008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.411996:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2033
00000100:00100000:1.0:1651532099.411998:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468122944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.412001:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2032
00000100:00100000:1.0:1651532099.412010:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468122880
00000100:00100000:1.0:1651532099.412022:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3699
00000100:00100000:1.0:1651532099.412024:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468122880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532099.412050:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.412054:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532099.412055:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.412058:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532099.412059:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.412063:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.412078:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532099.469615:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793503 is committed
00010000:00010000:1.0:1651532099.469629:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.469633:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.469651:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.469656:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468118784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432704us (432729us total) trans 158913793503 rc 0/0
00000100:00100000:1.0:1651532099.469660:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3691
00010000:00010000:0.0:1651532099.469661:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.469662:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.469676:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.469682:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.469682:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.469683:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.469686:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.469694:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.469697:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c21d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->8302591] (req 323584->8302591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.469702:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.469705:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.470064:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.470073:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.470085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.470091:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468123456
00000100:00100000:1.0:1651532099.470092:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.470111:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3700
00000100:00100000:0.0:1651532099.470112:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468123456:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532099.470113:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468123392
00010000:00010000:0.0:1651532099.470119:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.470123:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3701
00000100:00100000:1.0:1651532099.470125:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468123392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532099.470131:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.470132:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.470132:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.470135:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532099.470136:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.470142:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532099.470143:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.470156:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532099.470157:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.470160:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.470161:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.470164:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.470165:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.470174:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468123712
00010000:00010000:0.0:1651532099.470176:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.470179:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.470183:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468123776
00000100:00100000:1.0:1651532099.470189:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2034
00000100:00100000:1.0:1651532099.470191:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468123712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.470194:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.470202:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c304 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447899 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.470207:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468118848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433235us (433290us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532099.470210:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3692
00010000:00010000:1.0:1651532099.470213:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.470216:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c304 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447899 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.470218:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.470220:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c304 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447899 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.470221:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532099.470223:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532099.470229:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.470232:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.470237:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532099.470238:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468123712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (152us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532099.470238:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.470239:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.470241:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2034
00010000:00010000:0.0:1651532099.470242:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.470246:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2035
00000100:00100000:1.0:1651532099.470247:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468123776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.470248:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.470250:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.470251:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c224 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9891839] (req 462848->9891839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.470253:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c30b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478a0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.470256:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.470259:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c30b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478a0 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.470259:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.470263:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c30b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478a0 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.470266:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532099.470270:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468123776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (178us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.470273:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2035
00000100:00100000:1.0:1651532099.470620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.470631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.470632:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468123904
00000100:00100000:0.0:1651532099.470647:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468124032
00000100:00100000:1.0:1651532099.470651:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2036
00000100:00100000:1.0:1651532099.470658:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468123904:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532099.470658:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2037
00000100:00100000:0.0:1651532099.470660:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468124032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.470662:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.470665:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c312 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478a7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.470684:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.470688:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c312 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478a7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.470688:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c319 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478ae expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.470692:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c312 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478a7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.470696:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532099.470697:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c319 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478ae expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.470701:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c319 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478ae expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.470704:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532099.470706:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468123904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.470708:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2036
00000100:00100000:0.0:1651532099.470713:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468124032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.470716:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2037
00000100:00100000:1.0:1651532099.470736:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.470747:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468124160
00000100:00100000:0.0:1651532099.470753:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2038
00000100:00100000:0.0:1651532099.470755:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468124160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.470758:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.470761:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c320 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478b5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.470768:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c320 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478b5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.470772:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c320 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478b5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.470786:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532099.470799:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468124160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.470801:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2038
00000100:00100000:1.0:1651532099.471013:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.471024:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468124288
00000100:00100000:0.0:1651532099.471031:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2039
00000100:00100000:0.0:1651532099.471032:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001b5fb34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468124288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.471036:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.471039:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c327 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478bc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.471046:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c327 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478bc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.471050:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c327 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478bc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.471053:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532099.471067:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001b5fb34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468124288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.471069:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2039
00000001:00080000:1.0:1651532099.588609:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793504 is committed
00010000:00010000:0.0:1651532099.588638:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.588643:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.588671:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468119872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 360378us (360439us total) trans 158913793504 rc 0/0
00000100:00100000:0.0:1651532099.588674:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3693
00010000:00010000:1.0:1651532099.588675:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.588679:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532099.588680:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.588684:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.588689:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.588690:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.588690:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.588701:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.588705:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.588705:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.588706:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.588708:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.588728:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.588731:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c24e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3608576->10047487] (req 3608576->10047487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.588740:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.588742:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.588744:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.588746:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.589048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.589059:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.589074:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.589094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532099.589104:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.589108:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589133:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589138:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.589145:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468119936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 360801us (360895us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532099.589148:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3694
00000100:00100000:1.0:1651532099.589154:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468124672
00000100:00100000:0.0:1651532099.589156:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468121024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 243420us (243530us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532099.589159:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3695
00000100:00100000:1.0:1651532099.589164:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3702
00000100:00100000:1.0:1651532099.589165:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754468124672:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532099.589165:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468124608
00010000:00010000:1.0:1651532099.589172:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.589178:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3703
00000100:00100000:0.0:1651532099.589180:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468124608:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532099.589182:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.589183:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.589186:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532099.589186:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589186:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.589191:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.589194:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589198:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532099.589199:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589202:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532099.589203:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589207:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589211:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589217:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589221:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532099.589222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532099.589222:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589224:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589229:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589232:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c255 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->6791167] (req 765952->6791167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589241:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589244:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.589245:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589248:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589251:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.589252:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.589252:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589255:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.589258:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468124736
00010000:00010000:0.0:1651532099.589261:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589264:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c27f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->2416639] (req 2039808->2416639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.589265:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468124800
00000100:00100000:1.0:1651532099.589268:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468124864
00010000:00010000:0.0:1651532099.589269:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589272:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.589280:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2040
00000100:00100000:1.0:1651532099.589281:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468124736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.589285:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.589288:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c33c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478c3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.589296:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c33c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478c3 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.589318:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c33c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478c3 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532099.589320:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2041
00010000:00010000:1.0:1651532099.589323:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532099.589323:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468124800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.589326:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.589329:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c343 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478ca expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.589331:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468124736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (257us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.589334:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2040
00010000:00010000:0.0:1651532099.589337:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c343 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478ca expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532099.589339:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2042
00000100:00100000:1.0:1651532099.589340:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468124864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.589341:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c343 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478ca expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.589343:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.589344:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532099.589346:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c34a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478d1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.589352:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468124800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (258us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532099.589353:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c34a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478d1 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532099.589354:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2041
00010000:00010000:1.0:1651532099.589357:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c34a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478d1 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.589368:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532099.589374:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468124864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (153us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.589377:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2042
00000100:00100000:0.0:1651532099.589542:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.589635:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468124992
00000100:00100000:0.0:1651532099.589646:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3704
00000100:00100000:0.0:1651532099.589648:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468124992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532099.589655:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589683:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532099.589684:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532099.589692:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.589696:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.589717:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.589727:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468125120
00000100:00100000:1.0:1651532099.589737:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2043
00000100:00100000:1.0:1651532099.589739:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468125120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.589744:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.589748:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c358 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478d8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.589758:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c358 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478d8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.589778:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c358 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478d8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.589785:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532099.589815:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468125120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.589823:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2043
00000100:00100000:0.0:1651532099.589847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.589912:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468125312
00000100:00100000:1.0:1651532099.589922:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2044
00000100:00100000:1.0:1651532099.589923:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468125312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.589937:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.589941:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c35f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478df expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.589950:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c35f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478df expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.589954:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c35f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478df expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.589958:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532099.589971:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468125312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (124us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.589974:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2044
00000100:00100000:1.0:1651532099.590100:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.590108:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468125440
00000100:00100000:1.0:1651532099.590116:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2045
00000100:00100000:1.0:1651532099.590118:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468125440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.590121:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.590125:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c366 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478e6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.590132:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c366 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478e6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.590136:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c366 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478e6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.590140:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532099.590155:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468125440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.590158:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2045
00000100:00100000:1.0:1651532099.590225:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.590232:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468125568
00000100:00100000:1.0:1651532099.590239:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2046
00000100:00100000:1.0:1651532099.590241:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468125568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.590244:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.590247:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c36d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478ed expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.590255:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c36d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478ed expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.590259:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c36d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478ed expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.590262:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532099.590276:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468125568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.590278:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2046
00000100:00100000:1.0:1651532099.590526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.590534:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468125824
00000100:00100000:1.0:1651532099.590541:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2047
00000100:00100000:1.0:1651532099.590552:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468125824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.590556:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.590559:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c374 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478f4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.590567:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c374 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478f4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.590571:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c374 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478f4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.590574:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532099.590587:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468125824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.590589:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2047
00000001:00080000:1.0:1651532099.669636:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793505 is committed
00010000:00010000:0.0:1651532099.669662:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.669667:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.669689:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468120960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 323919us (324033us total) trans 158913793505 rc 0/0
00010000:00010000:1.0:1651532099.669691:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.669693:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3696
00010000:00010000:1.0:1651532099.669696:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532099.669697:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.669701:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.669706:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.669715:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.669716:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.669721:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.669746:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.669747:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.669750:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c286 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->10215423] (req 1835008->10215423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.669752:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.670110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.670142:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.670150:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.670159:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.670165:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.670176:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468126144
00000100:00100000:1.0:1651532099.670191:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468126208
00000100:00100000:1.0:1651532099.670194:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468126336
00000100:00100000:0.0:1651532099.670194:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.670197:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468126400
00000100:00100000:1.0:1651532099.670200:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2048
00000100:00100000:0.0:1651532099.670201:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468125952
00000100:00100000:1.0:1651532099.670202:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468126144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.670206:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.670209:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c37b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4478fb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670215:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.670218:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c37b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478fb expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532099.670223:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468126016
00000100:00100000:0.0:1651532099.670231:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3705
00000100:00100000:0.0:1651532099.670233:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468125952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532099.670234:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c37b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4478fb expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.670240:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670245:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532099.670246:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670248:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532099.670249:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670251:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532099.670252:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670256:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670259:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.670263:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468126144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.670266:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2048
00010000:00010000:0.0:1651532099.670269:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.670271:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2049
00000100:00100000:1.0:1651532099.670273:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468126208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.670275:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.670278:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c389 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447902 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670280:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670293:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670297:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.670299:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c389 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447902 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.670314:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c389 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447902 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.670318:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532099.670318:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468122624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 258636us (258698us total) trans 0 rc 45056/45056
00000100:00100000:0.0:1651532099.670321:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3697
00000100:00100000:1.0:1651532099.670325:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468126208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (165us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.670327:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3706
00000100:00100000:1.0:1651532099.670328:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2049
00000100:00100000:0.0:1651532099.670328:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468126016:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532099.670332:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2050
00000100:00100000:1.0:1651532099.670334:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468126336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.670335:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670336:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.670338:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.670339:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670342:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532099.670343:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670346:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670347:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c397 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447909 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670350:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670352:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.670354:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c397 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447909 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.670357:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670358:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c397 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447909 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.670361:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532099.670367:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468126336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (202us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532099.670368:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.670369:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.670370:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2050
00010000:00010000:0.0:1651532099.670372:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.670374:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2051
00000100:00100000:1.0:1651532099.670375:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468126400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.670377:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.670377:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.670377:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.670378:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670379:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c39e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447910 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670381:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670386:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c39e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447910 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.670390:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670394:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c2c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [589824->9433087] (req 589824->9433087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670398:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c39e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447910 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.670401:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532099.670415:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468126400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (226us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.670417:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2051
00010000:00010000:1.0:1651532099.670428:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670434:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.670787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.670796:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.670821:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468126528
00000100:00100000:0.0:1651532099.670829:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468126592
00000100:00100000:0.0:1651532099.670834:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2052
00000100:00100000:0.0:1651532099.670835:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468126528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.670847:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.670851:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c3a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447917 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670859:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c3a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447917 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.670864:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c3a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447917 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.670867:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532099.670869:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2053
00000100:00100000:1.0:1651532099.670872:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468126592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.670878:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.670883:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c3ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44791e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.670892:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c3ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44791e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.670896:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c3ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44791e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532099.670903:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468126528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.670906:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2052
00010000:00010000:1.0:1651532099.670924:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532099.670925:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.670934:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468126592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (138us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.670937:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2053
00000100:00100000:1.0:1651532099.670944:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468126784
00000100:00100000:0.0:1651532099.670951:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.670966:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468126976
00000100:00100000:0.0:1651532099.670981:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2054
00000100:00100000:0.0:1651532099.670984:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468126784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.670987:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.670991:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c3b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447925 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.670998:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c3b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447925 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.671002:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c3b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447925 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532099.671010:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2055
00000100:00100000:1.0:1651532099.671012:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468126976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.671014:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532099.671016:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.671020:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c3ba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44792c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.671024:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468126784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.671027:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2054
00010000:00010000:1.0:1651532099.671028:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c3ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44792c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.671032:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c3ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44792c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.671035:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532099.671043:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468126976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.671045:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2055
00000100:00100000:0.0:1651532099.671290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.671317:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468127168
00000100:00100000:1.0:1651532099.671328:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2056
00000100:00100000:1.0:1651532099.671330:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468127168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.671333:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.671337:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447933 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.671344:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447933 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.671348:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447933 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.671360:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532099.671373:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468127168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.671375:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2056
00000100:00100000:0.0:1651532099.671422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.671439:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468127360
00000100:00100000:1.0:1651532099.671450:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2057
00000100:00100000:1.0:1651532099.671452:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468127360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.671455:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.671459:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44793a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.671466:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44793a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.671470:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44793a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.671473:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532099.671485:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468127360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.671487:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2057
00000001:00080000:1.0:1651532099.794614:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793506 is committed
00010000:00010000:1.0:1651532099.794629:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.794635:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.794657:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468122560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 382971us (383019us total) trans 158913793506 rc 0/0
00000100:00100000:1.0:1651532099.794660:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3698
00010000:00010000:0.0:1651532099.794660:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.794665:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.794666:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.794670:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.794676:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.794676:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.794677:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.794680:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.794690:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.794703:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c2cc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [249856->10289151] (req 249856->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.794715:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.794720:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.795055:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.795066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.795072:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.795080:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468127616
00000100:00100000:0.0:1651532099.795080:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.795087:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.795091:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468127744
00000100:00100000:0.0:1651532099.795093:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.795101:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3707
00000100:00100000:1.0:1651532099.795103:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468127616:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532099.795106:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468127808
00010000:00010000:1.0:1651532099.795110:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.795113:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468127872
00010000:00010000:1.0:1651532099.795115:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532099.795115:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468127936
00010000:00010000:1.0:1651532099.795116:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.795118:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468128000
00010000:00010000:1.0:1651532099.795119:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532099.795120:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.795121:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2058
00000100:00100000:0.0:1651532099.795122:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468127808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.795126:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.795130:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c3d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447941 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.795134:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.795138:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.795138:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c3d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447941 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.795142:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c3d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447941 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.795145:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532099.795146:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3708
00000100:00100000:1.0:1651532099.795148:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468127744:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532099.795153:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.795157:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532099.795158:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.795160:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532099.795161:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.795164:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.795168:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468127808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.795171:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2058
00010000:00010000:1.0:1651532099.795174:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.795176:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2059
00000100:00100000:0.0:1651532099.795178:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468127872:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532099.795181:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2060
00010000:00010000:0.0:1651532099.795181:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532099.795183:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468127936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.795184:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c3e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447948 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.795190:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c3e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447948 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.795192:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.795194:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c3e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447948 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.795195:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c3eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44794f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.795197:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532099.795202:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c3eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44794f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532099.795202:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468127872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.795205:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2059
00010000:00010000:1.0:1651532099.795206:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c3eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44794f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532099.795209:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2061
00010000:00010000:1.0:1651532099.795210:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532099.795210:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468128000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.795212:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.795214:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c3f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447956 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.795219:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468127936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (132us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532099.795220:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c3f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447956 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532099.795221:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2060
00010000:00010000:0.0:1651532099.795231:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c3f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447956 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.795234:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532099.795241:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468128000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.795243:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2061
00000100:00100000:0.0:1651532099.795562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.795569:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468128256
00000100:00100000:0.0:1651532099.795576:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2062
00000100:00100000:0.0:1651532099.795578:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468128256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.795581:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.795585:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c3f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44795d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.795592:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c3f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44795d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.795596:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c3f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44795d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.795599:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532099.795616:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468128256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.795627:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2062
00000100:00100000:0.0:1651532099.795852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.795858:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468128384
00000100:00100000:0.0:1651532099.795865:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2063
00000100:00100000:0.0:1651532099.795867:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468128384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.795870:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.795882:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c400 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447964 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.795890:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c400 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447964 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.795894:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c400 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447964 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.795897:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532099.795912:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468128384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.795914:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2063
00000100:00100000:0.0:1651532099.796134:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.796141:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468128512
00000100:00100000:0.0:1651532099.796148:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2064
00000100:00100000:0.0:1651532099.796150:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468128512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.796153:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.796156:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c407 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44796b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.796170:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c407 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44796b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.796174:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c407 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44796b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.796178:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532099.796192:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468128512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.796194:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2064
00000100:00100000:0.0:1651532099.808076:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532099.808085:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231296
00000100:00100000:0.0:1651532099.808093:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 56
00000100:00100000:0.0:1651532099.808095:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231296:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532099.808101:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 860160 granted 351580736 pending 28672 free 81138851840 avail 76967280640
00000100:00100000:0.0:1651532099.808119:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231296:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (43us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532099.808122:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 56
00000001:00080000:1.0:1651532099.836382:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793507 is committed
00002000:00010000:1.0:1651532099.836396:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532098 -> 1651532099
00002000:00010000:1.0:1651532099.836398:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532098 -> 1651532099
00010000:00010000:1.0:1651532099.836400:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.836404:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.836425:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468122880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 424400us (424591us total) trans 158913793507 rc 0/0
00000100:00100000:1.0:1651532099.836428:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3699
00010000:00010000:1.0:1651532099.836435:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.836446:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532099.836448:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.836453:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.836461:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.836462:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.836463:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.836480:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.836494:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.836497:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c2ef lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1753088->1757183] (req 1753088->1757183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.836503:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.836507:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.836703:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532099.836729:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.836733:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.836753:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468123456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366639us (366696us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532099.836756:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3700
00010000:00010000:0.0:1651532099.836763:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.836766:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.836767:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.836770:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.836775:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.836776:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.836777:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.836780:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.836789:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.836801:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c2f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->10432511] (req 614400->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.836820:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468128640
00010000:00010000:0.0:1651532099.836827:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.836832:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2065
00000100:00100000:1.0:1651532099.836834:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468128640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.836835:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.836838:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.836841:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c40e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447972 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.836859:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c40e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447972 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.836864:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c40e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447972 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.836867:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532099.836878:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468128640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (175us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.836882:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2065
00000100:00100000:0.0:1651532099.837084:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.837090:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.837096:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468128704
00000100:00100000:0.0:1651532099.837096:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.837107:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468128768
00000100:00100000:1.0:1651532099.837116:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3709
00000100:00100000:1.0:1651532099.837117:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468128704:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532099.837127:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3710
00010000:00010000:1.0:1651532099.837129:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.837129:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468128768:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532099.837134:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532099.837135:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.837136:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.837138:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532099.837139:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.837144:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532099.837145:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.837148:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532099.837149:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.837152:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.837153:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.837159:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.837164:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.837166:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468128960
00000100:00100000:1.0:1651532099.837175:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2066
00000100:00100000:1.0:1651532099.837176:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468128960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532099.837179:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.837181:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c423 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447979 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.837188:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c423 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447979 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.837192:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c423 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447979 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.837196:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532099.837206:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468128960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532099.837209:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2066
00000001:00080000:1.0:1651532099.936402:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793508 is committed
00010000:00010000:0.0:1651532099.936432:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936437:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.936454:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468123392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466328us (466380us total) trans 158913793508 rc 0/0
00000100:00100000:0.0:1651532099.936457:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3701
00010000:00010000:0.0:1651532099.936464:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936467:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532099.936469:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936471:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936476:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.936477:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.936478:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936491:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936503:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936507:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c2fd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->7557119] (req 2621440->7557119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.936516:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.936521:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.936820:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.936839:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468129216
00000100:00100000:0.0:1651532099.936846:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2067
00000100:00100000:0.0:1651532099.936848:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468129216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.936852:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.936854:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936856:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c42a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447980 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.936859:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936862:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532099.936865:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c42a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447980 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.936869:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c42a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447980 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.936873:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532099.936876:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468124672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 347710us (347848us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532099.936879:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3702
00000100:00100000:0.0:1651532099.936881:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468129216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (62us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532099.936886:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.936889:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532099.936890:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.936892:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2067
00010000:00010000:1.0:1651532099.936893:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.936898:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.936899:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.936900:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.936903:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.936917:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.936918:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532099.936918:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.936921:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.936931:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.936934:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c32e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->9621503] (req 2965504->9621503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936935:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936938:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936960:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.936963:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.937375:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.937399:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.937410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.937411:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468129408
00000100:00100000:1.0:1651532099.937418:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532099.937427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.937436:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468129344
00000100:00100000:0.0:1651532099.937444:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3711
00000100:00100000:0.0:1651532099.937446:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468129408:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532099.937447:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3712
00000100:00100000:1.0:1651532099.937449:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468129344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532099.937453:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.937458:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.937458:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532099.937459:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532099.937460:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.937464:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532099.937465:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.937479:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.937482:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532099.937482:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.937486:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.937487:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.937490:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.937493:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532099.937506:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468129600
00000100:00100000:1.0:1651532099.937508:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468129664
00000100:00100000:0.0:1651532099.937515:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468129536
00000100:00100000:0.0:1651532099.937519:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2068
00000100:00100000:0.0:1651532099.937521:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754468129600:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532099.937523:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2069
00010000:00010000:0.0:1651532099.937524:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532099.937525:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754468129664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.937527:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c43f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44798e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532099.937528:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532099.937531:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c446 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447995 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.937534:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c43f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44798e expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.937538:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c43f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44798e expref: 24 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532099.937539:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c446 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447995 expref: 24 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.937542:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532099.937553:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754468129600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (143us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532099.937554:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c446 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447995 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532099.937555:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2068
00010000:00010000:1.0:1651532099.937557:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532099.937560:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2070
00000100:00100000:0.0:1651532099.937562:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468129536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.937564:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532099.937567:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468129664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (148us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532099.937567:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c44d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447987 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532099.937570:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2069
00010000:00010000:0.0:1651532099.937573:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c44d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447987 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.937585:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c44d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447987 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.937588:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532099.937596:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468129536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (169us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.937599:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2070
00000100:00100000:1.0:1651532099.937878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.937889:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468130048
00000100:00100000:0.0:1651532099.937912:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2071
00000100:00100000:0.0:1651532099.937914:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468130048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.937917:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.937920:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c454 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44799c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.937927:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c454 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44799c expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.937931:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c454 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44799c expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.937935:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532099.937947:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468130048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.937949:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2071
00000100:00100000:1.0:1651532099.937969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532099.937985:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468130112
00000100:00100000:0.0:1651532099.937996:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2072
00000100:00100000:0.0:1651532099.937998:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468130112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532099.938001:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532099.938004:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c45b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479a3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532099.938010:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c45b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479a3 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.938014:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c45b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479a3 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532099.938017:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532099.938026:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468130112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532099.938029:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2072
00000001:00080000:1.0:1651532100.036436:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793510 is committed
00010000:00010000:0.0:1651532100.036467:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036472:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.036494:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468124992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 446845us (446952us total) trans 158913793509 rc 0/0
00000100:00100000:0.0:1651532100.036498:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3704
00010000:00010000:0.0:1651532100.036505:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036517:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.036518:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036521:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036527:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036530:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c351 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9076736->9080831] (req 9076736->9080831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.036556:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.036560:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036581:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.036585:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468124608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 447404us (447525us total) trans 158913793510 rc 0/0
00000100:00100000:1.0:1651532100.036588:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3703
00010000:00010000:0.0:1651532100.036589:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.036590:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036593:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036597:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.036598:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.036599:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036611:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036619:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.036622:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c335 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1212416->6606847] (req 1212416->6606847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.036638:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.036643:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.036962:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.036969:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.036980:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.036981:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468130432
00000100:00100000:1.0:1651532100.036989:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.036997:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468130368
00000100:00100000:0.0:1651532100.037006:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3713
00000100:00100000:0.0:1651532100.037008:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468130432:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532100.037015:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.037019:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532100.037020:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.037023:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532100.037023:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.037028:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.037031:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.037047:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3714
00000100:00100000:0.0:1651532100.037049:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468130368:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532100.037063:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468130496
00010000:00010000:0.0:1651532100.037075:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.037079:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468130560
00010000:00010000:0.0:1651532100.037079:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532100.037080:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.037083:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532100.037084:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.037085:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2073
00000100:00100000:1.0:1651532100.037086:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468130496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.037088:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.037090:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.037091:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.037094:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c470 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479aa expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.037099:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2074
00000100:00100000:0.0:1651532100.037101:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468130560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.037102:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c470 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479aa expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.037104:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.037107:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c470 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479aa expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.037107:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c477 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479b1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.037110:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532100.037114:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c477 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479b1 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.037126:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c477 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479b1 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.037129:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532100.037134:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468130496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (153us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.037137:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2073
00000100:00100000:0.0:1651532100.037139:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468130560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (149us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.037142:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2074
00000100:00100000:1.0:1651532100.037155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.037166:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468130688
00000100:00100000:0.0:1651532100.037177:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2075
00000100:00100000:0.0:1651532100.037178:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468130688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.037181:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.037184:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c47e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479b8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.037191:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c47e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479b8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.037195:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c47e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479b8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.037199:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532100.037210:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468130688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.037212:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2075
00000001:00080000:1.0:1651532100.168740:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793511 is committed
00010000:00010000:1.0:1651532100.168756:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.168760:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.168788:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468125952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 498554us (498678us total) trans 158913793511 rc 0/0
00000100:00100000:1.0:1651532100.168792:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3705
00010000:00010000:1.0:1651532100.168799:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.168820:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532100.168822:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.168825:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.168831:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.168831:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.168832:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.168835:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.168844:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.168849:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c382 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9347071] (req 794624->9347071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.168856:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.168861:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.169182:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532100.169199:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169203:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.169223:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468126016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 498894us (499081us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532100.169226:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3706
00010000:00010000:0.0:1651532100.169233:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169237:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.169238:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169240:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169245:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.169246:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.169247:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169258:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169268:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169271:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c390 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2207744->10194943] (req 2207744->10194943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.169280:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468131136
00010000:00010000:0.0:1651532100.169281:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169284:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.169298:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2076
00000100:00100000:1.0:1651532100.169300:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468131136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.169315:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.169319:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c485 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479bf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.169327:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c485 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479bf expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.169332:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c485 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479bf expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.169337:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532100.169362:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468131136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (181us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.169366:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2076
00000100:00100000:1.0:1651532100.169620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.169632:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.169648:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.169656:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.169666:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468131264
00000100:00100000:1.0:1651532100.169676:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468131328
00000100:00100000:1.0:1651532100.169681:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3715
00000100:00100000:1.0:1651532100.169683:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468131264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532100.169690:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.169704:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532100.169704:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3716
00010000:00010000:1.0:1651532100.169705:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.169706:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468131328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532100.169708:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532100.169709:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.169713:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169714:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.169718:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169718:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532100.169720:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169722:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532100.169723:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169756:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169759:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.169761:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468131456
00000100:00100000:0.0:1651532100.169768:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468131648
00000100:00100000:1.0:1651532100.169769:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2077
00000100:00100000:1.0:1651532100.169771:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468131456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.169774:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532100.169779:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2078
00000100:00100000:0.0:1651532100.169781:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468131648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.169784:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.169785:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c49a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479c6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.169787:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c4a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479cd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.169793:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c49a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479c6 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.169795:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c4a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479cd expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.169797:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c49a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479c6 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.169799:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c4a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479cd expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.169815:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532100.169822:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532100.169828:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468131648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (172us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.169831:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2078
00000100:00100000:1.0:1651532100.169848:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468131456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 76us (200us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.169851:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2077
00000100:00100000:0.0:1651532100.169887:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.169946:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468131840
00000100:00100000:1.0:1651532100.169955:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2079
00000100:00100000:1.0:1651532100.169957:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468131840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.169961:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.169964:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c4a8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479d4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.169972:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c4a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479d4 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.169976:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c4a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479d4 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.169979:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532100.169995:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468131840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.169997:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2079
00000100:00100000:1.0:1651532100.170277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.170285:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468132096
00000100:00100000:1.0:1651532100.170292:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2080
00000100:00100000:1.0:1651532100.170294:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468132096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.170313:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.170317:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c4af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479db expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.170325:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c4af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479db expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.170329:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c4af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479db expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.170332:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532100.170345:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468132096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.170348:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2080
00000100:00100000:0.0:1651532100.284863:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1651532100.284878:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000003722c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966863488:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651532100.285116:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000003722c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966863488:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:1.0:1651532100.293775:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793512 is committed
00010000:00010000:0.0:1651532100.293813:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.293818:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.293839:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468127616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 498735us (498784us total) trans 158913793512 rc 0/0
00000100:00100000:0.0:1651532100.293842:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3707
00010000:00010000:0.0:1651532100.293850:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.293854:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.293855:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.293858:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.293863:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.293863:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.293864:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.293867:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.293885:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.293888:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c3cf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->10219519] (req 1658880->10219519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.293900:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.293905:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.294173:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.294181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.294205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532100.294231:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.294235:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.294269:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468127744:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499119us (499202us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532100.294274:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3708
00010000:00010000:1.0:1651532100.294282:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.294293:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532100.294294:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.294297:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.294298:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532100.294312:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.294313:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.294314:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.294317:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.294327:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.294331:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c3dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->8413183] (req 700416->8413183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.294333:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468132288
00000100:00100000:0.0:1651532100.294339:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468132352
00000100:00100000:0.0:1651532100.294342:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468132416
00000100:00100000:0.0:1651532100.294344:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468132480
00000100:00100000:0.0:1651532100.294347:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2081
00000100:00100000:0.0:1651532100.294349:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468132288:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532100.294353:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2082
00010000:00010000:0.0:1651532100.294353:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.294356:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c4b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479e2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.294363:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468132352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.294364:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c4b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479e2 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.294367:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.294369:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c4b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479e2 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.294371:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c4bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479e9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.294372:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532100.294378:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c4bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479e9 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.294382:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c4bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479e9 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532100.294382:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468132288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (210us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532100.294386:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532100.294387:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2081
00000100:00100000:0.0:1651532100.294392:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2083
00000100:00100000:0.0:1651532100.294393:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468132416:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532100.294394:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468132352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (213us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532100.294396:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532100.294397:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2082
00010000:00010000:0.0:1651532100.294398:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c4c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479f0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.294403:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2084
00010000:00010000:0.0:1651532100.294404:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c4c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479f0 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532100.294405:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468132480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.294407:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.294407:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c4c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479f0 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.294409:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c4cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479f7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.294411:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532100.294415:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c4cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479f7 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532100.294416:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468132416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (212us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.294418:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2083
00010000:00010000:1.0:1651532100.294419:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c4cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479f7 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.294432:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532100.294439:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468132480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (142us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.294443:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2084
00010000:00010000:0.0:1651532100.294457:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.294461:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.294553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.294565:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.294568:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468132544
00000100:00100000:0.0:1651532100.294572:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468132608
00000100:00100000:1.0:1651532100.294580:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3717
00000100:00100000:1.0:1651532100.294582:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468132544:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532100.294593:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3718
00010000:00010000:1.0:1651532100.294594:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.294595:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468132608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532100.294599:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532100.294600:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.294602:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.294603:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532100.294604:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.294608:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532100.294609:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.294612:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532100.294612:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.294616:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.294617:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.294620:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.294620:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.294727:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.294783:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468132736
00000100:00100000:0.0:1651532100.294795:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2085
00000100:00100000:0.0:1651532100.294797:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468132736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.294800:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.294815:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c4e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4479fe expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.294823:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c4e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479fe expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.294873:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c4e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4479fe expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.294877:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532100.294890:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468132736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 93us (164us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.294893:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2085
00000100:00100000:1.0:1651532100.294903:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.294926:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468132800
00000100:00100000:0.0:1651532100.294937:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2086
00000100:00100000:0.0:1651532100.294939:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045103c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468132800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.294942:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.294945:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c4e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a05 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.294952:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c4e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a05 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532100.294956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532100.294956:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c4e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a05 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.294960:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532100.294967:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.294969:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045103c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468132800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.294977:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2086
00000100:00100000:1.0:1651532100.295010:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468132992
00000100:00100000:0.0:1651532100.295012:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468133056
00000100:00100000:0.0:1651532100.295017:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2087
00000100:00100000:1.0:1651532100.295019:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2088
00000100:00100000:0.0:1651532100.295019:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468133056:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532100.295021:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468132992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.295021:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.295024:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.295025:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c4ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a13 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.295028:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c4f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a0c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.295032:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c4ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a13 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.295036:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c4f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a0c expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.295036:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c4ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a13 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.295039:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532100.295040:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c4f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a0c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.295044:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532100.295051:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468133056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.295054:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2087
00000100:00100000:1.0:1651532100.295060:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468132992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.295063:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2088
00000100:00100000:1.0:1651532100.295172:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.295180:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468133184
00000100:00100000:1.0:1651532100.295186:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2089
00000100:00100000:1.0:1651532100.295188:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468133184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.295191:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.295195:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c4fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a1a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.295214:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c4fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a1a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.295218:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c4fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a1a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.295221:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532100.295234:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468133184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.295237:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2089
00000100:00100000:1.0:1651532100.295300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.295318:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468133376
00000100:00100000:1.0:1651532100.295326:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2090
00000100:00100000:1.0:1651532100.295327:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468133376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.295330:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.295344:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c503 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a21 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.295353:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c503 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a21 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.295357:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c503 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a21 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.295360:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532100.295369:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.295378:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468133568
00000100:00100000:0.0:1651532100.295385:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2091
00000100:00100000:0.0:1651532100.295386:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468133568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.295390:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532100.295393:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468133376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (92us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532100.295393:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c50a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a28 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.295396:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2090
00010000:00010000:0.0:1651532100.295400:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c50a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a28 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.295415:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c50a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a28 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.295419:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532100.295430:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468133568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.295433:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2091
00000100:00100000:1.0:1651532100.295543:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.295554:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468133696
00000100:00100000:1.0:1651532100.295555:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.295568:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468133824
00000100:00100000:1.0:1651532100.295572:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2092
00000100:00100000:1.0:1651532100.295579:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468133696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532100.295580:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2093
00000100:00100000:0.0:1651532100.295582:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468133824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.295583:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.295585:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.295587:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c511 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a2f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.295589:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c518 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a36 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.295594:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c511 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a2f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.295596:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c518 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a36 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.295598:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c511 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a2f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.295600:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c518 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a36 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.295601:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532100.295603:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532100.295614:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468133696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.295617:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2092
00000100:00100000:0.0:1651532100.295619:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468133824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.295622:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2093
00000100:00100000:1.0:1651532100.295927:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.295938:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468134208
00000100:00100000:0.0:1651532100.295946:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2094
00000100:00100000:0.0:1651532100.295948:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468134208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.295951:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.295955:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c51f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a3d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.295962:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c51f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a3d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.295966:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c51f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a3d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.295969:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532100.295979:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468134208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.295981:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2094
00000001:00080000:1.0:1651532100.402095:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793513 is committed
00010000:00010000:0.0:1651532100.402125:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402130:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.402151:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468128704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565033us (565068us total) trans 158913793513 rc 0/0
00000100:00100000:0.0:1651532100.402154:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3709
00010000:00010000:0.0:1651532100.402162:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402173:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.402174:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402177:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402182:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.402183:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.402184:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402187:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402190:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.402191:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.402191:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402194:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402202:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402205:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c415 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2195456->3502079] (req 2195456->3502079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402218:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402221:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402243:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402246:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402510:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402515:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.402534:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468128768:12345-10.240.43.64@tcp:3:fio.0 Request processed in 565405us (565444us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532100.402538:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3710
00010000:00010000:0.0:1651532100.402545:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402548:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.402549:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402568:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402573:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402576:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c41c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->6991871] (req 905216->6991871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402585:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.402588:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.402605:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468129408:12345-10.240.43.64@tcp:3:fio.0 Request processed in 465158us (465232us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532100.402608:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3711
00010000:00010000:1.0:1651532100.402614:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.402619:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532100.402629:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.402635:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.402651:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.402652:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.402653:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.402656:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.402665:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.402668:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c431 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3899392->10338303] (req 3899392->10338303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.402674:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.402677:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.402930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.402970:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.402991:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.402997:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.403004:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.403015:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468134592
00000100:00100000:0.0:1651532100.403024:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468134528
00000100:00100000:0.0:1651532100.403032:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3719
00000100:00100000:0.0:1651532100.403034:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468134592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532100.403049:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.403053:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532100.403054:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532100.403055:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.403058:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.403066:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3720
00000100:00100000:1.0:1651532100.403068:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468134784
00000100:00100000:0.0:1651532100.403068:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468134528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532100.403072:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.403075:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532100.403076:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.403077:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468134848
00010000:00010000:0.0:1651532100.403078:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.403080:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468134912
00010000:00010000:0.0:1651532100.403081:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532100.403082:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.403083:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2095
00010000:00010000:0.0:1651532100.403086:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.403093:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468134784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.403097:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.403098:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.403101:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c534 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a44 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.403101:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.403108:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2096
00010000:00010000:1.0:1651532100.403109:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c534 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a44 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532100.403110:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468134848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.403113:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c534 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a44 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.403113:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.403115:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c53b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a4b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.403117:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532100.403122:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c53b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a4b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.403127:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c53b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a4b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.403130:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532100.403142:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468134784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (151us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.403142:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468134848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.403145:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2096
00000100:00100000:1.0:1651532100.403146:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2095
00000100:00100000:0.0:1651532100.403149:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2097
00000100:00100000:0.0:1651532100.403151:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468134912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.403162:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.403164:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c542 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a52 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.403170:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c542 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a52 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.403174:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c542 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a52 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.403177:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532100.403187:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468134912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (183us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.403190:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2097
00000001:00080000:1.0:1651532100.510470:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793514 is committed
00010000:00010000:1.0:1651532100.510486:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.510490:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.510508:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.510512:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468129344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 573063us (573113us total) trans 158913793514 rc 0/0
00010000:00010000:0.0:1651532100.510513:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.510514:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.510516:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3712
00010000:00010000:0.0:1651532100.510517:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.510523:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.510523:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.510524:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.510538:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.510546:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.510549:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c438 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->5984255] (req 933888->5984255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.510562:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.510578:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.510975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.510986:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.510997:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.510998:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468135232
00000100:00100000:0.0:1651532100.511012:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468135296
00000100:00100000:1.0:1651532100.511016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.511020:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3721
00000100:00100000:0.0:1651532100.511022:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468135232:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532100.511031:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532100.511034:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.511038:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532100.511039:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.511042:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532100.511043:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.511044:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3722
00000100:00100000:1.0:1651532100.511046:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468135296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532100.511047:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.511050:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511054:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511058:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.511060:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511063:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532100.511063:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511068:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511071:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.511072:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468135424
00000100:00100000:0.0:1651532100.511080:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468135488
00000100:00100000:0.0:1651532100.511083:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468135552
00000100:00100000:0.0:1651532100.511086:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2098
00000100:00100000:0.0:1651532100.511087:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468135424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.511090:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.511093:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c557 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a59 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511096:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511099:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.511102:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.511105:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c557 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a59 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.511109:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c557 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a59 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.511112:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532100.511119:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468130432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474110us (474157us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532100.511122:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3713
00000100:00100000:0.0:1651532100.511128:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468135424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (130us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532100.511129:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.511131:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2098
00010000:00010000:1.0:1651532100.511133:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532100.511134:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.511136:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2099
00010000:00010000:1.0:1651532100.511137:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.511138:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468135488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.511140:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.511141:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.511142:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.511142:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c55e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a60 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511143:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511146:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.511161:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c55e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a60 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.511164:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511168:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c462 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [966656->10252287] (req 966656->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.511170:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c55e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a60 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.511174:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532100.511177:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2100
00000100:00100000:1.0:1651532100.511179:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468135552:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532100.511180:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468135488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (164us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532100.511182:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532100.511183:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2099
00010000:00010000:1.0:1651532100.511185:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c565 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a67 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.511190:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511192:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c565 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a67 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.511193:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511196:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c565 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a67 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.511200:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532100.511207:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468135552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (176us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.511210:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2100
00000100:00100000:0.0:1651532100.511578:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.511593:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.511602:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468135680
00000100:00100000:1.0:1651532100.511611:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468135872
00000100:00100000:1.0:1651532100.511619:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2101
00000100:00100000:1.0:1651532100.511621:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468135680:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532100.511623:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2102
00000100:00100000:0.0:1651532100.511625:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468135872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.511629:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.511631:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.511633:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c56c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a75 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.511635:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c573 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a6e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.511641:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c56c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a75 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.511643:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c573 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a6e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.511647:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c573 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a6e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.511651:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532100.511654:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c56c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a75 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.511657:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532100.511661:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468135680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.511664:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2101
00000100:00100000:0.0:1651532100.511666:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468135872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.511669:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2102
00000100:00100000:0.0:1651532100.511915:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.511922:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468136000
00000100:00100000:0.0:1651532100.511934:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2103
00000100:00100000:0.0:1651532100.511935:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468136000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.511939:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.511942:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c57a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a7c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.511949:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c57a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a7c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.511953:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c57a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a7c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.511957:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532100.511968:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468136000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.511979:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2103
00000001:00080000:1.0:1651532100.618798:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793515 is committed
00002000:00010000:0.0:1651532100.618829:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532099 -> 1651532100
00010000:00010000:0.0:1651532100.618833:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.618837:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.618855:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468130368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 581806us (581885us total) trans 158913793515 rc 0/0
00000100:00100000:0.0:1651532100.618859:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3714
00010000:00010000:0.0:1651532100.618865:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.618869:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.618870:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.618873:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.618878:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.618878:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.618879:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.618882:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.618905:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.618908:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c469 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8417279] (req 1142784->8417279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.618918:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.618922:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.619315:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.619328:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.619335:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.619335:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468136192
00000100:00100000:1.0:1651532100.619345:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.619353:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468136256
00000100:00100000:1.0:1651532100.619357:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468136320
00000100:00100000:0.0:1651532100.619362:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3723
00000100:00100000:0.0:1651532100.619363:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468136192:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532100.619370:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468136384
00010000:00010000:0.0:1651532100.619370:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.619375:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532100.619376:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.619379:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532100.619379:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.619384:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2104
00010000:00010000:0.0:1651532100.619384:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.619386:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468136320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.619387:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.619390:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.619394:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c588 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a83 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.619395:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2105
00010000:00010000:1.0:1651532100.619402:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c588 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a83 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532100.619405:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468136384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.619407:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c588 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a83 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.619408:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.619410:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532100.619411:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c58f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a8a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.619418:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c58f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a8a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532100.619424:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468136320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.619427:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2104
00010000:00010000:0.0:1651532100.619429:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c58f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a8a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.619433:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532100.619435:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3724
00000100:00100000:1.0:1651532100.619437:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468136256:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532100.619442:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468136384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (97us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532100.619443:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.619445:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2105
00010000:00010000:1.0:1651532100.619447:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532100.619448:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.619451:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532100.619452:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.619464:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.619467:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532100.718890:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793516 is committed
00002000:00010000:1.0:1651532100.718904:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532099 -> 1651532100
00010000:00010000:1.0:1651532100.718907:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.718910:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.718933:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468131264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549249us (549314us total) trans 158913793516 rc 0/0
00010000:00010000:0.0:1651532100.718934:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.718937:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3715
00010000:00010000:0.0:1651532100.718939:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.718940:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.718944:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.718950:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.718950:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.718959:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.718962:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.718970:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.718974:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c48c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->10219519] (req 1744896->10219519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.718979:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.718982:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.719180:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.719184:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719198:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719203:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532100.719203:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468131328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 549497us (549571us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532100.719204:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.719207:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3716
00010000:00010000:1.0:1651532100.719208:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719223:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.719224:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.719225:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719229:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719251:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719255:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c493 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6152192->10334207] (req 6152192->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719262:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719264:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.719402:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.719430:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468136576
00000100:00100000:0.0:1651532100.719449:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2106
00000100:00100000:0.0:1651532100.719451:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468136576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.719454:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.719458:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c59d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a91 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.719466:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c59d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a91 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.719470:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c59d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a91 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.719473:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532100.719485:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468136576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.719487:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2106
00000100:00100000:0.0:1651532100.719549:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.719557:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.719567:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.719574:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468136832
00000100:00100000:0.0:1651532100.719603:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468136896
00000100:00100000:0.0:1651532100.719613:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3725
00000100:00100000:0.0:1651532100.719615:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468136832:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532100.719620:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3726
00010000:00010000:0.0:1651532100.719621:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.719623:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468136896:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532100.719626:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532100.719631:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.719634:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.719637:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532100.719638:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719642:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532100.719643:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719654:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532100.719655:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.719659:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719660:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719663:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.719663:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.719670:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468136960
00000100:00100000:0.0:1651532100.719678:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2107
00000100:00100000:0.0:1651532100.719679:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468136960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.719682:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532100.719683:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532100.719685:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a98 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.719698:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a98 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.719702:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a98 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.719705:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532100.719720:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468137024
00000100:00100000:0.0:1651532100.719732:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468136960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (165us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.719737:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2108
00000100:00100000:1.0:1651532100.719739:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468137024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.719742:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532100.719742:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2107
00010000:00010000:1.0:1651532100.719746:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c5b9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447a9f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.719754:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c5b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a9f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.719758:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c5b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447a9f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.719762:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532100.719771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.719772:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468137024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.719792:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2108
00000100:00100000:0.0:1651532100.719796:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468137152
00000100:00100000:0.0:1651532100.719820:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2109
00000100:00100000:0.0:1651532100.719822:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468137152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.719825:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.719829:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c5c0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447aa6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.719836:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c5c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447aa6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.719840:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c5c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447aa6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.719843:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532100.719853:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468137152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.719855:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2109
00000001:00080000:1.0:1651532100.827166:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793517 is committed
00010000:00010000:1.0:1651532100.827182:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.827186:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.827209:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468132544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532625us (532656us total) trans 158913793517 rc 0/0
00010000:00010000:0.0:1651532100.827209:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.827212:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3717
00010000:00010000:0.0:1651532100.827214:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.827215:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827228:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827234:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.827234:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.827235:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827238:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827241:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.827242:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.827242:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827245:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827253:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827256:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c4d2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->10416127] (req 2310144->10416127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827261:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827264:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827295:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827299:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.827630:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.827647:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468137472
00000100:00100000:0.0:1651532100.827660:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2110
00000100:00100000:0.0:1651532100.827661:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468137472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.827665:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.827668:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c5c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447aad expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827674:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.827676:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c5c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447aad expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.827680:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c5c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447aad expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.827684:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532100.827694:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468137472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.827697:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2110
00010000:00010000:0.0:1651532100.827707:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827720:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.827733:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468134592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424699us (424804us total) trans 0 rc 57344/57344
00000100:00100000:0.0:1651532100.827737:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3719
00010000:00010000:0.0:1651532100.827746:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827750:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.827766:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468132608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533170us (533201us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532100.827768:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3718
00010000:00010000:1.0:1651532100.827773:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827774:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.827778:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.827778:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532100.827779:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827779:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.827782:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827782:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827788:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.827791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.827791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532100.827792:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.827795:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.827798:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c4d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2912256->7589887] (req 2912256->7589887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.827828:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.827831:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c526 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [802816->8232959] (req 802816->8232959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.827842:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.827847:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.828284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.828297:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468137792
00000100:00100000:1.0:1651532100.828313:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.828324:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3727
00000100:00100000:1.0:1651532100.828325:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.828326:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468137792:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532100.828332:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532100.828334:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.828338:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532100.828338:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532100.828339:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.828342:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532100.828342:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.828344:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532100.828352:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.828354:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468137856
00010000:00010000:0.0:1651532100.828356:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.828366:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3728
00000100:00100000:0.0:1651532100.828367:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468137856:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532100.828369:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468137920
00000100:00100000:1.0:1651532100.828372:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468137984
00010000:00010000:0.0:1651532100.828372:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.828375:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468138112
00000100:00100000:1.0:1651532100.828377:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468138240
00000100:00100000:1.0:1651532100.828379:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2111
00000100:00100000:1.0:1651532100.828381:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468137920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.828384:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.828384:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532100.828385:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.828388:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532100.828388:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.828389:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c5dc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ab4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.828392:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.828395:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.828403:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2112
00010000:00010000:1.0:1651532100.828405:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c5dc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ab4 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532100.828405:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468137984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.828408:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.828409:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c5dc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ab4 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.828410:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c5e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447abb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.828413:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532100.828417:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c5e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447abb expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.828421:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c5e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447abb expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532100.828426:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468137920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.828430:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2111
00010000:00010000:0.0:1651532100.828431:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532100.828435:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2113
00000100:00100000:1.0:1651532100.828436:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468138112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.828439:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.828442:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c5ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ac2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.828446:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468137984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (114us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532100.828448:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c5ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ac2 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532100.828449:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2112
00010000:00010000:1.0:1651532100.828452:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c5ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ac2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.828455:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532100.828455:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2114
00000100:00100000:0.0:1651532100.828457:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468138240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.828459:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532100.828461:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468138112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (123us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532100.828462:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c5f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ac9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.828468:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c5f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ac9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532100.828471:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2113
00010000:00010000:0.0:1651532100.828472:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c5f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ac9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.828475:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532100.828480:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468138240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.828482:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2114
00000100:00100000:1.0:1651532100.828837:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.828848:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532100.828848:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468138368
00000100:00100000:1.0:1651532100.828856:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468138432
00000100:00100000:0.0:1651532100.828860:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2115
00000100:00100000:0.0:1651532100.828862:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468138368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.828865:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.828868:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c5f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ad0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.828869:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2116
00000100:00100000:1.0:1651532100.828870:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468138432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.828874:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.828878:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c5ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ad7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.828887:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c5ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ad7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.828888:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c5f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ad0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.828892:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c5f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ad0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.828894:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c5ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ad7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.828900:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532100.828917:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468138432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (68us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532100.828925:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532100.828935:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468138368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 72us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.828938:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2115
00000100:00100000:1.0:1651532100.828940:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2116
00000100:00100000:0.0:1651532100.828958:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.828965:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468138560
00000100:00100000:0.0:1651532100.828965:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.828975:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468138688
00000100:00100000:1.0:1651532100.828983:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2117
00000100:00100000:1.0:1651532100.828985:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468138560:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532100.828987:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2118
00010000:00010000:1.0:1651532100.828988:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532100.828989:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468138688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.828993:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.829002:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c60d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ade expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.829004:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c606 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ae5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.829010:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c60d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ade expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.829012:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c606 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ae5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.829014:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c60d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ade expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.829016:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c606 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ae5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.829017:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532100.829020:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532100.829026:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468138560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.829029:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2117
00000100:00100000:0.0:1651532100.829033:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468138688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.829035:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2118
00000001:00080000:1.0:1651532100.993832:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793518 is committed
00010000:00010000:1.0:1651532100.993847:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.993852:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.993876:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.993884:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468134528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 590815us (590913us total) trans 158913793518 rc 0/0
00010000:00010000:0.0:1651532100.993885:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532100.993886:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.993887:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3720
00010000:00010000:0.0:1651532100.993890:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.993896:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.993896:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532100.993897:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.993900:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.993908:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.993911:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c52d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->9539583] (req 1650688->9539583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.993916:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.993930:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.994352:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.994360:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.994367:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.994376:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.994383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.994399:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468139200
00000100:00100000:1.0:1651532100.994409:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468139264
00000100:00100000:1.0:1651532100.994415:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3729
00000100:00100000:1.0:1651532100.994417:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468139200:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532100.994423:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468139392
00010000:00010000:1.0:1651532100.994425:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.994429:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532100.994431:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.994434:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468139456
00000100:00100000:0.0:1651532100.994438:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468139584
00010000:00010000:1.0:1651532100.994440:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532100.994441:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.994441:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2119
00000100:00100000:0.0:1651532100.994443:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468139392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532100.994446:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.994447:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.994449:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.994451:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c61b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447aec expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.994457:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3730
00000100:00100000:1.0:1651532100.994458:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468139264:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532100.994459:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c61b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447aec expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.994463:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c61b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447aec expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.994464:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.994466:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532100.994467:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532100.994468:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.994479:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468139392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (112us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.994482:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2119
00010000:00010000:1.0:1651532100.994484:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532100.994485:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.994487:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2120
00010000:00010000:1.0:1651532100.994489:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532100.994489:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468139456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.994491:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.994492:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532100.994500:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2121
00000100:00100000:1.0:1651532100.994502:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468139584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.994502:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c629 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447af3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.994505:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.994509:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c629 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447af3 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.994512:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c629 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447af3 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.994520:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c630 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447afa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.994528:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c630 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447afa expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.994529:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532100.994532:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c630 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447afa expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.994536:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532100.994537:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468139456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (161us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.994540:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2120
00000100:00100000:1.0:1651532100.994545:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468139584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (161us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.994548:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2121
00000100:00100000:1.0:1651532100.994844:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.994852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532100.994858:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468139776
00000100:00100000:1.0:1651532100.994869:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468139840
00000100:00100000:0.0:1651532100.994879:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2122
00000100:00100000:1.0:1651532100.994881:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2123
00000100:00100000:0.0:1651532100.994881:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468139776:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532100.994883:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468139840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532100.994885:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532100.994887:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532100.994888:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c637 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b08 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532100.994891:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c63e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b01 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532100.994896:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c637 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b08 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.994899:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c63e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b01 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.994900:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c637 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b08 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532100.994903:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c63e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b01 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532100.994903:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532100.994906:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532100.994914:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468139840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532100.994914:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468139776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532100.994917:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2123
00000100:00100000:0.0:1651532100.994926:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2122
00000001:00080000:1.0:1651532101.093834:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793519 is committed
00010000:00010000:0.0:1651532101.093864:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.093868:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.093890:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468135232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582866us (582915us total) trans 158913793519 rc 0/0
00000100:00100000:0.0:1651532101.093893:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3721
00010000:00010000:0.0:1651532101.093900:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.093903:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532101.093904:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.093907:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.093912:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.093913:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.093914:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.093917:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.093935:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.093938:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c549 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->8671231] (req 204800->8671231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.093951:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.093956:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094161:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094174:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.094195:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468135296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 583148us (583208us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532101.094198:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3722
00010000:00010000:1.0:1651532101.094207:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094212:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532101.094213:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094218:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094244:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.094245:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.094246:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094252:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.094256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532101.094264:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094267:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c550 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1970176->8601599] (req 1970176->8601599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.094282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532101.094289:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.094293:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.094312:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468140288
00000100:00100000:1.0:1651532101.094322:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468140352
00000100:00100000:0.0:1651532101.094331:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2124
00000100:00100000:0.0:1651532101.094333:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468140288:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532101.094336:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2125
00000100:00100000:1.0:1651532101.094337:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468140352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.094337:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.094340:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c645 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b0f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094341:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.094345:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c64c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b16 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.094347:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c645 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b0f expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.094352:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c645 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b0f expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.094353:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c64c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b16 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.094357:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c64c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b16 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.094360:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532101.094366:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532101.094369:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468140352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.094371:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2125
00000100:00100000:0.0:1651532101.094374:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468140288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.094376:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2124
00000100:00100000:0.0:1651532101.094479:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.094490:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.094508:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468140416
00000100:00100000:0.0:1651532101.094513:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.094522:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468140480
00000100:00100000:0.0:1651532101.094527:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.094529:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3731
00000100:00100000:1.0:1651532101.094539:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468140416:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532101.094539:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3732
00000100:00100000:0.0:1651532101.094541:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468140480:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532101.094549:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.094571:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.094576:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532101.094577:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532101.094578:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.094581:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094583:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532101.094584:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094587:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094590:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532101.094591:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094596:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094598:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.094599:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468140544
00010000:00010000:1.0:1651532101.094601:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.094608:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468140608
00000100:00100000:0.0:1651532101.094612:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2126
00000100:00100000:0.0:1651532101.094614:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468140544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.094616:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532101.094619:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2127
00000100:00100000:1.0:1651532101.094621:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468140608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.094624:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.094627:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c661 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b1d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094628:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c668 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b24 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.094635:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c661 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b1d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.094636:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c668 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b24 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.094639:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c661 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b1d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.094641:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c668 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b24 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.094642:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532101.094644:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532101.094653:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468140608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.094653:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468140544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (140us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.094656:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2126
00000100:00100000:1.0:1651532101.094657:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2127
00000100:00100000:0.0:1651532101.094782:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.094829:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468140928
00000100:00100000:1.0:1651532101.094837:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2128
00000100:00100000:1.0:1651532101.094839:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468140928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.094842:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.094846:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c66f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b2b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.094853:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c66f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b2b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.094857:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c66f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b2b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.094860:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532101.094871:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468140928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.094873:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2128
00000001:00080000:1.0:1651532101.210499:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793520 is committed
00010000:00010000:0.0:1651532101.210528:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210533:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.210550:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468136192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 591186us (591246us total) trans 158913793520 rc 0/0
00000100:00100000:0.0:1651532101.210553:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3723
00010000:00010000:0.0:1651532101.210560:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210563:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532101.210565:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210576:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210582:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.210582:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.210583:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210586:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210598:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210601:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c581 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9601023] (req 2015232->9601023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.210609:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.210614:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.210863:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.210867:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210878:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210883:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532101.210884:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.210886:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468136256:12345-10.240.43.64@tcp:3:fio.0 Request processed in 591449us (591558us total) trans 0 rc 24576/24576
00010000:00010000:0.0:1651532101.210887:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.210890:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3724
00010000:00010000:0.0:1651532101.210892:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.210900:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.210901:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210904:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210912:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210915:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40c596 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9232383] (req 1282048->9232383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210920:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.210923:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.211096:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.211107:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.211113:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.211120:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468141248
00000100:00100000:1.0:1651532101.211132:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468141312
00000100:00100000:1.0:1651532101.211135:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468141440
00000100:00100000:1.0:1651532101.211138:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2129
00000100:00100000:1.0:1651532101.211139:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468141248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.211143:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.211147:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c676 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b32 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.211159:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c676 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b32 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.211173:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c676 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b32 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.211179:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532101.211184:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2130
00000100:00100000:0.0:1651532101.211186:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468141312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.211190:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.211194:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c67d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b39 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.211202:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c67d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b39 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532101.211203:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468141248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.211206:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2129
00010000:00010000:0.0:1651532101.211206:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c67d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b39 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532101.211212:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2131
00000100:00100000:1.0:1651532101.211213:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468141440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.211217:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.211218:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532101.211220:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c684 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b40 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.211228:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468141312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (121us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532101.211239:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c684 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b40 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.211244:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c684 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b40 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532101.211244:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2130
00010000:00010000:1.0:1651532101.211247:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532101.211254:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468141440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (140us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.211256:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2131
00000100:00100000:0.0:1651532101.211261:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.211291:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.211292:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468141504
00000100:00100000:0.0:1651532101.211300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.211320:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468141568
00000100:00100000:1.0:1651532101.211326:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3733
00000100:00100000:1.0:1651532101.211328:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468141504:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532101.211339:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3734
00010000:00010000:1.0:1651532101.211340:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.211341:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468141568:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532101.211344:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532101.211345:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.211348:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532101.211348:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.211349:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.211353:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532101.211354:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.211357:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532101.211358:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.211361:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.211362:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.211365:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.211365:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.211373:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468141632
00000100:00100000:1.0:1651532101.211380:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2132
00000100:00100000:1.0:1651532101.211381:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468141632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.211384:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.211386:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c699 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b47 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.211393:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c699 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b47 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.211408:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c699 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b47 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.211412:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532101.211420:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468141632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.211422:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2132
00000100:00100000:0.0:1651532101.211818:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.211829:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468142016
00000100:00100000:1.0:1651532101.211838:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2133
00000100:00100000:1.0:1651532101.211839:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007e79f8b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468142016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.211843:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.211846:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c6a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b4e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.211854:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c6a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b4e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.211858:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c6a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b4e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.211861:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532101.211871:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007e79f8b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468142016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.211873:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2133
00000001:00080000:1.0:1651532101.310502:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793521 is committed
00010000:00010000:0.0:1651532101.310533:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310537:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.310559:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.310559:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468136832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 590943us (591010us total) trans 158913793521 rc 0/0
00000100:00100000:0.0:1651532101.310562:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3725
00010000:00010000:1.0:1651532101.310564:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532101.310565:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.310568:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.310574:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.310574:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.310575:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.310578:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.310588:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.310593:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c5a4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9383935] (req 1449984->9383935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310594:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310598:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310764:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310768:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.310787:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468136896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 591164us (591230us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532101.310791:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3726
00010000:00010000:0.0:1651532101.310797:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310819:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532101.310820:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310824:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310834:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.310835:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.310836:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310855:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310863:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310865:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c5ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->6078463] (req 1114112->6078463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310881:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.310885:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.310932:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.310967:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.310968:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468142144
00000100:00100000:1.0:1651532101.310983:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468142208
00000100:00100000:1.0:1651532101.310994:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2134
00000100:00100000:1.0:1651532101.310997:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468142144:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532101.311014:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2135
00010000:00010000:1.0:1651532101.311017:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532101.311017:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468142208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.311021:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c6a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b55 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.311021:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.311025:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6ae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b5c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.311032:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c6a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b55 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.311033:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b5c expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.311037:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b5c expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.311039:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c6a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b55 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.311045:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532101.311056:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468142144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (124us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.311059:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2134
00010000:00010000:0.0:1651532101.311080:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532101.311089:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468142208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 72us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.311092:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2135
00000100:00100000:1.0:1651532101.311093:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.311134:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.311142:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468142336
00000100:00100000:0.0:1651532101.311151:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468142272
00000100:00100000:0.0:1651532101.311160:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3735
00000100:00100000:0.0:1651532101.311161:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468142336:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532101.311168:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.311172:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532101.311173:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532101.311182:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.311185:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.311188:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3736
00000100:00100000:1.0:1651532101.311190:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468142272:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532101.311199:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.311203:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532101.311204:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.311207:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.311221:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532101.311222:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.311227:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.311229:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.311233:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.311444:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.311452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.311465:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468142464
00000100:00100000:1.0:1651532101.311470:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468142528
00000100:00100000:0.0:1651532101.311476:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2136
00000100:00100000:0.0:1651532101.311478:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468142464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.311481:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532101.311485:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2137
00010000:00010000:0.0:1651532101.311485:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c6c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b63 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.311486:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468142528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.311490:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.311493:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c6c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b63 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.311494:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c6ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b6a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.311497:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c6c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b63 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.311500:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532101.311501:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c6ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b6a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.311505:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c6ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b6a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532101.311513:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468142464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.311516:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2136
00010000:00010000:1.0:1651532101.311523:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532101.311533:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468142528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.311536:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2137
00000001:00080000:1.0:1651532101.490654:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793522 is committed
00010000:00010000:0.0:1651532101.490685:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490700:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.490718:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468137792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 662391us (662434us total) trans 158913793522 rc 0/0
00000100:00100000:0.0:1651532101.490721:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3727
00010000:00010000:0.0:1651532101.490728:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490732:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532101.490733:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490736:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490741:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.490742:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.490742:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490746:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490752:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490755:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c5ce lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->8904703] (req 954368->8904703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490768:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490771:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490981:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.490986:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.491006:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468137856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 662638us (662681us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532101.491009:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3728
00010000:00010000:1.0:1651532101.491012:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.491017:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532101.491018:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.491021:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.491027:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.491028:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.491028:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.491032:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.491040:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.491043:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c5d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4116480->10485759] (req 4116480->10485759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.491056:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.491060:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.491151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.491166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.491178:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468142912
00000100:00100000:1.0:1651532101.491187:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468142976
00000100:00100000:1.0:1651532101.491195:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2138
00000100:00100000:1.0:1651532101.491197:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468142912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532101.491199:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2139
00010000:00010000:1.0:1651532101.491201:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532101.491201:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468142976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.491205:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.491206:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c6d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b71 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491209:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c6d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b78 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.491219:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c6d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b71 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.491219:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c6d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b78 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.491226:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c6d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b71 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.491232:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532101.491244:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468142912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.491247:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2138
00010000:00010000:0.0:1651532101.491254:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c6d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b78 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.491258:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532101.491267:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468142976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.491270:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2139
00000100:00100000:0.0:1651532101.491332:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.491341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.491348:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468143104
00000100:00100000:0.0:1651532101.491357:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468143168
00000100:00100000:0.0:1651532101.491362:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3737
00000100:00100000:0.0:1651532101.491364:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468143104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532101.491398:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491404:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532101.491405:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491407:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532101.491408:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491413:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491427:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.491436:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3738
00000100:00100000:0.0:1651532101.491438:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468143168:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532101.491444:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491447:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532101.491448:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491451:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532101.491451:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491455:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491457:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.491472:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.491479:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468143232
00000100:00100000:0.0:1651532101.491489:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2140
00000100:00100000:0.0:1651532101.491491:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468143232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.491502:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.491505:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c6ed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b7f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491513:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c6ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b7f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.491517:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c6ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b7f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.491520:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532101.491543:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468143232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.491546:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2140
00000100:00100000:0.0:1651532101.491574:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.491581:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468143360
00000100:00100000:0.0:1651532101.491590:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2141
00000100:00100000:0.0:1651532101.491592:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468143360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.491595:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.491598:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c6f4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b86 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491605:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c6f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b86 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.491609:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c6f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b86 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.491620:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532101.491630:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468143360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.491633:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2141
00000100:00100000:1.0:1651532101.491853:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.491864:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468143552
00000100:00100000:0.0:1651532101.491875:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2142
00000100:00100000:0.0:1651532101.491877:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468143552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.491880:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.491884:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c6fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b8d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.491891:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c6fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b8d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.491895:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c6fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b8d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.491898:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532101.491908:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468143552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.491911:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2142
00000001:00080000:1.0:1651532101.552205:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793523 is committed
00010000:00010000:1.0:1651532101.552228:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552232:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.552255:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468139200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557837us (557903us total) trans 158913793523 rc 0/0
00010000:00010000:0.0:1651532101.552255:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.552258:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3729
00010000:00010000:0.0:1651532101.552260:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532101.552261:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552264:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552270:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.552270:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.552271:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552274:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552277:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.552278:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.552279:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552281:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552291:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552294:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c614 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->10420223] (req 262144->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552325:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552329:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552358:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552363:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.552727:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.552738:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.552739:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468143808
00000100:00100000:1.0:1651532101.552745:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.552755:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468143936
00000100:00100000:0.0:1651532101.552758:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468144000
00000100:00100000:0.0:1651532101.552762:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2143
00000100:00100000:0.0:1651532101.552764:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468143808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.552767:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532101.552768:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2144
00000100:00100000:1.0:1651532101.552771:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468143936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.552775:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.552778:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c702 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b94 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552779:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c709 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447b9b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552783:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.552786:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c702 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b94 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.552790:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c702 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b94 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.552793:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532101.552794:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.552797:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c709 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b9b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.552802:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c709 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447b9b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.552819:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532101.552821:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468143808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (94us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.552824:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2143
00000100:00100000:1.0:1651532101.552828:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468143936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.552830:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2145
00000100:00100000:1.0:1651532101.552831:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2144
00000100:00100000:0.0:1651532101.552831:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468144000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.552834:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.552837:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c710 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ba2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552842:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.552844:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c710 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ba2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.552845:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552848:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552858:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c710 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ba2 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532101.552859:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468139264:12345-10.240.43.64@tcp:3:fio.0 Request processed in 558400us (558499us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532101.552861:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532101.552862:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3730
00010000:00010000:1.0:1651532101.552867:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.552868:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468144000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (124us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532101.552871:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532101.552871:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2145
00010000:00010000:1.0:1651532101.552872:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552878:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552883:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552886:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c622 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->9531391] (req 1118208->9531391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552894:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.552897:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552918:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552922:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532101.552924:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552927:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552932:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.552932:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.552933:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552936:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552946:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552958:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c65a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->9904127] (req 368640->9904127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.552962:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468140480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458420us (458472us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532101.552966:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3732
00010000:00010000:0.0:1651532101.552967:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.552969:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.553330:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.553341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.553363:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.553365:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468144128
00000100:00100000:0.0:1651532101.553371:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.553376:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468144192
00000100:00100000:0.0:1651532101.553378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.553389:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3739
00000100:00100000:1.0:1651532101.553391:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468144128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532101.553398:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553403:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532101.553404:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553407:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532101.553408:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553412:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553416:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.553423:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3740
00000100:00100000:1.0:1651532101.553425:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468144192:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532101.553429:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553432:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532101.553433:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553436:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532101.553436:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553440:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553443:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.553446:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468144256
00000100:00100000:0.0:1651532101.553457:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468144384
00000100:00100000:0.0:1651532101.553460:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468144448
00000100:00100000:0.0:1651532101.553463:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2146
00000100:00100000:0.0:1651532101.553465:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468144256:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532101.553466:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2147
00000100:00100000:1.0:1651532101.553468:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468144384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.553469:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.553470:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.553472:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c725 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ba9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553473:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c72c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447bb0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.553480:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c725 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ba9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.553482:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c72c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bb0 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.553484:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c725 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ba9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.553486:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c72c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bb0 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.553489:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532101.553496:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532101.553500:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468144384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.553502:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2147
00000100:00100000:0.0:1651532101.553505:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468144256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (148us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.553508:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2148
00000100:00100000:1.0:1651532101.553509:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468144448:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532101.553510:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2146
00010000:00010000:1.0:1651532101.553512:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.553514:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c733 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447bb7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553533:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c733 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bb7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.553547:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c733 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bb7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.553551:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532101.553558:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468144448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (180us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.553561:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2148
00000100:00100000:0.0:1651532101.553947:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.553962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.553967:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468144896
00000100:00100000:0.0:1651532101.553969:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468145024
00000100:00100000:1.0:1651532101.553980:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2149
00000100:00100000:1.0:1651532101.553982:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468144896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.553985:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532101.553985:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2150
00000100:00100000:0.0:1651532101.553986:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468145024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.553989:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c73a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447bbe expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.553990:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.553994:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c741 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447bc5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.553996:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c73a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bbe expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.554001:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c73a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bbe expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.554001:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c741 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bc5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.554005:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532101.554005:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c741 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bc5 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.554009:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532101.554015:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468144896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.554017:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468145024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.554018:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2149
00000100:00100000:0.0:1651532101.554028:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2150
00000100:00100000:0.0:1651532101.554282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.554289:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468145216
00000100:00100000:0.0:1651532101.554314:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2151
00000100:00100000:0.0:1651532101.554316:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468145216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.554319:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.554322:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c748 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447bcc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.554329:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c748 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bcc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.554333:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c748 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bcc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.554336:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532101.554352:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468145216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.554355:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2151
00000001:00080000:1.0:1651532101.660524:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793524 is committed
00002000:00010000:0.0:1651532101.660553:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532100 -> 1651532101
00002000:00010000:0.0:1651532101.660555:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532100 -> 1651532101
00010000:00010000:0.0:1651532101.660557:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.660561:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.660577:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468140416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566045us (566098us total) trans 158913793524 rc 0/0
00000100:00100000:0.0:1651532101.660580:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3731
00010000:00010000:0.0:1651532101.660595:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.660599:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532101.660600:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.660603:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.660608:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.660608:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.660609:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.660612:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.660624:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.660627:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c653 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->7405567] (req 24576->7405567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.660635:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.660640:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.661042:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.661058:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.661060:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468145408
00000100:00100000:1.0:1651532101.661069:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.661084:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468145472
00000100:00100000:1.0:1651532101.661088:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3741
00000100:00100000:1.0:1651532101.661091:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468145408:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532101.661096:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3742
00000100:00100000:0.0:1651532101.661098:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468145472:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532101.661105:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.661105:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.661109:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532101.661111:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.661113:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532101.661114:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.661118:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532101.661120:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.661122:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532101.661123:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.661127:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.661127:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.661130:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.661131:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.661139:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468145600
00000100:00100000:0.0:1651532101.661145:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2152
00000100:00100000:0.0:1651532101.661147:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468145600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.661150:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.661152:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c75d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447bd3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.661159:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c75d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bd3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.661163:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c75d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bd3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.661176:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532101.661187:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468145600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.661190:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2152
00000100:00100000:1.0:1651532101.661466:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.661483:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468145856
00000100:00100000:0.0:1651532101.661494:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2153
00000100:00100000:0.0:1651532101.661496:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468145856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.661499:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.661503:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c764 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447bda expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.661510:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c764 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bda expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.661514:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c764 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bda expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.661517:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532101.661527:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468145856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.661530:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2153
00000001:00080000:1.0:1651532101.793862:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793525 is committed
00010000:00010000:1.0:1651532101.793877:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.793881:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.793897:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468141504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582569us (582636us total) trans 158913793525 rc 0/0
00000100:00100000:1.0:1651532101.793901:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3733
00010000:00010000:1.0:1651532101.793907:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.793910:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532101.793912:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.793914:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.793919:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.793920:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.793921:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.793924:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.793936:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.793936:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.793937:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.793940:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.793952:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.793955:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c68b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->5353471] (req 827392->5353471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.793964:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.793969:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.794001:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.794005:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794161:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794166:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.794181:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468141568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 582840us (582890us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532101.794184:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3734
00010000:00010000:0.0:1651532101.794191:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794195:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532101.794196:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794198:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794204:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794207:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c692 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1236992->10424319] (req 1236992->10424319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.794243:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.794247:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794267:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.794271:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468142336:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483109us (483178us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532101.794283:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3735
00010000:00010000:0.0:1651532101.794285:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532101.794286:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794289:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794294:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.794294:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532101.794295:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794328:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794339:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794342:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c6b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8740863] (req 479232->8740863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.794352:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532101.794362:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.794366:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.794380:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468146048
00000100:00100000:0.0:1651532101.794390:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2154
00000100:00100000:0.0:1651532101.794392:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468146048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.794396:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.794399:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c76b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447be8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794422:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c76b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447be8 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.794427:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c76b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447be8 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532101.794429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532101.794430:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532101.794438:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468146048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.794441:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2154
00000100:00100000:0.0:1651532101.794446:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468145984
00000100:00100000:0.0:1651532101.794452:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2155
00000100:00100000:0.0:1651532101.794454:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468145984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.794456:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.794459:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c772 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447be1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794465:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c772 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447be1 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.794483:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c772 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447be1 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.794486:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532101.794493:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468145984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.794504:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.794504:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2155
00000100:00100000:0.0:1651532101.794541:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.794545:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468146112
00000100:00100000:0.0:1651532101.794549:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468146176
00000100:00100000:1.0:1651532101.794558:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3743
00000100:00100000:1.0:1651532101.794566:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468146112:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532101.794566:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3744
00000100:00100000:0.0:1651532101.794568:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468146176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532101.794573:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794575:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.794578:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532101.794579:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532101.794580:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794584:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532101.794585:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532101.794586:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794589:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.794590:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.794689:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.794698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.794705:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468146368
00000100:00100000:0.0:1651532101.794711:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468146432
00000100:00100000:0.0:1651532101.794718:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2156
00000100:00100000:0.0:1651532101.794719:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468146368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.794723:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.794726:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c787 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447bef expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.794733:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c787 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bef expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.794745:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c787 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bef expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.794749:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532101.794755:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2157
00000100:00100000:1.0:1651532101.794757:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468146432:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532101.794759:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468146368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (71us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532101.794761:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532101.794762:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2156
00010000:00010000:1.0:1651532101.794773:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c78e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447bf6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.794782:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c78e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bf6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.794789:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c78e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bf6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.794795:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532101.794848:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468146432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 90us (149us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.794852:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2157
00000100:00100000:1.0:1651532101.794973:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.794983:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.794989:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468146560
00000100:00100000:1.0:1651532101.794999:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468146752
00000100:00100000:1.0:1651532101.795007:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2158
00000100:00100000:1.0:1651532101.795008:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468146560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.795012:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532101.795012:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2159
00000100:00100000:0.0:1651532101.795014:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468146752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.795016:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c795 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447bfd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.795018:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532101.795022:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c79c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c04 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.795023:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c795 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bfd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.795028:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c795 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447bfd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.795029:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c79c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c04 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.795033:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c79c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c04 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532101.795036:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532101.795039:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532101.795046:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468146752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.795048:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468146560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532101.795049:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2159
00000100:00100000:1.0:1651532101.795051:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2158
00000100:00100000:1.0:1651532101.795314:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.795323:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468147008
00000100:00100000:1.0:1651532101.795333:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2160
00000100:00100000:1.0:1651532101.795335:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468147008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.795338:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.795342:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c7a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c0b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.795349:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c7a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c0b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.795353:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c7a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c0b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.795356:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532101.795368:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468147008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.795371:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2160
00000100:00100000:1.0:1651532101.795574:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.795581:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468147264
00000100:00100000:1.0:1651532101.795592:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2161
00000100:00100000:1.0:1651532101.795601:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468147264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.795604:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.795608:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7aa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c12 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.795615:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c12 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.795619:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c12 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.795623:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532101.795634:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468147264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.795637:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2161
00000001:00080000:1.0:1651532101.952165:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793526 is committed
00010000:00010000:1.0:1651532101.952179:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952183:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.952200:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468142272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 641009us (641066us total) trans 158913793526 rc 0/0
00000100:00100000:1.0:1651532101.952203:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3736
00010000:00010000:1.0:1651532101.952209:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952224:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532101.952225:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952228:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952233:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.952234:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532101.952235:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952238:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952250:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952253:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c6bc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->5652479] (req 536576->5652479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.952263:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.952275:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532101.952614:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.952625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532101.952634:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.952652:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468147456
00000100:00100000:0.0:1651532101.952656:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468147392
00000100:00100000:1.0:1651532101.952665:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3745
00000100:00100000:0.0:1651532101.952671:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3746
00000100:00100000:1.0:1651532101.952673:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468147456:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532101.952673:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468147392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532101.952680:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.952681:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.952686:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532101.952687:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.952690:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.952692:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.952695:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532101.952695:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952700:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532101.952701:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952705:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532101.952706:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.952711:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952713:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952719:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.952730:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468147520
00010000:00010000:0.0:1651532101.952737:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532101.952741:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532101.952747:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2162
00000100:00100000:1.0:1651532101.952749:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468147520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532101.952750:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952752:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.952755:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c7bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c19 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952762:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c7bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c19 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.952766:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c7bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c19 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.952780:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532101.952795:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468147520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (161us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.952798:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2162
00000100:00100000:0.0:1651532101.952823:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532101.952867:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468147648
00000100:00100000:1.0:1651532101.952878:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2163
00000100:00100000:1.0:1651532101.952880:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468147648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532101.952883:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532101.952887:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c7c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c20 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532101.952894:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c7c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c20 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.952898:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c7c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c20 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532101.952901:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532101.952911:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468147648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532101.952914:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2163
00000001:00080000:1.0:1651532102.060503:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793527 is committed
00010000:00010000:0.0:1651532102.060538:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060543:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.060561:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468143104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 569196us (569229us total) trans 158913793527 rc 0/0
00000100:00100000:0.0:1651532102.060564:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3737
00010000:00010000:0.0:1651532102.060571:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060575:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.060576:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060590:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060595:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.060595:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.060596:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060599:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060606:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060610:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c6df lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->5840895] (req 1961984->5840895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060615:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060618:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060827:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060832:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.060863:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468143168:12345-10.240.43.64@tcp:3:fio.0 Request processed in 569425us (569521us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532102.060866:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3738
00010000:00010000:0.0:1651532102.060874:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060877:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.060878:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060881:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060886:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.060886:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.060887:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060890:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060899:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.060902:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c6e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->4091903] (req 593920->4091903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.060916:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.060932:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.061163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.061174:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468148032
00000100:00100000:1.0:1651532102.061175:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.061184:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.061198:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468148096
00000100:00100000:0.0:1651532102.061222:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3747
00000100:00100000:0.0:1651532102.061224:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468148032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532102.061232:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.061236:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532102.061237:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.061240:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532102.061241:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.061245:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.061248:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.061256:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3748
00000100:00100000:0.0:1651532102.061258:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468148096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532102.061262:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.061265:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532102.061266:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.061273:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468148160
00010000:00010000:0.0:1651532102.061279:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532102.061279:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.061285:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2164
00000100:00100000:1.0:1651532102.061287:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468148160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.061289:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.061291:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.061292:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.061295:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c7db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c27 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.061302:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c7db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c27 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.061317:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c7db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c27 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532102.061319:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532102.061321:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532102.061327:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468148224
00000100:00100000:1.0:1651532102.061333:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468148160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (148us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.061337:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2165
00000100:00100000:0.0:1651532102.061339:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468148224:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532102.061342:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2164
00010000:00010000:0.0:1651532102.061342:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.061346:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c7e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c2e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.061353:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c7e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c2e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.061358:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c7e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c2e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.061361:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532102.061369:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468148224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.061380:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2165
00000100:00100000:0.0:1651532102.061597:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.061604:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468148352
00000100:00100000:0.0:1651532102.061617:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2166
00000100:00100000:0.0:1651532102.061619:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468148352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.061622:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.061626:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c7e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c35 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.061633:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c7e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c35 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.061637:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c7e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c35 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.061641:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532102.061653:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468148352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.061655:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2166
00000001:00080000:1.0:1651532102.152204:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793528 is committed
00010000:00010000:1.0:1651532102.152220:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.152232:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.152255:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468144128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 598863us (598925us total) trans 158913793528 rc 0/0
00000100:00100000:1.0:1651532102.152258:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3739
00010000:00010000:1.0:1651532102.152266:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.152269:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532102.152271:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.152274:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.152279:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.152280:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.152281:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.152286:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.152321:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.152325:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c717 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [663552->8228863] (req 663552->8228863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.152339:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.152342:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.152573:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.152590:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468148608
00000100:00100000:0.0:1651532102.152601:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2167
00000100:00100000:0.0:1651532102.152603:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468148608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.152606:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.152607:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.152610:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c7f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c3c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.152611:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.152635:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468144192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 599209us (599294us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532102.152639:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3740
00010000:00010000:0.0:1651532102.152643:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.152646:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c7f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c3c expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.152650:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c7f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c3c expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.152654:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532102.152662:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468148608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.152665:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2167
00000100:00100000:1.0:1651532102.152669:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532102.152673:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.152683:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.152684:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.152687:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.152692:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.152693:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.152694:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.152697:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.152714:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.152717:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c71e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->9179135] (req 643072->9179135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.152725:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468148736
00010000:00010000:1.0:1651532102.152734:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.152734:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2168
00000100:00100000:0.0:1651532102.152735:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468148736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.152738:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.152739:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.152741:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c7f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c43 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.152748:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c7f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c43 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.152752:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c7f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c43 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.152755:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532102.152763:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468148736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.152765:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2168
00000100:00100000:1.0:1651532102.153076:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.153094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.153101:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.153111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.153112:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468148928
00000100:00100000:0.0:1651532102.153122:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468149056
00000100:00100000:1.0:1651532102.153124:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468148800
00000100:00100000:0.0:1651532102.153127:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2169
00000100:00100000:0.0:1651532102.153137:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468148928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.153140:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532102.153143:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3749
00010000:00010000:0.0:1651532102.153144:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c7fe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c4a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.153145:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468148800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532102.153151:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c7fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c4a expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.153155:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c7fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c4a expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.153158:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.153159:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532102.153163:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532102.153164:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.153169:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532102.153170:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.153177:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.153181:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.153187:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468148928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.153190:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2169
00000100:00100000:1.0:1651532102.153195:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468148864
00000100:00100000:0.0:1651532102.153195:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2170
00000100:00100000:0.0:1651532102.153197:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468149056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.153200:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.153202:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c80c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c51 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.153204:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3750
00000100:00100000:1.0:1651532102.153206:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468148864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532102.153209:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c80c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c51 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.153211:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.153213:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c80c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c51 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.153215:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532102.153216:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.153229:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532102.153230:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.153230:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532102.153234:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.153238:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.153238:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468149056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.153240:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2170
00000100:00100000:0.0:1651532102.153262:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.153289:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468149184
00000100:00100000:0.0:1651532102.153300:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2171
00000100:00100000:0.0:1651532102.153301:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468149184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.153313:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.153316:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c81a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c58 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.153324:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c81a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c58 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.153327:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c81a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c58 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.153331:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532102.153340:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468149184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.153343:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2171
00000100:00100000:0.0:1651532102.153599:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.153619:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468149312
00000100:00100000:1.0:1651532102.153634:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2172
00000100:00100000:1.0:1651532102.153636:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468149312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.153640:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.153644:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c821 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c5f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.153652:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c821 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c5f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.153657:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c821 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c5f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.153660:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532102.153671:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468149312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.153684:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2172
00000001:00080000:1.0:1651532102.243960:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793529 is committed
00010000:00010000:1.0:1651532102.243976:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.243980:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.244001:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468145408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582910us (582960us total) trans 158913793529 rc 0/0
00010000:00010000:0.0:1651532102.244003:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.244005:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3741
00010000:00010000:0.0:1651532102.244018:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.244019:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244022:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244027:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.244028:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.244029:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244032:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244036:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.244036:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.244037:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244039:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244042:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.244043:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.244043:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244046:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244062:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244066:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c74f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9682943] (req 94208->9682943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244071:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244074:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.244075:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.244079:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244099:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244102:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.244534:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.244541:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.244555:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.244577:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468149760
00000100:00100000:0.0:1651532102.244588:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468149824
00000100:00100000:0.0:1651532102.244591:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468149952
00000100:00100000:0.0:1651532102.244594:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2173
00000100:00100000:0.0:1651532102.244596:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468149760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.244599:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.244603:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c828 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c66 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244621:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c828 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c66 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.244625:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c828 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c66 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.244628:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532102.244635:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2174
00000100:00100000:1.0:1651532102.244637:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468149824:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532102.244641:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468149760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.244644:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2173
00010000:00010000:1.0:1651532102.244647:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532102.244649:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2175
00010000:00010000:1.0:1651532102.244651:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c82f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c6d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.244651:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468149952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.244654:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.244657:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c836 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c74 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.244660:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c82f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c6d expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.244663:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c836 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c74 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.244667:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c836 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c74 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.244670:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532102.244673:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c82f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c6d expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532102.244675:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468149952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (120us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532102.244677:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532102.244685:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2175
00000100:00100000:1.0:1651532102.244697:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468149824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (155us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532102.244697:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.244701:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2174
00010000:00010000:0.0:1651532102.244701:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.244716:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468145472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 583618us (583658us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532102.244718:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.244719:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3742
00010000:00010000:1.0:1651532102.244722:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532102.244723:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.244726:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244728:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.244731:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.244737:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.244740:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40c756 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->10248191] (req 4202496->10248191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.244741:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468146176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 450173us (450201us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532102.244744:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.244744:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3744
00010000:00010000:1.0:1651532102.244755:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532102.244756:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.244759:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.244763:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.244765:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40c780 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->10420223] (req 4284416->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.245164:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.245188:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468150208
00000100:00100000:0.0:1651532102.245200:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3751
00000100:00100000:0.0:1651532102.245201:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468150208:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532102.245208:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.245209:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.245224:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532102.245226:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532102.245235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532102.245237:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532102.245238:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.245242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532102.245242:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.245249:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468150400
00000100:00100000:0.0:1651532102.245249:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468150144
00000100:00100000:1.0:1651532102.245264:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468150464
00000100:00100000:0.0:1651532102.245266:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3752
00000100:00100000:1.0:1651532102.245267:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468150592
00000100:00100000:0.0:1651532102.245268:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468150144:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532102.245271:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2176
00000100:00100000:1.0:1651532102.245272:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468150400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.245274:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.245276:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.245277:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532102.245278:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.245280:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c84b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c7b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.245281:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.245283:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532102.245284:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.245288:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.245291:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.245299:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c84b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c7b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.245303:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c84b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c7b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.245312:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.245315:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532102.245321:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2177
00000100:00100000:0.0:1651532102.245322:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468150464:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532102.245328:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468150400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (104us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532102.245330:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532102.245331:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2176
00010000:00010000:0.0:1651532102.245333:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c852 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c82 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.245337:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2178
00000100:00100000:1.0:1651532102.245338:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468150592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.245341:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.245341:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c852 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c82 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.245344:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c859 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c89 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.245345:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c852 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c82 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.245348:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532102.245350:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c859 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c89 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.245354:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c859 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c89 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.245357:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532102.245357:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468150464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.245360:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2177
00000100:00100000:1.0:1651532102.245363:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468150592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.245374:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2178
00000100:00100000:1.0:1651532102.245630:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.245656:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.245678:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468150720
00000100:00100000:1.0:1651532102.245690:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468150784
00000100:00100000:1.0:1651532102.245695:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2179
00000100:00100000:1.0:1651532102.245696:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468150720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.245700:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532102.245700:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2180
00000100:00100000:0.0:1651532102.245702:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ca61221 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468150784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.245703:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c860 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c90 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.245706:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.245710:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c867 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c97 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.245711:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c860 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c90 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.245715:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c860 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c90 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.245718:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532102.245730:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468150720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.245733:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2179
00010000:00010000:0.0:1651532102.245733:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c867 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c97 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.245737:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c867 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c97 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.245741:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532102.245749:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ca61221 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468150784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (94us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.245752:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2180
00000100:00100000:1.0:1651532102.245800:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.245851:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468150976
00000100:00100000:0.0:1651532102.245859:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2181
00000100:00100000:0.0:1651532102.245861:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468150976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.245864:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.245868:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c86e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447c9e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.245875:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c86e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c9e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.245878:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c86e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447c9e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.245882:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532102.245890:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468150976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.245901:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2181
00000100:00100000:1.0:1651532102.246074:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.246085:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468151232
00000100:00100000:0.0:1651532102.246093:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2182
00000100:00100000:0.0:1651532102.246095:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468151232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.246098:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.246102:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c875 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ca5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.246108:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c875 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ca5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.246112:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c875 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ca5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.246116:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532102.246125:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468151232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.246128:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2182
00000001:00080000:1.0:1651532102.402213:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793530 is committed
00010000:00010000:1.0:1651532102.402228:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.402242:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.402265:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468146112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 607699us (607762us total) trans 158913793530 rc 0/0
00010000:00010000:0.0:1651532102.402266:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.402269:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3743
00010000:00010000:0.0:1651532102.402270:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.402272:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402275:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402281:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.402282:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.402283:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402286:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402293:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402296:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c779 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->2490367] (req 1171456->2490367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402301:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402315:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.402621:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.402645:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468151552
00000100:00100000:0.0:1651532102.402658:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.402668:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.402671:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468151488
00000100:00100000:0.0:1651532102.402676:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.402683:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468151616
00000100:00100000:1.0:1651532102.402691:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3753
00000100:00100000:1.0:1651532102.402693:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468151552:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532102.402701:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.402707:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468151680
00000100:00100000:0.0:1651532102.402715:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2183
00000100:00100000:0.0:1651532102.402716:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468151616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.402721:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532102.402722:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.402725:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532102.402726:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402727:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.402731:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402731:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c883 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447cac expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.402734:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402739:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c883 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cac expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.402743:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c883 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cac expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.402746:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532102.402753:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3754
00000100:00100000:1.0:1651532102.402755:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468151488:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532102.402759:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468151616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.402762:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2183
00010000:00010000:1.0:1651532102.402766:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.402767:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2184
00000100:00100000:0.0:1651532102.402769:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468151680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.402770:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532102.402771:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402772:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.402773:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532102.402774:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402774:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c891 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447cb3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.402778:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402780:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c891 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cb3 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.402781:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.402784:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c891 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cb3 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.402796:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532102.402819:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468151680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.402822:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2184
00000001:00080000:1.0:1651532102.552181:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793531 is committed
00010000:00010000:0.0:1651532102.552211:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552215:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.552236:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468147392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599562us (599611us total) trans 158913793531 rc 0/0
00010000:00010000:1.0:1651532102.552237:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.552239:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3746
00010000:00010000:1.0:1651532102.552242:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532102.552243:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.552255:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.552261:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.552262:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.552263:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.552266:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.552281:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.552285:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40c7b8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->8597503] (req 1134592->8597503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.552290:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.552293:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.552634:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.552642:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.552647:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.552663:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468152000
00000100:00100000:0.0:1651532102.552673:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468152064
00010000:00010000:1.0:1651532102.552675:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.552676:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468152192
00000100:00100000:0.0:1651532102.552679:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2185
00010000:00010000:1.0:1651532102.552680:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.552680:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468152000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.552684:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.552687:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c898 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447cba expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552693:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.552696:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c898 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cba expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.552707:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c898 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cba expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532102.552710:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468147456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 600041us (600097us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532102.552711:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532102.552713:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3745
00000100:00100000:0.0:1651532102.552719:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468152000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.552721:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2185
00000100:00100000:1.0:1651532102.552724:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2186
00000100:00100000:1.0:1651532102.552726:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468152064:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532102.552726:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2187
00000100:00100000:0.0:1651532102.552728:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468152192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.552729:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.552730:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.552733:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c89f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447cc1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552733:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447cc8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552738:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.552739:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.552741:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cc8 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.552742:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c89f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cc1 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.552745:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cc8 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.552747:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c89f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cc1 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.552748:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532102.552750:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532102.552753:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468152192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.552755:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2187
00000100:00100000:1.0:1651532102.552757:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468152064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.552766:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2186
00010000:00010000:0.0:1651532102.552771:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552774:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.552776:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552779:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552783:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.552784:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.552785:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552788:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552795:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552798:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40c7b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->9523199] (req 2891776->9523199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552817:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.552820:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.553235:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.553246:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.553247:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468152384
00000100:00100000:0.0:1651532102.553254:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.553263:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468152320
00000100:00100000:0.0:1651532102.553263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.553273:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3755
00000100:00100000:1.0:1651532102.553275:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3756
00000100:00100000:0.0:1651532102.553275:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468152384:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532102.553277:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468152320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532102.553284:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.553285:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.553288:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532102.553289:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.553292:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532102.553293:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.553298:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532102.553299:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.553302:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532102.553302:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.553315:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.553316:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.553319:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.553320:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.553330:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468152704
00000100:00100000:0.0:1651532102.553332:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468152832
00000100:00100000:1.0:1651532102.553338:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2188
00000100:00100000:1.0:1651532102.553339:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468152704:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532102.553340:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2189
00010000:00010000:1.0:1651532102.553342:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532102.553342:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468152832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.553345:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ccf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.553353:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ccf expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.553354:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.553357:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ccf expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.553357:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c8c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447cd6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.553365:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c8c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cd6 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.553369:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c8c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cd6 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.553370:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532102.553372:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532102.553382:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468152704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.553382:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468152832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.553385:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2189
00000100:00100000:1.0:1651532102.553387:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2188
00000100:00100000:0.0:1651532102.553614:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.553633:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468152960
00000100:00100000:1.0:1651532102.553644:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2190
00000100:00100000:1.0:1651532102.553646:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468152960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.553649:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.553653:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c8c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447cdd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.553660:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c8c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cdd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.553664:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c8c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cdd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.553667:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532102.553677:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468152960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.553679:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2190
00000100:00100000:0.0:1651532102.553892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.553902:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468153152
00000100:00100000:1.0:1651532102.553913:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2191
00000100:00100000:1.0:1651532102.553915:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468153152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.553926:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.553929:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c8d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ce4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.553936:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c8d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ce4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.553940:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c8d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ce4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.553944:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532102.553954:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468153152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.553957:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2191
00000001:00080000:1.0:1651532102.610587:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793532 is committed
00002000:00010000:0.0:1651532102.610615:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532101 -> 1651532102
00002000:00010000:0.0:1651532102.610617:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532101 -> 1651532102
00010000:00010000:0.0:1651532102.610620:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610624:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.610640:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468148032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549416us (549478us total) trans 158913793532 rc 0/0
00000100:00100000:0.0:1651532102.610644:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3747
00010000:00010000:0.0:1651532102.610659:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610662:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.610663:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610666:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610671:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.610672:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.610672:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610676:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610683:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610685:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c7cd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9416703] (req 1036288->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610690:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610693:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610878:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.610883:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.610903:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468148096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 549644us (549728us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532102.610906:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.610906:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3748
00010000:00010000:1.0:1651532102.610911:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532102.610912:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.610915:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.610921:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.610922:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.610923:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.610926:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.610934:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.610936:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c7d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->2174975] (req 1953792->2174975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.610942:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.610945:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.611062:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.611081:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468153344
00000100:00100000:1.0:1651532102.611105:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2192
00000100:00100000:1.0:1651532102.611107:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468153344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.611110:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.611113:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c8d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ceb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.611113:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532102.611127:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c8d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ceb expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532102.611135:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532102.611136:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c8d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ceb expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532102.611143:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468153408
00010000:00010000:1.0:1651532102.611148:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532102.611149:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2193
00000100:00100000:0.0:1651532102.611151:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468153408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.611154:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.611158:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c8de lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447cf2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.611161:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468153344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.611164:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2192
00000100:00100000:1.0:1651532102.611170:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468153472
00000100:00100000:1.0:1651532102.611174:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2194
00000100:00100000:1.0:1651532102.611176:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468153472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.611178:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.611181:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c8e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447cf9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.611188:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c8e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cf9 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.611197:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c8de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cf2 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.611200:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c8e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cf9 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.611201:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c8de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447cf2 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.611204:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532102.611205:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532102.611210:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468153472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.611213:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2194
00000100:00100000:0.0:1651532102.611222:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468153408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 70us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.611224:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2193
00000100:00100000:0.0:1651532102.611241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.611255:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.611279:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468153536
00000100:00100000:0.0:1651532102.611288:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468153600
00000100:00100000:1.0:1651532102.611302:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3757
00000100:00100000:0.0:1651532102.611314:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3758
00000100:00100000:0.0:1651532102.611316:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468153600:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532102.611317:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468153536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532102.611323:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.611327:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532102.611329:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.611329:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.611331:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532102.611332:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.611348:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532102.611349:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.611352:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532102.611353:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.611357:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.611357:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.611360:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.611361:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.611618:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.611627:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.611640:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468153728
00000100:00100000:0.0:1651532102.611645:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468153792
00000100:00100000:1.0:1651532102.611650:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2195
00000100:00100000:1.0:1651532102.611652:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468153728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.611656:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532102.611661:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2196
00000100:00100000:0.0:1651532102.611663:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468153792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.611664:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c8fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d00 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.611672:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c8fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d00 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.611673:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.611676:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c8fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d00 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.611681:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c901 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d07 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.611688:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532102.611688:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c901 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d07 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.611692:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c901 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d07 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.611696:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532102.611701:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468153728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.611704:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2195
00000100:00100000:0.0:1651532102.611710:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468153792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.611713:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2196
00000100:00100000:1.0:1651532102.611953:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.611964:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468154176
00000100:00100000:0.0:1651532102.611972:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2197
00000100:00100000:0.0:1651532102.611974:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468154176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.611977:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.611980:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c908 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d0e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.611988:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c908 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d0e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.611991:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c908 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d0e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.612006:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532102.612017:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468154176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.612020:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2197
00000001:00080000:1.0:1651532102.710610:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793533 is committed
00010000:00010000:1.0:1651532102.710626:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.710630:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.710654:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468148800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557508us (557589us total) trans 158913793533 rc 0/0
00010000:00010000:0.0:1651532102.710654:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.710657:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3749
00010000:00010000:0.0:1651532102.710659:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.710660:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710663:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710668:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.710669:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.710670:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710673:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710676:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.710677:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.710677:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710680:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710691:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710694:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40c805 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8728575] (req 1048576->8728575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710703:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.710705:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710706:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.710709:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710930:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710934:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.710954:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468148864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 557747us (557859us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532102.710957:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3750
00010000:00010000:0.0:1651532102.710964:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710968:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.710969:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710982:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710988:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.710991:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40c813 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7569408->8765439] (req 7569408->8765439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711009:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711013:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.711040:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468150208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 465838us (465876us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532102.711043:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3751
00010000:00010000:1.0:1651532102.711051:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711054:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532102.711055:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711058:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711063:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.711064:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.711065:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711067:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711077:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711081:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c83d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9932799] (req 294912->9932799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.711089:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532102.711096:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.711099:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.711122:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468154368
00000100:00100000:1.0:1651532102.711147:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2198
00000100:00100000:1.0:1651532102.711149:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468154368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.711153:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.711156:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c90f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d15 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711171:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c90f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d15 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.711175:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c90f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d15 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.711179:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532102.711191:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468154368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.711194:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2198
00000100:00100000:1.0:1651532102.711328:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.711336:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.711347:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468154560
00000100:00100000:0.0:1651532102.711348:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468154496
00000100:00100000:1.0:1651532102.711356:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3759
00000100:00100000:1.0:1651532102.711358:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468154560:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532102.711364:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711369:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532102.711370:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.711374:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3760
00000100:00100000:0.0:1651532102.711375:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468154496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532102.711382:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711383:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532102.711384:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.711388:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532102.711389:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.711392:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532102.711401:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711405:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.711406:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711409:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.711410:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.711459:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.711475:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468154752
00000100:00100000:1.0:1651532102.711486:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2199
00000100:00100000:1.0:1651532102.711488:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468154752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.711492:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.711495:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c924 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d1c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.711502:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c924 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d1c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.711506:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c924 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d1c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.711509:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532102.711521:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468154752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.711538:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2199
00000100:00100000:1.0:1651532102.711554:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.711567:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468154816
00000100:00100000:0.0:1651532102.711579:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2200
00000100:00100000:0.0:1651532102.711581:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468154816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.711584:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.711588:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c92b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d23 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.711613:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c92b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d23 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.711618:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c92b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d23 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.711621:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532102.711624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.711630:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468154816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.711632:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2200
00000100:00100000:0.0:1651532102.711637:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468154944
00000100:00100000:0.0:1651532102.711654:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2201
00000100:00100000:0.0:1651532102.711656:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468154944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.711659:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.711661:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c932 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d2a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.711668:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c932 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d2a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.711687:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c932 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d2a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.711690:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532102.711703:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468154944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.711706:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2201
00000100:00100000:0.0:1651532102.711858:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.711865:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468155072
00000100:00100000:0.0:1651532102.711876:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2202
00000100:00100000:0.0:1651532102.711878:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468155072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.711881:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.711885:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c939 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d31 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.711892:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c939 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d31 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.711907:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c939 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d31 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.711910:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532102.711923:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468155072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.711925:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2202
00000100:00100000:0.0:1651532102.712027:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.712034:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468155200
00000100:00100000:0.0:1651532102.712045:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2203
00000100:00100000:0.0:1651532102.712046:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468155200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.712049:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.712053:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c940 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d38 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.712060:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c940 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d38 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.712064:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c940 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d38 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.712067:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532102.712078:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468155200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.712090:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2203
00000100:00100000:0.0:1651532102.712141:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.712157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.712166:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468155328
00000100:00100000:0.0:1651532102.712166:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468155456
00000100:00100000:0.0:1651532102.712175:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2204
00000100:00100000:0.0:1651532102.712177:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468155456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.712180:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532102.712182:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2205
00010000:00010000:0.0:1651532102.712183:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c947 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d46 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.712184:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468155328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.712188:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.712190:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c947 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d46 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.712191:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c94e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d3f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.712194:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c947 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d46 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.712198:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532102.712199:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c94e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d3f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.712203:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c94e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d3f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532102.712209:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468155456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532102.712212:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532102.712212:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2204
00000100:00100000:1.0:1651532102.712221:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468155328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.712224:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2205
00000100:00100000:0.0:1651532102.712471:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.712489:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468155712
00000100:00100000:1.0:1651532102.712497:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2206
00000100:00100000:1.0:1651532102.712499:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468155712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.712502:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.712506:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c955 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d4d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.712521:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c955 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d4d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.712525:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c955 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d4d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.712528:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532102.712539:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468155712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.712541:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2206
00000001:00080000:1.0:1651532102.827334:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793534 is committed
00010000:00010000:0.0:1651532102.827365:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.827369:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.827396:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468150144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582127us (582188us total) trans 158913793534 rc 0/0
00000100:00100000:0.0:1651532102.827399:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3752
00010000:00010000:0.0:1651532102.827406:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.827409:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.827410:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.827413:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.827418:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.827419:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.827419:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.827422:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.827434:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.827438:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c844 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->9396223] (req 1048576->9396223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.827447:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.827451:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.827848:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.827886:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.827893:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.827902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.827916:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468156032
00000100:00100000:0.0:1651532102.827918:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468155840
00000100:00100000:1.0:1651532102.827925:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468156224
00000100:00100000:0.0:1651532102.827930:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468155968
00000100:00100000:1.0:1651532102.827939:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2207
00000100:00100000:0.0:1651532102.827944:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3761
00000100:00100000:1.0:1651532102.827945:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468156032:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532102.827946:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468155840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532102.827949:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.827953:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c963 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d54 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.827953:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.827957:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532102.827958:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.827961:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532102.827962:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.827965:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.827975:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.827976:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c963 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d54 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.827979:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.827980:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c963 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d54 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.827984:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532102.827986:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2208
00000100:00100000:0.0:1651532102.827988:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468156224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.827991:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.827993:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c96a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d5b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.827995:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468156032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.827998:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2207
00000100:00100000:1.0:1651532102.828005:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3762
00010000:00010000:0.0:1651532102.828005:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532102.828007:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468155968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532102.828008:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c96a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d5b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.828012:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c96a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d5b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.828013:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828015:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532102.828017:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.828018:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.828021:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532102.828021:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.828024:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468156224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (122us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532102.828026:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.828026:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2208
00010000:00010000:1.0:1651532102.828029:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828045:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828049:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.828060:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468151552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425367us (425440us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532102.828063:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3753
00010000:00010000:0.0:1651532102.828069:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828072:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.828073:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828087:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828092:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.828092:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.828093:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828096:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828105:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828109:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40c87c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->9773055] (req 610304->9773055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.828113:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.828117:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.828414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.828426:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.828499:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468156352
00000100:00100000:1.0:1651532102.828510:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468156416
00000100:00100000:0.0:1651532102.828515:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2209
00000100:00100000:1.0:1651532102.828518:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2210
00000100:00100000:0.0:1651532102.828518:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468156352:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532102.828519:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468156416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.828521:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.828523:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.828525:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c978 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d62 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.828529:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c97f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d69 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828533:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c978 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d62 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.828541:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c97f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d69 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.828545:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c97f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d69 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.828548:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532102.828548:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c978 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d62 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.828552:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532102.828563:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468156416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.828565:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2210
00000100:00100000:0.0:1651532102.828567:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468156352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (153us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.828570:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2209
00000100:00100000:1.0:1651532102.828628:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.828654:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468156608
00000100:00100000:0.0:1651532102.828665:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2211
00000100:00100000:0.0:1651532102.828666:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468156608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.828670:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.828673:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c986 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d70 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828681:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c986 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d70 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.828685:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c986 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d70 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.828688:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532102.828697:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468156608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.828699:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2211
00000100:00100000:1.0:1651532102.828888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.828906:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468156864
00000100:00100000:0.0:1651532102.828917:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2212
00000100:00100000:0.0:1651532102.828919:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468156864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.828922:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.828925:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c98d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d77 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.828932:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c98d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d77 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.828936:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c98d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d77 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.828939:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532102.828950:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468156864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.828952:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2212
00000100:00100000:1.0:1651532102.829194:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.829204:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468157056
00000100:00100000:0.0:1651532102.829215:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2213
00000100:00100000:0.0:1651532102.829217:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468157056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.829220:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.829223:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c994 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d7e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.829230:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c994 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d7e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.829244:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c994 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d7e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.829248:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532102.829259:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468157056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.829261:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2213
00000100:00100000:1.0:1651532102.829493:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.829504:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468157248
00000100:00100000:0.0:1651532102.829515:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2214
00000100:00100000:0.0:1651532102.829516:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468157248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.829520:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.829523:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c99b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d85 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.829530:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c99b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d85 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.829534:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c99b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d85 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.829537:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532102.829547:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468157248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.829549:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2214
00000001:00080000:1.0:1651532102.927329:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793535 is committed
00010000:00010000:1.0:1651532102.927345:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.927349:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.927366:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468151488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524610us (524709us total) trans 158913793535 rc 0/0
00000100:00100000:1.0:1651532102.927370:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3754
00010000:00010000:1.0:1651532102.927376:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.927380:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532102.927381:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.927384:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.927389:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.927389:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532102.927390:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.927393:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.927417:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.927420:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40c88a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8130559] (req 81920->8130559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927430:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927435:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927609:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927613:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.927629:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468152384:12345-10.240.43.64@tcp:3:fio.0 Request processed in 374353us (374394us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532102.927632:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3755
00010000:00010000:0.0:1651532102.927638:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927642:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532102.927643:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927646:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927651:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.927651:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532102.927652:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927666:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927678:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927681:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40c8ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7557120->9801727] (req 7557120->9801727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.927686:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.927690:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.927905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.927916:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.927916:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468157376
00000100:00100000:1.0:1651532102.927923:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.927926:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468157440
00000100:00100000:1.0:1651532102.927932:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.927942:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3763
00000100:00100000:0.0:1651532102.927943:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468157376:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532102.927945:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532102.927963:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927968:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532102.927969:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927972:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532102.927973:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927977:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927980:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.927988:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3764
00000100:00100000:0.0:1651532102.927990:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468157440:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532102.927995:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.927998:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532102.927999:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.928002:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532102.928002:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.928006:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.928008:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.928010:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468157504
00000100:00100000:0.0:1651532102.928015:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468157568
00000100:00100000:1.0:1651532102.928018:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468157696
00000100:00100000:1.0:1651532102.928022:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2215
00000100:00100000:1.0:1651532102.928024:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468157504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.928027:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532102.928030:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2216
00010000:00010000:1.0:1651532102.928031:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c9b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d8c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532102.928032:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468157696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.928035:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.928037:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c9b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d9a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.928039:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c9b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d8c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.928053:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c9b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d9a expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.928056:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40c9b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d8c expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.928057:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40c9b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d9a expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.928060:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532102.928060:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532102.928073:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468157696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.928076:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2216
00000100:00100000:0.0:1651532102.928081:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2217
00000100:00100000:0.0:1651532102.928083:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468157568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.928086:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.928088:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c9be lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447d93 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.928091:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468157504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (167us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532102.928094:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c9be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d93 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532102.928095:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2215
00010000:00010000:0.0:1651532102.928097:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40c9be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447d93 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.928101:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532102.928106:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468157568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (174us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.928116:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2217
00000100:00100000:1.0:1651532102.928121:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.928160:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468157760
00000100:00100000:0.0:1651532102.928169:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2218
00000100:00100000:0.0:1651532102.928171:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468157760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.928174:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.928177:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c9c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447da1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.928183:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c9c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447da1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.928187:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40c9c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447da1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.928190:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532102.928201:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468157760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.928204:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2218
00000100:00100000:0.0:1651532102.928427:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.928434:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.928447:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468157888
00000100:00100000:1.0:1651532102.928453:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468157952
00000100:00100000:0.0:1651532102.928457:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2219
00000100:00100000:0.0:1651532102.928459:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468157888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532102.928462:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532102.928466:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2220
00010000:00010000:0.0:1651532102.928466:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c9cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447da8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532102.928468:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468157952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.928472:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.928476:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c9d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447daf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.928498:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c9cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447da8 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.928501:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c9d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447daf expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.928502:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c9cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447da8 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.928505:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40c9d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447daf expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.928506:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532102.928509:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532102.928516:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468157888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.928517:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468157952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.928519:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2219
00000100:00100000:1.0:1651532102.928529:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2220
00000100:00100000:0.0:1651532102.928548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.928561:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468158144
00000100:00100000:1.0:1651532102.928568:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2221
00000100:00100000:1.0:1651532102.928569:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468158144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.928573:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532102.928576:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c9da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447db6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532102.928583:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c9da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447db6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.928587:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40c9da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447db6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.928590:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532102.928597:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468158144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.928599:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2221
00000100:00100000:0.0:1651532102.928857:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532102.928871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532102.928880:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468158336
00000100:00100000:1.0:1651532102.928887:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468158400
00000100:00100000:1.0:1651532102.928895:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2222
00000100:00100000:1.0:1651532102.928896:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468158336:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532102.928898:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2223
00010000:00010000:1.0:1651532102.928900:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532102.928900:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468158400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532102.928903:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447dbd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.928904:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532102.928908:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c9e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447dc4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532102.928915:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c9e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dc4 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532102.928919:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c9e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dc4 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.928920:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dbd expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.928924:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dbd expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532102.928928:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532102.928934:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532102.928938:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468158336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532102.928941:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2222
00000100:00100000:0.0:1651532102.928943:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468158400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532102.928945:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2223
00000001:00080000:1.0:1651532103.018997:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793536 is committed
00010000:00010000:1.0:1651532103.019012:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019016:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.019038:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468152320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 465760us (465791us total) trans 158913793536 rc 0/0
00010000:00010000:0.0:1651532103.019040:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.019041:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3756
00010000:00010000:0.0:1651532103.019045:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.019046:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019049:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019055:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.019055:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.019056:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019059:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019066:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019070:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40c8b4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->8343551] (req 1044480->8343551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019084:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019088:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.019427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.019438:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.019445:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.019461:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.019463:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468158848
00000100:00100000:1.0:1651532103.019468:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468158720
00000100:00100000:0.0:1651532103.019475:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468158912
00000100:00100000:0.0:1651532103.019482:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2224
00000100:00100000:0.0:1651532103.019484:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca2c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468158848:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532103.019487:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468158784
00010000:00010000:0.0:1651532103.019487:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.019490:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c9ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447dcb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.019497:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3765
00000100:00100000:1.0:1651532103.019499:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468158720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532103.019501:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.019504:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c9ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dcb expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.019506:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019508:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40c9ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dcb expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.019511:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.019512:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019512:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532103.019515:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532103.019516:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019520:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.019525:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca2c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468158848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.019528:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2224
00010000:00010000:1.0:1651532103.019529:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.019533:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2225
00000100:00100000:0.0:1651532103.019535:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468158912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532103.019537:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3766
00010000:00010000:0.0:1651532103.019537:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532103.019539:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468158784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532103.019540:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c9fd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447dd2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019555:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.019557:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019557:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c9fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dd2 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.019560:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.019561:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019564:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532103.019564:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019568:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019568:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40c9fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dd2 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.019571:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.019572:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532103.019578:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468158912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.019581:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2225
00010000:00010000:1.0:1651532103.019584:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019587:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.019602:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468153600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408285us (408347us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532103.019605:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3758
00010000:00010000:1.0:1651532103.019613:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019619:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532103.019620:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019623:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019628:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.019628:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.019629:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019632:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019638:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019641:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40c8ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->10072063] (req 2670592->10072063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019646:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.019648:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.020069:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.020092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.020096:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468159168
00000100:00100000:1.0:1651532103.020100:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468159232
00000100:00100000:0.0:1651532103.020108:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2226
00000100:00100000:0.0:1651532103.020109:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468159168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.020113:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532103.020114:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2227
00000100:00100000:1.0:1651532103.020116:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079770f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468159232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.020116:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ca0b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447dd9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.020120:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.020124:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca12 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447de0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.020124:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ca0b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dd9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.020128:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ca0b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dd9 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.020131:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532103.020132:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca12 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447de0 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.020136:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca12 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447de0 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.020140:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532103.020151:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468159168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.020154:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2226
00000100:00100000:1.0:1651532103.020157:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079770f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468159232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.020160:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2227
00000100:00100000:1.0:1651532103.020464:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.020472:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.020484:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468159360
00000100:00100000:0.0:1651532103.020489:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468159424
00000100:00100000:1.0:1651532103.020494:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2228
00000100:00100000:1.0:1651532103.020496:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca2c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468159360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.020500:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532103.020502:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2229
00010000:00010000:1.0:1651532103.020503:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca19 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447de7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.020504:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468159424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.020507:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.020510:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ca20 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447dee expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.020517:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ca20 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dee expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.020521:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca19 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447de7 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.020521:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ca20 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dee expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.020524:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532103.020525:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca19 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447de7 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.020529:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532103.020538:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468159424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.020541:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2229
00000100:00100000:1.0:1651532103.020543:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca2c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468159360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.020546:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2228
00000100:00100000:1.0:1651532103.020783:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.020790:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468159616
00000100:00100000:1.0:1651532103.020813:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2230
00000100:00100000:1.0:1651532103.020815:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468159616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.020819:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.020822:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca27 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447df5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.020830:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447df5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.020834:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447df5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.020837:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532103.020854:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468159616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.020857:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2230
00000001:00080000:1.0:1651532103.144008:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793537 is committed
00010000:00010000:1.0:1651532103.144023:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.144027:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.144051:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468153536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532745us (532809us total) trans 158913793537 rc 0/0
00010000:00010000:0.0:1651532103.144051:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.144054:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3757
00010000:00010000:0.0:1651532103.144056:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.144057:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144070:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144076:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.144076:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.144077:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144080:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144087:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144090:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40c8f3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10473471] (req 1404928->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.144103:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.144107:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.144460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.144480:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.144488:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.144494:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.144504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.144506:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468160000
00000100:00100000:1.0:1651532103.144518:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468159936
00000100:00100000:0.0:1651532103.144519:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468160128
00000100:00100000:0.0:1651532103.144521:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468160192
00000100:00100000:0.0:1651532103.144525:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2231
00000100:00100000:0.0:1651532103.144527:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468160000:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532103.144530:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468159872
00000100:00100000:1.0:1651532103.144536:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3767
00010000:00010000:0.0:1651532103.144536:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532103.144538:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edc3418e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468159936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532103.144539:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ca2e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447dfc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144545:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.144547:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ca2e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dfc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.144554:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.144558:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.144560:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532103.144560:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.144564:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144565:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ca2e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447dfc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.144568:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532103.144571:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3768
00000100:00100000:1.0:1651532103.144573:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468159872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532103.144577:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.144583:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468160000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (94us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.144585:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2231
00010000:00010000:1.0:1651532103.144587:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532103.144588:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.144591:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.144591:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2232
00000100:00100000:0.0:1651532103.144592:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468160128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.144593:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532103.144594:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144595:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.144597:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ca43 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e03 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.144598:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144602:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.144604:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ca43 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e03 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.144608:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ca43 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e03 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.144610:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144611:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532103.144614:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.144616:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468160128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.144618:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2232
00010000:00010000:1.0:1651532103.144625:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.144627:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.144630:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2233
00000100:00100000:0.0:1651532103.144632:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf91ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468160192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.144640:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.144643:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca4a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e0a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.144645:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468154560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433286us (433317us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532103.144648:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3759
00010000:00010000:0.0:1651532103.144648:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.144650:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca4a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e0a expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.144654:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca4a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e0a expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.144657:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532103.144664:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf91ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468160192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (160us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.144666:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2233
00010000:00010000:0.0:1651532103.144674:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144677:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.144678:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144681:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144685:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.144694:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.144695:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144698:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144706:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144709:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40c916 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9895935] (req 884736->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144714:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.144717:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.145063:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.145070:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.145079:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.145088:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468160384
00000100:00100000:1.0:1651532103.145094:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468160512
00000100:00100000:1.0:1651532103.145097:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468160640
00000100:00100000:1.0:1651532103.145099:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2234
00000100:00100000:1.0:1651532103.145101:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468160384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.145104:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.145108:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca51 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e11 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.145127:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca51 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e11 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532103.145128:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2235
00010000:00010000:1.0:1651532103.145131:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca51 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e11 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532103.145131:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063e5a52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468160512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.145134:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.145135:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532103.145138:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ca58 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e18 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.145145:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468160384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (82us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532103.145145:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ca58 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e18 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532103.145148:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2234
00010000:00010000:0.0:1651532103.145149:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ca58 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e18 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532103.145152:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2236
00000100:00100000:1.0:1651532103.145155:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468160640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.145159:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.145161:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532103.145164:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca5f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e1f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.145171:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063e5a52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468160512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.145173:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2235
00010000:00010000:1.0:1651532103.145175:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e1f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.145182:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e1f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.145199:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532103.145207:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468160640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (128us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.145217:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2236
00000100:00100000:1.0:1651532103.145510:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.145517:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468160768
00000100:00100000:1.0:1651532103.145528:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2237
00000100:00100000:1.0:1651532103.145530:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468160768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.145533:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.145537:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca66 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e26 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.145544:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca66 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e26 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.145548:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca66 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e26 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.145551:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532103.145561:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468160768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.145563:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2237
00000001:00080000:1.0:1651532103.235713:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793538 is committed
00010000:00010000:0.0:1651532103.235744:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.235748:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.235768:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468154496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524392us (524431us total) trans 158913793538 rc 0/0
00010000:00010000:1.0:1651532103.235771:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.235771:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3760
00010000:00010000:1.0:1651532103.235775:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532103.235777:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.235790:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.235795:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.235796:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.235797:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.235800:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.235831:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.235834:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40c91d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8105983] (req 2433024->8105983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.235844:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.235848:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.236112:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.236124:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.236143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.236159:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.236170:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468161216
00000100:00100000:1.0:1651532103.236180:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468161280
00000100:00100000:1.0:1651532103.236184:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2238
00000100:00100000:1.0:1651532103.236186:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468161216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.236189:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.236193:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca6d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e2d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.236198:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2239
00000100:00100000:0.0:1651532103.236200:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468161280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.236204:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.236208:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ca74 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e34 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.236209:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca6d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e2d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.236213:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca6d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e2d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.236216:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532103.236229:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468161216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.236231:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2238
00010000:00010000:0.0:1651532103.236233:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ca74 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e34 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.236238:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ca74 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e34 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532103.236239:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468161152
00010000:00010000:0.0:1651532103.236241:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532103.236247:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468161088
00000100:00100000:0.0:1651532103.236250:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468161280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.236253:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2239
00000100:00100000:1.0:1651532103.236264:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3769
00000100:00100000:1.0:1651532103.236266:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4e0e265 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468161152:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532103.236272:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.236276:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532103.236276:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3770
00010000:00010000:1.0:1651532103.236277:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.236278:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468161088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532103.236280:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532103.236281:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.236284:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.236285:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.236289:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532103.236290:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.236293:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532103.236293:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.236297:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.236298:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.236320:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.236580:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.236587:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468161536
00000100:00100000:1.0:1651532103.236598:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2240
00000100:00100000:1.0:1651532103.236600:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468161536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.236603:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.236607:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca89 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e3b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.236614:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e3b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.236618:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e3b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.236621:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532103.236633:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468161536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.236635:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2240
00000001:00080000:1.0:1651532103.349688:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793539 is committed
00010000:00010000:0.0:1651532103.349721:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.349726:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.349748:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468155840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 521801us (521900us total) trans 158913793539 rc 0/0
00000100:00100000:0.0:1651532103.349752:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3761
00010000:00010000:0.0:1651532103.349759:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.349762:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.349764:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.349766:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.349771:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.349772:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.349773:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.349789:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.349809:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.349813:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.349814:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.349817:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40c95c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6316032->7606271] (req 6316032->7606271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.350069:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532103.350091:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.350095:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.350117:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468155968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 522109us (522231us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532103.350121:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3762
00010000:00010000:0.0:1651532103.350122:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.350126:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.350127:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.350129:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468161728
00010000:00010000:0.0:1651532103.350130:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.350139:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2241
00000100:00100000:1.0:1651532103.350140:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468161728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.350141:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.350141:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.350142:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.350144:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.350145:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.350147:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca90 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e42 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.350153:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.350155:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca90 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e42 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.350159:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ca90 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e42 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.350162:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532103.350164:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40c971 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->10272767] (req 16384->10272767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.350169:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468161728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (100us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532103.350171:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.350174:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.350180:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2241
00000100:00100000:0.0:1651532103.350571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.350584:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.350595:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468161792
00000100:00100000:1.0:1651532103.350606:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468161856
00000100:00100000:0.0:1651532103.350608:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.350611:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3771
00000100:00100000:1.0:1651532103.350618:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468161792:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532103.350621:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532103.350625:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.350629:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532103.350629:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468161984
00010000:00010000:1.0:1651532103.350630:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.350633:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532103.350634:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.350636:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468162112
00010000:00010000:1.0:1651532103.350639:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.350644:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2242
00000100:00100000:0.0:1651532103.350646:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468161984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.350648:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.350649:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.350654:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ca9e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e49 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.350655:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3772
00000100:00100000:1.0:1651532103.350657:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468161856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532103.350661:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.350662:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ca9e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e49 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.350666:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ca9e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e49 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.350675:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532103.350676:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.350679:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532103.350680:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.350680:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532103.350683:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.350686:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.350694:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468161984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.350697:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2242
00000100:00100000:1.0:1651532103.350702:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2243
00000100:00100000:1.0:1651532103.350704:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468162112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.350706:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.350709:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40caac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e50 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.350716:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40caac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e50 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.350720:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40caac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e50 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.350723:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532103.350739:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468162112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.350742:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2243
00000100:00100000:0.0:1651532103.350986:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.351004:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468162368
00000100:00100000:1.0:1651532103.351016:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2244
00000100:00100000:1.0:1651532103.351018:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468162368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.351021:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.351024:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cab3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e57 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.351031:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cab3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e57 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.351036:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cab3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e57 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.351039:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532103.351049:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468162368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.351051:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2244
00000100:00100000:0.0:1651532103.351267:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.351278:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468162496
00000100:00100000:1.0:1651532103.351290:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2245
00000100:00100000:1.0:1651532103.351292:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468162496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.351295:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.351298:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40caba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e5e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.351324:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40caba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e5e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.351328:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40caba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e5e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.351331:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532103.351342:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468162496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.351344:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2245
00000100:00100000:0.0:1651532103.351548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.351558:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468162624
00000100:00100000:1.0:1651532103.351570:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2246
00000100:00100000:1.0:1651532103.351572:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468162624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.351575:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.351578:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cac1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e65 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.351585:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cac1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e65 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.351589:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cac1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e65 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.351592:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532103.351602:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468162624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.351605:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2246
00000001:00080000:1.0:1651532103.416455:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793540 is committed
00010000:00010000:0.0:1651532103.416487:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.416491:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.416514:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.416514:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468157376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 488569us (488619us total) trans 158913793540 rc 0/0
00000100:00100000:0.0:1651532103.416517:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3763
00010000:00010000:1.0:1651532103.416519:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532103.416520:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.416523:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.416529:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.416530:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.416531:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.416534:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.416544:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.416552:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.416554:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40c9a2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [77824->10313727] (req 77824->10313727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.416559:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.416852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.416861:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468162816
00000100:00100000:1.0:1651532103.416874:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2247
00000100:00100000:1.0:1651532103.416876:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468162816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.416877:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.416880:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.416884:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cac8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e6c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.416892:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.416895:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.416898:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cac8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e6c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.416902:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cac8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e6c expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.416906:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532103.416921:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468162816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.416924:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2247
00000100:00100000:0.0:1651532103.416932:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468157440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 488940us (489015us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532103.416936:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3764
00010000:00010000:0.0:1651532103.416944:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.416947:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.416948:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.416951:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.416952:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532103.416959:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.416960:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.416962:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.416967:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.416979:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.416983:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40c9a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [561152->10239999] (req 561152->10239999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.416993:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.416995:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468162944
00010000:00010000:1.0:1651532103.416997:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.417004:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2248
00000100:00100000:0.0:1651532103.417006:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468162944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.417009:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.417012:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cacf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e73 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.417020:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cacf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e73 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.417024:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cacf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e73 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.417028:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532103.417042:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468162944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.417045:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2248
00000100:00100000:1.0:1651532103.417240:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.417263:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468163136
00000100:00100000:1.0:1651532103.417268:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.417279:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.417284:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468163072
00000100:00100000:1.0:1651532103.417286:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.417298:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3773
00000100:00100000:0.0:1651532103.417300:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468163136:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532103.417302:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3774
00000100:00100000:1.0:1651532103.417304:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468163072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532103.417317:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.417321:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.417322:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.417329:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532103.417330:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.417335:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532103.417336:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.417339:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.417341:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532103.417342:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.417346:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.417347:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.417349:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.417353:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.417356:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468163200
00000100:00100000:1.0:1651532103.417361:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468163264
00000100:00100000:0.0:1651532103.417363:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2249
00000100:00100000:0.0:1651532103.417365:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468163200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.417367:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532103.417372:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2250
00000100:00100000:1.0:1651532103.417374:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468163264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.417376:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.417376:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cae4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e7a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.417379:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40caeb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e81 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.417384:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cae4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e7a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.417388:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cae4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e7a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.417391:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532103.417395:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40caeb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e81 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.417399:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40caeb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e81 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.417402:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532103.417402:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468163200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.417405:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2249
00000100:00100000:1.0:1651532103.417411:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468163264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.417414:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2250
00000100:00100000:1.0:1651532103.417474:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.417481:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468163520
00000100:00100000:1.0:1651532103.417491:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2251
00000100:00100000:1.0:1651532103.417493:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468163520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.417496:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.417499:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40caf2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e88 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.417506:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40caf2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e88 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.417510:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40caf2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e88 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.417513:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532103.417532:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468163520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.417535:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2251
00000100:00100000:1.0:1651532103.417686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.417693:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468163712
00000100:00100000:1.0:1651532103.417703:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2252
00000100:00100000:1.0:1651532103.417705:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468163712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.417708:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.417711:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40caf9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e8f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.417718:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40caf9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e8f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.417722:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40caf9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e8f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.417725:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532103.417736:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468163712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.417739:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2252
00000001:00080000:1.0:1651532103.499784:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793541 is committed
00010000:00010000:1.0:1651532103.499800:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.499814:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.499847:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468158720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 480346us (480419us total) trans 158913793541 rc 0/0
00010000:00010000:0.0:1651532103.499849:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.499850:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3765
00010000:00010000:0.0:1651532103.499854:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.499862:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.499866:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.499871:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.499872:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.499873:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.499876:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.499879:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.499879:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.499880:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.499882:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.499889:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.499892:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40c9f6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.499901:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.499905:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.499934:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.499937:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500187:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500191:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.500211:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edc3418e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468159936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 355672us (355752us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532103.500214:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3767
00010000:00010000:1.0:1651532103.500221:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500234:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532103.500243:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500246:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500252:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500255:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ca35 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->7671807] (req 118784->7671807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500265:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500268:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.500280:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.500292:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468158784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 480752us (480854us total) trans 0 rc 36864/36864
00010000:00010000:0.0:1651532103.500294:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532103.500295:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3766
00010000:00010000:0.0:1651532103.500295:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.500298:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.500303:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.500304:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.500304:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.500317:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.500326:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.500329:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ca04 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [307200->10199039] (req 307200->10199039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.500339:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.500342:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.500461:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.500469:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468164096
00000100:00100000:1.0:1651532103.500479:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3775
00000100:00100000:1.0:1651532103.500481:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468164096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532103.500514:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500518:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532103.500519:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.500520:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532103.500536:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532103.500537:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500542:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500546:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.500553:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468164160
00000100:00100000:1.0:1651532103.500565:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3776
00000100:00100000:1.0:1651532103.500567:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468164160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532103.500572:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500576:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532103.500576:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500579:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532103.500580:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500590:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.500594:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.500733:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.500743:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468164480
00000100:00100000:0.0:1651532103.500746:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.500754:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468164544
00000100:00100000:1.0:1651532103.500761:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2253
00000100:00100000:1.0:1651532103.500762:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468164480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.500765:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532103.500766:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2254
00010000:00010000:1.0:1651532103.500768:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cb0e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e96 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.500768:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468164544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.500772:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.500776:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cb0e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e96 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.500780:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cb0e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e96 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.500783:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532103.500791:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cb15 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447e9d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.500814:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468164480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.500817:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2253
00010000:00010000:0.0:1651532103.500819:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cb15 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e9d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.500823:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cb15 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447e9d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.500827:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532103.500836:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468164544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.500839:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2254
00000100:00100000:1.0:1651532103.500846:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.500880:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468164672
00000100:00100000:0.0:1651532103.500888:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2255
00000100:00100000:0.0:1651532103.500890:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468164672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.500893:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.500896:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cb1c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ea4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.500904:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cb1c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ea4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.500919:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cb1c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ea4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.500923:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532103.500935:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468164672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.500938:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2255
00000100:00100000:0.0:1651532103.501094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.501100:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468164800
00000100:00100000:0.0:1651532103.501107:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2256
00000100:00100000:0.0:1651532103.501109:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468164800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.501112:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.501115:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cb23 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447eab expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.501122:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cb23 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447eab expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.501126:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cb23 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447eab expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.501129:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532103.501145:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468164800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.501157:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2256
00000100:00100000:0.0:1651532103.501203:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.501209:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468164928
00000100:00100000:0.0:1651532103.501216:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2257
00000100:00100000:0.0:1651532103.501217:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468164928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.501221:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.501224:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cb2a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447eb2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.501231:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cb2a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447eb2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.501235:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cb2a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447eb2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.501238:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532103.501251:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468164928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.501254:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2257
00000100:00100000:0.0:1651532103.501321:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.501329:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468165056
00000100:00100000:0.0:1651532103.501335:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2258
00000100:00100000:0.0:1651532103.501337:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468165056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.501340:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.501343:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb31 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447eb9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.501358:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb31 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447eb9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.501362:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb31 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447eb9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.501366:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532103.501378:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468165056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.501380:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2258
00000100:00100000:0.0:1651532103.501634:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.501641:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468165376
00000100:00100000:0.0:1651532103.501647:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2259
00000100:00100000:0.0:1651532103.501649:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468165376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.501652:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.501656:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb38 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ec0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.501663:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb38 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ec0 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.501666:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb38 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ec0 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.501669:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532103.501694:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468165376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.501697:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2259
00000100:00100000:0.0:1651532103.501908:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.501914:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468165568
00000100:00100000:0.0:1651532103.501921:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2260
00000100:00100000:0.0:1651532103.501922:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468165568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.501925:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.501929:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb3f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ec7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.501936:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb3f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ec7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.501939:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb3f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ec7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.501943:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532103.501958:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468165568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.501961:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2260
00000001:00080000:1.0:1651532103.616483:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793542 is committed
00002000:00010000:0.0:1651532103.616511:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532102 -> 1651532103
00010000:00010000:0.0:1651532103.616515:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.616518:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.616550:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468159872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 471976us (472077us total) trans 158913793542 rc 0/0
00010000:00010000:1.0:1651532103.616552:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.616554:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3768
00010000:00010000:1.0:1651532103.616556:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532103.616557:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.616561:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.616566:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.616566:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.616567:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.616570:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.616578:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.616581:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ca3c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->8200191] (req 397312->8200191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.616586:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.616590:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.616897:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.616930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.616938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.616949:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468165696
00000100:00100000:0.0:1651532103.616959:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468165760
00000100:00100000:0.0:1651532103.616964:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3777
00000100:00100000:0.0:1651532103.616966:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468165696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532103.616973:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.616978:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532103.616979:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.616982:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532103.616982:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.616998:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617001:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.617009:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3778
00000100:00100000:0.0:1651532103.617011:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468165760:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532103.617016:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617019:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.617020:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617022:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532103.617023:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617026:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617029:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617039:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617052:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.617073:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4e0e265 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468161152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 380806us (380961us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532103.617076:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3769
00010000:00010000:0.0:1651532103.617083:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617086:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.617087:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617090:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617095:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.617095:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.617096:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617099:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617106:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617109:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ca7b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9723903] (req 3633152->9723903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.617114:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468165824
00010000:00010000:0.0:1651532103.617122:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.617127:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2261
00000100:00100000:1.0:1651532103.617129:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468165824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.617130:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.617133:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.617137:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cb54 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ece expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.617152:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cb54 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ece expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.617157:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cb54 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ece expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.617160:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532103.617169:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468165824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (230us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.617171:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2261
00000100:00100000:0.0:1651532103.617343:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.617366:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.617378:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468166080
00000100:00100000:1.0:1651532103.617379:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468166144
00000100:00100000:0.0:1651532103.617386:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2262
00000100:00100000:0.0:1651532103.617387:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468166080:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532103.617388:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2263
00000100:00100000:1.0:1651532103.617389:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468166144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.617391:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.617393:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.617394:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb5b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ed5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.617396:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cb62 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447edc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.617402:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb5b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ed5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.617404:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cb62 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447edc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.617406:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb5b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ed5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.617408:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cb62 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447edc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.617410:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532103.617411:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532103.617419:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468166144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.617419:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468166080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.617422:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2262
00000100:00100000:1.0:1651532103.617434:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2263
00000100:00100000:1.0:1651532103.617508:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.617528:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468166272
00000100:00100000:1.0:1651532103.617535:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2264
00000100:00100000:1.0:1651532103.617536:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468166272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.617540:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.617549:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb69 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ee3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.617557:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb69 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ee3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.617561:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb69 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ee3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.617564:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532103.617577:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468166272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.617579:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2264
00000100:00100000:1.0:1651532103.617630:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.617636:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468166400
00000100:00100000:1.0:1651532103.617642:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2265
00000100:00100000:1.0:1651532103.617644:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468166400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.617647:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.617650:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb70 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447eea expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.617657:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb70 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447eea expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.617661:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb70 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447eea expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.617664:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532103.617676:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468166400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.617678:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2265
00000001:00080000:1.0:1651532103.716502:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793543 is committed
00010000:00010000:0.0:1651532103.716531:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.716536:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.716558:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468161088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 480279us (480433us total) trans 158913793543 rc 0/0
00000100:00100000:0.0:1651532103.716561:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3770
00010000:00010000:0.0:1651532103.716568:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.716572:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.716573:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.716576:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.716581:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.716581:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.716582:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.716585:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.716592:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.716605:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ca82 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9867263] (req 995328->9867263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.716610:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.716614:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.716924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.716956:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.716966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.716975:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.716985:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468166848
00000100:00100000:0.0:1651532103.716995:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468166784
00000100:00100000:0.0:1651532103.717000:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3779
00000100:00100000:0.0:1651532103.717002:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468166848:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532103.717006:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3780
00000100:00100000:1.0:1651532103.717009:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468166784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532103.717009:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.717013:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532103.717014:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.717017:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.717018:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.717021:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532103.717023:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.717028:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.717031:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532103.717032:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.717036:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.717039:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.717044:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468166912
00000100:00100000:0.0:1651532103.717053:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468167040
00000100:00100000:0.0:1651532103.717058:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2266
00010000:00010000:1.0:1651532103.717059:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.717059:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468166912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.717062:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532103.717067:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2267
00000100:00100000:1.0:1651532103.717069:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468167040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.717072:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.717073:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cb85 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ef1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.717075:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb8c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ef8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.717080:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cb85 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ef1 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.717082:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb8c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ef8 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.717085:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cb85 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ef1 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.717086:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb8c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ef8 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.717088:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532103.717090:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532103.717101:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468166912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.717104:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2266
00000100:00100000:1.0:1651532103.717107:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468167040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (131us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532103.717110:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2267
00000001:00080000:1.0:1651532103.833197:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793544 is committed
00010000:00010000:1.0:1651532103.833212:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833215:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.833237:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468161792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482624us (482667us total) trans 158913793544 rc 0/0
00000100:00100000:1.0:1651532103.833241:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3771
00010000:00010000:1.0:1651532103.833248:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833251:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532103.833252:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833255:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833260:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.833261:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.833262:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833265:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833268:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.833269:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.833269:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833281:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833294:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833297:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ca97 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5664768->6500351] (req 5664768->6500351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833303:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833313:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833315:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833320:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833502:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833512:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833527:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.833532:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468161856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 482875us (482948us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532103.833535:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3772
00010000:00010000:0.0:1651532103.833536:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.833537:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833541:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833557:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833560:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40caa5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->7397375] (req 1024000->7397375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833595:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833599:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.833618:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468163136:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416317us (416378us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532103.833621:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3773
00010000:00010000:0.0:1651532103.833629:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833632:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532103.833633:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833636:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833640:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.833641:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532103.833649:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833652:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833661:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833664:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833664:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cad6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9625599] (req 753664->9625599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833669:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.833679:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.833693:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468167296
00000100:00100000:0.0:1651532103.833701:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2268
00000100:00100000:0.0:1651532103.833702:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468167296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.833706:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.833709:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cb93 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447eff expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833716:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cb93 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447eff expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.833720:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cb93 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447eff expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.833723:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532103.833733:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468167296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.833744:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2268
00000100:00100000:1.0:1651532103.833841:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.833855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.833863:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468167424
00000100:00100000:0.0:1651532103.833865:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468167360
00000100:00100000:1.0:1651532103.833873:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3781
00000100:00100000:1.0:1651532103.833875:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468167424:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532103.833876:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3782
00000100:00100000:0.0:1651532103.833878:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c031ba3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468167360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532103.833882:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833884:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833886:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532103.833887:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833890:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532103.833891:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833895:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532103.833896:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833899:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532103.833899:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833903:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833904:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.833907:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.833917:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.833961:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.833978:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468167616
00000100:00100000:0.0:1651532103.833988:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2269
00000100:00100000:0.0:1651532103.833990:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468167616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.833993:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.833997:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cba8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f06 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.834014:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cba8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f06 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.834019:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cba8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f06 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.834022:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532103.834032:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468167616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.834035:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2269
00000100:00100000:1.0:1651532103.834097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.834105:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468167744
00000100:00100000:0.0:1651532103.834128:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2270
00000100:00100000:0.0:1651532103.834130:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468167744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.834134:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.834137:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cbaf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f0d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.834145:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cbaf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f0d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.834149:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cbaf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f0d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.834152:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532103.834162:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468167744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.834174:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2270
00000100:00100000:1.0:1651532103.834299:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.834317:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468167936
00000100:00100000:0.0:1651532103.834327:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2271
00000100:00100000:0.0:1651532103.834329:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468167936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.834332:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.834336:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cbb6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f14 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.834342:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cbb6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f14 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.834346:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cbb6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f14 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.834350:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532103.834360:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468167936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.834362:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2271
00000100:00100000:1.0:1651532103.834625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.834636:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468168128
00000100:00100000:0.0:1651532103.834648:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2272
00000100:00100000:0.0:1651532103.834649:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468168128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.834653:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.834656:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cbbd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f1b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.834663:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cbbd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f1b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.834675:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cbbd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f1b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.834678:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532103.834689:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468168128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.834692:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2272
00000100:00100000:1.0:1651532103.834919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.834929:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468168320
00000100:00100000:0.0:1651532103.834939:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2273
00000100:00100000:0.0:1651532103.834941:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468168320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.834944:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.834948:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cbc4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f22 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.834955:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cbc4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f22 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.834959:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cbc4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f22 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.834962:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532103.834972:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468168320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.834974:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2273
00000001:00080000:1.0:1651532103.899903:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793545 is committed
00010000:00010000:1.0:1651532103.899918:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.899922:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.899939:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468163072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482634us (482677us total) trans 158913793545 rc 0/0
00000100:00100000:1.0:1651532103.899942:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3774
00010000:00010000:1.0:1651532103.899949:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.899952:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532103.899953:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.899956:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.899970:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.899970:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532103.899971:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.899974:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.899981:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.899984:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cadd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->9461759] (req 303104->9461759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.899989:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.899993:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.900316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.900326:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.900338:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.900345:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468168576
00000100:00100000:0.0:1651532103.900349:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468168512
00000100:00100000:0.0:1651532103.900364:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2274
00000100:00100000:1.0:1651532103.900365:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468168448
00000100:00100000:0.0:1651532103.900366:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023c32fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468168512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.900370:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532103.900374:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3783
00000100:00100000:1.0:1651532103.900376:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000704fce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468168576:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532103.900378:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cbcb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f29 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.900383:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.900386:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cbcb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f29 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.900390:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cbcb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f29 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.900393:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532103.900395:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532103.900396:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.900399:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532103.900400:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.900405:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.900408:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532103.900416:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3784
00000100:00100000:0.0:1651532103.900420:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023c32fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468168512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.900423:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2274
00000100:00100000:1.0:1651532103.900443:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f23ba88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468168448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532103.900449:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.900453:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532103.900453:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.900456:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532103.900456:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.900460:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.900463:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532103.900472:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.900508:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532103.900511:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468168640
00000100:00100000:0.0:1651532103.900515:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468168704
00000100:00100000:1.0:1651532103.900525:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2275
00000100:00100000:1.0:1651532103.900527:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468168640:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532103.900528:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2276
00000100:00100000:0.0:1651532103.900529:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468168704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532103.900530:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.900533:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532103.900534:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cbe0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f30 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.900536:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cbe7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f37 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532103.900542:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cbe0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f30 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.900544:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cbe7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f37 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.900546:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cbe0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f30 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532103.900549:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532103.900556:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cbe7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f37 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532103.900560:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468168640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (88us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532103.900560:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532103.900563:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2275
00000100:00100000:0.0:1651532103.900568:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468168704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.900571:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2276
00000100:00100000:0.0:1651532103.900864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.900871:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468169024
00000100:00100000:0.0:1651532103.900878:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2277
00000100:00100000:0.0:1651532103.900879:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca2c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468169024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.900883:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.900886:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cbee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f3e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.900893:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cbee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f3e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.900897:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cbee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f3e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.900900:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532103.900916:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca2c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468169024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.900927:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2277
00000100:00100000:0.0:1651532103.901147:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532103.901154:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468169152
00000100:00100000:0.0:1651532103.901161:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2278
00000100:00100000:0.0:1651532103.901162:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468169152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532103.901165:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532103.901169:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cbf5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f45 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532103.901176:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cbf5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f45 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.901180:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cbf5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f45 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532103.901183:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532103.901199:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468169152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532103.901202:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2278
00000001:00080000:1.0:1651532104.016618:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793546 is committed
00002000:00010000:1.0:1651532104.016631:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532102 -> 1651532103
00010000:00010000:1.0:1651532104.016634:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.016647:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.016668:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468164096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516186us (516207us total) trans 158913793546 rc 0/0
00000100:00100000:1.0:1651532104.016671:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3775
00010000:00010000:0.0:1651532104.016671:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.016675:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.016677:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.016689:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.016695:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.016696:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.016696:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.016699:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.016706:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.016709:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cb00 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->8658943] (req 286720->8658943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.016721:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.016726:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.017076:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.017088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.017097:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.017104:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468169344
00000100:00100000:0.0:1651532104.017115:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468169408
00000100:00100000:0.0:1651532104.017118:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468169536
00010000:00010000:1.0:1651532104.017120:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.017122:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2279
00000100:00100000:0.0:1651532104.017123:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468169344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.017124:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017126:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.017130:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cbfc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f4c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017141:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532104.017142:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468164160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 516574us (516622us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532104.017143:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cbfc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f4c expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532104.017145:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3776
00000100:00100000:1.0:1651532104.017153:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2280
00000100:00100000:1.0:1651532104.017154:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b87a626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468169408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.017155:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cbfc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f4c expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.017158:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.017159:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532104.017168:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468169344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (92us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532104.017169:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cc03 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f53 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.017171:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2279
00010000:00010000:1.0:1651532104.017175:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532104.017176:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2281
00010000:00010000:1.0:1651532104.017178:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cc03 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f53 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532104.017178:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000284741f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468169536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.017180:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.017182:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cc03 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f53 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.017183:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc0a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f5a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.017185:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532104.017187:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.017189:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc0a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f5a expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532104.017192:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b87a626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468169408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (103us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532104.017193:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc0a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f5a expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532104.017195:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2280
00010000:00010000:0.0:1651532104.017197:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532104.017202:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000284741f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468169536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.017204:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2281
00010000:00010000:0.0:1651532104.017218:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017221:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.017223:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017226:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017230:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.017231:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.017232:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017235:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017242:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017245:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cb07 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->10256383] (req 1286144->10256383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017250:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017253:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.017638:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.017646:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.017652:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.017657:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.017663:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.017673:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468169664
00000100:00100000:1.0:1651532104.017684:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468169792
00000100:00100000:1.0:1651532104.017692:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3785
00000100:00100000:1.0:1651532104.017694:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afa5d0ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468169664:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532104.017701:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.017716:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532104.017717:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.017719:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532104.017720:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.017724:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3786
00010000:00010000:1.0:1651532104.017725:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.017727:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c48da76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468169792:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532104.017728:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017735:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.017736:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468169856
00010000:00010000:0.0:1651532104.017739:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532104.017740:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.017742:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468169984
00010000:00010000:0.0:1651532104.017743:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00000100:00100000:1.0:1651532104.017744:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468170048
00010000:00010000:0.0:1651532104.017744:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.017747:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2282
00010000:00010000:0.0:1651532104.017748:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.017749:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468169856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.017751:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.017752:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.017754:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40cc1f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f61 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.017760:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2283
00010000:00010000:1.0:1651532104.017761:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40cc1f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f61 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532104.017762:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468169984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.017764:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.017765:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40cc1f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f61 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.017766:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cc26 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f68 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.017773:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cc26 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f68 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.017776:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532104.017786:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468169856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (134us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532104.017786:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cc26 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f68 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532104.017789:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2282
00010000:00010000:0.0:1651532104.017789:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532104.017794:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2284
00000100:00100000:1.0:1651532104.017796:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468170048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.017798:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532104.017799:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468169984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (141us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532104.017801:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc2d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f6f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.017802:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2283
00010000:00010000:1.0:1651532104.017832:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f6f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.017836:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f6f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.017839:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532104.017846:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468170048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (183us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.017849:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2284
00000100:00100000:1.0:1651532104.018139:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.018146:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468170368
00000100:00100000:1.0:1651532104.018157:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2285
00000100:00100000:1.0:1651532104.018159:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468170368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.018164:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.018167:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cc34 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f76 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.018174:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cc34 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f76 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.018178:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cc34 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f76 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.018181:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532104.018190:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468170368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.018192:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2285
00000100:00100000:1.0:1651532104.018223:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.018260:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468170496
00000100:00100000:1.0:1651532104.018272:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2286
00000100:00100000:1.0:1651532104.018274:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468170496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.018277:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.018280:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cc3b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f7d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.018287:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cc3b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f7d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.018291:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cc3b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f7d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.018302:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532104.018320:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468170496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.018323:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2286
00000100:00100000:1.0:1651532104.018563:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.018571:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468170688
00000100:00100000:1.0:1651532104.018581:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2287
00000100:00100000:1.0:1651532104.018582:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468170688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.018585:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.018589:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cc42 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f84 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.018596:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cc42 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f84 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.018600:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cc42 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f84 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.018603:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532104.018612:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468170688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.018615:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2287
00000001:00080000:1.0:1651532104.116619:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793547 is committed
00010000:00010000:0.0:1651532104.116649:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.116654:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.116674:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468165696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499707us (499777us total) trans 158913793547 rc 0/0
00010000:00010000:1.0:1651532104.116677:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.116677:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3777
00010000:00010000:1.0:1651532104.116685:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532104.116686:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.116689:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.116695:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.116695:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.116696:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.116699:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.116703:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.116703:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.116704:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.116706:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.116713:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.116716:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40cb46 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7856127] (req 278528->7856127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.116721:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.116725:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.116737:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.116741:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.117101:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.117130:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468170880
00000100:00100000:0.0:1651532104.117136:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.117144:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.117147:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468170944
00000100:00100000:1.0:1651532104.117158:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468171008
00000100:00100000:1.0:1651532104.117162:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2288
00000100:00100000:1.0:1651532104.117163:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468170880:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532104.117163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532104.117167:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.117170:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cc49 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f8b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.117176:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.117178:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cc49 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f8b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.117182:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cc49 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f8b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.117186:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532104.117201:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468171072
00000100:00100000:1.0:1651532104.117205:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468170880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.117208:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2288
00000100:00100000:0.0:1651532104.117213:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2289
00000100:00100000:1.0:1651532104.117215:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2290
00000100:00100000:0.0:1651532104.117215:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468170944:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532104.117217:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf91ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468171008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.117219:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.117219:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.117222:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cc50 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f99 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117222:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cc57 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447f92 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.117227:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.117229:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cc50 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f99 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.117229:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.117231:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cc57 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f92 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.117233:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cc50 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f99 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.117236:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532104.117236:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cc57 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447f92 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.117239:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532104.117242:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf91ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468171008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.117244:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2290
00000100:00100000:0.0:1651532104.117247:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468170944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.117248:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2291
00000100:00100000:1.0:1651532104.117250:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468171072:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532104.117250:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2289
00010000:00010000:1.0:1651532104.117252:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.117254:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cc5e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fa0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.117258:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.117260:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cc5e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fa0 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.117261:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117264:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.117268:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cc5e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fa0 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.117271:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532104.117276:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468171072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.117276:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468165760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 500264us (500346us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532104.117278:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2291
00000100:00100000:0.0:1651532104.117278:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3778
00010000:00010000:1.0:1651532104.117290:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.117294:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117294:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117298:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.117299:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117318:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.117321:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468166848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 400318us (400397us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532104.117324:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.117326:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3779
00010000:00010000:0.0:1651532104.117327:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cb4d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->10125311] (req 1216512->10125311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117330:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117333:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.117334:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117337:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117340:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.117340:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.117341:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117345:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117354:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117357:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cb77 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->9244671] (req 1495040->9244671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117367:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117370:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.117794:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.117829:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.117837:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.117846:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.117848:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468171328
00000100:00100000:1.0:1651532104.117853:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.117859:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468171200
00000100:00100000:1.0:1651532104.117861:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3787
00000100:00100000:1.0:1651532104.117863:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468171328:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532104.117866:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3788
00000100:00100000:0.0:1651532104.117867:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468171200:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532104.117871:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.117878:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532104.117879:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532104.117880:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.117883:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117889:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.117890:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468171264
00010000:00010000:0.0:1651532104.117894:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532104.117895:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.117900:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468171456
00000100:00100000:1.0:1651532104.117902:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468171584
00010000:00010000:0.0:1651532104.117903:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.117905:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2292
00000100:00100000:1.0:1651532104.117907:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468171264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.117909:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.117912:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40cc73 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fa7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117913:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532104.117914:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117919:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.117920:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40cc73 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fa7 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.117922:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.117924:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40cc73 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fa7 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.117926:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.117927:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532104.117935:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2293
00000100:00100000:1.0:1651532104.117937:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468171264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (144us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.117937:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468171456:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532104.117940:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2292
00010000:00010000:0.0:1651532104.117940:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.117943:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cc7a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fae expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.117944:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2294
00000100:00100000:1.0:1651532104.117946:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468171584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.117948:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.117950:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cc7a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fae expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.117951:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cc81 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fb5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.117954:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cc7a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fae expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.117956:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cc81 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fb5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.117957:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532104.117960:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40cc81 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fb5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.117963:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532104.117968:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468171584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.117970:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2294
00000100:00100000:0.0:1651532104.117973:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468171456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.117976:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2293
00000100:00100000:1.0:1651532104.117985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.118019:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468171712
00000100:00100000:0.0:1651532104.118029:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2295
00000100:00100000:0.0:1651532104.118031:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468171712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.118034:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.118037:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cc88 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fbc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.118044:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cc88 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fbc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118048:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cc88 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fbc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118052:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532104.118076:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468171712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.118078:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2295
00000100:00100000:0.0:1651532104.118256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.118263:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468171840
00000100:00100000:0.0:1651532104.118276:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2296
00000100:00100000:0.0:1651532104.118278:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063e5a52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468171840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.118281:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.118284:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cc8f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fc3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.118291:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cc8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fc3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118295:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cc8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fc3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118299:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532104.118328:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063e5a52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468171840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.118336:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2296
00000100:00100000:0.0:1651532104.118351:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.118358:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468172032
00000100:00100000:0.0:1651532104.118368:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2297
00000100:00100000:0.0:1651532104.118369:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468172032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.118372:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.118375:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cc96 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fca expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.118382:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cc96 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fca expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118386:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cc96 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fca expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118389:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532104.118408:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468172032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.118411:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2297
00000100:00100000:0.0:1651532104.118463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.118470:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468172160
00000100:00100000:0.0:1651532104.118481:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2298
00000100:00100000:0.0:1651532104.118482:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468172160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.118486:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.118489:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cc9d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fd1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.118496:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cc9d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fd1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118500:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cc9d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fd1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118503:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532104.118514:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468172160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.118516:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2298
00000100:00100000:0.0:1651532104.118610:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.118617:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468172288
00000100:00100000:0.0:1651532104.118629:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2299
00000100:00100000:0.0:1651532104.118631:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468172288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.118634:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.118643:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40cca4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fd8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.118651:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40cca4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fd8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118654:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40cca4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fd8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118658:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532104.118669:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468172288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.118672:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2299
00000100:00100000:0.0:1651532104.118718:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.118725:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468172480
00000100:00100000:0.0:1651532104.118735:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2300
00000100:00100000:0.0:1651532104.118737:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468172480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.118740:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.118743:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ccab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fdf expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.118750:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ccab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fdf expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118754:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ccab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fdf expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118767:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532104.118779:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468172480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.118782:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2300
00000100:00100000:0.0:1651532104.118841:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.118847:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468172608
00000100:00100000:0.0:1651532104.118857:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2301
00000100:00100000:0.0:1651532104.118859:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468172608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.118862:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.118866:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccb2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fe6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.118873:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccb2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fe6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118877:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccb2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fe6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.118880:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000603f6abd, rc 0)
00000100:00100000:0.0:1651532104.118891:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468172608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.118893:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2301
00000001:00080000:1.0:1651532104.183361:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793548 is committed
00010000:00010000:0.0:1651532104.183392:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.183406:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.183427:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468166784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466418us (466471us total) trans 158913793548 rc 0/0
00010000:00010000:1.0:1651532104.183428:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.183431:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3780
00010000:00010000:1.0:1651532104.183434:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532104.183435:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183439:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183455:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.183456:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.183457:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183460:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183476:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183479:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cb7e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8527871] (req 1028096->8527871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183485:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183488:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.183779:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.183820:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.183831:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.183844:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468172992
00000100:00100000:0.0:1651532104.183845:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.183854:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468173056
00000100:00100000:1.0:1651532104.183865:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3789
00000100:00100000:1.0:1651532104.183867:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468172992:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532104.183873:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3790
00000100:00100000:0.0:1651532104.183875:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468173056:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532104.183878:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.183882:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183883:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532104.183892:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183895:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532104.183896:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.183900:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.183901:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.183904:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532104.183905:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183908:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.183909:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183912:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.183923:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183930:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.183932:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468173120
00010000:00010000:1.0:1651532104.183934:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.183940:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468173312
00000100:00100000:0.0:1651532104.183950:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2302
00000100:00100000:0.0:1651532104.183952:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468173120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.183955:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.183958:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccc7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447fed expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.183960:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468167424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350084us (350119us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532104.183963:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3781
00010000:00010000:0.0:1651532104.183963:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.183965:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccc7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fed expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.183970:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccc7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447fed expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532104.183971:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2303
00000100:00100000:1.0:1651532104.183973:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468173312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.183973:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000035f6d17d, rc 0)
00010000:00010000:1.0:1651532104.183976:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.183979:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ff4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.183981:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468173120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (150us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.183983:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2302
00010000:00010000:1.0:1651532104.183984:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.183987:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ff4 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.183990:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.183992:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ff4 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.183993:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532104.183995:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532104.184001:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468173312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (156us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532104.184003:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.184004:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2303
00010000:00010000:0.0:1651532104.184006:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.184012:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.184012:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.184013:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.184016:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.184023:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.184026:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cb9a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->9543679] (req 4177920->9543679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.184031:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.184034:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.184357:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.184368:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468173504
00000100:00100000:1.0:1651532104.184377:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2304
00000100:00100000:1.0:1651532104.184378:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468173504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.184382:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.184385:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ccd5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447ffb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.184393:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ccd5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ffb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.184397:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ccd5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447ffb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.184400:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532104.184410:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468173504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.184412:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2304
00000100:00100000:0.0:1651532104.184437:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.184451:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468173632
00000100:00100000:1.0:1651532104.184458:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2305
00000100:00100000:1.0:1651532104.184460:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468173632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.184463:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.184466:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ccdc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448002 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.184473:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ccdc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448002 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.184477:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40ccdc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448002 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.184480:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532104.184487:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468173632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.184489:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2305
00000001:00080000:1.0:1651532104.275064:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793549 is committed
00010000:00010000:0.0:1651532104.275095:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275109:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.275127:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c031ba3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468167360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 441249us (441272us total) trans 158913793549 rc 0/0
00000100:00100000:0.0:1651532104.275130:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3782
00010000:00010000:0.0:1651532104.275137:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275140:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.275142:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275144:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275149:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.275150:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.275151:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275153:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275165:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275169:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cba1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9527295] (req 1105920->9527295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275179:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275183:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275373:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275377:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.275402:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000704fce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468168576:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375025us (375096us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532104.275405:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3783
00010000:00010000:1.0:1651532104.275412:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275416:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532104.275417:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275420:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275425:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.275425:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.275426:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275429:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275436:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275439:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cbd2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5701632->9113599] (req 5701632->9113599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275444:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275454:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.275515:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.275525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.275536:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468173888
00000100:00100000:0.0:1651532104.275536:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468173824
00000100:00100000:1.0:1651532104.275546:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3791
00000100:00100000:1.0:1651532104.275548:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468173888:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532104.275549:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3792
00000100:00100000:0.0:1651532104.275551:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468173824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532104.275555:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275557:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275559:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532104.275560:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532104.275561:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275567:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532104.275568:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275571:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275573:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532104.275574:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275577:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275578:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275581:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.275584:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.275746:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.275754:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468174144
00000100:00100000:1.0:1651532104.275762:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2306
00000100:00100000:1.0:1651532104.275763:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468174144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.275767:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.275770:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ccf1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448009 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.275826:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ccf1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448009 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.275831:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ccf1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448009 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.275835:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532104.275849:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468174144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 84us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.275851:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2306
00000100:00100000:1.0:1651532104.276141:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.276149:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468174336
00000100:00100000:1.0:1651532104.276162:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2307
00000100:00100000:1.0:1651532104.276164:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468174336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.276167:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.276170:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccf8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448010 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.276178:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccf8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448010 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.276182:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccf8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448010 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.276185:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532104.276198:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468174336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.276201:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2307
00000001:00080000:1.0:1651532104.333472:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793550 is committed
00010000:00010000:1.0:1651532104.333488:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.333492:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.333515:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.333516:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f23ba88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468168448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 433073us (433177us total) trans 158913793550 rc 0/0
00000100:00100000:1.0:1651532104.333519:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3784
00010000:00010000:0.0:1651532104.333520:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.333521:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.333524:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.333529:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.333530:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.333531:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.333534:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.333543:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.333546:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cbd9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3461120->9515007] (req 3461120->9515007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.333560:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.333564:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.333910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.333924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.333934:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468174528
00000100:00100000:1.0:1651532104.333945:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468174592
00000100:00100000:1.0:1651532104.333952:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3793
00000100:00100000:1.0:1651532104.333953:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468174528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532104.333961:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.333965:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532104.333966:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.333970:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532104.333970:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.333975:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.333978:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.333985:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3794
00000100:00100000:1.0:1651532104.333987:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468174592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532104.334000:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.334003:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.334004:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532104.334005:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.334008:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532104.486996:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793551 is committed
00010000:00010000:0.0:1651532104.487027:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487031:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.487065:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afa5d0ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468169664:12345-10.240.43.64@tcp:4:fio.0 Request processed in 469371us (469428us total) trans 158913793551 rc 0/0
00000100:00100000:0.0:1651532104.487069:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3785
00010000:00010000:0.0:1651532104.487077:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487080:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.487082:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487084:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487090:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.487090:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.487091:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487094:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487097:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.487098:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.487098:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487101:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487119:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487122:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cc11 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->8957951] (req 1384448->8957951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487124:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487127:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487130:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487131:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487439:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.487442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532104.487444:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.487464:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c48da76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468169792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 469737us (469818us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532104.487468:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3786
00010000:00010000:0.0:1651532104.487481:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487485:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.487492:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487504:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487508:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487512:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487522:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487525:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cc18 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8949759] (req 1155072->8949759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.487528:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468171328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 369665us (369699us total) trans 0 rc 36864/36864
00010000:00010000:0.0:1651532104.487529:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487531:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532104.487532:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3787
00010000:00010000:0.0:1651532104.487532:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487535:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487539:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.487539:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.487540:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487543:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487549:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487552:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cc65 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1421312->10014719] (req 1421312->10014719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487558:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.487561:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.487572:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468175040
00000100:00100000:1.0:1651532104.487587:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2308
00000100:00100000:1.0:1651532104.487589:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468175040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.487593:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.487597:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cd0d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448017 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487606:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cd0d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448017 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.487610:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cd0d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448017 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.487632:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532104.487645:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468175040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (204us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.487648:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2308
00000100:00100000:0.0:1651532104.487824:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.487834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.487849:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468175104
00000100:00100000:0.0:1651532104.487849:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.487863:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3795
00000100:00100000:1.0:1651532104.487865:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468175104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532104.487872:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487876:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532104.487877:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487880:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532104.487881:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487885:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487888:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.487903:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468175232
00000100:00100000:1.0:1651532104.487909:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468175296
00000100:00100000:1.0:1651532104.487916:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2309
00000100:00100000:1.0:1651532104.487925:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468175232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.487928:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.487931:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cd1b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44801e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487938:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cd1b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44801e expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.487942:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cd1b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44801e expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.487945:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532104.487953:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468175232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.487956:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2309
00000100:00100000:1.0:1651532104.487960:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2310
00000100:00100000:1.0:1651532104.487962:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468175296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.487964:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.487966:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40cd22 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448025 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.487973:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40cd22 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448025 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.487979:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40cd22 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448025 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532104.487980:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532104.487990:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532104.488001:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468175296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (152us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.488010:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.488025:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2310
00000100:00100000:1.0:1651532104.488042:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468175488
00000100:00100000:0.0:1651532104.488044:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.488056:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468175424
00000100:00100000:1.0:1651532104.488065:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3796
00000100:00100000:1.0:1651532104.488067:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468175488:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532104.488074:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3797
00000100:00100000:0.0:1651532104.488076:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468175424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532104.488080:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.488085:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532104.488086:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.488088:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532104.488089:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.488093:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.488097:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.488097:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.488103:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468175616
00010000:00010000:0.0:1651532104.488103:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532104.488104:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532104.488105:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.488108:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.488109:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2311
00000100:00100000:1.0:1651532104.488111:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468175616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.488123:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.488126:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cd37 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44802c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.488133:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cd37 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44802c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.488136:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cd37 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44802c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.488140:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532104.488150:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468175616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.488152:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2311
00000100:00100000:0.0:1651532104.488300:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.488318:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468175744
00000100:00100000:0.0:1651532104.488318:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.488333:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468175872
00000100:00100000:0.0:1651532104.488342:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2312
00000100:00100000:1.0:1651532104.488345:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2313
00000100:00100000:0.0:1651532104.488345:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000086bdfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468175744:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532104.488347:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468175872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.488349:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.488350:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.488353:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd45 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44803a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.488353:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40cd3e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448033 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.488362:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd45 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44803a expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.488363:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40cd3e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448033 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.488366:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd45 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44803a expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.488367:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40cd3e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448033 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.488370:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532104.488371:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000087dc8b1c, rc 0)
00000100:00100000:1.0:1651532104.488380:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468175872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.488380:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000086bdfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468175744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.488382:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2313
00000100:00100000:0.0:1651532104.488396:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2312
00000100:00100000:1.0:1651532104.488430:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.488448:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468176000
00000100:00100000:0.0:1651532104.488456:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2314
00000100:00100000:0.0:1651532104.488458:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468176000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.488461:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.488465:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f40cd4c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448041 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.488483:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f40cd4c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448041 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.488487:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f40cd4c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448041 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.488490:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043f2db54, rc 0)
00000100:00100000:0.0:1651532104.488500:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468176000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.488503:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2314
00000100:00100000:1.0:1651532104.488609:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.488619:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468176128
00000100:00100000:0.0:1651532104.488627:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2315
00000100:00100000:0.0:1651532104.488629:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468176128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.488632:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.488635:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f40cd53 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448048 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.488642:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f40cd53 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448048 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.488646:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f40cd53 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448048 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.488649:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f67c21a7, rc 0)
00000100:00100000:0.0:1651532104.488659:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468176128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.488671:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2315
00000100:00100000:1.0:1651532104.488882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.488893:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468176448
00000100:00100000:0.0:1651532104.488901:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2316
00000100:00100000:0.0:1651532104.488902:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096a49a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468176448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.488906:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.488909:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cd5a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44804f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.488916:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cd5a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44804f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.488919:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cd5a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44804f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.488923:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022e189ae, rc 0)
00000100:00100000:0.0:1651532104.488932:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096a49a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468176448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.488935:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2316
00000100:00100000:1.0:1651532104.489126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.489135:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468176576
00000100:00100000:0.0:1651532104.489142:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2317
00000100:00100000:0.0:1651532104.489144:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000386cd267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468176576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.489147:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.489150:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd61 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448056 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.489157:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd61 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448056 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.489170:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd61 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448056 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.489173:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d25e63b7, rc 0)
00000100:00100000:0.0:1651532104.489184:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000386cd267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468176576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.489187:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2317
00000100:00100000:1.0:1651532104.489376:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.489387:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468176704
00000100:00100000:0.0:1651532104.489395:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2318
00000100:00100000:0.0:1651532104.489396:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468176704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.489399:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.489403:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd68 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44805d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.489410:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd68 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44805d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.489414:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd68 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44805d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.489417:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077af4bf9, rc 0)
00000100:00100000:0.0:1651532104.489426:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468176704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.489429:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2318
00000001:00080000:1.0:1651532104.600066:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793552 is committed
00010000:00010000:0.0:1651532104.600096:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.600101:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.600122:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468171200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482254us (482284us total) trans 158913793552 rc 0/0
00000100:00100000:0.0:1651532104.600125:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3788
00010000:00010000:0.0:1651532104.600132:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.600136:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.600137:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.600140:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.600144:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.600145:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.600146:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.600149:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.600158:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.600170:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.600171:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cc6c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4218880->8859647] (req 4218880->8859647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.600176:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.600417:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.600430:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468176896
00000100:00100000:0.0:1651532104.600439:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2319
00000100:00100000:0.0:1651532104.600441:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468176896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.600444:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.600448:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd6f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448064 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.600455:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd6f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448064 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.600459:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd6f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448064 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.600463:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077af4bf9, rc 0)
00000100:00100000:0.0:1651532104.600477:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468176896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.600480:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2319
00000001:00080000:1.0:1651532104.666843:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793553 is committed
00002000:00010000:1.0:1651532104.666857:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532103 -> 1651532104
00010000:00010000:1.0:1651532104.666860:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.666865:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.666888:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468172992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 483020us (483109us total) trans 158913793553 rc 0/0
00010000:00010000:0.0:1651532104.666889:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.666893:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.666895:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.666901:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3789
00010000:00010000:0.0:1651532104.666905:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.666910:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.666911:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.666912:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.666915:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.666918:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.666919:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.666919:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.666922:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.666933:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.666936:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ccb9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9318399] (req 356352->9318399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.666941:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.666944:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.666959:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.666964:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.667330:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.667347:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.667358:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.667359:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468177152
00000100:00100000:1.0:1651532104.667368:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.667384:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468177280
00010000:00010000:1.0:1651532104.667390:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.667391:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3798
00000100:00100000:0.0:1651532104.667393:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468177152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532104.667394:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667400:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667410:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00000100:00100000:1.0:1651532104.667413:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468173888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391864us (391888us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532104.667415:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.667416:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3791
00010000:00010000:0.0:1651532104.667418:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667421:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532104.667421:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.667422:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3799
00000100:00100000:1.0:1651532104.667424:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468177280:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532104.667426:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667428:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667431:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667432:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667435:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.667437:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667440:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532104.667440:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667445:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667448:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667450:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667453:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.667454:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667457:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.667461:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468177344
00010000:00010000:0.0:1651532104.667462:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667465:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40cce3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2588672->10186751] (req 2588672->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.667468:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468177536
00000100:00100000:1.0:1651532104.667472:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2320
00000100:00100000:1.0:1651532104.667474:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468177344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.667475:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667477:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.667478:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667480:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cd84 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44806b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667485:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.667488:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cd84 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44806b expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.667492:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40cd84 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44806b expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532104.667493:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468173056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483617us (483673us total) trans 0 rc 53248/53248
00010000:00010000:1.0:1651532104.667495:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532104.667496:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3790
00010000:00010000:0.0:1651532104.667502:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.667513:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468177344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (155us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532104.667515:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000603f6abd already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532104.667516:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2320
00010000:00010000:0.0:1651532104.667516:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667519:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.667521:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2321
00000100:00100000:1.0:1651532104.667522:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2cf024f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468177536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.667524:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.667524:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.667525:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.667525:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667528:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40cd8b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448072 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667528:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.667535:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667537:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40cd8b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448072 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.667538:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40ccc0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [794624->7233535] (req 794624->7233535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667541:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40cd8b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448072 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.667543:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.667544:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532104.667546:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.667549:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2cf024f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468177536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (181us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.667551:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2321
00000100:00100000:0.0:1651532104.667970:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.668010:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.668020:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.668026:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.668033:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468177600
00000100:00100000:0.0:1651532104.668046:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3800
00000100:00100000:0.0:1651532104.668048:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6eb996c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468177600:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532104.668049:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468177664
00010000:00010000:0.0:1651532104.668055:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.668059:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468177856
00010000:00010000:0.0:1651532104.668060:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532104.668061:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468177792
00010000:00010000:0.0:1651532104.668061:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.668064:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.668065:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2322
00000100:00100000:1.0:1651532104.668066:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0dbb280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468177664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.668066:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532104.668067:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.668070:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.668071:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.668074:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cd99 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448079 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.668074:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.668077:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.668082:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cd99 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448079 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668086:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40cd99 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448079 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668090:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532104.668111:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0dbb280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468177664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.668114:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2322
00000100:00100000:1.0:1651532104.668119:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2323
00000100:00100000:1.0:1651532104.668120:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025404360 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468177856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.668123:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.668125:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cda0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448087 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.668126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532104.668131:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cda0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448087 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668135:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40cda0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448087 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668138:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532104.668144:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025404360 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468177856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.668161:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468178048
00000100:00100000:0.0:1651532104.668168:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2324
00000100:00100000:0.0:1651532104.668170:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000020c3a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468177792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.668173:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.668177:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cda7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448080 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.668179:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2323
00000100:00100000:1.0:1651532104.668184:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2325
00010000:00010000:0.0:1651532104.668185:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cda7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448080 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532104.668186:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62aec33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468178048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.668189:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.668189:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cda7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448080 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668192:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cdae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44808e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.668193:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022e189ae, rc 0)
00010000:00010000:1.0:1651532104.668199:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cdae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44808e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668203:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40cdae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44808e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532104.668203:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000020c3a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468177792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (177us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532104.668206:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532104.668206:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2324
00000100:00100000:1.0:1651532104.668213:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62aec33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468178048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.668216:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2325
00000100:00100000:1.0:1651532104.668405:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.668413:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468178240
00000100:00100000:1.0:1651532104.668419:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2326
00000100:00100000:1.0:1651532104.668421:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096a49a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468178240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.668424:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.668427:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cdb5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448095 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.668446:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cdb5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448095 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668450:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40cdb5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448095 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668453:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532104.668464:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096a49a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468178240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.668466:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.668475:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2326
00000100:00100000:1.0:1651532104.668480:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468178432
00000100:00100000:1.0:1651532104.668494:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2327
00000100:00100000:1.0:1651532104.668496:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468178432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.668499:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.668502:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cdbc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44809c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.668508:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cdbc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44809c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668511:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40cdbc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44809c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668514:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532104.668526:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468178432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.668535:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2327
00000100:00100000:0.0:1651532104.668568:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.668578:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468178560
00000100:00100000:1.0:1651532104.668584:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2328
00000100:00100000:1.0:1651532104.668586:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468178560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.668589:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.668592:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cdc3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480a3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.668598:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cdc3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480a3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668602:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40cdc3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480a3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668605:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532104.668614:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468178560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.668616:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2328
00000100:00100000:0.0:1651532104.668693:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.668703:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468178752
00000100:00100000:1.0:1651532104.668710:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2329
00000100:00100000:1.0:1651532104.668712:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468178752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.668715:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.668717:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cdca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480aa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.668724:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cdca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480aa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668728:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cdca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480aa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668732:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532104.668741:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468178752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.668743:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2329
00000100:00100000:0.0:1651532104.668946:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.668958:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468179072
00000100:00100000:1.0:1651532104.668967:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2330
00000100:00100000:1.0:1651532104.668969:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b09418 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468179072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.668972:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.668975:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdd1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480b1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.668983:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdd1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480b1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668986:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdd1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480b1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.668990:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532104.668999:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b09418 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468179072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.669002:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2330
00000100:00100000:0.0:1651532104.669205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.669215:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468179200
00000100:00100000:1.0:1651532104.669222:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2331
00000100:00100000:1.0:1651532104.669223:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e209f38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468179200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.669226:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.669229:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40cdd8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480b8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.669236:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40cdd8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480b8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.669240:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40cdd8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480b8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.669243:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532104.669252:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e209f38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468179200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.669255:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2331
00000001:00080000:1.0:1651532104.766877:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793554 is committed
00010000:00010000:0.0:1651532104.766908:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.766923:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.766940:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468173824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491389us (491425us total) trans 158913793554 rc 0/0
00000100:00100000:0.0:1651532104.766944:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3792
00010000:00010000:0.0:1651532104.766950:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.766954:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000035f6d17d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.766955:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.766958:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.766962:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.766963:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.766964:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.766967:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.766970:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.766970:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.766971:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.766983:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.766996:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.766998:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ccea lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3624960->9461759] (req 3624960->9461759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.767009:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.767014:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767029:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767033:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767195:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767200:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.767221:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468174592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433233us (433297us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532104.767225:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3794
00010000:00010000:0.0:1651532104.767232:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767245:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.767246:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767249:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767254:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767257:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40cd06 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->692223] (req 577536->692223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.767422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.767430:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.767438:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.767449:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468179328
00000100:00100000:0.0:1651532104.767459:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468179392
00000100:00100000:0.0:1651532104.767464:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3801
00000100:00100000:1.0:1651532104.767466:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468179520
00000100:00100000:0.0:1651532104.767466:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005707ba64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468179328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532104.767473:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.767477:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2332
00010000:00010000:0.0:1651532104.767477:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532104.767478:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.767479:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468179520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.767493:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.767497:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40cde6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480bf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767509:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532104.767510:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.767516:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40cde6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480bf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.767516:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767519:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.767521:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40cde6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480bf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.767524:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532104.767528:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3802
00000100:00100000:0.0:1651532104.767529:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1a53c01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468179392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532104.767535:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.767539:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468179520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.767542:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2332
00010000:00010000:0.0:1651532104.767545:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532104.767546:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767548:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532104.767549:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767552:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.767555:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.767560:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.767595:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468179648
00000100:00100000:1.0:1651532104.767602:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2333
00000100:00100000:1.0:1651532104.767604:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000386cd267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468179648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.767607:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.767610:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdf4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480c6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.767617:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdf4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480c6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.767621:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdf4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480c6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.767634:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532104.767649:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000386cd267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468179648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.767651:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2333
00000001:00080000:1.0:1651532104.891872:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793555 is committed
00010000:00010000:1.0:1651532104.891887:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.891891:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.891914:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468174528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557960us (558005us total) trans 158913793555 rc 0/0
00010000:00010000:0.0:1651532104.891915:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.891918:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3793
00010000:00010000:0.0:1651532104.891920:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.891921:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.891924:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.891930:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.891930:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.891931:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.891934:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.891943:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.891946:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ccff lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->9269247] (req 1241088->9269247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.891957:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.891961:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.892232:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.892239:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.892244:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468179968
00000100:00100000:0.0:1651532104.892247:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.892257:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468179904
00000100:00100000:1.0:1651532104.892264:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3803
00000100:00100000:1.0:1651532104.892266:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000086bdfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468179968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532104.892273:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.892279:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3804
00000100:00100000:0.0:1651532104.892281:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468179904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532104.892289:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532104.892290:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.892294:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.892294:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.892298:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532104.892299:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.892301:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468180032
00010000:00010000:0.0:1651532104.892302:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.892305:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532104.892306:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.892320:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2334
00010000:00010000:0.0:1651532104.892320:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.892321:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468180032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.892323:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.892324:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.892326:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.892327:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce09 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480cd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.892335:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce09 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480cd expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.892339:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce09 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480cd expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.892342:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532104.892379:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468180032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (132us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.892382:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2334
00000100:00100000:0.0:1651532104.892390:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.892431:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468180096
00000100:00100000:0.0:1651532104.892431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.892441:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468180224
00000100:00100000:0.0:1651532104.892447:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2335
00000100:00100000:0.0:1651532104.892449:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468180096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532104.892455:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2336
00000100:00100000:1.0:1651532104.892457:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468180224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.892460:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.892462:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.892464:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce10 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480db expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.892466:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f40ce17 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480d4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.892471:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce10 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480db expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.892474:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f40ce17 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480d4 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.892475:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce10 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480db expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.892478:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:0.0:1651532104.892478:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f40ce17 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480d4 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.892482:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f67c21a7, rc 0)
00000100:00100000:1.0:1651532104.892488:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468180224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.892490:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468180096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.892491:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2336
00000100:00100000:0.0:1651532104.892493:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2335
00000100:00100000:0.0:1651532104.892760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.892767:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468180480
00000100:00100000:0.0:1651532104.892774:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2337
00000100:00100000:0.0:1651532104.892776:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468180480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.892779:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.892782:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f40ce1e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480e2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.892790:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f40ce1e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480e2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.892794:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f40ce1e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480e2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.892826:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043f2db54, rc 0)
00000100:00100000:0.0:1651532104.892839:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468180480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.892842:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2337
00000100:00100000:0.0:1651532104.928107:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532104.928116:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231488
00000100:00100000:0.0:1651532104.928124:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 57
00000100:00100000:0.0:1651532104.928126:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231488:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532104.928131:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 573440 granted 350917184 pending 258048 free 81138851840 avail 76966047744
00000100:00100000:0.0:1651532104.928148:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231488:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 21us (41us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532104.928151:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 57
00000001:00080000:1.0:1651532104.958563:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793556 is committed
00002000:00010000:1.0:1651532104.958577:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532103 -> 1651532104
00010000:00010000:1.0:1651532104.958580:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.958583:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.958604:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468175104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 470738us (470781us total) trans 158913793556 rc 0/0
00000100:00100000:1.0:1651532104.958608:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3795
00010000:00010000:0.0:1651532104.958608:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.958612:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532104.958613:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.958616:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.958622:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.958622:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.958623:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.958636:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.958640:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.958640:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532104.958641:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.958644:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.958652:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.958655:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40cd14 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->7864319] (req 974848->7864319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.958658:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.958660:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.958662:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.958663:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.958676:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.958679:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.958697:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468175488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 470630us (470717us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532104.958700:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3796
00010000:00010000:1.0:1651532104.958739:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.958744:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532104.958745:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.958748:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.958754:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.958757:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40cd29 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7528448->7532543] (req 7528448->7532543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.958990:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.959004:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532104.959012:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.959020:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468180672
00000100:00100000:1.0:1651532104.959022:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.959027:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468180736
00000100:00100000:1.0:1651532104.959030:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468180800
00000100:00100000:1.0:1651532104.959036:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2338
00000100:00100000:1.0:1651532104.959038:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468180672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.959047:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532104.959048:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468180864
00010000:00010000:1.0:1651532104.959051:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce25 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480e9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.959052:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2339
00000100:00100000:0.0:1651532104.959054:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468180800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.959059:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce25 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480e9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532104.959063:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce25 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480e9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.959065:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.959066:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:0.0:1651532104.959068:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f40ce2c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480f7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.959075:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468180672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (86us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532104.959076:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f40ce2c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480f7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532104.959078:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2338
00010000:00010000:0.0:1651532104.959080:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f40ce2c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480f7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532104.959084:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2340
00010000:00010000:0.0:1651532104.959084:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043f2db54, rc 0)
00000100:00100000:1.0:1651532104.959086:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468180736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532104.959088:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532104.959091:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce33 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480f0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532104.959093:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468180800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (81us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532104.959096:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce33 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480f0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532104.959096:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2339
00010000:00010000:1.0:1651532104.959100:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce33 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480f0 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532104.959101:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2341
00010000:00010000:1.0:1651532104.959103:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532104.959103:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468180864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.959105:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.959107:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f40ce3a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4480fe expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.959108:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468180736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.959111:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2340
00010000:00010000:0.0:1651532104.959113:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f40ce3a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480fe expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.959117:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f40ce3a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4480fe expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532104.959124:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532104.959130:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f67c21a7, rc 0)
00000100:00100000:0.0:1651532104.959137:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468180864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532104.959139:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.959140:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2341
00000100:00100000:0.0:1651532104.959153:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468180992
00000100:00100000:0.0:1651532104.959161:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468180928
00000100:00100000:0.0:1651532104.959166:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3805
00000100:00100000:0.0:1651532104.959168:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468180992:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532104.959174:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.959178:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532104.959179:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.959182:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532104.959182:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.959187:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.959190:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.959191:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3806
00000100:00100000:1.0:1651532104.959193:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468180928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532104.959200:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.959204:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532104.959205:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.959208:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532104.959209:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.959225:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532104.959228:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532104.959451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.959462:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468181120
00000100:00100000:0.0:1651532104.959470:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2342
00000100:00100000:0.0:1651532104.959480:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ae2c042 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468181120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.959483:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.959487:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40ce4f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448105 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.959494:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40ce4f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448105 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.959498:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40ce4f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448105 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.959501:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532104.959516:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ae2c042 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468181120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.959519:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2342
00000100:00100000:1.0:1651532104.959755:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532104.959765:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468181440
00000100:00100000:0.0:1651532104.959773:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2343
00000100:00100000:0.0:1651532104.959775:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc66c150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468181440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532104.959778:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532104.959781:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce56 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44810c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532104.959788:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce56 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44810c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.959792:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce56 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44810c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532104.959818:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532104.959830:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc66c150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468181440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532104.959833:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2343
00000001:00080000:1.0:1651532105.000547:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793557 is committed
00010000:00010000:0.0:1651532105.000577:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.000581:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.000602:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468175424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 512525us (512592us total) trans 158913793557 rc 0/0
00000100:00100000:0.0:1651532105.000605:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3797
00010000:00010000:0.0:1651532105.000612:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.000616:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008bdd51b3 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.000617:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.000619:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.000624:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.000625:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.000625:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.000636:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.000644:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.000647:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f40cd30 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6840320->6844415] (req 6840320->6844415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.000652:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.000655:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532105.125304:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793558 is committed
00010000:00010000:0.0:1651532105.125344:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125348:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.125371:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468177152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457977us (458041us total) trans 158913793558 rc 0/0
00000100:00100000:0.0:1651532105.125374:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3798
00010000:00010000:0.0:1651532105.125381:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125387:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077af4bf9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.125388:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125391:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125396:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.125396:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.125397:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125400:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125406:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125409:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f40cd76 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [995328->9371647] (req 995328->9371647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.125415:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.125421:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.125873:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.125888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.125898:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.125900:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468181696
00000100:00100000:1.0:1651532105.125907:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.125919:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468181760
00000100:00100000:0.0:1651532105.125925:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3807
00010000:00010000:1.0:1651532105.125927:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.125927:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468181696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532105.125932:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125934:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.125947:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468177280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458522us (458600us total) trans 0 rc 45056/45056
00010000:00010000:0.0:1651532105.125950:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532105.125951:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125954:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532105.125954:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125959:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.125960:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3799
00010000:00010000:0.0:1651532105.125962:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.125966:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3808
00000100:00100000:1.0:1651532105.125968:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468181760:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532105.125972:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468181824
00010000:00010000:1.0:1651532105.125976:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.125978:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468181952
00010000:00010000:1.0:1651532105.125980:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.125982:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.125985:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2344
00000100:00100000:0.0:1651532105.125987:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468181824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.125990:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.125991:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532105.125992:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125993:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40ce6b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448113 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.125997:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.125998:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.126000:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.126001:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40ce6b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448113 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.126005:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40ce6b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448113 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.126007:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.126010:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532105.126011:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.126015:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:1.0:1651532105.126016:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.126021:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.126022:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.126023:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.126024:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468181824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (126us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532105.126026:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.126027:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2344
00000100:00100000:0.0:1651532105.126032:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2345
00010000:00010000:1.0:1651532105.126035:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.126038:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40cd7d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->9031679] (req 327680->9031679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.126041:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468181952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.126044:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.126047:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40ce72 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44811a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.126053:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40ce72 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44811a expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.126057:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40ce72 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44811a expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.126060:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532105.126066:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468181952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (159us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.126068:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2345
00010000:00010000:0.0:1651532105.126074:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.126078:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.126478:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.126486:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.126493:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468182208
00000100:00100000:1.0:1651532105.126503:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468182528
00000100:00100000:1.0:1651532105.126508:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2346
00000100:00100000:1.0:1651532105.126510:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b87a626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468182208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.126513:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.126517:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce79 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448121 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.126525:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce79 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448121 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.126530:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce79 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448121 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.126534:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532105.126540:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2347
00000100:00100000:0.0:1651532105.126542:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000284741f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468182528:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532105.126544:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b87a626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468182208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (66us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532105.126546:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532105.126547:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2346
00010000:00010000:0.0:1651532105.126550:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40ce80 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448128 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.126557:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40ce80 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448128 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.126561:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40ce80 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448128 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.126565:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532105.126579:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000284741f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468182528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.126581:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2347
00000100:00100000:1.0:1651532105.126843:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.126854:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468182656
00000100:00100000:0.0:1651532105.126865:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2348
00000100:00100000:0.0:1651532105.126867:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468182656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.126871:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.126874:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40ce87 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44812f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.126881:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40ce87 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44812f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.126895:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40ce87 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44812f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.126899:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532105.126914:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468182656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.126917:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2348
00000100:00100000:1.0:1651532105.127139:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.127149:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468182848
00000100:00100000:0.0:1651532105.127159:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2349
00000100:00100000:0.0:1651532105.127161:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468182848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.127164:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.127168:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40ce8e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448136 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.127175:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40ce8e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448136 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.127179:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40ce8e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448136 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.127182:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532105.127194:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468182848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.127196:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2349
00000001:00080000:1.0:1651532105.233704:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793559 is committed
00010000:00010000:0.0:1651532105.233751:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.233758:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.233785:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6eb996c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468177600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565735us (565814us total) trans 158913793559 rc 0/0
00000100:00100000:0.0:1651532105.233789:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3800
00010000:00010000:0.0:1651532105.233798:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.233814:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d25e63b7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.233815:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.233819:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.233825:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.233826:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.233827:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.233833:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.233844:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.233860:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f40cd92 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->5455871] (req 176128->5455871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.233867:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.233871:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.234179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.234189:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.234197:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.234206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.234214:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468183040
00000100:00100000:1.0:1651532105.234227:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468183104
00000100:00100000:1.0:1651532105.234234:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3809
00000100:00100000:1.0:1651532105.234236:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468183040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532105.234244:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.234249:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532105.234250:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.234253:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532105.234254:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.234258:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.234262:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.234269:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468183168
00000100:00100000:1.0:1651532105.234274:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468183232
00000100:00100000:0.0:1651532105.234275:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3810
00000100:00100000:1.0:1651532105.234278:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2350
00000100:00100000:0.0:1651532105.234278:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468183104:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532105.234280:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468183168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.234282:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.234285:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ce9c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44813d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.234287:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.234292:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ce9c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44813d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.234292:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532105.234293:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.234296:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532105.234297:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.234301:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ce9c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44813d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.234302:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.234305:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:0.0:1651532105.234305:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.234325:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468183168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (128us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.234328:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2350
00000100:00100000:1.0:1651532105.234333:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2351
00000100:00100000:1.0:1651532105.234335:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468183232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.234338:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.234340:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ceaa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448144 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.234347:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ceaa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448144 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.234350:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ceaa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448144 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.234354:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532105.234359:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468183232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (153us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.234361:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2351
00000100:00100000:1.0:1651532105.234619:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.234627:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468183424
00000100:00100000:1.0:1651532105.234637:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2352
00000100:00100000:1.0:1651532105.234639:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468183424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.234642:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.234646:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ceb1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44814b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.234653:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ceb1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44814b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.234668:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ceb1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44814b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.234671:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532105.234683:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468183424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.234685:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2352
00000001:00080000:1.0:1651532105.317031:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793560 is committed
00010000:00010000:0.0:1651532105.317063:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317068:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.317093:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005707ba64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468179328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549625us (549671us total) trans 158913793560 rc 0/0
00000100:00100000:0.0:1651532105.317096:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3801
00010000:00010000:0.0:1651532105.317104:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317108:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022e189ae already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.317109:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317112:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317117:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.317118:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.317119:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317122:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317141:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.317143:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.317143:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317147:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317161:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317164:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f40cddf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9670655] (req 1069056->9670655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.317170:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317170:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317173:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.317175:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.317525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.317533:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.317545:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468183680
00010000:00010000:1.0:1651532105.317557:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.317559:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468183616
00010000:00010000:1.0:1651532105.317561:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.317564:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2353
00000100:00100000:0.0:1651532105.317566:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468183680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.317570:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.317574:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40ceb8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448159 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.317579:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000086bdfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468179968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425312us (425348us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532105.317582:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3803
00010000:00010000:1.0:1651532105.317589:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317597:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.317600:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.317601:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40ceb8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448159 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.317602:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.317605:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317605:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40ceb8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448159 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.317609:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532105.317611:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.317613:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cdfb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2990080->5246975] (req 2990080->5246975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.317619:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468183680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.317621:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2354
00000100:00100000:1.0:1651532105.317623:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468183616:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532105.317623:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2353
00010000:00010000:1.0:1651532105.317627:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.317630:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cebf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448152 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.317635:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.317637:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cebf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448152 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.317637:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317640:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.317645:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cebf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448152 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532105.317652:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1a53c01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468179392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 550122us (550222us total) trans 0 rc 49152/49152
00000100:00100000:0.0:1651532105.317655:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3802
00010000:00010000:1.0:1651532105.317657:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:0.0:1651532105.317662:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.317665:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468183616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (132us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532105.317665:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000603f6abd already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.317666:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.317668:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2354
00010000:00010000:0.0:1651532105.317680:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317685:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.317685:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.317686:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317689:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317697:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317700:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f40cded lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->9703423] (req 421888->9703423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317705:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.317708:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.318224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.318236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.318247:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468183808
00000100:00100000:0.0:1651532105.318248:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.318256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.318266:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.318270:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468183872
00000100:00100000:1.0:1651532105.318278:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3811
00000100:00100000:1.0:1651532105.318279:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468183808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532105.318286:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.318290:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3812
00010000:00010000:1.0:1651532105.318291:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532105.318292:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.318292:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468183872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532105.318295:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532105.318296:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.318300:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.318302:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.318304:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.318315:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532105.318317:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.318320:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532105.318321:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.318325:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.318328:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.318329:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468184128
00000100:00100000:1.0:1651532105.318338:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468184192
00000100:00100000:1.0:1651532105.318341:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468184384
00000100:00100000:1.0:1651532105.318344:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2355
00000100:00100000:1.0:1651532105.318346:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468184128:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532105.318346:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2356
00000100:00100000:0.0:1651532105.318348:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468184192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.318349:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.318351:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ced4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448160 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.318351:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.318354:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cedb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448167 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.318358:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ced4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448160 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.318362:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ced4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448160 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.318362:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cedb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448167 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.318366:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532105.318377:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468184128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (129us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532105.318378:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cedb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448167 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532105.318379:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2355
00010000:00010000:0.0:1651532105.318381:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532105.318384:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2357
00000100:00100000:1.0:1651532105.318385:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468184384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.318388:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.318390:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cee2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44816e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.318391:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468184192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.318394:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2356
00010000:00010000:1.0:1651532105.318395:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cee2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44816e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.318402:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cee2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44816e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.318405:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532105.318411:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468184384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (144us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.318413:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2357
00000100:00100000:0.0:1651532105.318674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.318694:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468184512
00000100:00100000:1.0:1651532105.318705:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2358
00000100:00100000:1.0:1651532105.318707:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468184512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.318710:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.318713:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cee9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448175 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.318720:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cee9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448175 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.318724:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cee9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448175 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.318727:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532105.318737:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468184512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.318739:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2358
00000100:00100000:0.0:1651532105.318959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.318978:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468184896
00000100:00100000:1.0:1651532105.318989:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2359
00000100:00100000:1.0:1651532105.318990:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468184896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.318994:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.318997:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cef0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44817c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.319004:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cef0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44817c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.319008:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cef0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44817c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.319011:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532105.319021:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468184896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.319023:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2359
00000100:00100000:0.0:1651532105.319233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.319252:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468185024
00000100:00100000:1.0:1651532105.319264:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2360
00000100:00100000:1.0:1651532105.319266:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468185024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.319269:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.319272:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cef7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448183 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.319279:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cef7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448183 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.319293:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cef7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448183 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.319297:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532105.319316:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468185024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.319318:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2360
00000100:00100000:0.0:1651532105.319553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.319572:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468185152
00000100:00100000:1.0:1651532105.319583:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2361
00000100:00100000:1.0:1651532105.319585:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085b1d320 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468185152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.319588:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.319591:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cefe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44818a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.319598:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cefe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44818a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.319602:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cefe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44818a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.319605:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532105.319615:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085b1d320 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468185152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.319617:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2361
00000001:00080000:1.0:1651532105.433746:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793561 is committed
00010000:00010000:0.0:1651532105.433782:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.433787:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.433825:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468179904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541543us (541585us total) trans 158913793561 rc 0/0
00000100:00100000:0.0:1651532105.433828:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3804
00010000:00010000:1.0:1651532105.433832:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.433836:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000035f6d17d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532105.433837:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.433841:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.433847:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.433847:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.433848:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.433851:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.433861:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.433871:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f40ce02 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->6139903] (req 696320->6139903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.433871:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.433877:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.434224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.434236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.434243:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.434254:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.434260:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468185472
00000100:00100000:0.0:1651532105.434266:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468185280
00000100:00100000:1.0:1651532105.434272:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468185536
00000100:00100000:1.0:1651532105.434278:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2362
00000100:00100000:1.0:1651532105.434280:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468185472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.434285:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532105.434287:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468185344
00000100:00100000:0.0:1651532105.434294:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3813
00010000:00010000:1.0:1651532105.434296:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf05 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448191 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.434296:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e251c56c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468185280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532105.434301:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.434303:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.434304:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf05 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448191 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.434318:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf05 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448191 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.434322:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:0.0:1651532105.434328:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532105.434329:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.434333:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532105.434333:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.434334:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468185472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.434336:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2362
00010000:00010000:0.0:1651532105.434338:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.434342:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2363
00010000:00010000:0.0:1651532105.434342:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.434343:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a5796b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468185536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.434346:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.434348:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf13 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448198 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.434352:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3814
00010000:00010000:1.0:1651532105.434353:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532105.434354:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5d14c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468185344:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532105.434355:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf13 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448198 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.434359:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf13 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448198 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.434368:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.434371:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.434372:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:0.0:1651532105.434372:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.434375:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532105.434376:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.434379:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a5796b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468185536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (125us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532105.434379:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.434382:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2363
00010000:00010000:0.0:1651532105.434382:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.434394:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.434397:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.434418:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468180992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 475248us (475293us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532105.434423:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3805
00010000:00010000:1.0:1651532105.434444:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.434448:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087dc8b1c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532105.434449:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.434452:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.434457:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.434458:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.434459:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.434462:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.434469:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.434472:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f40ce41 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8249343] (req 458752->8249343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.434489:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.434492:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.434738:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.434767:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468185728
00000100:00100000:0.0:1651532105.434778:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2364
00000100:00100000:0.0:1651532105.434780:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468185728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.434792:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.434796:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf21 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44819f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.434818:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf21 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44819f expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.434823:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf21 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44819f expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.434826:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532105.434840:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468185728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.434843:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2364
00000001:00080000:1.0:1651532105.517063:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793562 is committed
00010000:00010000:1.0:1651532105.517078:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.517082:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.517103:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468180928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557909us (557964us total) trans 158913793562 rc 0/0
00000100:00100000:1.0:1651532105.517106:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3806
00010000:00010000:0.0:1651532105.517107:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517112:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.517113:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517116:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517122:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.517123:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.517123:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517137:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517148:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517153:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ce48 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8019968->9871359] (req 8019968->9871359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517162:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517165:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.517499:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.517507:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.517518:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.517527:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468185920
00000100:00100000:1.0:1651532105.517539:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468185856
00000100:00100000:1.0:1651532105.517547:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3815
00000100:00100000:1.0:1651532105.517548:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca2c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468185920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532105.517555:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.517562:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532105.517564:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.517567:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.517579:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3816
00000100:00100000:1.0:1651532105.517581:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468185856:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532105.517585:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.517588:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532105.517589:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.517589:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468185984
00010000:00010000:1.0:1651532105.517592:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.517594:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532105.517595:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.517602:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2365
00000100:00100000:0.0:1651532105.517604:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468185984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.517606:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517608:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.517609:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517612:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf36 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481a6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517620:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf36 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481a6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.517621:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.517624:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf36 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481a6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.517637:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532105.517663:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468185984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (144us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.517666:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2365
00000001:00080000:1.0:1651532105.633760:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793563 is committed
00002000:00010000:0.0:1651532105.633790:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532104 -> 1651532105
00010000:00010000:0.0:1651532105.633794:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.633797:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.633821:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.633825:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532105.633827:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.633831:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468181696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507903us (507958us total) trans 158913793563 rc 0/0
00010000:00010000:1.0:1651532105.633834:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.633835:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3807
00010000:00010000:1.0:1651532105.633840:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.633841:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.633842:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.633845:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.633851:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.633854:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40ce5d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->9342975] (req 1056768->9342975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.633872:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.633878:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.634155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.634163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.634182:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468186176
00000100:00100000:1.0:1651532105.634194:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468186240
00000100:00100000:0.0:1651532105.634200:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.634205:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468186304
00000100:00100000:1.0:1651532105.634209:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2366
00000100:00100000:1.0:1651532105.634210:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468186176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532105.634213:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2367
00010000:00010000:1.0:1651532105.634214:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532105.634215:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096331adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468186240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.634218:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf3d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481ad expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.634223:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.634226:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf3d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481ad expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.634230:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf3d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481ad expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.634231:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.634234:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:0.0:1651532105.634235:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf44 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481b4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634241:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.634244:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf44 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481b4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532105.634245:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468186176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.634248:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2366
00010000:00010000:0.0:1651532105.634249:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf44 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481b4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.634252:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532105.634253:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2368
00000100:00100000:1.0:1651532105.634254:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468186304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.634257:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.634259:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cf4b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481bb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.634261:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096331adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468186240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.634264:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2367
00010000:00010000:1.0:1651532105.634266:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.634268:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cf4b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481bb expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.634271:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cf4b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481bb expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.634274:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:0.0:1651532105.634277:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.634280:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468186304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (81us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532105.634281:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.634282:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2368
00000100:00100000:0.0:1651532105.634292:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468181760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508324us (508404us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532105.634295:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3808
00010000:00010000:0.0:1651532105.634301:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634317:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.634319:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634322:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634327:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.634328:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.634329:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634332:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634341:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634344:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ce64 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->9445375] (req 1183744->9445375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634359:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634364:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.634842:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.634866:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468186496
00000100:00100000:1.0:1651532105.634872:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.634886:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468186560
00000100:00100000:0.0:1651532105.634893:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3817
00000100:00100000:1.0:1651532105.634894:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.634895:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468186496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532105.634907:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.634909:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3818
00000100:00100000:1.0:1651532105.634911:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468186560:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532105.634912:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532105.634913:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634916:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532105.634917:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.634920:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634921:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.634924:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532105.634925:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532105.634926:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.634931:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634931:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.634940:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468186752
00000100:00100000:0.0:1651532105.634949:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2369
00000100:00100000:0.0:1651532105.634950:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468186752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.634953:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.634956:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40cf60 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481c2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.634963:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40cf60 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481c2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.634975:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40cf60 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481c2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.634979:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532105.634991:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468186752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.634994:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2369
00000001:00080000:1.0:1651532105.767079:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793564 is committed
00010000:00010000:0.0:1651532105.767112:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.767117:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.767138:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468183040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532900us (532959us total) trans 158913793564 rc 0/0
00010000:00010000:1.0:1651532105.767139:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.767141:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3809
00010000:00010000:1.0:1651532105.767144:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532105.767145:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.767148:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.767154:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.767154:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.767155:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.767158:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.767168:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.767171:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ce95 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10035199] (req 720896->10035199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.767179:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.767185:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.767489:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.767515:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532105.767534:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.767536:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468187008
00000100:00100000:1.0:1651532105.767547:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468187072
00000100:00100000:1.0:1651532105.767554:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2370
00010000:00010000:0.0:1651532105.767557:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.767563:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c52c0bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468187008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.767567:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.767576:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cf67 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481c9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.767582:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.767585:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cf67 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481c9 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.767589:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cf67 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481c9 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.767593:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532105.767598:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468183104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533319us (533408us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532105.767601:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3810
00000100:00100000:1.0:1651532105.767602:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c52c0bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468187008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.767605:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2370
00000100:00100000:0.0:1651532105.767610:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2371
00000100:00100000:0.0:1651532105.767612:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9301923 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468187072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.767615:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.767616:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.767618:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532105.767619:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.767620:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40cf6e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481d0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.767622:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.767625:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.767629:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.767630:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40cf6e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481d0 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.767638:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.767639:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.767642:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.767647:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40cf6e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481d0 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.767650:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.767650:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:1.0:1651532105.767653:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40cea3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10272767] (req 430080->10272767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.767658:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.767658:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9301923 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468187072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (143us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532105.767661:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.767661:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2371
00000100:00100000:0.0:1651532105.767678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.767714:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468187200
00000100:00100000:0.0:1651532105.767735:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2372
00000100:00100000:0.0:1651532105.767737:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468187200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.767743:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.767747:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf75 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481d7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.767755:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf75 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481d7 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.767759:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40cf75 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481d7 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.767763:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532105.767774:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468187200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.767779:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2372
00000100:00100000:0.0:1651532105.768098:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.768108:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.768115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.768121:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468187264
00000100:00100000:0.0:1651532105.768135:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468187392
00000100:00100000:1.0:1651532105.768140:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3819
00000100:00100000:1.0:1651532105.768142:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468187264:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532105.768145:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3820
00000100:00100000:0.0:1651532105.768147:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c0ee2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468187392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532105.768151:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.768155:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532105.768155:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.768156:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.768159:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.768170:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532105.768171:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.768193:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532105.768203:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.768207:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532105.768207:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.768212:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.768213:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.768215:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.768217:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.768218:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.768226:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468187648
00000100:00100000:0.0:1651532105.768233:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2373
00000100:00100000:0.0:1651532105.768235:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b4b17ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468187648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.768238:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.768241:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40cf8a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481de expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.768249:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40cf8a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481de expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.768253:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40cf8a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481de expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.768256:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532105.768266:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b4b17ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468187648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (152us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.768277:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2373
00000100:00100000:0.0:1651532105.768294:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.768328:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468187776
00000100:00100000:0.0:1651532105.768338:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2374
00000100:00100000:0.0:1651532105.768340:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085b1d320 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468187776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.768343:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.768347:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40cf91 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481e5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.768354:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40cf91 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481e5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.768358:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40cf91 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481e5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.768362:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532105.768371:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085b1d320 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468187776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.768374:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2374
00000100:00100000:0.0:1651532105.768534:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.768541:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468187968
00000100:00100000:0.0:1651532105.768549:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2375
00000100:00100000:0.0:1651532105.768550:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468187968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.768554:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.768558:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40cf98 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481ec expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.768575:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40cf98 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481ec expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.768579:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40cf98 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481ec expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.768583:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532105.768593:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468187968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.768596:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2375
00000100:00100000:0.0:1651532105.768660:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.768667:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468188096
00000100:00100000:0.0:1651532105.768674:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2376
00000100:00100000:0.0:1651532105.768676:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a5796b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468188096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.768679:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.768683:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40cf9f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481f3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.768690:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40cf9f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481f3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.768693:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40cf9f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481f3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.768697:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532105.768717:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a5796b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468188096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.768720:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2376
00000100:00100000:0.0:1651532105.768951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.768958:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468188352
00000100:00100000:0.0:1651532105.768965:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2377
00000100:00100000:0.0:1651532105.768967:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468188352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.768970:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.768974:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfa6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4481fa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.768981:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfa6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481fa expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.768985:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfa6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4481fa expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.768989:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532105.768998:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468188352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.769000:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2377
00000100:00100000:0.0:1651532105.769222:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.769229:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468188480
00000100:00100000:0.0:1651532105.769236:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2378
00000100:00100000:0.0:1651532105.769238:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096331adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468188480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.769241:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.769255:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448201 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.769262:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448201 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.769266:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448201 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.769269:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532105.769279:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096331adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468188480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.769282:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2378
00000001:00080000:1.0:1651532105.875440:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793565 is committed
00010000:00010000:1.0:1651532105.875455:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.875459:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.875481:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468183808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557201us (557258us total) trans 158913793565 rc 0/0
00010000:00010000:0.0:1651532105.875484:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.875485:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3811
00010000:00010000:0.0:1651532105.875489:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.875491:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875494:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875500:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.875501:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.875502:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875505:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875522:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875527:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40cec6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4493312->8093695] (req 4493312->8093695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875537:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875540:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.875794:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532105.875833:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.875835:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468188736
00010000:00010000:0.0:1651532105.875837:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.875853:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2379
00000100:00100000:1.0:1651532105.875855:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf91ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468188736:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532105.875860:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468183872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 557567us (557624us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532105.875864:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3812
00010000:00010000:1.0:1651532105.875866:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.875870:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cfb4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448208 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.875876:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.875879:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cfb4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448208 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.875883:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cfb4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448208 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.875887:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:0.0:1651532105.875899:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.875906:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf91ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468188736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (113us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532105.875906:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.875908:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.875909:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2379
00010000:00010000:0.0:1651532105.875923:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875928:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.875929:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.875930:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875933:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875943:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875947:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cecd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->5648383] (req 1794048->5648383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875954:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.875957:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.876231:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.876250:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.876261:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468188800
00000100:00100000:0.0:1651532105.876261:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.876271:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468188864
00000100:00100000:1.0:1651532105.876277:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3821
00000100:00100000:1.0:1651532105.876278:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468188800:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532105.876283:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3822
00010000:00010000:1.0:1651532105.876285:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.876290:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532105.876291:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.876293:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b87a626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468188864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532105.876294:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532105.876294:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.876300:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.876317:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532105.876318:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.876321:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532105.876322:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.876326:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.876327:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.876330:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.876330:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.876339:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468188992
00000100:00100000:1.0:1651532105.876349:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2380
00000100:00100000:1.0:1651532105.876350:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000284741f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468188992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.876353:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.876356:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40cfc9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44820f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.876363:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40cfc9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44820f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.876367:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40cfc9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44820f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.876371:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532105.876381:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000284741f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468188992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.876384:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2380
00000001:00080000:1.0:1651532105.975434:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793566 is committed
00010000:00010000:0.0:1651532105.975478:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.975482:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975505:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.975507:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e251c56c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468185280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541210us (541284us total) trans 158913793566 rc 0/0
00000100:00100000:0.0:1651532105.975510:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3813
00010000:00010000:1.0:1651532105.975516:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532105.975517:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975521:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975526:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.975527:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.975528:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975531:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975534:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.975534:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.975535:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975538:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975560:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975563:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40cf0c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2486272->9867263] (req 2486272->9867263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975572:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975575:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.975575:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.975587:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.975868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.975887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532105.975902:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975906:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.975910:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.975919:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.975926:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca2c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468185920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458377us (458427us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532105.975930:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3815
00000100:00100000:0.0:1651532105.975934:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5d14c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468185344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 541580us (541698us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532105.975937:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3814
00000100:00100000:1.0:1651532105.975938:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468189184
00000100:00100000:1.0:1651532105.975947:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468189312
00000100:00100000:1.0:1651532105.975952:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2381
00010000:00010000:0.0:1651532105.975953:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.975954:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468189184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.975957:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.975959:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532105.975960:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975961:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40cfd0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448216 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.975966:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532105.975969:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40cfd0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448216 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.975984:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40cfd0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448216 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.975988:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:0.0:1651532105.975994:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.976003:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.976004:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468189184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.976007:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2381
00000100:00100000:1.0:1651532105.976012:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2382
00000100:00100000:1.0:1651532105.976014:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468189312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.976017:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.976018:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40cf28 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->5775359] (req 2719744->5775359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976019:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cfd7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44821d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.976022:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976024:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.976025:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532105.976026:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cfd7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44821d expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.976026:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976029:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40cfd7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44821d expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.976029:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976033:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:0.0:1651532105.976033:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.976034:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532105.976035:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.976038:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468189312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (151us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532105.976038:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532105.976040:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2382
00010000:00010000:0.0:1651532105.976047:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.976051:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40cf1a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2625536->9699327] (req 2625536->9699327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976057:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976060:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.976069:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.976081:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468189376
00000100:00100000:1.0:1651532105.976093:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2383
00000100:00100000:1.0:1651532105.976095:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468189376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.976098:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532105.976099:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532105.976100:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cfde lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448224 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976113:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cfde lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448224 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.976117:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40cfde lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448224 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.976121:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532105.976136:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468189504
00000100:00100000:0.0:1651532105.976146:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2384
00000100:00100000:0.0:1651532105.976149:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468189504:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532105.976157:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468189376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.976160:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2383
00010000:00010000:0.0:1651532105.976162:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.976166:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cfe5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44822b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.976176:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cfe5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44822b expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.976183:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40cfe5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44822b expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.976207:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532105.976223:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468189504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 74us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.976227:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2384
00000100:00100000:1.0:1651532105.976497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.976509:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.976528:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468189632
00000100:00100000:1.0:1651532105.976533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.976545:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.976547:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468189568
00000100:00100000:0.0:1651532105.976554:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3823
00000100:00100000:0.0:1651532105.976561:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468189632:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532105.976564:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3824
00000100:00100000:1.0:1651532105.976566:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468189568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532105.976569:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.976573:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532105.976575:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.976575:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976588:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532105.976589:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976592:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976595:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532105.976595:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.976599:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976600:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976602:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976606:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532105.976625:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468189760
00000100:00100000:0.0:1651532105.976636:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468189824
00000100:00100000:1.0:1651532105.976640:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2385
00000100:00100000:1.0:1651532105.976647:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063e5a52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468189760:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532105.976648:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2386
00010000:00010000:1.0:1651532105.976650:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532105.976650:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468189824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.976653:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cffa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448232 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.976653:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.976660:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cffa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448232 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.976663:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d001 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448239 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.976664:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40cffa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448232 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.976668:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:0.0:1651532105.976671:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d001 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448239 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.976676:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d001 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448239 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532105.976678:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063e5a52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468189760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (152us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532105.976679:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532105.976680:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2385
00000100:00100000:0.0:1651532105.976688:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468189824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.976691:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2386
00000100:00100000:1.0:1651532105.976696:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.976710:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468190016
00000100:00100000:0.0:1651532105.976720:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2387
00000100:00100000:0.0:1651532105.976721:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468190016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.976724:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532105.976737:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d008 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448240 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.976748:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d008 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448240 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.976752:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d008 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448240 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.976755:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532105.976768:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468190016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.976771:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2387
00000100:00100000:0.0:1651532105.977066:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.977073:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.977079:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532105.977093:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468190208
00000100:00100000:1.0:1651532105.977098:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468190272
00000100:00100000:0.0:1651532105.977102:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468190464
00000100:00100000:0.0:1651532105.977106:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2388
00000100:00100000:0.0:1651532105.977108:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468190208:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532105.977111:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2389
00010000:00010000:0.0:1651532105.977111:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532105.977112:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468190464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532105.977115:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d00f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448247 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.977116:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.977119:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40d016 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448255 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532105.977122:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d00f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448247 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.977127:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40d016 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448255 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532105.977127:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d00f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448247 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.977131:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40d016 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448255 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.977137:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:0.0:1651532105.977138:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532105.977147:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468190464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532105.977148:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468190208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.977150:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2389
00000100:00100000:0.0:1651532105.977152:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2388
00000100:00100000:1.0:1651532105.977155:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2390
00000100:00100000:1.0:1651532105.977157:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468190272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.977159:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.977161:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40d01d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44824e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.977166:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40d01d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44824e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.977170:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40d01d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44824e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.977173:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532105.977178:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468190272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.977181:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2390
00000100:00100000:0.0:1651532105.977487:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.977506:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468190720
00000100:00100000:1.0:1651532105.977514:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2391
00000100:00100000:1.0:1651532105.977516:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468190720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.977519:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.977530:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40d024 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44825c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.977537:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40d024 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44825c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.977541:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40d024 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44825c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.977545:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532105.977555:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468190720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.977557:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2391
00000100:00100000:0.0:1651532105.977757:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.977775:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468190848
00000100:00100000:1.0:1651532105.977783:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2392
00000100:00100000:1.0:1651532105.977785:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468190848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.977788:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.977791:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d02b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448263 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.977798:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d02b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448263 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.977801:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d02b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448263 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.977820:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532105.977840:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468190848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.977842:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2392
00000100:00100000:0.0:1651532105.978050:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.978069:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468190976
00000100:00100000:1.0:1651532105.978076:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2393
00000100:00100000:1.0:1651532105.978078:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468190976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.978081:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.978084:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d032 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44826a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.978092:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d032 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44826a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.978096:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d032 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44826a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.978099:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532105.978108:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468190976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.978110:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2393
00000100:00100000:0.0:1651532105.978305:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532105.978332:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468191104
00000100:00100000:1.0:1651532105.978339:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2394
00000100:00100000:1.0:1651532105.978341:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468191104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532105.978344:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532105.978347:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d039 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448271 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532105.978365:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d039 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448271 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.978369:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d039 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448271 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532105.978372:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532105.978382:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468191104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532105.978385:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2394
00000001:00080000:1.0:1651532106.083816:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793567 is committed
00010000:00010000:1.0:1651532106.083830:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083834:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.083856:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468185856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566274us (566348us total) trans 158913793567 rc 0/0
00000100:00100000:1.0:1651532106.083859:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3816
00010000:00010000:1.0:1651532106.083866:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083870:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532106.083871:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083877:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083882:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.083882:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.083883:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083886:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083890:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.083890:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.083891:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083903:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083916:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083919:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40cf2f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->9707519] (req 364544->9707519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083925:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.083928:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.083930:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.083935:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.084225:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.084238:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468191360
00000100:00100000:0.0:1651532106.084239:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.084248:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.084257:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468191296
00000100:00100000:1.0:1651532106.084269:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3825
00000100:00100000:1.0:1651532106.084271:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468191360:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532106.084272:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3826
00000100:00100000:0.0:1651532106.084274:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468191296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532106.084278:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.084282:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532106.084284:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.084284:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.084286:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532106.084287:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.084293:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532106.084294:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.084316:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532106.084317:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.084322:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.084323:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.084326:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.084327:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.084338:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.084340:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468191488
00010000:00010000:1.0:1651532106.084342:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.084352:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2395
00000100:00100000:0.0:1651532106.084353:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468191488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.084357:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.084360:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d04e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448278 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.084374:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468186560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449462us (449503us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532106.084374:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d04e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448278 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532106.084377:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3818
00010000:00010000:0.0:1651532106.084379:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d04e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448278 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.084382:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532106.084392:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468191488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (144us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.084406:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2395
00010000:00010000:0.0:1651532106.084417:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.084422:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.084424:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.084429:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.084436:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.084440:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40cf59 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4866048->7426047] (req 4866048->7426047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.084701:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.084708:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468191680
00000100:00100000:0.0:1651532106.084747:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2396
00000100:00100000:0.0:1651532106.084750:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468191680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.084753:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.084757:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d055 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44827f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.084765:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d055 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44827f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532106.084773:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532106.084783:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d055 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44827f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532106.084787:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468191744
00010000:00010000:0.0:1651532106.084788:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532106.084799:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2397
00000100:00100000:1.0:1651532106.084800:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0dbb280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468191744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.084816:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.084820:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d05c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448286 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.084820:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468191680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 69us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.084823:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2396
00010000:00010000:1.0:1651532106.084828:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d05c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448286 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.084832:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d05c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448286 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.084835:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532106.084843:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0dbb280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468191744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.084846:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2397
00000100:00100000:1.0:1651532106.085122:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.085130:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468191936
00000100:00100000:1.0:1651532106.085141:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2398
00000100:00100000:1.0:1651532106.085143:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025404360 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468191936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.085146:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.085149:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d063 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44828d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.085157:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d063 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44828d expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.085160:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d063 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44828d expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.085164:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532106.085175:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025404360 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468191936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.085177:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2398
00000001:00080000:1.0:1651532106.167172:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793568 is committed
00010000:00010000:0.0:1651532106.167204:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167209:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.167231:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468186496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532336us (532389us total) trans 158913793568 rc 0/0
00000100:00100000:0.0:1651532106.167235:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3817
00010000:00010000:0.0:1651532106.167242:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167246:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.167247:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167250:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167266:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.167267:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.167268:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167273:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167288:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.167292:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167292:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40cf52 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8245248->8249343] (req 8245248->8249343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.167297:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.167618:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.167632:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.167644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.167654:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468192064
00000100:00100000:1.0:1651532106.167655:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468192128
00000100:00100000:0.0:1651532106.167666:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3827
00000100:00100000:0.0:1651532106.167667:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468192064:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532106.167668:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3828
00000100:00100000:1.0:1651532106.167670:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468192128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532106.167675:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.167677:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167679:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532106.167680:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167683:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532106.167693:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.167698:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532106.167699:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.167702:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532106.167702:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167706:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.167707:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.167710:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167710:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.167723:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468192192
00000100:00100000:0.0:1651532106.167730:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2399
00000100:00100000:0.0:1651532106.167731:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468192192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.167734:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.167737:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d078 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448294 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.167744:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d078 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448294 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.167748:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d078 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448294 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.167752:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532106.167766:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468192192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.167769:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2399
00000001:00080000:1.0:1651532106.235237:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793569 is committed
00010000:00010000:1.0:1651532106.235253:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.235257:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.235281:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468187264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 467137us (467184us total) trans 158913793569 rc 0/0
00000100:00100000:1.0:1651532106.235284:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3819
00010000:00010000:1.0:1651532106.235292:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.235295:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532106.235296:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.235300:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.235305:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.235305:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.235306:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.235320:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.235336:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.235339:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40cf7c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->10022911] (req 380928->10022911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235344:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235360:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.235673:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.235681:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.235692:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468192512
00000100:00100000:0.0:1651532106.235699:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468192576
00000100:00100000:0.0:1651532106.235704:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2400
00000100:00100000:0.0:1651532106.235705:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468192512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.235709:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.235713:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d07f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44829b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235719:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.235722:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d07f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44829b expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.235726:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d07f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44829b expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.235729:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532106.235745:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468192512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.235748:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2400
00000100:00100000:0.0:1651532106.235753:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2401
00000100:00100000:0.0:1651532106.235754:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468192576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.235765:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.235769:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d086 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482a2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235776:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.235780:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d086 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482a2 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.235786:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d086 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482a2 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.235790:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532106.235801:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468192576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (120us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.235823:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2401
00010000:00010000:0.0:1651532106.235836:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235839:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.235852:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c0ee2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468187392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 467705us (467745us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532106.235855:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3820
00010000:00010000:0.0:1651532106.235861:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235875:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.235876:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235879:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235884:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.235885:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.235886:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235889:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235900:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.235903:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40cf83 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6533120->9093119] (req 6533120->9093119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.235908:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.235912:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.236041:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.236054:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468192704
00000100:00100000:0.0:1651532106.236098:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2402
00000100:00100000:0.0:1651532106.236101:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468192704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.236106:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.236111:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d08d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482a9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.236127:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d08d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482a9 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.236131:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d08d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482a9 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.236134:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532106.236146:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468192704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.236149:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2402
00000100:00100000:1.0:1651532106.236451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.236465:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.236472:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468192832
00000100:00100000:1.0:1651532106.236473:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.236483:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.236491:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468192896
00000100:00100000:1.0:1651532106.236497:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3829
00000100:00100000:1.0:1651532106.236500:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000020c3a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468192832:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532106.236500:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3830
00000100:00100000:0.0:1651532106.236502:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62aec33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468192896:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532106.236508:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.236509:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.236513:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532106.236514:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.236517:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532106.236517:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.236521:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532106.236523:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.236526:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532106.236526:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.236530:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.236531:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.236533:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.236541:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468192960
00010000:00010000:0.0:1651532106.236542:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.236548:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468193088
00000100:00100000:0.0:1651532106.236551:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2403
00000100:00100000:1.0:1651532106.236553:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2404
00000100:00100000:0.0:1651532106.236553:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468192960:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532106.236555:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468193088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.236556:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.236558:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.236559:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482b0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.236560:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d0a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482b7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.236566:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482b0 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.236568:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d0a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482b7 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.236570:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482b0 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.236573:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:1.0:1651532106.236582:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d0a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482b7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532106.236584:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468192960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (111us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532106.236586:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532106.236587:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2403
00000100:00100000:1.0:1651532106.236595:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468193088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.236598:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2404
00000100:00100000:1.0:1651532106.236918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.236926:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468193472
00000100:00100000:1.0:1651532106.236933:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2405
00000100:00100000:1.0:1651532106.236934:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468193472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.236938:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.236941:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d0b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482be expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.236948:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d0b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482be expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.236952:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d0b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482be expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.236956:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532106.236972:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468193472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.236976:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2405
00000001:00080000:1.0:1651532106.351893:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793570 is committed
00010000:00010000:1.0:1651532106.351908:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.351912:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.351934:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468188800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 475655us (475705us total) trans 158913793570 rc 0/0
00010000:00010000:0.0:1651532106.351936:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.351938:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3821
00010000:00010000:0.0:1651532106.351941:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.351942:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.351955:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.351961:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.351962:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.351963:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.351966:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.351972:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.351972:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.351973:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.351978:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.351990:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.351993:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40cfbb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->10424319] (req 1351680->10424319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352000:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352003:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352055:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352059:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.352364:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532106.352391:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352395:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.352397:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.352418:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468193792
00000100:00100000:0.0:1651532106.352421:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468189632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375859us (375924us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532106.352425:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3823
00000100:00100000:1.0:1651532106.352426:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468193920
00000100:00100000:1.0:1651532106.352434:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2406
00000100:00100000:1.0:1651532106.352436:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b09418 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468193792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.352440:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.352443:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d0b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482c5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352444:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352447:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.352451:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.352453:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d0b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482c5 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.352457:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d0b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482c5 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532106.352459:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b87a626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468188864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 476166us (476209us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532106.352462:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3822
00010000:00010000:1.0:1651532106.352464:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532106.352467:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.352472:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b09418 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468193792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.352475:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2406
00000100:00100000:1.0:1651532106.352479:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2407
00000100:00100000:1.0:1651532106.352481:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e209f38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468193920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.352482:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532106.352483:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.352483:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.352485:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d0be lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482cc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352486:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.352491:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.352493:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.352494:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d0be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482cc expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.352496:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40cfec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [798720->3301375] (req 798720->3301375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.352497:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d0be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482cc expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.352499:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.352501:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532106.352502:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.352503:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.352505:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e209f38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468193920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (109us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532106.352505:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.352507:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2407
00010000:00010000:0.0:1651532106.352509:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.352509:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.352510:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352520:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352530:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.352533:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40cfc2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [704512->9773055] (req 704512->9773055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.352534:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.352538:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.352951:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.352995:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.353007:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.353017:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.353018:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468194176
00000100:00100000:0.0:1651532106.353028:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468193984
00000100:00100000:1.0:1651532106.353031:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468194240
00000100:00100000:1.0:1651532106.353036:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2408
00000100:00100000:0.0:1651532106.353040:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468194048
00000100:00100000:1.0:1651532106.353042:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468194176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532106.353048:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3831
00010000:00010000:1.0:1651532106.353050:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532106.353050:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468193984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532106.353054:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d0c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482d3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.353057:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.353062:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d0c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482d3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.353062:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532106.353063:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.353066:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532106.353067:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.353081:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d0c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482d3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.353082:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.353084:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532106.353086:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.353094:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3832
00000100:00100000:1.0:1651532106.353095:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468194176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.353095:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468194048:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532106.353098:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2408
00010000:00010000:0.0:1651532106.353100:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.353102:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2409
00000100:00100000:1.0:1651532106.353104:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468194240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.353104:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532106.353105:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.353107:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.353107:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532106.353108:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.353109:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d0da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482da expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.353111:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.353115:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d0da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482da expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.353115:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.353119:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d0da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482da expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.353122:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532106.353127:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468194240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.353129:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2409
00000100:00100000:0.0:1651532106.353373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.353393:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468194560
00000100:00100000:1.0:1651532106.353406:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2410
00000100:00100000:1.0:1651532106.353408:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468194560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.353411:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.353414:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d0e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482e1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.353421:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d0e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482e1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.353425:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d0e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482e1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.353428:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532106.353438:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468194560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.353441:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2410
00000100:00100000:0.0:1651532106.353707:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.353734:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468194688
00000100:00100000:1.0:1651532106.353746:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2411
00000100:00100000:1.0:1651532106.353748:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468194688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.353751:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.353755:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482e8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.353762:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482e8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.353766:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482e8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.353769:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532106.353779:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468194688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.353781:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2411
00000001:00080000:1.0:1651532106.426937:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793571 is committed
00002000:00010000:1.0:1651532106.426950:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532104 -> 1651532105
00010000:00010000:1.0:1651532106.426953:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.426956:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.426977:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468189568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 450411us (450468us total) trans 158913793571 rc 0/0
00010000:00010000:0.0:1651532106.426981:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.426982:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3824
00010000:00010000:0.0:1651532106.426986:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.426987:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.426990:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.426995:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.426996:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.426997:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427000:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427009:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427012:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40cff3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->4882431] (req 393216->4882431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427024:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427030:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.427355:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.427379:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.427397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.427397:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468194880
00000100:00100000:1.0:1651532106.427405:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468194944
00000100:00100000:0.0:1651532106.427410:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3833
00000100:00100000:0.0:1651532106.427412:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468194880:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532106.427418:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3834
00000100:00100000:1.0:1651532106.427420:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468194944:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532106.427425:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.427427:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427430:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532106.427430:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427433:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532106.427434:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.427437:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.427439:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.427442:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532106.427442:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427446:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.427447:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.427450:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427450:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.427457:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468195136
00000100:00100000:1.0:1651532106.427466:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2412
00010000:00010000:0.0:1651532106.427467:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.427468:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468195136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.427471:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.427472:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.427474:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d0fd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482ef expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.427485:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.427488:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d0fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482ef expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532106.427493:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468191360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 343221us (343270us total) trans 0 rc 57344/57344
00010000:00010000:1.0:1651532106.427497:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d0fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482ef expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.427501:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532106.427503:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3825
00000100:00100000:1.0:1651532106.427509:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468195136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.427512:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2412
00010000:00010000:0.0:1651532106.427516:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427519:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.427520:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427523:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427528:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.427529:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.427529:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427533:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427540:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.427544:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d040 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->9179135] (req 1167360->9179135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.427554:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.427558:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.427786:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.427793:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468195264
00000100:00100000:1.0:1651532106.427819:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2413
00000100:00100000:1.0:1651532106.427821:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468195264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.427829:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.427840:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d104 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482f6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.427853:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d104 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482f6 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.427857:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d104 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482f6 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.427860:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532106.427871:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468195264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.427874:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2413
00000100:00100000:1.0:1651532106.428057:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.428067:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.428077:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468195328
00000100:00100000:0.0:1651532106.428078:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468195520
00000100:00100000:1.0:1651532106.428088:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2414
00000100:00100000:1.0:1651532106.428089:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468195328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.428093:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532106.428095:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2415
00000100:00100000:0.0:1651532106.428097:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468195520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.428109:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.428110:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d10b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4482fd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.428113:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d112 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448304 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.428119:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d10b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482fd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.428121:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d112 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448304 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.428123:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d10b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4482fd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.428126:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d112 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448304 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.428129:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:1.0:1651532106.428137:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532106.428144:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468195520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.428147:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2415
00000100:00100000:1.0:1651532106.428153:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468195328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.428155:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2414
00000001:00080000:1.0:1651532106.551959:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793572 is committed
00010000:00010000:1.0:1651532106.551974:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.551977:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.552000:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468191296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 467725us (467760us total) trans 158913793572 rc 0/0
00010000:00010000:0.0:1651532106.552001:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.552003:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3826
00010000:00010000:0.0:1651532106.552006:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.552007:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552011:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552016:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.552017:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.552018:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552031:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552043:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552047:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d047 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->10092543] (req 2605056->10092543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552055:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552058:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.552380:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.552388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.552400:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.552408:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468195968
00000100:00100000:1.0:1651532106.552420:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468195904
00000100:00100000:1.0:1651532106.552425:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3835
00000100:00100000:1.0:1651532106.552427:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468195968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532106.552434:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.552438:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532106.552439:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.552455:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.552462:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468196096
00000100:00100000:1.0:1651532106.552472:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2416
00000100:00100000:1.0:1651532106.552474:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9301923 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468196096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.552476:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.552479:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d120 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44830b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.552484:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3836
00010000:00010000:1.0:1651532106.552486:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d120 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44830b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532106.552486:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c52c0bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468195904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532106.552490:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d120 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44830b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.552494:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532106.552495:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552500:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532106.552501:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.552502:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9301923 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468196096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.552504:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2416
00010000:00010000:0.0:1651532106.552504:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552518:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00000100:00100000:1.0:1651532106.552519:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532106.552519:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552523:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552526:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.552530:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.552563:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468196224
00000100:00100000:1.0:1651532106.552574:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2417
00000100:00100000:1.0:1651532106.552575:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468196224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.552579:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.552589:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d12e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448312 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.552596:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d12e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448312 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.552600:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d12e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448312 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.552603:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532106.552613:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468196224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.552616:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2417
00000100:00100000:1.0:1651532106.552826:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.552833:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468196416
00000100:00100000:1.0:1651532106.552843:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2418
00000100:00100000:1.0:1651532106.552844:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b4b17ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468196416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.552848:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.552851:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d135 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448319 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.552858:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d135 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448319 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.552862:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d135 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448319 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.552876:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532106.552886:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b4b17ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468196416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.552889:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2418
00000001:00080000:1.0:1651532106.610354:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793573 is committed
00010000:00010000:0.0:1651532106.610384:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610389:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.610412:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468192064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 442744us (442795us total) trans 158913793573 rc 0/0
00000100:00100000:0.0:1651532106.610416:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3827
00010000:00010000:0.0:1651532106.610423:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610427:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.610428:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610438:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610444:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.610445:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.610446:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610451:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610465:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610468:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d06a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->10092543] (req 483328->10092543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.610470:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.610475:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.610718:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.610725:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.610737:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468196672
00010000:00010000:1.0:1651532106.610743:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.610745:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468196736
00010000:00010000:1.0:1651532106.610748:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.610750:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2419
00000100:00100000:0.0:1651532106.610752:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085b1d320 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468196672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.610761:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.610765:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d13c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448320 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.610766:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468192128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 443095us (443134us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532106.610769:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3828
00010000:00010000:0.0:1651532106.610771:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.610774:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d13c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448320 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532106.610777:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2420
00000100:00100000:1.0:1651532106.610778:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468196736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.610782:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.610790:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d13c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448320 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.610793:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d143 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448327 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610794:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:1.0:1651532106.610799:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.610801:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d143 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448327 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532106.610817:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085b1d320 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468196672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (86us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532106.610818:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d143 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448327 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532106.610821:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2419
00010000:00010000:1.0:1651532106.610822:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532106.610830:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468196736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (104us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532106.610831:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.610832:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2420
00010000:00010000:0.0:1651532106.610834:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.610835:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610838:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610843:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.610843:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.610844:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610847:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610857:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.610871:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d071 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->8355839] (req 487424->8355839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.610874:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.610878:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.611203:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.611212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.611222:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468196928
00000100:00100000:0.0:1651532106.611223:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468196864
00000100:00100000:1.0:1651532106.611238:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3837
00000100:00100000:1.0:1651532106.611240:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a5796b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468196928:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532106.611241:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3838
00000100:00100000:0.0:1651532106.611243:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468196864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532106.611247:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.611250:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.611254:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532106.611255:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.611258:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532106.611259:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.611263:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532106.611264:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.611267:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532106.611268:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.611271:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.611272:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.611275:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.611276:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532106.718733:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793574 is committed
00010000:00010000:1.0:1651532106.718747:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.718751:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.718773:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000020c3a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468192832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482273us (482322us total) trans 158913793574 rc 0/0
00010000:00010000:0.0:1651532106.718774:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.718776:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3829
00010000:00010000:0.0:1651532106.718779:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.718787:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.718791:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.718797:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.718797:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.718798:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.718801:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.718826:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.718829:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d094 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5361663] (req 32768->5361663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.718835:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.718838:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.719064:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.719082:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468197312
00000100:00100000:0.0:1651532106.719106:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2421
00000100:00100000:0.0:1651532106.719108:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096331adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468197312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.719121:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.719125:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d158 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44832e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.719131:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.719134:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d158 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44832e expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.719138:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d158 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44832e expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.719142:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532106.719158:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096331adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468197312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.719161:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2421
00010000:00010000:0.0:1651532106.719173:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.719177:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.719198:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62aec33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468192896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 482694us (482731us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532106.719202:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.719202:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3830
00010000:00010000:1.0:1651532106.719210:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532106.719211:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.719214:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.719219:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.719220:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.719221:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.719224:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.719234:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.719237:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d09b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->5922815] (req 2019328->5922815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.719238:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.719252:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.719544:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.719563:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.719585:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.719595:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468197568
00000100:00100000:1.0:1651532106.719607:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468197632
00000100:00100000:1.0:1651532106.719615:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3839
00000100:00100000:1.0:1651532106.719617:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000069aba2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468197568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532106.719630:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.719634:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532106.719635:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.719638:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532106.719639:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.719643:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.719645:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3840
00010000:00010000:1.0:1651532106.719646:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.719647:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000284741f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468197632:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532106.719655:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.719660:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532106.719661:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.719664:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532106.719664:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.719669:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.719672:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.719681:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468197696
00000100:00100000:0.0:1651532106.719693:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2422
00000100:00100000:0.0:1651532106.719694:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468197696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.719697:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.719708:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d16d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448335 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.719715:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d16d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448335 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.719719:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d16d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448335 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.719722:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532106.719736:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468197696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (151us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.719739:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2422
00000001:00080000:1.0:1651532106.785429:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793575 is committed
00010000:00010000:0.0:1651532106.785469:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.785473:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.785497:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468193984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432446us (432547us total) trans 158913793575 rc 0/0
00000100:00100000:0.0:1651532106.785500:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3831
00010000:00010000:0.0:1651532106.785507:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.785511:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.785512:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.785526:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.785532:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.785533:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.785534:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.785539:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.785550:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.785554:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d0cc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8925183] (req 139264->8925183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.785560:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.785563:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.785892:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.785904:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.785910:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468197952
00000100:00100000:1.0:1651532106.785920:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468198016
00000100:00100000:0.0:1651532106.785927:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2423
00000100:00100000:0.0:1651532106.785930:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468197952:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532106.785934:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2424
00000100:00100000:1.0:1651532106.785936:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468198016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.785940:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.785944:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d174 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448343 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.785950:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.785953:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d174 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448343 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.785958:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d174 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448343 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.785961:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532106.785972:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532106.785985:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468198016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (81us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532106.785987:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d17b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44833c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.785988:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2424
00010000:00010000:0.0:1651532106.785993:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.785996:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d17b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44833c expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.786000:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d17b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44833c expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532106.786001:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532106.786004:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532106.786013:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468197952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 83us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.786016:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2423
00000100:00100000:0.0:1651532106.786022:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468198144
00000100:00100000:0.0:1651532106.786029:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2425
00000100:00100000:0.0:1651532106.786032:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468198144:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532106.786035:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532106.786036:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.786040:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d182 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44834a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786044:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.786047:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d182 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44834a expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.786051:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d182 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44834a expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532106.786063:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468198208
00000100:00100000:1.0:1651532106.786068:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2426
00010000:00010000:0.0:1651532106.786069:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532106.786070:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468198208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.786073:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.786077:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d189 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448351 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.786082:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468198144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.786085:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2425
00010000:00010000:1.0:1651532106.786088:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.786091:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d189 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448351 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.786095:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d189 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448351 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.786098:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532106.786106:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468198208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.786109:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2426
00010000:00010000:0.0:1651532106.786119:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786123:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.786147:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468194048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433050us (433153us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532106.786151:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3832
00010000:00010000:0.0:1651532106.786159:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786163:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.786164:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786168:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786176:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.786177:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.786178:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786192:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786201:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786203:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d0d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->4530175] (req 692224->4530175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786211:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786216:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.786529:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.786539:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.786548:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.786556:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.786564:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468198656
00000100:00100000:1.0:1651532106.786572:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468198784
00000100:00100000:1.0:1651532106.786578:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2427
00000100:00100000:1.0:1651532106.786580:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468198656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.786584:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.786587:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d190 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448358 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.786595:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d190 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448358 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.786599:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d190 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448358 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.786602:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532106.786611:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468198656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.786614:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2428
00000100:00100000:1.0:1651532106.786616:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2427
00000100:00100000:0.0:1651532106.786617:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468198784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.786621:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.786625:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d197 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44835f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786632:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d197 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44835f expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.786637:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d197 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44835f expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532106.786649:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468198528
00010000:00010000:0.0:1651532106.786653:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532106.786669:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468198592
00000100:00100000:0.0:1651532106.786680:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468198784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.786683:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2428
00000100:00100000:1.0:1651532106.786694:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3841
00000100:00100000:1.0:1651532106.786695:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf91ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468198528:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532106.786699:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3842
00000100:00100000:0.0:1651532106.786701:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063e5a52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468198592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532106.786712:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.786716:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532106.786717:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.786720:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532106.786720:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.786721:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786725:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532106.786726:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786729:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532106.786730:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.786735:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786735:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.786738:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.786739:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.786954:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.786966:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468198912
00000100:00100000:0.0:1651532106.786976:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2429
00000100:00100000:0.0:1651532106.786977:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468198912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.786989:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.786993:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d1ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448366 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.787001:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d1ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448366 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.787005:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d1ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448366 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.787008:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532106.787021:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468198912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.787024:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2429
00000001:00080000:1.0:1651532106.918772:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793576 is committed
00010000:00010000:0.0:1651532106.918812:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.918816:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.918837:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468194880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491424us (491482us total) trans 158913793576 rc 0/0
00010000:00010000:1.0:1651532106.918840:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.918840:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3833
00010000:00010000:1.0:1651532106.918844:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532106.918845:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918849:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918862:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.918862:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.918863:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918867:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918870:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.918870:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532106.918871:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918873:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918889:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918892:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d0ef lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9400319] (req 3268608->9400319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918898:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918901:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918923:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.918935:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.919253:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.919261:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.919281:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468199168
00010000:00010000:1.0:1651532106.919288:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.919289:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468199296
00010000:00010000:1.0:1651532106.919292:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.919296:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2430
00000100:00100000:0.0:1651532106.919298:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468199168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.919302:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.919323:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d1b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44836d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.919327:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468194944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491906us (491954us total) trans 0 rc 24576/24576
00010000:00010000:0.0:1651532106.919329:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532106.919330:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3834
00010000:00010000:0.0:1651532106.919332:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d1b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44836d expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.919336:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d1b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44836d expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.919340:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:1.0:1651532106.919341:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919344:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.919349:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468199168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.919358:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2430
00000100:00100000:1.0:1651532106.919359:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468195968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366931us (366979us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532106.919361:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3835
00000100:00100000:0.0:1651532106.919363:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2431
00000100:00100000:0.0:1651532106.919364:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468199296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.919367:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.919370:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d1ba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448374 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.919375:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.919376:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d1ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448374 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.919393:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d1ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448374 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.919398:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:1.0:1651532106.919409:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919413:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532106.919413:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468199296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (152us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532106.919414:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.919416:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2431
00010000:00010000:0.0:1651532106.919423:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919425:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.919427:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532106.919430:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919431:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919434:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d0f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1892352->10465279] (req 1892352->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.919434:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.919439:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.919440:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532106.919441:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.919446:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.919474:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.919489:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d119 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3182592->4808703] (req 3182592->4808703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.919496:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.919499:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.919767:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.919775:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.919781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.919790:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.919797:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.919819:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468199488
00000100:00100000:1.0:1651532106.919831:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468199424
00000100:00100000:1.0:1651532106.919839:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3843
00000100:00100000:1.0:1651532106.919840:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468199488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532106.919847:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919851:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532106.919852:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532106.919853:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919856:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.919870:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3844
00000100:00100000:1.0:1651532106.919871:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468199424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532106.919876:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919880:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532106.919880:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919883:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919886:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532106.919886:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919890:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919893:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919896:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532106.919902:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468199616
00000100:00100000:1.0:1651532106.919907:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468199680
00000100:00100000:1.0:1651532106.919910:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468199808
00000100:00100000:1.0:1651532106.919913:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2432
00000100:00100000:1.0:1651532106.919914:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468199616:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532106.919916:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2433
00010000:00010000:1.0:1651532106.919917:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.919919:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d1cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44837b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532106.919919:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468199680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.919923:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.919926:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d1cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44837b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.919927:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d1d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448382 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919931:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d1cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44837b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.919934:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532106.919935:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d1d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448382 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.919939:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d1d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448382 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532106.919942:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468199616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (161us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532106.919942:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532106.919945:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2432
00000100:00100000:1.0:1651532106.919949:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2434
00000100:00100000:1.0:1651532106.919951:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468199808:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532106.919951:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468199680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (161us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532106.919953:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532106.919954:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2433
00010000:00010000:1.0:1651532106.919956:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d1dd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448389 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.919961:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d1dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448389 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.919965:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d1dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448389 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.919968:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532106.919973:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468199808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (177us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.919976:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2434
00000100:00100000:0.0:1651532106.919982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.920034:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468199936
00000100:00100000:1.0:1651532106.920042:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2435
00000100:00100000:1.0:1651532106.920044:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468199936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.920047:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.920050:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d1e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448390 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.920057:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d1e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448390 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.920061:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d1e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448390 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.920064:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532106.920073:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468199936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.920075:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2435
00000100:00100000:0.0:1651532106.920283:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.920298:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.920315:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468200064
00000100:00100000:1.0:1651532106.920323:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468200128
00000100:00100000:1.0:1651532106.920330:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2436
00000100:00100000:1.0:1651532106.920332:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468200064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.920335:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532106.920335:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2437
00000100:00100000:0.0:1651532106.920337:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468200128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.920339:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d1eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448397 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.920341:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532106.920345:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d1f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44839e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.920346:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d1eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448397 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.920350:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d1eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448397 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.920353:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532106.920353:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d1f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44839e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.920357:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d1f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44839e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.920361:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532106.920362:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468200064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.920365:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2436
00000100:00100000:0.0:1651532106.920369:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468200128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.920372:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2437
00000100:00100000:0.0:1651532106.920618:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.920641:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532106.920657:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468200512
00000100:00100000:1.0:1651532106.920662:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468200640
00000100:00100000:0.0:1651532106.920669:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2438
00000100:00100000:0.0:1651532106.920671:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468200512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.920674:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532106.920675:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2439
00000100:00100000:1.0:1651532106.920677:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468200640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532106.920678:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d1f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483a5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.920680:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.920691:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d200 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483ac expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532106.920694:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d1f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483a5 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.920698:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d1f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483a5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.920699:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d200 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483ac expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532106.920702:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:1.0:1651532106.920703:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d200 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483ac expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.920710:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532106.920714:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468200512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532106.920717:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2438
00000100:00100000:1.0:1651532106.920724:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468200640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.920726:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2439
00000100:00100000:0.0:1651532106.920947:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532106.920965:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468200832
00000100:00100000:1.0:1651532106.920973:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2440
00000100:00100000:1.0:1651532106.920975:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468200832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532106.920978:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532106.920981:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d207 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483b3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532106.920988:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d207 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483b3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.920992:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d207 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483b3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532106.920995:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532106.921005:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468200832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532106.921007:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2440
00000001:00080000:1.0:1651532107.018766:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793577 is committed
00010000:00010000:0.0:1651532107.018798:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.018812:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.018833:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c52c0bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468195904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466346us (466444us total) trans 158913793577 rc 0/0
00010000:00010000:1.0:1651532107.018834:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.018836:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3836
00010000:00010000:1.0:1651532107.018847:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532107.018848:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.018852:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.018857:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.018858:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.018858:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.018861:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.018875:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.018878:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d127 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->10268671] (req 1261568->10268671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.018884:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.018888:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.019270:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.019278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.019287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.019306:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468201280
00000100:00100000:1.0:1651532107.019326:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2441
00000100:00100000:0.0:1651532107.019331:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468200960
00000100:00100000:1.0:1651532107.019334:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0dbb280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468201280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.019337:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.019341:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d20e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483ba expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.019343:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468201088
00000100:00100000:0.0:1651532107.019349:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3845
00000100:00100000:0.0:1651532107.019351:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468200960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532107.019352:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d20e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483ba expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.019355:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d20e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483ba expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.019359:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532107.019359:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.019363:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532107.019364:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.019367:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532107.019368:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.019372:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0dbb280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468201280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.019375:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2441
00010000:00010000:0.0:1651532107.019379:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.019383:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.019390:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3846
00000100:00100000:1.0:1651532107.019392:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.019392:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468201088:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532107.019412:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.019416:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532107.019418:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.019422:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532107.019423:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.019426:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468201472
00010000:00010000:0.0:1651532107.019430:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.019434:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2442
00010000:00010000:0.0:1651532107.019434:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.019435:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468201472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.019438:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.019441:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d223 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483c1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.019448:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d223 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483c1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.019452:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d223 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483c1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.019455:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532107.019474:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468201472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.019476:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2442
00000100:00100000:0.0:1651532107.019661:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.019678:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468201664
00000100:00100000:1.0:1651532107.019686:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2443
00000100:00100000:1.0:1651532107.019687:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025404360 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468201664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.019690:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.019694:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d22a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483c8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.019701:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d22a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483c8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.019705:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d22a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483c8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.019708:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532107.019718:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025404360 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468201664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.019720:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2443
00000100:00100000:0.0:1651532107.019858:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.019868:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468201792
00000100:00100000:1.0:1651532107.019875:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2444
00000100:00100000:1.0:1651532107.019877:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468201792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.019880:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.019883:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d231 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483cf expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.019902:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d231 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483cf expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.019906:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d231 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483cf expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.019909:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532107.019919:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468201792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.019922:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2444
00000100:00100000:1.0:1651532107.019965:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.019973:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468201920
00000100:00100000:1.0:1651532107.019979:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2445
00000100:00100000:1.0:1651532107.019981:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468201920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.019984:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.019987:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d238 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483d6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.019994:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d238 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483d6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.019998:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d238 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483d6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.020001:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532107.020022:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468201920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.020024:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2445
00000100:00100000:1.0:1651532107.020139:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.020145:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468202048
00000100:00100000:1.0:1651532107.020151:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2446
00000100:00100000:1.0:1651532107.020153:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468202048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.020156:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.020159:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d23f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483dd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.020166:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d23f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483dd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.020170:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d23f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483dd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.020173:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532107.020185:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468202048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.020188:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2446
00000001:00080000:1.0:1651532107.152093:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793578 is committed
00010000:00010000:0.0:1651532107.152124:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152129:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.152154:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468196864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 540910us (540941us total) trans 158913793578 rc 0/0
00010000:00010000:1.0:1651532107.152155:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.152157:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3838
00010000:00010000:1.0:1651532107.152160:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532107.152161:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152172:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152178:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.152179:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.152180:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152183:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152190:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152193:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d151 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->10067967] (req 1126400->10067967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152199:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152202:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152441:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152446:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152467:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.152470:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a5796b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468196928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 541229us (541268us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532107.152474:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3837
00010000:00010000:0.0:1651532107.152495:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.152496:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152500:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152506:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.152506:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.152507:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152510:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152523:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152524:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152528:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152528:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d14a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->8310783] (req 364544->8310783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.152561:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.152572:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468202368
00000100:00100000:1.0:1651532107.152581:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2447
00000100:00100000:1.0:1651532107.152582:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468202368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.152585:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.152589:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d246 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483e4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.152590:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532107.152608:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d246 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483e4 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.152612:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d246 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483e4 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.152622:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532107.152628:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468202432
00000100:00100000:1.0:1651532107.152635:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468202368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.152644:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2448
00000100:00100000:1.0:1651532107.152646:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2447
00000100:00100000:0.0:1651532107.152646:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468202432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.152659:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.152664:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d24d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483eb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152676:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d24d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483eb expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.152683:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d24d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483eb expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.152689:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532107.152722:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468202432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 74us (131us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.152725:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2448
00000100:00100000:0.0:1651532107.152825:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.152858:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.152869:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468202560
00000100:00100000:0.0:1651532107.152871:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468202496
00000100:00100000:1.0:1651532107.152884:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3847
00000100:00100000:1.0:1651532107.152886:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b09418 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468202560:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532107.152892:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3848
00010000:00010000:1.0:1651532107.152894:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.152894:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e209f38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468202496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532107.152898:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532107.152899:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152902:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.152903:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152906:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532107.152907:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152910:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152914:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532107.152914:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152919:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152922:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.152925:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.153099:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.153110:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468202688
00000100:00100000:0.0:1651532107.153142:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2449
00000100:00100000:0.0:1651532107.153144:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468202688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.153147:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.153151:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d262 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483f2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.153159:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d262 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483f2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.153163:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d262 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483f2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.153177:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532107.153189:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468202688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.153192:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2449
00000100:00100000:0.0:1651532107.153218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.153250:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468202880
00000100:00100000:0.0:1651532107.153262:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2450
00000100:00100000:0.0:1651532107.153263:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468202880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.153267:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.153270:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d269 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4483f9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.153277:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d269 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483f9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.153282:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d269 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4483f9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.153285:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532107.153295:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468202880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.153298:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2450
00000001:00080000:1.0:1651532107.302090:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793579 is committed
00002000:00010000:1.0:1651532107.302104:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532105 -> 1651532106
00002000:00010000:1.0:1651532107.302105:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532105 -> 1651532106
00010000:00010000:1.0:1651532107.302107:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.302111:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.302134:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000069aba2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468197568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582516us (582590us total) trans 158913793579 rc 0/0
00000100:00100000:1.0:1651532107.302137:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3839
00010000:00010000:0.0:1651532107.302173:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.302193:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.302194:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.302197:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.302203:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.302204:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.302205:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.302208:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.302216:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.302219:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d15f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->8228863] (req 110592->8228863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.302225:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.302228:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.302525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.302544:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532107.302566:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.302567:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468203200
00010000:00010000:0.0:1651532107.302571:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.302587:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468203264
00000100:00100000:0.0:1651532107.302589:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000284741f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468197632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 582942us (583027us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532107.302592:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2451
00000100:00100000:0.0:1651532107.302593:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3840
00000100:00100000:1.0:1651532107.302594:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468203200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.302598:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.302601:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d270 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448400 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.302601:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2452
00000100:00100000:0.0:1651532107.302603:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468203264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.302607:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.302608:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.302610:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d270 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448400 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.302610:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d277 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448407 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.302615:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d270 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448400 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.302616:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.302618:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532107.302619:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d277 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448407 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.302623:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d277 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448407 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.302626:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532107.302627:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468203200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.302630:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2451
00000100:00100000:0.0:1651532107.302633:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468203264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.302635:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2452
00010000:00010000:1.0:1651532107.302636:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.302640:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532107.302641:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.302644:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.302651:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.302652:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.302653:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.302656:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.302663:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.302665:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d166 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->6664191] (req 1454080->6664191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.302670:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.302673:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.303111:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.303127:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.303138:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468203520
00000100:00100000:0.0:1651532107.303138:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.303145:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468203648
00000100:00100000:1.0:1651532107.303150:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3849
00000100:00100000:1.0:1651532107.303151:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468203520:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532107.303159:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3850
00000100:00100000:0.0:1651532107.303161:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468203648:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532107.303164:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.303168:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.303169:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532107.303170:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.303173:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532107.303174:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.303179:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532107.303180:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.303183:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532107.303183:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.303187:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.303188:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.303191:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.303191:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.303198:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468203840
00000100:00100000:0.0:1651532107.303205:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2453
00000100:00100000:0.0:1651532107.303206:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468203840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.303209:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.303212:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d28c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44840e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.303227:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d28c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44840e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.303231:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d28c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44840e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.303235:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532107.303246:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468203840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.303249:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2453
00000001:00080000:1.0:1651532107.443704:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793580 is committed
00010000:00010000:1.0:1651532107.443719:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.443722:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.443744:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf91ff9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468198528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 657047us (657215us total) trans 158913793580 rc 0/0
00010000:00010000:0.0:1651532107.443746:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.443747:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3841
00010000:00010000:0.0:1651532107.443751:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.443752:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.443755:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.443762:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.443762:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.443763:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.443766:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.443780:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.443780:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.443782:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.443786:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.443808:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.443812:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.443815:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.443819:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d19e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->6393855] (req 380928->6393855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.443825:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.443828:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.444115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532107.444143:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.444147:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532107.444148:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444166:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444171:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.444177:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063e5a52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468198592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 657475us (657638us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532107.444185:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468199488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 524344us (524418us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532107.444188:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3843
00000100:00100000:0.0:1651532107.444192:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3842
00010000:00010000:1.0:1651532107.444194:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444198:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532107.444199:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444201:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444202:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444204:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.444207:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444208:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444210:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d1a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->9953279] (req 4194304->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444210:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444216:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.444216:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.444217:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444220:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.444224:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468204096
00010000:00010000:0.0:1651532107.444231:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444234:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d1c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1425408->5681151] (req 1425408->5681151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.444242:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468204224
00000100:00100000:1.0:1651532107.444247:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2454
00000100:00100000:1.0:1651532107.444249:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468204096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532107.444249:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2455
00000100:00100000:0.0:1651532107.444251:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468204224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.444252:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.444255:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d293 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448415 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444255:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.444263:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d293 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448415 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.444266:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d29a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44841c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444267:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d293 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448415 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.444270:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532107.444273:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d29a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44841c expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532107.444277:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468204096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (163us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532107.444278:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d29a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44841c expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532107.444280:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2454
00010000:00010000:0.0:1651532107.444281:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:1.0:1651532107.444286:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444289:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.444290:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468204224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.444292:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2455
00000100:00100000:0.0:1651532107.444654:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.444665:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.444676:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468204352
00000100:00100000:0.0:1651532107.444677:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.444687:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468204288
00000100:00100000:1.0:1651532107.444692:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3851
00000100:00100000:1.0:1651532107.444702:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468204352:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532107.444707:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3852
00000100:00100000:0.0:1651532107.444709:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468204288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532107.444714:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444716:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444719:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532107.444720:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532107.444721:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444725:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532107.444727:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444731:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444765:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532107.444766:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444769:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444771:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444774:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.444778:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468204480
00010000:00010000:0.0:1651532107.444778:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.444785:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2456
00000100:00100000:1.0:1651532107.444786:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468204480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.444789:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.444791:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d2af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448423 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444798:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d2af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448423 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.444814:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d2af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448423 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.444818:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532107.444832:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468204480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (155us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.444836:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2456
00000100:00100000:0.0:1651532107.444843:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.444885:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468204608
00000100:00100000:0.0:1651532107.444889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.444893:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468204672
00000100:00100000:1.0:1651532107.444897:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2457
00000100:00100000:1.0:1651532107.444899:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468204608:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532107.444900:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2458
00010000:00010000:1.0:1651532107.444902:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532107.444902:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468204672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.444905:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44842a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.444906:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.444909:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d2bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448431 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.444912:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44842a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.444916:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44842a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.444918:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d2bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448431 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.444920:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532107.444922:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d2bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448431 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532107.444929:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468204608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.444931:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2457
00010000:00010000:0.0:1651532107.444938:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532107.444947:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468204672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.444950:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2458
00000100:00100000:0.0:1651532107.445176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.445184:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468204864
00000100:00100000:0.0:1651532107.445199:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2459
00000100:00100000:0.0:1651532107.445201:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468204864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.445204:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.445208:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448438 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.445215:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448438 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.445219:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448438 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.445223:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532107.445237:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468204864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.445239:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2459
00000100:00100000:0.0:1651532107.445475:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.445482:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468205056
00000100:00100000:0.0:1651532107.445497:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2460
00000100:00100000:0.0:1651532107.445505:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468205056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.445509:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.445512:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44843f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.445520:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44843f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.445524:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44843f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.445527:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532107.445542:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468205056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.445544:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2460
00000001:00080000:1.0:1651532107.543748:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793581 is committed
00010000:00010000:1.0:1651532107.543762:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.543766:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.543787:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468199424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 623915us (624011us total) trans 158913793581 rc 0/0
00010000:00010000:0.0:1651532107.543790:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.543795:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.543796:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.543798:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3844
00010000:00010000:0.0:1651532107.543800:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.543814:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.543815:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.543823:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.543827:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.543835:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.543838:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d1c8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9420799] (req 450560->9420799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.543845:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.543857:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.544290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.544307:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.544325:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.544338:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.544344:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468205376
00000100:00100000:1.0:1651532107.544345:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468205184
00000100:00100000:0.0:1651532107.544357:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468205440
00000100:00100000:0.0:1651532107.544362:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2461
00000100:00100000:1.0:1651532107.544363:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468205248
00000100:00100000:0.0:1651532107.544364:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468205376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.544368:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532107.544370:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3853
00000100:00100000:1.0:1651532107.544371:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468205184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532107.544371:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448446 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.544379:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.544379:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448446 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.544383:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532107.544384:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.544387:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532107.544388:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.544391:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448446 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.544392:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.544395:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532107.544409:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468205376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (84us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532107.544412:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.544419:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2461
00000100:00100000:1.0:1651532107.544421:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2462
00000100:00100000:1.0:1651532107.544422:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468205440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.544425:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.544428:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d2e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44844d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.544434:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3854
00010000:00010000:1.0:1651532107.544435:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d2e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44844d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532107.544436:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468205248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532107.544439:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d2e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44844d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.544443:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532107.544443:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.544447:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532107.544448:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.544451:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468205440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (113us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532107.544451:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532107.544452:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.544454:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2462
00010000:00010000:0.0:1651532107.544456:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.544460:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532107.652080:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793582 is committed
00010000:00010000:1.0:1651532107.652094:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652098:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.652130:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468200960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 632778us (632860us total) trans 158913793582 rc 0/0
00000100:00100000:1.0:1651532107.652133:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3845
00010000:00010000:0.0:1651532107.652134:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652139:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.652140:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652152:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.652158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.652159:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652163:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652168:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.652169:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.652170:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652174:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652191:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652195:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d215 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->7483391] (req 2457600->7483391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652201:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652201:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652204:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652205:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.652514:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.652534:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468205760
00010000:00010000:0.0:1651532107.652540:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.652545:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2463
00000100:00100000:1.0:1651532107.652546:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468205760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.652550:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.652550:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652554:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d2ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448454 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652560:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.652563:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d2ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448454 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532107.652570:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468201088:12345-10.240.43.64@tcp:3:fio.0 Request processed in 633177us (633291us total) trans 0 rc 45056/45056
00010000:00010000:1.0:1651532107.652573:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d2ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448454 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532107.652573:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3846
00010000:00010000:1.0:1651532107.652577:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532107.652582:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.652585:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468205760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (72us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532107.652585:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.652586:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.652588:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2463
00010000:00010000:0.0:1651532107.652589:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652595:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652597:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d21c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->10375167] (req 159744->10375167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652599:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652603:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.652614:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b09418 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468202560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499727us (499789us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532107.652617:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3847
00010000:00010000:1.0:1651532107.652622:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652625:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532107.652627:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652630:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652634:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.652635:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532107.652635:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652638:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652662:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.652665:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d254 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2342912->10108927] (req 2342912->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652672:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.652687:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.653059:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.653095:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.653104:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.653112:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.653119:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468206016
00000100:00100000:1.0:1651532107.653121:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.653130:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468206080
00000100:00100000:0.0:1651532107.653140:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3855
00000100:00100000:0.0:1651532107.653142:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468206016:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532107.653149:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3856
00000100:00100000:1.0:1651532107.653150:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468206080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532107.653154:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.653158:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.653159:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532107.653160:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.653163:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532107.653164:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.653168:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532107.653169:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.653172:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532107.653173:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.653176:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.653177:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.653180:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.653183:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.653188:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468206144
00000100:00100000:1.0:1651532107.653191:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468206272
00000100:00100000:0.0:1651532107.653195:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468206336
00000100:00100000:1.0:1651532107.653196:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2464
00000100:00100000:1.0:1651532107.653198:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468206144:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532107.653199:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2465
00010000:00010000:1.0:1651532107.653200:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532107.653200:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468206272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.653210:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d303 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44845b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.653212:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.653215:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d30a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448462 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.653218:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d303 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44845b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.653222:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d303 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44845b expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.653222:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d30a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448462 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.653226:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532107.653227:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d30a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448462 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.653230:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532107.653236:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468206144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (157us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.653239:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2464
00000100:00100000:0.0:1651532107.653240:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468206272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.653243:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2465
00000100:00100000:1.0:1651532107.653244:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2466
00000100:00100000:1.0:1651532107.653246:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468206336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.653249:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.653251:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d311 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448469 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.653257:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d311 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448469 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.653261:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d311 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448469 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.653264:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532107.653269:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468206336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (149us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.653271:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2466
00000100:00100000:1.0:1651532107.653561:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.653569:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.653579:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468206592
00000100:00100000:0.0:1651532107.653583:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468206656
00000100:00100000:1.0:1651532107.653588:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2467
00000100:00100000:1.0:1651532107.653590:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468206592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.653593:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.653597:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d318 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448470 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.653604:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d318 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448470 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.653614:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d318 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448470 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532107.653616:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2468
00000100:00100000:0.0:1651532107.653618:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468206656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.653620:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532107.653621:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.653625:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d31f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448477 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.653630:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468206592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.653632:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2467
00010000:00010000:0.0:1651532107.653633:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d31f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448477 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.653637:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d31f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448477 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.653651:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532107.653662:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468206656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.653666:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2468
00000100:00100000:1.0:1651532107.653667:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.653674:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468206784
00000100:00100000:0.0:1651532107.653680:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2469
00000100:00100000:0.0:1651532107.653681:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468206784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.653684:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.653687:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d326 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44847e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.653696:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d326 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44847e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.653702:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d326 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44847e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.653706:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532107.653721:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468206784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.653724:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2469
00000100:00100000:1.0:1651532107.654089:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.654100:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468207104
00000100:00100000:0.0:1651532107.654108:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2470
00000100:00100000:0.0:1651532107.654110:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468207104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.654123:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.654126:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d32d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448485 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.654133:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d32d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448485 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.654137:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d32d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448485 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.654141:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532107.654156:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468207104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.654158:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2470
00000100:00100000:1.0:1651532107.654400:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.654411:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468207296
00000100:00100000:0.0:1651532107.654419:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2471
00000100:00100000:0.0:1651532107.654421:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468207296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.654424:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.654428:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d334 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44848c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.654435:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d334 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44848c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.654439:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d334 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44848c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.654454:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532107.654469:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468207296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.654472:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2471
00000001:00080000:1.0:1651532107.760430:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793583 is committed
00002000:00010000:0.0:1651532107.760459:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532106 -> 1651532107
00002000:00010000:0.0:1651532107.760461:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532106 -> 1651532107
00010000:00010000:0.0:1651532107.760463:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760467:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.760490:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e209f38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468202496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 607595us (607632us total) trans 158913793583 rc 0/0
00000100:00100000:0.0:1651532107.760493:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3848
00010000:00010000:0.0:1651532107.760500:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760504:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.760505:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760508:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760513:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.760521:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.760523:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760528:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760543:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760546:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d25b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10342399] (req 434176->10342399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.760548:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.760552:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.760906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.760917:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.760922:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468207488
00000100:00100000:1.0:1651532107.760924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.760933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.760940:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468207424
00000100:00100000:1.0:1651532107.760959:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3857
00000100:00100000:1.0:1651532107.760961:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468207424:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532107.760966:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3858
00010000:00010000:1.0:1651532107.760968:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.760968:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468207488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532107.760973:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532107.760974:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760975:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.760977:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532107.760978:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760985:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532107.760986:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760989:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532107.760990:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.760993:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.760994:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.760996:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.761008:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.761018:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468207616
00000100:00100000:0.0:1651532107.761024:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468207680
00000100:00100000:0.0:1651532107.761032:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2472
00000100:00100000:0.0:1651532107.761034:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468207616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.761036:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.761039:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d349 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448493 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.761046:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d349 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448493 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.761050:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d349 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448493 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.761054:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532107.761063:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468207616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.761065:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2472
00000100:00100000:0.0:1651532107.761070:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2473
00000100:00100000:0.0:1651532107.761071:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468207680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.761073:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.761083:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d350 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44849a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.761084:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532107.761090:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d350 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44849a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.761093:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d350 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44849a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.761097:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532107.761103:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468207680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (169us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.761106:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2473
00000100:00100000:0.0:1651532107.761111:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468207808
00000100:00100000:0.0:1651532107.761118:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2474
00000100:00100000:0.0:1651532107.761121:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468207808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.761125:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.761128:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d357 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484a1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.761137:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d357 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484a1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.761141:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d357 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484a1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.761144:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532107.761167:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468207808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.761170:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2474
00000100:00100000:1.0:1651532107.761445:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.761457:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468208128
00000100:00100000:0.0:1651532107.761468:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2475
00000100:00100000:0.0:1651532107.761470:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468208128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.761473:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.761476:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d35e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484a8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.761484:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d35e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484a8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.761488:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d35e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484a8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.761491:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532107.761506:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468208128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.761508:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2475
00000100:00100000:1.0:1651532107.761755:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.761766:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468208256
00000100:00100000:0.0:1651532107.761776:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2476
00000100:00100000:0.0:1651532107.761778:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468208256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.761781:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.761785:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d365 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484af expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.761794:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d365 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484af expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.761798:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d365 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484af expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.761801:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532107.761825:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468208256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.761827:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2476
00000001:00080000:1.0:1651532107.868785:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793584 is committed
00010000:00010000:1.0:1651532107.868799:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.868815:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.868837:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468203520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565685us (565728us total) trans 158913793584 rc 0/0
00010000:00010000:0.0:1651532107.868839:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.868841:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3849
00010000:00010000:0.0:1651532107.868844:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.868846:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.868849:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.868855:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.868855:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.868856:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.868860:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.868875:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.868876:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.868877:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.868882:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.868899:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.868902:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d27e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->8630271] (req 471040->8630271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.868909:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.868910:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.868912:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.868915:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.869181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.869191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.869193:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468208512
00000100:00100000:0.0:1651532107.869209:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468208576
00000100:00100000:0.0:1651532107.869216:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2477
00000100:00100000:0.0:1651532107.869218:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468208512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.869221:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869222:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.869226:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869226:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d36c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484b6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.869240:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468204352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424537us (424588us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532107.869242:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532107.869243:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3851
00010000:00010000:0.0:1651532107.869245:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d36c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484b6 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.869249:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d36c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484b6 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532107.869251:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2478
00000100:00100000:1.0:1651532107.869252:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468208576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.869252:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:1.0:1651532107.869256:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.869259:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d373 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484bd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.869261:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468208512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (81us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532107.869264:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532107.869264:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2477
00010000:00010000:1.0:1651532107.869267:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d373 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484bd expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.869271:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d373 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484bd expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.869274:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532107.869276:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869279:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.869291:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468208576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.869292:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468203648:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566131us (566165us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532107.869294:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2478
00000100:00100000:0.0:1651532107.869295:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3850
00010000:00010000:0.0:1651532107.869301:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.869302:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869304:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.869305:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.869306:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532107.869307:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.869321:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.869327:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869328:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.869330:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d285 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->9646079] (req 647168->9646079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869333:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.869334:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.869335:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869338:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869345:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869348:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d2a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->10203135] (req 421888->10203135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869354:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869357:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.869765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.869775:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.869786:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468208704
00000100:00100000:1.0:1651532107.869796:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3859
00000100:00100000:1.0:1651532107.869798:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468208704:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532107.869825:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468208640
00010000:00010000:1.0:1651532107.869831:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.869835:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532107.869837:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532107.869838:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.869839:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3860
00010000:00010000:1.0:1651532107.869841:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.869841:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468208640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532107.869848:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.869852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.869861:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532107.869861:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532107.869862:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869865:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.869867:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532107.869868:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532107.869868:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.869873:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468208832
00010000:00010000:0.0:1651532107.869873:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869876:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.869879:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.869883:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468208896
00000100:00100000:1.0:1651532107.869886:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468209024
00000100:00100000:1.0:1651532107.869889:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2479
00000100:00100000:1.0:1651532107.869891:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468208832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.869894:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532107.869895:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2480
00010000:00010000:1.0:1651532107.869897:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d388 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484c4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.869897:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468208896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.869900:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.869903:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d38f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484cb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.869904:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d388 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484c4 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.869908:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d388 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484c4 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.869910:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d38f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484cb expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.869912:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532107.869921:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468208832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (69us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532107.869922:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d38f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484cb expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532107.869924:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2479
00010000:00010000:0.0:1651532107.869926:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532107.869929:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2481
00000100:00100000:1.0:1651532107.869931:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468209024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.869933:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.869935:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d396 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484d2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.869936:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468208896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.869938:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2480
00010000:00010000:1.0:1651532107.869940:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d396 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484d2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.869944:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d396 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484d2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.869947:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532107.869952:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468209024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.869955:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2481
00000100:00100000:1.0:1651532107.870327:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.870334:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.870346:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532107.870354:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468209216
00000100:00100000:0.0:1651532107.870358:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468209152
00000100:00100000:1.0:1651532107.870363:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468209408
00000100:00100000:1.0:1651532107.870366:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2482
00000100:00100000:1.0:1651532107.870368:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468209216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532107.870370:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2483
00010000:00010000:1.0:1651532107.870371:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532107.870372:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468209408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.870374:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d39d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484e0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.870376:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.870379:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d3a4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484e7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.870384:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d39d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484e0 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.870387:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d3a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484e7 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.870388:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d39d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484e0 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.870391:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d3a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484e7 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532107.870392:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532107.870394:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532107.870411:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468209216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.870411:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468209408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.870413:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2483
00000100:00100000:1.0:1651532107.870422:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2482
00000100:00100000:0.0:1651532107.870426:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2484
00000100:00100000:0.0:1651532107.870428:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468209152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.870430:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.870433:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d3ab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484d9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.870439:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d3ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484d9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.870443:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d3ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484d9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.870446:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532107.870461:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468209152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.870465:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2484
00000100:00100000:1.0:1651532107.870716:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.870728:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468209728
00000100:00100000:0.0:1651532107.870736:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2485
00000100:00100000:0.0:1651532107.870738:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468209728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.870741:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.870745:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d3b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484ee expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.870752:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d3b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484ee expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.870768:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d3b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484ee expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.870771:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532107.870787:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468209728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.870789:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2485
00000100:00100000:1.0:1651532107.870999:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.871010:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468209856
00000100:00100000:0.0:1651532107.871019:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2486
00000100:00100000:0.0:1651532107.871020:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468209856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532107.871024:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532107.871027:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3b9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484f5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.871035:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484f5 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.871038:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484f5 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.871042:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532107.871058:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468209856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.871061:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2486
00000001:00080000:1.0:1651532107.935500:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793585 is committed
00010000:00010000:0.0:1651532107.935531:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.935535:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.935558:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468204288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490847us (490892us total) trans 158913793585 rc 0/0
00000100:00100000:0.0:1651532107.935561:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3852
00010000:00010000:0.0:1651532107.935568:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.935572:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532107.935573:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.935576:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.935581:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.935581:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532107.935582:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.935585:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.935592:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.935602:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.935606:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.935611:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d2a8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2482176->9535487] (req 2482176->9535487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532107.935946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.935959:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468209984
00000100:00100000:1.0:1651532107.935963:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.935979:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468210048
00000100:00100000:1.0:1651532107.935985:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.935987:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3861
00000100:00100000:1.0:1651532107.935996:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3862
00000100:00100000:0.0:1651532107.935997:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468209984:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532107.935998:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468210048:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532107.936007:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.936023:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532107.936024:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.936025:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.936027:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532107.936027:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.936032:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532107.936033:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.936036:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532107.936036:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.936040:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.936041:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.936044:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.936044:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532107.936054:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468210176
00000100:00100000:1.0:1651532107.936059:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532107.936069:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468210304
00000100:00100000:1.0:1651532107.936079:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2487
00000100:00100000:1.0:1651532107.936081:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468210176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532107.936082:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2488
00000100:00100000:0.0:1651532107.936084:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468210304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532107.936085:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.936088:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3ce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4484fc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532107.936094:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532107.936095:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3ce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484fc expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.936098:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d3d5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448503 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532107.936099:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3ce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4484fc expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.936105:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d3d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448503 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.936109:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d3d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448503 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532107.936112:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:1.0:1651532107.936113:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532107.936126:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468210304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532107.936129:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2488
00000100:00100000:1.0:1651532107.936130:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468210176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (146us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532107.936134:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2487
00000001:00080000:1.0:1651532108.043894:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793586 is committed
00010000:00010000:1.0:1651532108.043909:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.043913:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.043929:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468205184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499557us (499640us total) trans 158913793586 rc 0/0
00000100:00100000:1.0:1651532108.043932:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3853
00010000:00010000:1.0:1651532108.043939:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.043942:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532108.043943:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.043947:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.043951:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.043952:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.043961:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.043965:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.043977:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.043980:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d2d9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->5881855] (req 3903488->5881855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.043985:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.043990:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044345:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044350:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.044372:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468205248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499935us (500065us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532108.044383:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3854
00010000:00010000:0.0:1651532108.044391:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044395:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.044396:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044401:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044409:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.044410:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.044412:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044415:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044424:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044427:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d2e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->10342399] (req 2015232->10342399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044433:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044435:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.044764:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.044773:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.044780:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.044788:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.044795:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.044816:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468210816
00000100:00100000:1.0:1651532108.044829:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468210880
00000100:00100000:1.0:1651532108.044837:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3863
00000100:00100000:1.0:1651532108.044839:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468210816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532108.044845:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.044850:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532108.044851:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.044853:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:0.0:1651532108.044858:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468210944
00010000:00010000:1.0:1651532108.044861:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.044866:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.044870:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.044875:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468211008
00000100:00100000:1.0:1651532108.044878:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468211136
00000100:00100000:0.0:1651532108.044879:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2489
00000100:00100000:0.0:1651532108.044881:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468210944:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532108.044883:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2490
00010000:00010000:0.0:1651532108.044884:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532108.044885:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468211008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.044888:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.044888:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d3e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44850a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.044890:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d3ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448511 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044896:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d3e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44850a expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.044898:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d3ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448511 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.044901:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d3e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44850a expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.044902:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d3ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448511 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.044904:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:1.0:1651532108.044905:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532108.044918:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468210944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.044921:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2489
00000100:00100000:0.0:1651532108.044926:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2491
00000100:00100000:0.0:1651532108.044928:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468211136:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532108.044934:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468211008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (145us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.044937:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2490
00010000:00010000:0.0:1651532108.044944:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.044947:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d3f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448518 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.044954:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d3f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448518 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.044966:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d3f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448518 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.044972:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532108.044983:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3864
00000100:00100000:0.0:1651532108.044989:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468211136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (194us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.044990:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468210880:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532108.044992:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2491
00010000:00010000:1.0:1651532108.045004:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.045008:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532108.045009:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.045012:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532108.045013:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.045017:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.045020:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532108.143919:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793587 is committed
00010000:00010000:0.0:1651532108.143945:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.143950:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.143974:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468206016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490831us (490915us total) trans 158913793587 rc 0/0
00000100:00100000:0.0:1651532108.143977:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3855
00010000:00010000:0.0:1651532108.143985:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.143989:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.143990:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.143993:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144008:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.144009:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.144011:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144015:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144029:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144033:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d2f5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->8257535] (req 2179072->8257535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144034:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144039:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.144273:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.144283:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.144292:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468211456
00010000:00010000:1.0:1651532108.144302:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.144303:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468211520
00000100:00100000:0.0:1651532108.144321:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2492
00000100:00100000:0.0:1651532108.144323:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468211456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.144326:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144327:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.144331:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d3ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44851f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144339:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532108.144342:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468206080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491191us (491238us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532108.144342:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d3ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44851f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532108.144346:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3856
00010000:00010000:0.0:1651532108.144347:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d3ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44851f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.144353:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144356:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532108.144357:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144360:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144361:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:1.0:1651532108.144365:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.144366:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.144367:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144370:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.144372:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468211456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.144375:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2492
00010000:00010000:1.0:1651532108.144376:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144380:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d2fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->6270975] (req 1093632->6270975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.144380:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2493
00000100:00100000:0.0:1651532108.144382:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468211520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.144385:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.144394:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144394:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d406 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448526 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144397:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144402:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d406 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448526 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.144406:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d406 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448526 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.144409:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532108.144416:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468211520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (133us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.144419:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2493
00000100:00100000:1.0:1651532108.144866:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.144873:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.144884:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.144891:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468211648
00000100:00100000:1.0:1651532108.144893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.144902:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468211712
00000100:00100000:0.0:1651532108.144916:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3865
00000100:00100000:0.0:1651532108.144918:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468211648:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532108.144919:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3866
00000100:00100000:1.0:1651532108.144921:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468211712:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532108.144927:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144928:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144932:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532108.144933:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532108.144934:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144937:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144942:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532108.144943:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144947:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144950:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532108.144950:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144955:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144958:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.144961:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.144970:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468211968
00000100:00100000:0.0:1651532108.144977:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468212032
00000100:00100000:0.0:1651532108.144985:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2494
00000100:00100000:0.0:1651532108.144987:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468211968:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532108.144988:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2495
00000100:00100000:1.0:1651532108.144990:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468212032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.144990:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.144993:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d41b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44852d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.144995:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.144997:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d422 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448534 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.145005:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d422 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448534 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.145009:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d422 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448534 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.145011:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d41b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44852d expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.145013:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532108.145016:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d41b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44852d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.145019:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532108.145024:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468212032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.145027:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2495
00000100:00100000:0.0:1651532108.145030:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468211968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (146us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.145033:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2494
00000100:00100000:1.0:1651532108.145264:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.145276:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468212224
00000100:00100000:0.0:1651532108.145284:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2496
00000100:00100000:0.0:1651532108.145286:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468212224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.145289:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.145292:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d429 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44853b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.145301:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d429 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44853b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.145305:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d429 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44853b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.145319:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532108.145333:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468212224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.145343:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2496
00000001:00080000:1.0:1651532108.243905:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793588 is committed
00010000:00010000:1.0:1651532108.243920:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.243924:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.243948:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468207424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482986us (483030us total) trans 158913793588 rc 0/0
00010000:00010000:0.0:1651532108.243949:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.243951:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3857
00010000:00010000:0.0:1651532108.243954:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.243956:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.243959:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.243965:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.243966:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.243967:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.243970:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.243973:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.243973:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.243974:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.243977:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.243988:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244002:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d33b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9998335] (req 950272->9998335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244008:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244011:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244022:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244030:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.244393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.244403:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.244411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.244412:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468212480
00010000:00010000:1.0:1651532108.244431:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244435:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.244440:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468212608
00000100:00100000:0.0:1651532108.244444:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468212672
00000100:00100000:0.0:1651532108.244453:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2497
00000100:00100000:0.0:1651532108.244455:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468212480:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532108.244458:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468208704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 374659us (374683us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532108.244459:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532108.244462:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3859
00010000:00010000:0.0:1651532108.244463:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d430 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448542 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.244469:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2498
00010000:00010000:0.0:1651532108.244469:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532108.244471:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468212608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.244472:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d430 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448542 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.244475:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.244476:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d430 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448542 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.244478:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d437 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448549 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244480:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:1.0:1651532108.244484:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.244486:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d437 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448549 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532108.244488:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468212480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (96us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532108.244490:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d437 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448549 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532108.244501:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2497
00010000:00010000:1.0:1651532108.244502:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532108.244506:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2499
00000100:00100000:0.0:1651532108.244508:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468212672:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532108.244509:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468212608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (107us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532108.244511:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532108.244512:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2498
00010000:00010000:0.0:1651532108.244513:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d43e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448550 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244518:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.244520:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d43e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448550 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.244524:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d43e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448550 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.244527:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532108.244534:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468212672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (123us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.244535:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.244537:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2499
00000100:00100000:0.0:1651532108.244541:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468212736
00000100:00100000:0.0:1651532108.244545:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2500
00000100:00100000:0.0:1651532108.244546:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468212736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.244549:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.244551:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d445 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448557 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244555:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.244557:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d445 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448557 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.244560:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d445 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448557 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.244563:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532108.244574:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468212736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (39us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.244576:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2500
00010000:00010000:0.0:1651532108.244583:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244587:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.244588:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244591:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244596:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244599:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d37a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->7622655] (req 233472->7622655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244609:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244623:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244646:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244650:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532108.244651:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244655:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.244663:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468207488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483694us (483757us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532108.244665:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.244666:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.244666:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.244667:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3858
00010000:00010000:1.0:1651532108.244670:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244680:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244683:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d342 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->10133503] (req 757760->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244707:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244710:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.244941:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.244951:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.244951:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468212864
00000100:00100000:1.0:1651532108.244959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.244965:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468212928
00000100:00100000:0.0:1651532108.244973:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3867
00000100:00100000:0.0:1651532108.244975:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468212864:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532108.244978:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3868
00000100:00100000:1.0:1651532108.244980:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468212928:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532108.244981:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244986:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532108.244987:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244988:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.244990:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532108.244990:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.244997:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532108.244998:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.245001:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532108.245001:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.245005:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.245006:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.245009:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.245009:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.245071:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.245083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.245090:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468213056
00000100:00100000:1.0:1651532108.245092:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468213184
00000100:00100000:0.0:1651532108.245096:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468213376
00000100:00100000:1.0:1651532108.245100:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2501
00000100:00100000:1.0:1651532108.245102:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468213056:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532108.245102:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2502
00000100:00100000:0.0:1651532108.245104:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468213184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.245106:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.245107:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.245109:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d45a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44855e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.245110:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d461 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448565 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.245117:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d45a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44855e expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.245118:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d461 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448565 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.245121:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d45a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44855e expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.245123:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d461 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448565 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.245124:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532108.245126:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532108.245136:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468213056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (177us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.245136:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468213184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.245139:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2501
00000100:00100000:0.0:1651532108.245140:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2502
00000100:00100000:1.0:1651532108.245144:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2503
00000100:00100000:1.0:1651532108.245146:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468213376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.245148:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.245150:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d468 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44856c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.245156:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d468 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44856c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.245186:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d468 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44856c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.245190:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532108.245198:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468213376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.245201:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2503
00000100:00100000:0.0:1651532108.245511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.245531:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468213568
00000100:00100000:1.0:1651532108.245542:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2504
00000100:00100000:1.0:1651532108.245544:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468213568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.245548:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.245551:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d46f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448573 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.245558:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d46f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448573 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.245562:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d46f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448573 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.245565:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532108.245575:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468213568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.245578:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2504
00000100:00100000:0.0:1651532108.245608:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.245623:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468213760
00000100:00100000:1.0:1651532108.245634:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2505
00000100:00100000:1.0:1651532108.245635:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468213760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.245638:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.245642:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d476 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44857a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.245649:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d476 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44857a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.245652:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d476 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44857a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.245656:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532108.245663:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468213760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.245665:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2505
00000100:00100000:0.0:1651532108.245966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.245982:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468214080
00000100:00100000:1.0:1651532108.245994:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2506
00000100:00100000:1.0:1651532108.245995:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096a49a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468214080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.245999:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.246002:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d47d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448581 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.246009:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d47d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448581 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.246016:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d47d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448581 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.246019:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532108.246029:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096a49a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468214080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.246032:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2506
00000100:00100000:0.0:1651532108.246277:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.246295:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468214272
00000100:00100000:1.0:1651532108.246307:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2507
00000100:00100000:1.0:1651532108.246316:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000386cd267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468214272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.246319:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.246322:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d484 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448588 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.246329:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d484 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448588 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.246333:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d484 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448588 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.246336:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532108.246346:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000386cd267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468214272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.246349:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2507
00000001:00080000:1.0:1651532108.368885:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793589 is committed
00010000:00010000:1.0:1651532108.368899:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.368903:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.368926:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468208640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499085us (499162us total) trans 158913793589 rc 0/0
00000100:00100000:1.0:1651532108.368930:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3860
00010000:00010000:0.0:1651532108.368936:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.368949:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.368950:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.368954:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.368961:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.368961:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.368962:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.368965:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.368976:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.368979:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d381 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->6799359] (req 1372160->6799359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.368989:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.368993:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.369206:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.369214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532108.369230:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.369233:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468214528
00010000:00010000:1.0:1651532108.369234:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.369253:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468214464
00000100:00100000:1.0:1651532108.369256:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468210048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433258us (433293us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532108.369262:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3869
00000100:00100000:1.0:1651532108.369280:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3862
00000100:00100000:0.0:1651532108.369280:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468214528:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532108.369286:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3870
00000100:00100000:1.0:1651532108.369287:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468214464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532108.369287:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369294:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.369295:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369295:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532108.369296:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.369300:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532108.369301:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.369304:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.369307:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532108.369308:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.369323:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369323:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.369326:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.369330:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369331:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369334:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.369335:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369338:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369343:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.369343:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.369344:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369347:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.369349:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532108.369354:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369368:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d3c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9805823] (req 61440->9805823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369373:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369376:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.369381:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468214656
00000100:00100000:1.0:1651532108.369393:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2508
00000100:00100000:1.0:1651532108.369395:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468214656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.369398:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.369414:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d499 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44858f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.369422:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d499 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44858f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.369426:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d499 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44858f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.369429:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532108.369437:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468214656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.369440:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2508
00000100:00100000:1.0:1651532108.369658:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.369675:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.369685:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468214848
00000100:00100000:1.0:1651532108.369694:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468214912
00000100:00100000:1.0:1651532108.369700:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2509
00000100:00100000:1.0:1651532108.369702:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468214848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.369705:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.369708:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448596 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.369716:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448596 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.369720:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448596 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.369723:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532108.369730:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2510
00000100:00100000:1.0:1651532108.369733:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468214848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.369733:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468214912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532108.369735:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2509
00010000:00010000:0.0:1651532108.369737:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.369741:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d4a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44859d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369749:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d4a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44859d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.369753:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d4a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44859d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.369757:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532108.369766:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468214912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.369769:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2510
00000100:00100000:1.0:1651532108.369880:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.369890:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468215040
00000100:00100000:0.0:1651532108.369907:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2511
00000100:00100000:0.0:1651532108.369909:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468215040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.369912:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.369916:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d4ae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485a4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.369923:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d4ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485a4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.369927:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d4ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485a4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.369930:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532108.369946:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468215040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.369949:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2511
00000100:00100000:1.0:1651532108.370049:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.370061:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468215296
00000100:00100000:0.0:1651532108.370068:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2512
00000100:00100000:0.0:1651532108.370070:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468215296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.370073:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.370076:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d4b5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485ab expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.370083:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d4b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485ab expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.370098:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d4b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485ab expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.370102:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532108.370114:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468215296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.370117:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2512
00000100:00100000:1.0:1651532108.370340:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.370351:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468215552
00000100:00100000:0.0:1651532108.370359:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2513
00000100:00100000:0.0:1651532108.370361:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468215552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.370364:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.370367:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485b2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.370374:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485b2 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.370378:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485b2 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.370381:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532108.370395:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468215552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.370397:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2513
00000100:00100000:1.0:1651532108.370591:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.370601:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468215680
00000100:00100000:0.0:1651532108.370608:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2514
00000100:00100000:0.0:1651532108.370610:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468215680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.370613:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.370616:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485b9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.370622:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485b9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.370626:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485b9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.370629:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532108.370642:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468215680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.370645:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2514
00000001:00080000:1.0:1651532108.452266:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793590 is committed
00010000:00010000:0.0:1651532108.452297:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.452302:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452327:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.452332:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468209984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516335us (516387us total) trans 158913793590 rc 0/0
00000100:00100000:0.0:1651532108.452335:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3861
00010000:00010000:1.0:1651532108.452336:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532108.452338:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452341:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452347:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.452347:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.452348:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452351:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452378:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452381:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d3c7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->7487487] (req 2125824->7487487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452388:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452390:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.452657:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.452678:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468215872
00000100:00100000:1.0:1651532108.452681:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.452690:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.452700:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468215808
00000100:00100000:0.0:1651532108.452706:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3871
00000100:00100000:0.0:1651532108.452708:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468215872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532108.452715:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.452716:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3872
00000100:00100000:1.0:1651532108.452718:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468215808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532108.452720:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532108.452721:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.452724:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532108.452724:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452725:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.452729:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.452732:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.452740:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468216000
00010000:00010000:1.0:1651532108.452745:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532108.452747:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452750:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532108.452750:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.452755:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.452755:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2515
00000100:00100000:0.0:1651532108.452756:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468216000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.452759:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.452759:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.452762:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485c0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.452769:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485c0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.452782:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485c0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.452786:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532108.452797:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468216000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.452800:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2515
00000100:00100000:1.0:1651532108.453074:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.453085:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468216128
00000100:00100000:0.0:1651532108.453097:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2516
00000100:00100000:0.0:1651532108.453099:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468216128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.453102:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.453106:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d4df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485c7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.453113:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d4df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485c7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.453117:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d4df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485c7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.453120:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532108.453130:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468216128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.453132:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2516
00000001:00080000:1.0:1651532108.510684:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793591 is committed
00002000:00010000:1.0:1651532108.510697:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532107 -> 1651532108
00002000:00010000:1.0:1651532108.510699:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532107 -> 1651532108
00010000:00010000:1.0:1651532108.510701:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.510705:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.510728:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468210816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 465888us (465964us total) trans 158913793591 rc 0/0
00010000:00010000:0.0:1651532108.510729:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.510731:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3863
00010000:00010000:0.0:1651532108.510734:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.510735:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.510738:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.510744:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.510745:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.510746:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.510749:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.510752:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.510753:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.510753:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.510756:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.510766:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.510769:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d3dc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10342399] (req 122880->10342399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.510776:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.510780:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.510787:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.510790:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.511094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.511112:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.511112:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468216384
00000100:00100000:0.0:1651532108.511121:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468216448
00000100:00100000:0.0:1651532108.511133:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2517
00000100:00100000:0.0:1651532108.511135:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468216384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.511139:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.511140:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511143:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d4e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485ce expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511145:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511149:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.511158:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d4e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485ce expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532108.511162:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468210880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466177us (466389us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532108.511162:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d4e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485ce expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.511165:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532108.511166:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3864
00000100:00100000:1.0:1651532108.511174:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2518
00000100:00100000:0.0:1651532108.511174:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468216384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.511176:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468216448:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532108.511177:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2517
00010000:00010000:1.0:1651532108.511179:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.511183:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d4ed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485d5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511188:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.511189:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511202:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511207:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d4ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485d5 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.511218:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d4ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485d5 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532108.511218:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468211712:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366297us (366345us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532108.511222:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532108.511222:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3866
00000100:00100000:1.0:1651532108.511229:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468216448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (117us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532108.511229:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.511232:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2518
00010000:00010000:0.0:1651532108.511232:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.511233:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511236:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511241:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511244:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d3f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5488640->8331263] (req 5488640->8331263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511248:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511251:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532108.511252:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511255:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511260:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.511260:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.511261:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511264:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511274:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511277:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d414 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4812800->7561215] (req 4812800->7561215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511277:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511281:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.511710:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.511732:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468216640
00000100:00100000:1.0:1651532108.511738:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.511753:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.511754:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3873
00000100:00100000:0.0:1651532108.511756:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468216640:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532108.511760:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532108.511768:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.511770:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468216704
00010000:00010000:0.0:1651532108.511773:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532108.511774:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511777:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532108.511778:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.511781:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3874
00010000:00010000:0.0:1651532108.511782:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511786:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.511791:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468216704:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532108.511793:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468216768
00010000:00010000:1.0:1651532108.511798:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.511812:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468216832
00000100:00100000:0.0:1651532108.511818:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2519
00000100:00100000:0.0:1651532108.511820:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468216768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.511821:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532108.511822:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511823:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.511825:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532108.511826:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511830:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511833:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d502 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485dc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.511834:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.511843:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2520
00000100:00100000:1.0:1651532108.511844:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468216832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.511847:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.511848:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d502 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485dc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.511850:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d509 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485e3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.511852:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d502 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485dc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.511856:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532108.511857:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d509 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485e3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.511861:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d509 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485e3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532108.511869:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468216768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.511872:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2519
00010000:00010000:1.0:1651532108.511876:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532108.511885:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468216832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.511888:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2520
00000001:00080000:1.0:1651532108.610726:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793592 is committed
00010000:00010000:0.0:1651532108.610762:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.610767:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.610791:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468211648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 465872us (465925us total) trans 158913793592 rc 0/0
00000100:00100000:0.0:1651532108.610794:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3865
00010000:00010000:0.0:1651532108.610817:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.610821:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.610822:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.610835:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.610841:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.610842:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.610843:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.610846:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.610854:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.610857:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d40d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5017600->9314303] (req 5017600->9314303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.610863:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.610865:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.611103:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.611121:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.611129:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468217216
00000100:00100000:1.0:1651532108.611139:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468217280
00000100:00100000:1.0:1651532108.611145:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3875
00000100:00100000:1.0:1651532108.611147:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468217216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532108.611154:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.611158:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532108.611159:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.611162:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532108.611163:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.611167:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.611170:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3876
00010000:00010000:1.0:1651532108.611171:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.611172:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468217280:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532108.611181:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.611222:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532108.611223:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.611226:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532108.611226:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.611242:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.611246:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.611249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.611259:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468217408
00000100:00100000:1.0:1651532108.611264:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.611274:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468217536
00000100:00100000:1.0:1651532108.611279:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2521
00000100:00100000:1.0:1651532108.611282:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468217408:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532108.611284:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2522
00010000:00010000:1.0:1651532108.611285:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532108.611286:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468217536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.611289:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d51e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485ea expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.611289:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.611293:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d525 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485f1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.611297:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d51e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485ea expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.611301:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d51e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485ea expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.611301:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d525 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485f1 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.611304:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532108.611306:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d525 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485f1 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532108.611325:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468217408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.611329:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2521
00010000:00010000:0.0:1651532108.611329:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532108.611340:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468217536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.611343:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2522
00000001:00080000:1.0:1651532108.677412:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793593 is committed
00010000:00010000:0.0:1651532108.677441:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677445:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.677465:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468212864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432490us (432525us total) trans 158913793593 rc 0/0
00010000:00010000:1.0:1651532108.677469:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.677469:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3867
00010000:00010000:1.0:1651532108.677473:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532108.677474:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677480:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677485:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.677486:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.677487:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677490:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677493:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.677494:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.677494:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677497:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677514:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677514:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677517:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d44c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [225280->9515007] (req 225280->9515007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677518:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677523:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677526:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.677862:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.677870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532108.677894:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677898:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677912:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.677917:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.677933:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468214528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 308653us (308727us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532108.677937:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3869
00000100:00100000:1.0:1651532108.677939:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468212928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 432958us (432987us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532108.677943:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3868
00010000:00010000:0.0:1651532108.677944:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677947:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.677949:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677952:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677957:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677960:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d48b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->9867263] (req 348160->9867263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677964:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677967:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.677967:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677970:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677982:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.677983:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.677984:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.677987:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.677988:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468217792
00010000:00010000:0.0:1651532108.677996:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.678003:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468217920
00010000:00010000:0.0:1651532108.678004:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d453 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1634304->9252863] (req 1634304->9252863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.678008:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2523
00000100:00100000:1.0:1651532108.678010:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468217792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.678013:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532108.678013:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2524
00000100:00100000:0.0:1651532108.678015:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468217920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.678017:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d52c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485f8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.678019:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.678022:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d533 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4485ff expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.678025:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d52c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485f8 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.678029:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d52c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485f8 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.678029:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d533 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485ff expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.678033:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532108.678034:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d533 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4485ff expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.678037:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532108.678045:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468217792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (184us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.678056:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2523
00000100:00100000:0.0:1651532108.678056:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468217920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (185us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.678059:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2524
00010000:00010000:1.0:1651532108.678064:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.678067:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.678281:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.678288:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.678322:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468218048
00000100:00100000:0.0:1651532108.678333:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468218112
00000100:00100000:0.0:1651532108.678342:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3877
00000100:00100000:0.0:1651532108.678344:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468218048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532108.678351:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.678354:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532108.678355:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532108.678356:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.678359:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532108.678360:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.678362:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532108.678364:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.678368:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.678370:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3878
00000100:00100000:1.0:1651532108.678372:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468218112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532108.678379:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.678384:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532108.678385:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.678388:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532108.678389:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.678393:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.678397:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.678477:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468218240
00000100:00100000:1.0:1651532108.678488:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468218304
00000100:00100000:0.0:1651532108.678492:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2525
00000100:00100000:1.0:1651532108.678494:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2526
00000100:00100000:0.0:1651532108.678494:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468218240:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532108.678496:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468218304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.678498:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.678500:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.678501:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d548 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448606 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.678504:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d54f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44860d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.678511:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d54f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44860d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.678515:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d54f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44860d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.678516:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d548 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448606 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.678519:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532108.678521:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d548 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448606 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.678524:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532108.678532:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468218304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (170us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.678535:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2526
00000100:00100000:0.0:1651532108.678540:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468218240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (186us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.678542:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2525
00000100:00100000:1.0:1651532108.678551:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.678563:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.678569:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468218432
00000100:00100000:1.0:1651532108.678574:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468218560
00000100:00100000:1.0:1651532108.678578:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2527
00000100:00100000:1.0:1651532108.678608:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468218432:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532108.678608:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2528
00000100:00100000:0.0:1651532108.678610:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468218560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.678611:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.678614:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.678617:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d556 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44861b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.678623:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d55d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448614 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.678624:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d556 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44861b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.678628:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d556 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44861b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.678630:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d55d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448614 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.678631:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:1.0:1651532108.678634:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d55d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448614 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.678638:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532108.678640:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468218560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.678643:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2528
00000100:00100000:1.0:1651532108.678646:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468218432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.678649:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2527
00000100:00100000:0.0:1651532108.678837:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.678847:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468218688
00000100:00100000:1.0:1651532108.678855:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2529
00000100:00100000:1.0:1651532108.678857:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468218688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.678860:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.678863:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d564 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448622 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.678870:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d564 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448622 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.678874:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d564 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448622 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.678877:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532108.678897:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468218688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.678899:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2529
00000100:00100000:1.0:1651532108.679006:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.679025:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.679038:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468218880
00000100:00100000:1.0:1651532108.679044:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468218944
00000100:00100000:1.0:1651532108.679052:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2530
00000100:00100000:1.0:1651532108.679054:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468218880:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532108.679056:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2531
00010000:00010000:1.0:1651532108.679057:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532108.679058:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468218944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.679061:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d56b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448629 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.679062:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.679065:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d572 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448630 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.679068:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d56b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448629 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.679073:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d56b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448629 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.679073:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d572 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448630 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.679076:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532108.679077:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d572 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448630 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.679080:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532108.679087:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468218880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.679090:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2530
00000100:00100000:0.0:1651532108.679095:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468218944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.679098:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2531
00000100:00100000:1.0:1651532108.679359:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.679370:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468219264
00000100:00100000:1.0:1651532108.679371:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.679381:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468219328
00000100:00100000:1.0:1651532108.679389:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2532
00000100:00100000:1.0:1651532108.679392:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468219264:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532108.679392:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2533
00000100:00100000:0.0:1651532108.679393:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468219328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.679395:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.679397:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.679399:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d579 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448637 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.679401:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d580 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44863e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.679406:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d579 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448637 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.679410:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d579 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448637 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.679413:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532108.679418:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d580 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44863e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532108.679425:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468219264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.679428:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2532
00010000:00010000:0.0:1651532108.679428:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d580 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44863e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.679432:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532108.679440:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468219328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.679443:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2533
00000100:00100000:1.0:1651532108.679674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.679684:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468219520
00000100:00100000:0.0:1651532108.679694:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2534
00000100:00100000:0.0:1651532108.679696:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468219520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.679699:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.679703:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d587 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448645 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.679710:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d587 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448645 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.679714:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d587 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448645 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.679717:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532108.679727:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468219520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.679730:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2534
00000001:00080000:1.0:1651532108.744151:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793594 is committed
00010000:00010000:1.0:1651532108.744166:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744170:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.744187:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468214464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 374899us (374972us total) trans 158913793594 rc 0/0
00000100:00100000:1.0:1651532108.744190:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3870
00010000:00010000:1.0:1651532108.744196:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744203:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532108.744204:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744207:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744212:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.744212:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532108.744213:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744216:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744229:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744232:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d492 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->10100735] (req 1359872->10100735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744242:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744246:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744430:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744434:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.744450:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468215872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 291741us (291793us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532108.744453:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3871
00010000:00010000:0.0:1651532108.744459:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744462:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.744463:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744466:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744471:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.744480:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.744481:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744484:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744496:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744499:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d4ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8720383] (req 1441792->8720383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744504:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744509:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.744717:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.744736:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.744736:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468219712
00000100:00100000:1.0:1651532108.744743:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.744753:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468219776
00000100:00100000:1.0:1651532108.744756:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.744759:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3879
00000100:00100000:0.0:1651532108.744761:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468219712:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532108.744763:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532108.744767:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.744770:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3880
00000100:00100000:1.0:1651532108.744772:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468219776:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532108.744772:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532108.744773:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744775:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532108.744776:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744780:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744780:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744785:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532108.744786:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744789:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532108.744789:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744794:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744795:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744797:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532108.744819:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468219904
00000100:00100000:1.0:1651532108.744825:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468220032
00000100:00100000:1.0:1651532108.744835:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468220096
00000100:00100000:1.0:1651532108.744838:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2535
00000100:00100000:1.0:1651532108.744840:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468219904:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532108.744841:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2536
00010000:00010000:1.0:1651532108.744843:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532108.744843:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468220032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.744847:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.744850:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d59c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448653 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.744853:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d5a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44864c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744857:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d59c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448653 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.744861:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d5a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44864c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.744861:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d59c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448653 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.744865:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:1.0:1651532108.744866:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d5a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44864c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.744869:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532108.744880:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468220032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.744882:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2536
00000100:00100000:1.0:1651532108.744884:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468219904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (140us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.744887:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2535
00000100:00100000:0.0:1651532108.744889:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2537
00000100:00100000:0.0:1651532108.744891:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468220096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.744893:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.744896:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d5aa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44865a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744902:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d5aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44865a expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.744905:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d5aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44865a expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.744908:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532108.744914:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468220096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (152us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.744917:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2537
00000100:00100000:0.0:1651532108.744931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.744965:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468220224
00000100:00100000:0.0:1651532108.744972:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2538
00000100:00100000:0.0:1651532108.744974:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468220224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.744976:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.744980:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d5b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448661 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.744986:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d5b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448661 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.744990:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d5b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448661 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.744993:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532108.745011:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468220224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.745014:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2538
00000100:00100000:1.0:1651532108.745245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.745257:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468220416
00000100:00100000:1.0:1651532108.745259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.745267:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468220544
00000100:00100000:0.0:1651532108.745274:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2539
00000100:00100000:0.0:1651532108.745275:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468220416:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532108.745279:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2540
00010000:00010000:0.0:1651532108.745279:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532108.745281:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468220544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.745282:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d5b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448668 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.745285:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.745289:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d5bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44866f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.745289:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d5b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448668 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.745293:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d5b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448668 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.745297:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d5bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44866f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.745297:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:1.0:1651532108.745301:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d5bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44866f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.745324:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532108.745333:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468220416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.745336:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2539
00000100:00100000:1.0:1651532108.745340:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468220544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.745343:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2540
00000100:00100000:0.0:1651532108.745365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.745380:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468220672
00000100:00100000:1.0:1651532108.745388:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2541
00000100:00100000:1.0:1651532108.745390:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ae2c042 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468220672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.745393:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.745396:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d5c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448676 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.745403:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d5c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448676 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.745407:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d5c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448676 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.745410:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532108.745417:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ae2c042 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468220672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.745420:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2541
00000100:00100000:0.0:1651532108.745462:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.745472:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468220864
00000100:00100000:1.0:1651532108.745480:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2542
00000100:00100000:1.0:1651532108.745481:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc66c150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468220864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.745494:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.745497:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d5cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44867d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.745503:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d5cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44867d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.745507:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d5cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44867d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.745511:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532108.745520:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc66c150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468220864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.745523:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2542
00000100:00100000:0.0:1651532108.745666:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.745677:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468221120
00000100:00100000:0.0:1651532108.745678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.745688:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468221184
00000100:00100000:1.0:1651532108.745696:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2543
00000100:00100000:1.0:1651532108.745697:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468221120:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532108.745699:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2544
00010000:00010000:1.0:1651532108.745701:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532108.745701:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468221184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.745703:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5d4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448684 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.745710:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448684 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.745713:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532108.745714:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448684 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.745717:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44868b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.745724:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44868b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.745725:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532108.745728:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44868b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.745731:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532108.745735:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468221120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.745738:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2543
00000100:00100000:0.0:1651532108.745739:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468221184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.745742:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2544
00000001:00080000:1.0:1651532108.919140:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793595 is committed
00010000:00010000:1.0:1651532108.919157:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.919161:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.919183:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468215808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466464us (466502us total) trans 158913793595 rc 0/0
00000100:00100000:1.0:1651532108.919187:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3872
00010000:00010000:0.0:1651532108.919189:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919194:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532108.919195:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919198:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919204:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.919205:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532108.919206:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919219:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919228:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919230:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d4d1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->10424319] (req 438272->10424319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919236:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919239:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.919597:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.919605:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.919612:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.919621:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532108.919628:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468221504
00000100:00100000:1.0:1651532108.919640:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468221440
00000100:00100000:1.0:1651532108.919646:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3881
00000100:00100000:1.0:1651532108.919648:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468221504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532108.919656:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.919660:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532108.919665:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3882
00000100:00100000:0.0:1651532108.919668:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468221440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532108.919669:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532108.919670:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.919674:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919676:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919680:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532108.919681:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.919683:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468221568
00010000:00010000:0.0:1651532108.919684:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.919689:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468221632
00000100:00100000:1.0:1651532108.919693:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2545
00000100:00100000:1.0:1651532108.919694:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468221568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532108.919697:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.919698:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532108.919699:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.919700:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d5f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448692 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919704:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.919707:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d5f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448692 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.919707:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.919710:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532108.919711:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d5f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448692 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532108.919714:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532108.919718:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2546
00000100:00100000:0.0:1651532108.919720:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468221632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.919723:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.919725:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d5f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448699 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532108.919738:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468221568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532108.919740:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2545
00010000:00010000:0.0:1651532108.919745:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d5f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448699 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.919749:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d5f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448699 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.919753:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532108.919762:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468221632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (141us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.919765:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2546
00000100:00100000:1.0:1651532108.919999:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532108.920010:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468221888
00000100:00100000:0.0:1651532108.920022:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2547
00000100:00100000:0.0:1651532108.920023:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468221888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532108.920027:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532108.920030:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d5fe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486a0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532108.920037:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d5fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486a0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.920041:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d5fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486a0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532108.920045:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532108.920059:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468221888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532108.920062:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2547
00000001:00080000:1.0:1651532109.010822:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793596 is committed
00010000:00010000:0.0:1651532109.010856:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.010861:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.010882:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468216640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499125us (499172us total) trans 158913793596 rc 0/0
00010000:00010000:1.0:1651532109.010883:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.010893:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3873
00010000:00010000:1.0:1651532109.010895:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.010896:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.010899:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.010905:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.010905:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.010906:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.010909:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.010917:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.010920:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d4f4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8191999] (req 45056->8191999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.010926:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.010929:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.011236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.011244:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.011261:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468222208
00000100:00100000:1.0:1651532109.011263:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468222272
00000100:00100000:0.0:1651532109.011271:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2548
00000100:00100000:0.0:1651532109.011273:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468222208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.011277:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532109.011282:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2549
00000100:00100000:1.0:1651532109.011284:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468222272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.011288:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.011288:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d605 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486a7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.011291:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d60c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486ae expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011293:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.011296:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d605 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486a7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.011297:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.011300:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d60c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486ae expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.011300:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d605 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486a7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.011304:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d60c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486ae expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.011304:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:1.0:1651532109.011307:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532109.011326:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468222208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.011329:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2548
00000100:00100000:1.0:1651532109.011331:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468222272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.011334:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2549
00010000:00010000:1.0:1651532109.011347:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.011350:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011364:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.011366:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468216704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499575us (499613us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532109.011368:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532109.011369:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3874
00010000:00010000:0.0:1651532109.011369:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011372:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011377:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.011378:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.011379:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011382:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011392:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011395:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d4fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2531328->8167423] (req 2531328->8167423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011403:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011406:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.011781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.011792:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468222464
00000100:00100000:0.0:1651532109.011792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.011800:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.011820:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468222528
00000100:00100000:1.0:1651532109.011823:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3883
00000100:00100000:1.0:1651532109.011825:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096a49a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468222464:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532109.011835:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3884
00010000:00010000:1.0:1651532109.011837:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.011842:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532109.011842:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.011843:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000386cd267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468222528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532109.011845:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532109.011846:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.011850:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011850:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.011854:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011855:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532109.011856:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011859:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532109.011860:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011864:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011868:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.011876:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468222784
00000100:00100000:0.0:1651532109.011882:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2550
00000100:00100000:0.0:1651532109.011884:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468222784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.011886:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.011889:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d621 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486b5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.011896:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d621 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486b5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.011903:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d621 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486b5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.011906:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532109.011923:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468222784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.011925:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2550
00000001:00080000:1.0:1651532109.119166:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793597 is committed
00010000:00010000:0.0:1651532109.119198:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119203:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.119221:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468217216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 508073us (508118us total) trans 158913793597 rc 0/0
00000100:00100000:0.0:1651532109.119224:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3875
00010000:00010000:0.0:1651532109.119231:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119234:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532109.119235:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119238:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119255:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.119255:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.119256:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119259:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119267:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119270:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d510 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2150400->9781247] (req 2150400->9781247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119275:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119278:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119469:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119474:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.119495:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468217280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508322us (508374us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532109.119499:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.119504:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.119505:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.119507:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3876
00010000:00010000:1.0:1651532109.119508:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.119524:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.119525:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.119526:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.119529:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.119539:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.119542:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d517 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->10448895] (req 720896->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119543:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119547:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.119722:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.119743:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468223040
00000100:00100000:0.0:1651532109.119753:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2551
00000100:00100000:0.0:1651532109.119755:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468223040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532109.119763:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532109.119763:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.119767:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d628 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486c3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.119772:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468222976
00010000:00010000:0.0:1651532109.119775:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d628 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486c3 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532109.119783:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2552
00000100:00100000:1.0:1651532109.119785:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468222976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.119785:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d628 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486c3 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.119789:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.119789:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:1.0:1651532109.119793:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d62f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486bc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.119816:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468223040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.119819:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2551
00010000:00010000:1.0:1651532109.119825:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d62f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486bc expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.119830:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d62f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486bc expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.119841:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532109.119858:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468222976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 72us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.119861:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2552
00000100:00100000:1.0:1651532109.119878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.119897:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.119917:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468223232
00000100:00100000:0.0:1651532109.119930:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468223360
00000100:00100000:0.0:1651532109.119939:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3885
00000100:00100000:0.0:1651532109.119941:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468223232:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532109.119944:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3886
00000100:00100000:1.0:1651532109.119946:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468223360:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532109.119948:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119953:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532109.119954:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.119955:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119957:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532109.119958:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.119961:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532109.119963:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.119966:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532109.119966:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119970:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.119971:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.119974:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.119974:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.120152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.120163:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468223488
00000100:00100000:0.0:1651532109.120174:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2553
00000100:00100000:0.0:1651532109.120176:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468223488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.120179:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.120183:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d644 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486ca expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.120190:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d644 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486ca expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.120198:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d644 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486ca expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.120201:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532109.120212:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468223488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.120215:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2553
00000100:00100000:1.0:1651532109.120445:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.120457:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468223744
00000100:00100000:0.0:1651532109.120467:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2554
00000100:00100000:0.0:1651532109.120469:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468223744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.120472:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.120476:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d64b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486d1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.120483:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d64b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486d1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.120487:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d64b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486d1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.120490:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532109.120500:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468223744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.120503:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2554
00000001:00080000:1.0:1651532109.260819:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793598 is committed
00010000:00010000:0.0:1651532109.260851:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.260856:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.260879:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468218048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582533us (582597us total) trans 158913793598 rc 0/0
00000100:00100000:0.0:1651532109.260882:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3877
00010000:00010000:0.0:1651532109.260889:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.260893:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532109.260894:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.260897:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.260902:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.260902:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.260903:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.260906:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.260915:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.260928:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.260928:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d53a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1449984->9035775] (req 1449984->9035775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.260933:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.261277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.261288:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.261289:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468223936
00000100:00100000:0.0:1651532109.261300:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468224000
00000100:00100000:0.0:1651532109.261305:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2555
00000100:00100000:0.0:1651532109.261307:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468223936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.261320:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.261321:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261324:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d652 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486d8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.261326:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261330:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.261339:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d652 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486d8 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532109.261346:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468218112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 582973us (583057us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532109.261347:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d652 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486d8 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532109.261349:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3878
00010000:00010000:0.0:1651532109.261351:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532109.261359:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2556
00000100:00100000:1.0:1651532109.261360:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468224000:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532109.261360:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468223936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.261363:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2555
00010000:00010000:1.0:1651532109.261364:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.261367:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d659 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486df expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261371:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.261373:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.261375:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.261376:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d659 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486df expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.261376:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261380:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.261383:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d659 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486df expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.261385:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.261385:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.261386:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.261387:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532109.261389:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.261393:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468224000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.261396:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2556
00010000:00010000:0.0:1651532109.261396:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261399:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d541 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->3518463] (req 1806336->3518463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261404:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261407:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.261738:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.261754:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.261762:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468224256
00000100:00100000:0.0:1651532109.261774:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468224192
00000100:00100000:1.0:1651532109.261789:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3887
00000100:00100000:1.0:1651532109.261792:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468224256:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532109.261801:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3888
00000100:00100000:0.0:1651532109.261815:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468224192:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532109.261817:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.261823:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532109.261823:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.261824:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532109.261825:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261829:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532109.261830:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261833:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532109.261834:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.261837:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261838:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.261842:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532109.360817:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793599 is committed
00010000:00010000:0.0:1651532109.360851:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.360855:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.360877:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468219712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616115us (616160us total) trans 158913793599 rc 0/0
00010000:00010000:1.0:1651532109.360880:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.360880:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3879
00010000:00010000:1.0:1651532109.360886:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.360887:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360891:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360898:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.360899:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.360899:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360903:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360906:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.360906:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.360907:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360910:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360928:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360932:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d58e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9121791] (req 1777664->9121791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360937:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360940:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360975:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.360978:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.361264:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.361282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.361283:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468224576
00000100:00100000:0.0:1651532109.361297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.361308:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468224640
00000100:00100000:1.0:1651532109.361323:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468224704
00000100:00100000:0.0:1651532109.361332:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2557
00000100:00100000:1.0:1651532109.361335:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2558
00000100:00100000:0.0:1651532109.361335:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468224576:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532109.361338:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468224640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.361339:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.361342:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.361343:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d66e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486e6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361346:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d675 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486ed expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.361349:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.361352:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.361352:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d66e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486e6 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.361355:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d675 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486ed expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.361357:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d66e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486e6 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.361360:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d675 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486ed expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.361360:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:1.0:1651532109.361364:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532109.361370:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468224576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.361373:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468224640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.361373:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2557
00000100:00100000:1.0:1651532109.361376:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2558
00000100:00100000:0.0:1651532109.361379:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2559
00000100:00100000:0.0:1651532109.361380:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468224704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.361383:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.361385:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d67c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486f4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.361389:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.361391:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361395:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.361399:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d67c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486f4 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532109.361411:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468219776:12345-10.240.43.64@tcp:3:fio.0 Request processed in 616638us (616675us total) trans 0 rc 49152/49152
00000100:00100000:1.0:1651532109.361414:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3880
00010000:00010000:0.0:1651532109.361414:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d67c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486f4 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.361418:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:1.0:1651532109.361425:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.361425:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468224704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (128us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532109.361428:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.361428:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2559
00000100:00100000:1.0:1651532109.361442:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468221504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441793us (441846us total) trans 0 rc 40960/40960
00010000:00010000:0.0:1651532109.361443:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.361445:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3881
00010000:00010000:0.0:1651532109.361447:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532109.361448:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.361451:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361456:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.361456:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361459:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532109.361459:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d595 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1536000->8974335] (req 1536000->8974335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361460:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361463:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361468:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.361469:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.361470:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361473:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361483:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361485:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d5e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [290816->10346495] (req 290816->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361519:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.361527:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.361928:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.361954:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468224832
00000100:00100000:0.0:1651532109.361959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.361969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.361981:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468224768
00000100:00100000:1.0:1651532109.361994:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3889
00000100:00100000:1.0:1651532109.361996:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ae2c042 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468224832:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532109.361996:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532109.362003:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.362003:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532109.362013:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532109.362014:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.362014:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3890
00000100:00100000:0.0:1651532109.362016:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc66c150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468224768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532109.362020:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532109.362021:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.362024:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.362026:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.362029:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532109.362030:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.362046:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532109.362047:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.362051:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.362053:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.362056:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.362058:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468224960
00000100:00100000:1.0:1651532109.362065:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468225152
00000100:00100000:0.0:1651532109.362065:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468225216
00000100:00100000:1.0:1651532109.362068:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2560
00000100:00100000:1.0:1651532109.362069:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468224960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.362072:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532109.362072:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2561
00000100:00100000:0.0:1651532109.362073:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468225152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.362075:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d691 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4486fb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.362076:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.362079:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d698 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448702 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.362082:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d691 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486fb expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362087:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d691 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4486fb expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.362089:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d698 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448702 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362090:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532109.362093:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d698 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448702 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.362096:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532109.362104:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468224960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (135us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.362107:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2560
00000100:00100000:1.0:1651532109.362112:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2562
00000100:00100000:0.0:1651532109.362113:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468225152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.362114:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468225216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532109.362116:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2561
00010000:00010000:1.0:1651532109.362117:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.362119:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d69f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448709 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.362125:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d69f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448709 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362128:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d69f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448709 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532109.362130:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532109.362131:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532109.362137:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468225216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (135us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.362140:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2562
00000100:00100000:1.0:1651532109.362144:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468225408
00000100:00100000:1.0:1651532109.362147:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2563
00000100:00100000:1.0:1651532109.362149:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468225408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.362151:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.362153:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d6a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448710 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.362158:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d6a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448710 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362180:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d6a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448710 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362184:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532109.362195:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468225408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.362198:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2563
00000100:00100000:0.0:1651532109.362506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.362525:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468225728
00000100:00100000:1.0:1651532109.362538:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2564
00000100:00100000:1.0:1651532109.362540:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468225728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.362543:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.362546:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448717 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.362554:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448717 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362557:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448717 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362561:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532109.362575:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468225728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.362577:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2564
00000100:00100000:0.0:1651532109.362686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.362702:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468225920
00000100:00100000:1.0:1651532109.362712:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2565
00000100:00100000:1.0:1651532109.362714:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468225920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.362717:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.362720:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d6b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44871e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.362727:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d6b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44871e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362731:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d6b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44871e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362734:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532109.362746:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468225920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.362748:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2565
00000100:00100000:0.0:1651532109.362852:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.362862:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468226112
00000100:00100000:1.0:1651532109.362872:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2566
00000100:00100000:1.0:1651532109.362874:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468226112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.362877:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.362880:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448725 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.362887:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448725 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362894:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448725 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.362897:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532109.362909:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468226112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.362911:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2566
00000001:00080000:1.0:1651532109.460851:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793600 is committed
00010000:00010000:1.0:1651532109.460866:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.460870:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.460894:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468221440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541225us (541288us total) trans 158913793600 rc 0/0
00000100:00100000:1.0:1651532109.460897:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3882
00010000:00010000:1.0:1651532109.460904:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.460908:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.460909:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.460912:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.460926:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.460926:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.460927:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.460939:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.460947:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.460950:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d5e9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->9097215] (req 356352->9097215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.460956:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.460959:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.461361:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.461372:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.461380:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.461390:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468226496
00000100:00100000:0.0:1651532109.461401:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468226560
00000100:00100000:0.0:1651532109.461409:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3891
00000100:00100000:0.0:1651532109.461411:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468226496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532109.461419:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.461424:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532109.461425:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.461433:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3892
00000100:00100000:1.0:1651532109.461435:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468226560:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532109.461436:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532109.461437:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.461442:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.461445:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.461446:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.461452:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532109.461454:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.461460:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532109.461461:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.461461:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468226752
00000100:00100000:0.0:1651532109.461468:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2567
00010000:00010000:1.0:1651532109.461469:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.461469:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c031ba3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468226752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.461473:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.461475:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d6d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44872c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.461476:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.461483:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d6d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44872c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.461488:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d6d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44872c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.461491:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532109.461502:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c031ba3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468226752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.461515:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2567
00000001:00080000:1.0:1651532109.602541:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793601 is committed
00010000:00010000:1.0:1651532109.602557:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.602561:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.602583:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096a49a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468222464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 590758us (590803us total) trans 158913793601 rc 0/0
00000100:00100000:1.0:1651532109.602587:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3883
00010000:00010000:0.0:1651532109.602589:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.602594:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532109.602595:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.602599:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.602605:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.602606:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.602606:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.602610:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.602618:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.602621:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d613 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->10268671] (req 925696->10268671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.602633:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.602638:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.602958:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.602978:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.602978:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468227008
00000100:00100000:1.0:1651532109.602985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.602994:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468227072
00000100:00100000:0.0:1651532109.602997:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468227200
00000100:00100000:0.0:1651532109.603001:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2568
00010000:00010000:1.0:1651532109.603003:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.603003:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468227008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.603007:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.603007:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.603011:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d6d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448733 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.603016:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.603019:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d6d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448733 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532109.603024:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000386cd267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468222528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 591180us (591232us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532109.603027:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3884
00010000:00010000:0.0:1651532109.603031:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d6d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448733 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.603034:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.603034:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:1.0:1651532109.603038:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.603039:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.603042:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.603044:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468227008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (86us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532109.603047:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.603047:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532109.603047:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2568
00010000:00010000:1.0:1651532109.603048:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.603051:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.603052:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2569
00000100:00100000:0.0:1651532109.603054:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468227072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.603056:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.603060:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.603063:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d61a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->4616191] (req 1220608->4616191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.603066:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d6de lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44873a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.603071:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2570
00000100:00100000:1.0:1651532109.603073:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468227200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.603073:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d6de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44873a expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.603076:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.603076:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d6de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44873a expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.603079:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d6e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448741 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.603080:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:1.0:1651532109.603086:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d6e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448741 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532109.603086:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468227072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.603089:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2569
00010000:00010000:1.0:1651532109.603091:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d6e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448741 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.603094:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532109.603096:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.603099:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.603101:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468227200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (116us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.603103:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2570
00000100:00100000:0.0:1651532109.603527:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.603539:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468227328
00000100:00100000:1.0:1651532109.603552:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3893
00000100:00100000:1.0:1651532109.603554:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000704fce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468227328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532109.603569:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.603571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532109.603577:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532109.603578:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.603580:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532109.603581:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.603589:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532109.603590:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.603591:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532109.603599:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.603601:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468227392
00010000:00010000:1.0:1651532109.603602:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.603606:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.603612:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3894
00000100:00100000:0.0:1651532109.603614:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f23ba88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468227392:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532109.603617:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468227456
00010000:00010000:0.0:1651532109.603621:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.603627:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468227648
00000100:00100000:1.0:1651532109.603633:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2571
00000100:00100000:1.0:1651532109.603635:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afa5d0ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468227456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.603636:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532109.603637:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.603638:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.603640:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d6fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448748 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.603640:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532109.603641:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.603646:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.603650:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d6fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448748 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.603650:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.603654:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d6fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448748 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.603658:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532109.603658:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2572
00000100:00100000:0.0:1651532109.603659:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c48da76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468227648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.603662:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532109.603669:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afa5d0ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468227456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.603671:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2571
00010000:00010000:0.0:1651532109.603674:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d701 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44874f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.603681:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d701 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44874f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.603686:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d701 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44874f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.603689:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532109.603701:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c48da76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468227648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.603704:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2572
00000100:00100000:0.0:1651532109.603909:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.603915:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468227904
00000100:00100000:0.0:1651532109.603922:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2573
00000100:00100000:0.0:1651532109.603924:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468227904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.603927:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.603931:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d708 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448756 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.603938:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d708 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448756 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.603942:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d708 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448756 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.603945:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532109.603959:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468227904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.603962:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2573
00000001:00080000:1.0:1651532109.660910:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793602 is committed
00002000:00010000:0.0:1651532109.660941:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532108 -> 1651532109
00002000:00010000:0.0:1651532109.660943:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532108 -> 1651532109
00010000:00010000:0.0:1651532109.660945:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.660949:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.660972:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468223232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541030us (541094us total) trans 158913793602 rc 0/0
00010000:00010000:1.0:1651532109.660973:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.660975:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3885
00010000:00010000:1.0:1651532109.660978:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.660979:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.660983:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.660988:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.660989:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.660990:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.660993:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.660996:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.660997:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.660997:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661000:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661016:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661019:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d636 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->7221247] (req 303104->7221247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661025:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661027:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661051:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661054:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.661329:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.661360:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468228032
00010000:00010000:1.0:1651532109.661367:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.661368:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2574
00000100:00100000:0.0:1651532109.661370:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468228032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.661374:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661374:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.661377:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d70f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44875d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661390:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.661393:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d70f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44875d expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532109.661396:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468223360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 541448us (541498us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532109.661397:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d70f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44875d expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532109.661399:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3886
00010000:00010000:0.0:1651532109.661401:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:1.0:1651532109.661409:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.661409:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468228032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.661412:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2574
00010000:00010000:1.0:1651532109.661413:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661419:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661422:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532109.661424:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468224256:12345-10.240.43.64@tcp:3:fio.0 Request processed in 399631us (399687us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532109.661424:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.661426:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3887
00010000:00010000:0.0:1651532109.661427:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661432:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661435:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.661436:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661439:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661444:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661446:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.661447:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.661447:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d63d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->1564671] (req 782336->1564671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661448:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661451:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661457:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661459:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661460:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d660 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4034560->7442431] (req 4034560->7442431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661462:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.661853:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.661862:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.661868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.661878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.661880:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468228352
00000100:00100000:1.0:1651532109.661888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.661896:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468228480
00000100:00100000:0.0:1651532109.661899:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468228544
00000100:00100000:1.0:1651532109.661901:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468228288
00000100:00100000:0.0:1651532109.661902:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2575
00000100:00100000:0.0:1651532109.661904:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468228352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.661908:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532109.661915:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468228224
00010000:00010000:0.0:1651532109.661917:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d716 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448764 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.661924:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3895
00000100:00100000:1.0:1651532109.661925:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468228288:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532109.661930:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d716 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448764 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.661933:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661934:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d716 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448764 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.661937:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532109.661938:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532109.661939:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661940:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:1.0:1651532109.661945:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.661951:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468228352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.661952:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3896
00000100:00100000:1.0:1651532109.661954:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468228224:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532109.661954:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2575
00010000:00010000:1.0:1651532109.661958:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.661959:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2576
00010000:00010000:1.0:1651532109.661961:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532109.661961:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468228480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.661962:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661964:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.661965:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661966:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d72b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44876b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661967:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532109.661968:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.661972:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661972:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d72b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44876b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.661975:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661976:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d72b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44876b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.661978:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.661979:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532109.661984:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468228480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.661986:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2576
00000100:00100000:1.0:1651532109.661988:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2577
00000100:00100000:1.0:1651532109.661990:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468228544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.661992:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.661995:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d732 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448772 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.662002:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d732 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448772 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.662006:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d732 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448772 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.662010:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532109.662032:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468228544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (143us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.662034:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2577
00000100:00100000:0.0:1651532109.662322:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.662340:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468228672
00000100:00100000:1.0:1651532109.662354:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2578
00000100:00100000:1.0:1651532109.662355:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468228672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.662359:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.662362:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d739 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448779 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.662369:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d739 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448779 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.662377:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d739 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448779 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.662380:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532109.662390:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468228672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.662392:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2578
00000001:00080000:1.0:1651532109.770628:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793603 is committed
00010000:00010000:0.0:1651532109.770663:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.770668:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.770695:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468224192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 508891us (508941us total) trans 158913793603 rc 0/0
00000100:00100000:0.0:1651532109.770699:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3888
00010000:00010000:0.0:1651532109.770706:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.770709:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532109.770710:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.770713:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.770718:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.770719:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.770720:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.770723:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.770735:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.770738:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d667 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4141056->10276863] (req 4141056->10276863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.770747:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.770752:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.770925:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.770929:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.770950:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ae2c042 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468224832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408953us (409022us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532109.770953:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3889
00010000:00010000:1.0:1651532109.770960:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.770966:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.770967:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.770970:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.770984:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.770984:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.770985:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.770988:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.770998:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.771001:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d683 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3883008->4878335] (req 3883008->4878335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.771002:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.771006:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.771105:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.771132:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468228992
00000100:00100000:1.0:1651532109.771151:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3897
00000100:00100000:1.0:1651532109.771153:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b87a626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468228992:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532109.771157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532109.771160:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.771166:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532109.771167:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532109.771168:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.771177:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532109.771177:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.771178:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468229056
00010000:00010000:1.0:1651532109.771182:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.771185:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.771189:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3898
00000100:00100000:0.0:1651532109.771191:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468229056:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532109.771192:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468229184
00010000:00010000:0.0:1651532109.771198:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.771203:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2579
00000100:00100000:1.0:1651532109.771204:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468229184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.771207:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.771209:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532109.771210:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d74e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448780 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.771210:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.771213:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532109.771214:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.771219:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d74e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448780 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.771234:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.771235:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d74e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448780 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.771239:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.771249:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532109.771258:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468229184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.771261:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2579
00000100:00100000:1.0:1651532109.771276:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.771301:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468229312
00000100:00100000:0.0:1651532109.771320:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2580
00000100:00100000:0.0:1651532109.771322:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468229312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.771326:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532109.771328:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532109.771330:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d755 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448787 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.771344:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d755 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448787 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532109.771345:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468229376
00010000:00010000:0.0:1651532109.771349:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d755 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448787 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.771352:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532109.771354:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2581
00000100:00100000:1.0:1651532109.771356:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468229376:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532109.771367:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468229312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.771370:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2580
00010000:00010000:1.0:1651532109.771378:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.771382:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d75c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44878e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.771390:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d75c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44878e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.771394:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d75c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44878e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.771398:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532109.771406:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468229376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.771430:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2581
00000001:00080000:1.0:1651532109.862282:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793604 is committed
00010000:00010000:0.0:1651532109.862322:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.862327:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.862350:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc66c150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468224768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 500333us (500390us total) trans 158913793604 rc 0/0
00010000:00010000:1.0:1651532109.862351:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.862355:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3890
00010000:00010000:1.0:1651532109.862364:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.862365:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.862368:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.862374:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.862375:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.862376:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.862379:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.862395:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.862397:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.862398:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d68a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3567616->10096639] (req 3567616->10096639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.862401:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.862701:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.862712:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.862721:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.862730:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468229824
00000100:00100000:0.0:1651532109.862731:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468229696
00000100:00100000:1.0:1651532109.862741:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2582
00000100:00100000:1.0:1651532109.862743:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468229824:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532109.862747:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468229760
00010000:00010000:1.0:1651532109.862748:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.862751:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d763 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448795 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.862757:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3899
00000100:00100000:0.0:1651532109.862759:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468229696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532109.862766:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d763 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448795 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.862766:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.862770:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532109.862772:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.862774:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532109.862775:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.862779:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d763 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448795 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.862780:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.862783:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532109.862783:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.862793:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3900
00000100:00100000:1.0:1651532109.862794:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468229824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.862795:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468229760:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532109.862797:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2582
00010000:00010000:0.0:1651532109.862799:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.862813:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532109.862814:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.862817:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532109.862817:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.862821:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.862824:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532109.978998:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793605 is committed
00010000:00010000:0.0:1651532109.979035:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.979040:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.979059:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdcfde3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468226496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 517648us (517699us total) trans 158913793605 rc 0/0
00000100:00100000:0.0:1651532109.979074:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3891
00010000:00010000:0.0:1651532109.979082:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.979086:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532109.979087:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.979090:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.979095:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.979095:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532109.979096:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.979099:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.979111:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.979114:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d6c2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->10178559] (req 1671168->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979124:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979129:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979383:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979388:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.979405:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb47a1af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468226560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 517968us (518032us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532109.979409:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3892
00010000:00010000:1.0:1651532109.979416:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979419:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532109.979420:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979423:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979428:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.979429:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532109.979430:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979432:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979439:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979442:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d6c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10211327] (req 876544->10211327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979447:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979450:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.979530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.979541:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.979542:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468230080
00000100:00100000:0.0:1651532109.979550:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.979557:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468230144
00000100:00100000:1.0:1651532109.979590:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468230208
00000100:00100000:1.0:1651532109.979594:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2583
00000100:00100000:0.0:1651532109.979598:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.979602:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468230080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.979606:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.979610:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d778 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44879c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979618:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d778 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44879c expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.979629:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d778 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44879c expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532109.979630:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468230336
00010000:00010000:1.0:1651532109.979632:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532109.979638:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2584
00000100:00100000:0.0:1651532109.979640:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edc3418e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468230144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.979644:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.979647:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d77f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487a3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.979651:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468230080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (121us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.979654:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2583
00000100:00100000:1.0:1651532109.979659:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2585
00000100:00100000:1.0:1651532109.979661:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468230208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.979662:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d77f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487a3 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.979664:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.979666:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d786 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487aa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979676:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d786 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487aa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.979679:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d77f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487a3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.979680:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d786 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487aa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.979683:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532109.979683:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532109.979688:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468230208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.979691:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2585
00000100:00100000:0.0:1651532109.979692:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edc3418e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468230144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (151us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.979694:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2586
00000100:00100000:1.0:1651532109.979696:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468230336:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532109.979696:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2584
00010000:00010000:1.0:1651532109.979698:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.979700:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d78d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487b1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979705:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d78d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487b1 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.979709:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d78d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487b1 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.979712:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532109.979717:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468230336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.979720:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2586
00000100:00100000:0.0:1651532109.979737:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.979764:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.979784:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468230464
00000100:00100000:0.0:1651532109.979793:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468230528
00000100:00100000:0.0:1651532109.979816:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3901
00000100:00100000:0.0:1651532109.979831:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4e0e265 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468230464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532109.979838:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.979839:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3902
00000100:00100000:1.0:1651532109.979843:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca2c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468230528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532109.979854:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532109.979855:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979856:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.979858:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532109.979859:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979864:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532109.979866:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979870:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532109.979872:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.979878:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979880:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.979882:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.979884:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532109.980116:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.980124:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.980144:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468230656
00000100:00100000:0.0:1651532109.980147:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.980162:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468230720
00000100:00100000:1.0:1651532109.980164:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468230976
00000100:00100000:1.0:1651532109.980169:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2587
00000100:00100000:1.0:1651532109.980170:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468230656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532109.980171:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2588
00000100:00100000:0.0:1651532109.980172:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468230720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.980174:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.980176:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.980177:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d7a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487b8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.980179:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487bf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.980188:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487bf expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.980189:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d7a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487b8 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.980193:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d7a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487b8 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.980195:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487bf expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.980196:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532109.980199:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532109.980207:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468230656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.980208:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468230720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.980210:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2587
00000100:00100000:0.0:1651532109.980212:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2588
00000100:00100000:1.0:1651532109.980215:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2589
00000100:00100000:1.0:1651532109.980216:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468230976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.980219:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.980221:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d7b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487c6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.980226:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d7b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487c6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.980230:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d7b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487c6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.980233:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532109.980239:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468230976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.980241:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2589
00000100:00100000:0.0:1651532109.980512:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.980527:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.980533:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468231104
00000100:00100000:0.0:1651532109.980534:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468231168
00000100:00100000:1.0:1651532109.980545:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2590
00000100:00100000:1.0:1651532109.980546:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468231104:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532109.980549:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2591
00010000:00010000:1.0:1651532109.980550:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532109.980551:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468231168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.980553:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487cd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.980555:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.980558:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d7be lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487d4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.980560:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487cd expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.980565:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487cd expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.980566:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d7be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487d4 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.980568:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532109.980570:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d7be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487d4 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.980573:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532109.980578:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468231104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.980581:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2590
00000100:00100000:0.0:1651532109.980581:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468231168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.980595:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2591
00000100:00100000:0.0:1651532109.980871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.980878:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532109.980884:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468231360
00000100:00100000:0.0:1651532109.980890:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468231424
00000100:00100000:0.0:1651532109.980901:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2592
00000100:00100000:0.0:1651532109.980902:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468231360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532109.980906:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532109.980909:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2593
00010000:00010000:0.0:1651532109.980909:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d7c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487db expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532109.980911:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468231424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.980915:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532109.980916:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d7c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487db expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.980918:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d7cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487e2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532109.980920:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d7c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487db expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532109.980924:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:1.0:1651532109.980925:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d7cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487e2 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.980929:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d7cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487e2 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.980933:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532109.980936:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468231360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532109.980939:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2592
00000100:00100000:1.0:1651532109.980947:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468231424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.980950:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2593
00000100:00100000:0.0:1651532109.981153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532109.981171:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468231616
00000100:00100000:1.0:1651532109.981182:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2594
00000100:00100000:1.0:1651532109.981184:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468231616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532109.981187:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532109.981190:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d7d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487e9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532109.981197:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d7d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487e9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.981201:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d7d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487e9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532109.981205:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532109.981214:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468231616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532109.981217:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2594
00000100:00100000:0.0:1651532110.048091:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532110.048100:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231616
00000100:00100000:0.0:1651532110.048109:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 58
00000100:00100000:0.0:1651532110.048111:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231616:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532110.048117:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 860160 granted 351183424 pending 172032 free 81138851840 avail 76966936576
00000100:00100000:0.0:1651532110.048135:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231616:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (44us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532110.048138:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 58
00000001:00080000:1.0:1651532110.134895:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793606 is committed
00010000:00010000:1.0:1651532110.134910:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.134914:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.134938:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000704fce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468227328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 531383us (531412us total) trans 158913793606 rc 0/0
00000100:00100000:1.0:1651532110.134942:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3893
00010000:00010000:1.0:1651532110.134950:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.134953:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532110.134954:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.134957:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.134962:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.134963:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.134964:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.134967:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.134970:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.134971:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.134971:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.134983:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.134997:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.135000:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d6ec lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10444799] (req 147456->10444799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.135006:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.135009:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135010:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135016:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.135351:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.135362:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.135368:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468232000
00000100:00100000:0.0:1651532110.135369:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.135383:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468232064
00000100:00100000:1.0:1651532110.135386:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468232192
00000100:00100000:0.0:1651532110.135387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.135388:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468232256
00000100:00100000:1.0:1651532110.135391:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2595
00000100:00100000:1.0:1651532110.135393:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468232000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.135397:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532110.135398:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2596
00000100:00100000:0.0:1651532110.135400:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468232064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.135401:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d7da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487f0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135404:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.135406:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.135408:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d7e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487f7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.135409:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d7da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487f0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.135414:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d7da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487f0 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.135414:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.135417:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532110.135417:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d7e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487f7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.135421:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d7e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487f7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532110.135428:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468232000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.135431:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2595
00000100:00100000:1.0:1651532110.135435:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2597
00000100:00100000:1.0:1651532110.135437:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468232192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.135437:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:1.0:1651532110.135439:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.135441:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d7e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4487fe expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.135445:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532110.135446:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468232064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (84us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532110.135447:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d7e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487fe expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532110.135449:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2596
00010000:00010000:1.0:1651532110.135451:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d7e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4487fe expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.135454:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532110.135455:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2598
00000100:00100000:0.0:1651532110.135457:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468232256:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532110.135460:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468232192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (91us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532110.135460:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532110.135462:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2597
00010000:00010000:0.0:1651532110.135463:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d7ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448805 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135467:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.135470:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d7ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448805 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.135474:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d7ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448805 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.135477:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532110.135482:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468232256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (95us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532110.135483:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.135485:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2598
00010000:00010000:1.0:1651532110.135487:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.135503:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468228288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 473577us (473650us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532110.135503:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.135506:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3895
00010000:00010000:0.0:1651532110.135507:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.135531:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f23ba88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468227392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 531916us (531960us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532110.135534:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3894
00010000:00010000:0.0:1651532110.135542:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135545:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532110.135546:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135549:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135555:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135557:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40d71d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3907584->9719807] (req 3907584->9719807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135560:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135563:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532110.135564:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135567:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135578:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.135578:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.135579:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135583:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135592:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.135594:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d6f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4632576->9256959] (req 4632576->9256959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.135599:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.135603:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.135983:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.136013:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.136027:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.136031:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468232320
00000100:00100000:1.0:1651532110.136034:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.136045:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468232384
00000100:00100000:0.0:1651532110.136051:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3903
00000100:00100000:0.0:1651532110.136053:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468232320:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532110.136060:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3904
00010000:00010000:0.0:1651532110.136060:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.136062:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468232384:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532110.136064:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532110.136065:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.136068:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532110.136069:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.136069:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.136075:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532110.136076:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.136082:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532110.136083:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.136087:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.136087:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.136090:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.136091:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.136098:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468232512
00000100:00100000:0.0:1651532110.136103:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468232704
00000100:00100000:0.0:1651532110.136110:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2599
00000100:00100000:0.0:1651532110.136112:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468232512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.136114:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.136124:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d804 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44880c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.136132:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d804 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44880c expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.136136:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d804 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44880c expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.136139:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532110.136150:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468232512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.136153:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2599
00000100:00100000:0.0:1651532110.136157:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2600
00000100:00100000:0.0:1651532110.136159:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468232704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.136162:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.136164:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d80b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448813 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.136170:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d80b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448813 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.136174:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d80b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448813 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.136177:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532110.136181:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468232704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.136184:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2600
00000100:00100000:1.0:1651532110.136466:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.136485:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468232896
00000100:00100000:0.0:1651532110.136496:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2601
00000100:00100000:0.0:1651532110.136498:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468232896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.136501:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.136504:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d812 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44881a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.136511:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d812 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44881a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.136515:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d812 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44881a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.136528:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532110.136539:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468232896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.136542:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2601
00000001:00080000:1.0:1651532110.245604:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793607 is committed
00010000:00010000:1.0:1651532110.245620:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.245624:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.245641:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468228224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 583686us (583779us total) trans 158913793607 rc 0/0
00000100:00100000:1.0:1651532110.245644:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3896
00010000:00010000:1.0:1651532110.245651:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.245654:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532110.245655:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.245670:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.245675:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.245676:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.245676:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.245680:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.245687:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.245690:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d724 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->5750783] (req 323584->5750783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.245695:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.245698:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.246050:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.246060:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.246066:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.246080:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.246087:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468233152
00000100:00100000:0.0:1651532110.246090:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468233216
00000100:00100000:1.0:1651532110.246098:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468233088
00000100:00100000:0.0:1651532110.246101:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468233280
00000100:00100000:0.0:1651532110.246108:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2602
00000100:00100000:0.0:1651532110.246110:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468233216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532110.246118:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3905
00010000:00010000:0.0:1651532110.246119:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532110.246120:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468233152:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532110.246123:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d819 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448821 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.246128:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.246132:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532110.246132:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d819 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448821 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.246133:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532110.246134:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.246140:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d819 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448821 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.246141:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.246144:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532110.246149:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2603
00000100:00100000:1.0:1651532110.246151:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468233280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.246153:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532110.246155:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468233216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (88us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532110.246156:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d827 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448828 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.246157:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2602
00010000:00010000:1.0:1651532110.246163:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d827 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448828 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532110.246165:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3906
00000100:00100000:0.0:1651532110.246167:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468233088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532110.246168:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d827 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448828 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.246171:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532110.246175:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.246179:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532110.246180:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468233280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (101us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532110.246180:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.246183:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.246186:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532110.246186:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.246190:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.246191:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2603
00010000:00010000:0.0:1651532110.246193:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.246197:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.246496:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.246504:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468233472
00000100:00100000:1.0:1651532110.246511:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2604
00000100:00100000:1.0:1651532110.246513:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468233472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.246517:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.246520:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d835 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44882f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.246527:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d835 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44882f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.246532:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d835 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44882f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.246535:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532110.246550:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468233472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.246553:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2604
00000001:00080000:1.0:1651532110.328979:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793608 is committed
00010000:00010000:1.0:1651532110.328995:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.328999:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.329019:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b87a626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468228992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557866us (557915us total) trans 158913793608 rc 0/0
00000100:00100000:1.0:1651532110.329023:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3897
00010000:00010000:1.0:1651532110.329029:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329033:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532110.329034:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329037:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329042:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.329042:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.329043:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329046:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329059:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329062:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d740 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7352319] (req 4722688->7352319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329068:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329072:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329239:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329244:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.329260:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d36e3e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468229056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 558068us (558103us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532110.329264:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3898
00010000:00010000:0.0:1651532110.329270:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329274:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532110.329275:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329278:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329283:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.329283:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.329284:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329287:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329294:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329297:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d747 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->7442431] (req 61440->7442431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329333:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329337:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.329359:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.329374:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468233664
00000100:00100000:1.0:1651532110.329394:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2605
00000100:00100000:1.0:1651532110.329396:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468233664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.329400:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.329404:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d83c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448836 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329412:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d83c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448836 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.329416:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d83c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448836 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.329419:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532110.329435:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468233664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.329438:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2605
00000100:00100000:1.0:1651532110.329657:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.329689:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468233792
00000100:00100000:1.0:1651532110.329693:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.329705:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468233728
00000100:00100000:1.0:1651532110.329708:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.329713:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3907
00000100:00100000:0.0:1651532110.329715:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468233792:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532110.329720:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532110.329723:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.329728:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3908
00010000:00010000:0.0:1651532110.329728:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532110.329729:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.329730:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468233728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532110.329732:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532110.329732:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329737:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329738:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329740:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329743:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532110.329753:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329756:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532110.329757:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329762:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329765:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.329773:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468233920
00000100:00100000:1.0:1651532110.329780:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468233984
00000100:00100000:1.0:1651532110.329784:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2606
00000100:00100000:1.0:1651532110.329786:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468233920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.329789:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.329791:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d851 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44883d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.329793:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2607
00000100:00100000:0.0:1651532110.329795:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468233984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.329798:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d851 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44883d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.329799:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.329814:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d858 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448844 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.329815:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d851 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44883d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.329819:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532110.329823:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d858 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448844 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.329827:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d858 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448844 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.329831:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532110.329837:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468233920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.329840:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468233984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.329841:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2606
00000100:00100000:0.0:1651532110.329843:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2607
00000100:00100000:1.0:1651532110.329893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.329903:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468234112
00000100:00100000:0.0:1651532110.329914:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2608
00000100:00100000:0.0:1651532110.329916:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468234112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.329919:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.329922:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d85f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44884b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.329929:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d85f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44884b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.329937:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d85f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44884b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.329940:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532110.329949:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468234112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.329952:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2608
00000100:00100000:1.0:1651532110.330202:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.330213:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468234368
00000100:00100000:0.0:1651532110.330223:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2609
00000100:00100000:0.0:1651532110.330225:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468234368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.330228:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.330231:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d866 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448852 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.330238:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d866 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448852 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.330242:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d866 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448852 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.330246:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532110.330256:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468234368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.330258:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2609
00000001:00080000:1.0:1651532110.549080:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793609 is committed
00010000:00010000:0.0:1651532110.549112:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549117:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.549139:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468229696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 686379us (686439us total) trans 158913793609 rc 0/0
00010000:00010000:1.0:1651532110.549141:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.549142:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3899
00010000:00010000:1.0:1651532110.549146:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532110.549147:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.549150:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.549156:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.549157:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.549158:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.549161:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.549171:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.549174:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d76a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->7196671] (req 1507328->7196671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549181:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549185:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549372:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549376:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.549394:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.549396:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468229760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 686600us (686684us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532110.549398:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532110.549399:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.549400:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3900
00010000:00010000:1.0:1651532110.549402:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.549406:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.549407:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.549408:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.549410:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.549419:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.549422:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d771 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->6209535] (req 1470464->6209535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549429:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549433:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.549597:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.549669:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468234624
00000100:00100000:0.0:1651532110.549708:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2610
00000100:00100000:0.0:1651532110.549710:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468234624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.549713:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.549718:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d86d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448859 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549727:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d86d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448859 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.549731:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d86d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448859 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.549747:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532110.549756:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468234624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (159us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.549759:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2610
00000100:00100000:0.0:1651532110.549774:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.549821:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.549830:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.549839:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468234816
00000100:00100000:0.0:1651532110.549848:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468234944
00000100:00100000:0.0:1651532110.549854:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3909
00000100:00100000:0.0:1651532110.549856:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468234816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532110.549864:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549868:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532110.549869:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549872:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532110.549873:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549877:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549881:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.549888:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3910
00000100:00100000:0.0:1651532110.549889:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468234944:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532110.549894:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549897:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532110.549898:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549900:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532110.549901:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549907:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549910:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.549917:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468234880
00000100:00100000:0.0:1651532110.549928:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2611
00000100:00100000:0.0:1651532110.549929:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468234880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.549932:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.549934:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d882 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448860 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.549941:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d882 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448860 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.549946:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d882 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448860 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.549949:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532110.549959:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468234880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (157us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.549962:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2611
00000001:00080000:1.0:1651532110.780020:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793610 is committed
00010000:00010000:0.0:1651532110.780048:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780065:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780088:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.780088:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4e0e265 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468230464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 800257us (800351us total) trans 158913793610 rc 0/0
00000100:00100000:0.0:1651532110.780092:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3901
00010000:00010000:1.0:1651532110.780095:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532110.780097:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780100:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780105:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.780106:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.780107:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780110:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780118:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780121:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d794 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->9084927] (req 851968->9084927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780126:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780130:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780144:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780147:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780165:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.780167:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca2c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468230528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 800324us (800402us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651532110.780169:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532110.780170:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.780170:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3902
00010000:00010000:1.0:1651532110.780176:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780180:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.780180:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.780181:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780184:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780194:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780197:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d79b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7188480->7192575] (req 7188480->7192575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780203:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780207:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.780414:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.780422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.780440:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468235264
00000100:00100000:1.0:1651532110.780449:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468235328
00000100:00100000:1.0:1651532110.780454:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2612
00000100:00100000:1.0:1651532110.780456:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468235264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.780460:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.780469:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d889 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448867 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.780473:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2613
00000100:00100000:0.0:1651532110.780475:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468235328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.780480:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.780484:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d889 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448867 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.780484:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d890 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44886e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780492:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d889 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448867 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.780493:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d890 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44886e expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.780496:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532110.780497:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d890 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44886e expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.780501:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532110.780511:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468235264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.780514:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2612
00000100:00100000:0.0:1651532110.780539:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468235328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.780542:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2613
00000100:00100000:0.0:1651532110.780601:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.780623:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.780724:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468235392
00000100:00100000:0.0:1651532110.780735:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468235456
00000100:00100000:0.0:1651532110.780741:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3911
00000100:00100000:0.0:1651532110.780743:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468235392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532110.780750:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780764:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532110.780765:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780768:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532110.780768:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780773:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780776:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.780784:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3912
00000100:00100000:0.0:1651532110.780786:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468235456:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532110.780792:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780795:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532110.780796:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780798:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532110.780799:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780819:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.780830:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.780885:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.780892:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468235776
00000100:00100000:1.0:1651532110.780913:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2614
00000100:00100000:1.0:1651532110.780916:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468235776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.780920:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.780924:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d8a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448875 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.780932:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d8a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448875 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.780936:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d8a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448875 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.780939:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532110.780956:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468235776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.780959:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2614
00000001:00080000:1.0:1651532110.887702:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793611 is committed
00010000:00010000:0.0:1651532110.887736:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887741:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.887760:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468232320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 751707us (751777us total) trans 158913793611 rc 0/0
00000100:00100000:0.0:1651532110.887764:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3903
00010000:00010000:0.0:1651532110.887771:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887775:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532110.887776:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887779:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887784:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.887785:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.887785:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887798:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887801:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.887802:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.887817:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887820:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887828:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887830:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40d7f6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->9498623] (req 274432->9498623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.887833:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.887838:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887872:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.887876:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.888285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.888299:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468235904
00000100:00100000:0.0:1651532110.888305:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.888327:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468236032
00000100:00100000:1.0:1651532110.888334:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2615
00000100:00100000:0.0:1651532110.888334:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.888336:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468235904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.888340:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.888350:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d8ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44887c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.888352:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532110.888356:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.888359:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d8ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44887c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.888362:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.888372:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888377:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40d8ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44887c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.888385:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532110.888393:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468233152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 642272us (642343us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532110.888396:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3905
00000100:00100000:1.0:1651532110.888400:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468235904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (127us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.888403:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2615
00000100:00100000:0.0:1651532110.888405:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468236096
00000100:00100000:1.0:1651532110.888408:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468236160
00000100:00100000:0.0:1651532110.888411:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2616
00000100:00100000:0.0:1651532110.888413:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468236032:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532110.888414:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2617
00000100:00100000:1.0:1651532110.888416:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468236096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.888417:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.888419:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.888420:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d8b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448883 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888421:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d8ba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44888a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.888426:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.888427:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.888430:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d8b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448883 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.888431:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d8ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44888a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.888435:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40d8ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44888a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.888435:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40d8b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448883 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.888438:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532110.888439:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532110.888444:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468236096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.888446:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2617
00000100:00100000:0.0:1651532110.888446:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468236032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (141us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.888448:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2616
00000100:00100000:1.0:1651532110.888450:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2618
00000100:00100000:1.0:1651532110.888452:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468236160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.888454:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.888456:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d8c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448891 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888460:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.888461:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d8c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448891 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.888465:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40d8c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448891 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.888465:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888471:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532110.888476:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468236160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (124us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532110.888476:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.888478:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2618
00000100:00100000:0.0:1651532110.888492:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468232384:12345-10.240.43.64@tcp:3:fio.0 Request processed in 752429us (752478us total) trans 0 rc 49152/49152
00010000:00010000:1.0:1651532110.888493:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.888495:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3904
00010000:00010000:1.0:1651532110.888497:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532110.888498:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888501:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888506:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888509:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40d820 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->9170943] (req 176128->9170943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888512:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888515:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532110.888515:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888529:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888538:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.888538:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532110.888540:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888543:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888559:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.888562:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d7fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1372160->8728575] (req 1372160->8728575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.888563:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.888568:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.889019:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.889035:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.889043:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.889048:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.889057:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.889059:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468236288
00000100:00100000:0.0:1651532110.889064:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.889074:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468236608
00000100:00100000:1.0:1651532110.889077:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468236800
00000100:00100000:0.0:1651532110.889079:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468236864
00000100:00100000:1.0:1651532110.889080:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2619
00000100:00100000:1.0:1651532110.889082:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468236288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.889085:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532110.889086:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2620
00010000:00010000:1.0:1651532110.889088:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d8c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448898 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.889088:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468236608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.889092:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.889096:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d8c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448898 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.889096:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d8cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44889f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.889104:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d8cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44889f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.889111:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d8c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448898 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.889114:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532110.889117:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40d8cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44889f expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.889121:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532110.889128:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468236288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.889130:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2619
00000100:00100000:1.0:1651532110.889136:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2621
00000100:00100000:0.0:1651532110.889136:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468236608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.889137:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468236800:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532110.889139:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2620
00010000:00010000:1.0:1651532110.889140:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.889142:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d8d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488a6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.889145:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2622
00000100:00100000:0.0:1651532110.889146:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468236864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.889148:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d8d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488a6 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.889149:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.889152:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d8d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488a6 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.889152:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d8dd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488ad expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.889155:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532110.889158:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d8dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488ad expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532110.889161:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468236800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (103us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532110.889162:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40d8dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488ad expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532110.889163:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2621
00010000:00010000:0.0:1651532110.889165:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532110.889170:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468236864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.889173:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2622
00000100:00100000:1.0:1651532110.889176:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468236544
00000100:00100000:1.0:1651532110.889188:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468236480
00000100:00100000:1.0:1651532110.889195:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3913
00000100:00100000:1.0:1651532110.889197:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468236544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532110.889203:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.889207:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532110.889208:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532110.889209:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.889212:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.889221:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3914
00000100:00100000:0.0:1651532110.889231:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468236480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532110.889238:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.889243:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532110.889244:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.889247:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.889249:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532110.889250:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.889254:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.889257:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.889260:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.889520:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.889526:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.889533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.889539:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468237056
00000100:00100000:0.0:1651532110.889550:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468236992
00000100:00100000:1.0:1651532110.889555:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468237248
00000100:00100000:0.0:1651532110.889562:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2623
00000100:00100000:0.0:1651532110.889563:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468237056:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532110.889564:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2624
00000100:00100000:1.0:1651532110.889566:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468236992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.889567:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.889569:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.889570:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d8f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488bb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.889573:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d8f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488b4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.889578:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d8f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488bb expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.889581:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d8f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488b4 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.889582:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40d8f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488bb expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.889585:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d8f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488b4 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.889585:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:1.0:1651532110.889588:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532110.889595:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468237056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.889598:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468236992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.889598:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2623
00000100:00100000:1.0:1651532110.889600:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2624
00000100:00100000:0.0:1651532110.889603:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2625
00000100:00100000:0.0:1651532110.889604:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468237248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.889607:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.889616:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d900 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488c2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.889622:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d900 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488c2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.889626:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40d900 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488c2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.889634:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532110.889641:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468237248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.889643:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2625
00000100:00100000:0.0:1651532110.889984:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.889992:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.889998:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468237696
00000100:00100000:0.0:1651532110.890004:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468237760
00000100:00100000:0.0:1651532110.890013:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2626
00000100:00100000:0.0:1651532110.890014:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468237696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532110.890015:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2627
00000100:00100000:1.0:1651532110.890017:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0dbb280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468237760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.890018:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.890021:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.890021:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d907 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488c9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.890024:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d90e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488d0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.890028:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d907 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488c9 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.890031:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d90e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488d0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.890032:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40d907 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488c9 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.890035:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d90e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488d0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.890036:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:1.0:1651532110.890038:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532110.890045:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0dbb280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468237760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.890045:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468237696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.890048:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2626
00000100:00100000:1.0:1651532110.890049:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2627
00000100:00100000:0.0:1651532110.890278:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.890288:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.890294:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468237952
00000100:00100000:0.0:1651532110.890305:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468238016
00000100:00100000:0.0:1651532110.890310:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2628
00000100:00100000:0.0:1651532110.890320:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025404360 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468237952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.890323:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532110.890324:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2629
00000100:00100000:1.0:1651532110.890327:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468238016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.890327:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d915 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488d7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.890330:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.890333:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d91c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488de expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.890334:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d915 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488d7 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.890338:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d915 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488d7 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.890340:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d91c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488de expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.890341:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532110.890344:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d91c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488de expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.890348:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532110.890351:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025404360 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468237952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.890354:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2628
00000100:00100000:1.0:1651532110.890355:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468238016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.890357:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2629
00000100:00100000:0.0:1651532110.890574:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.890588:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.890592:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468238208
00000100:00100000:0.0:1651532110.890595:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468238272
00000100:00100000:1.0:1651532110.890604:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2630
00000100:00100000:1.0:1651532110.890606:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468238208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.890609:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532110.890610:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2631
00010000:00010000:1.0:1651532110.890612:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d923 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488e5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.890612:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468238272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.890615:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532110.890618:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d923 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488e5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.890619:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d92a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488ec expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.890622:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d923 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488e5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.890625:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532110.890637:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468238208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.890640:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2630
00010000:00010000:0.0:1651532110.890642:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d92a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488ec expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.890646:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d92a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488ec expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.890650:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532110.890658:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468238272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.890660:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2631
00000001:00080000:1.0:1651532110.937176:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793612 is committed
00010000:00010000:1.0:1651532110.937193:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.937197:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.937220:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468233088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 691052us (691160us total) trans 158913793612 rc 0/0
00010000:00010000:0.0:1651532110.937223:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532110.937224:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3906
00010000:00010000:0.0:1651532110.937228:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532110.937229:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937232:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937238:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.937238:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.937239:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937242:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937259:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937262:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40d82e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4063232->9035775] (req 4063232->9035775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937267:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937270:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937450:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937455:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.937471:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468233792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 607755us (607815us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532110.937474:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3907
00010000:00010000:0.0:1651532110.937481:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937484:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532110.937485:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937500:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937505:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.937506:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532110.937507:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937510:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937521:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937524:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40d843 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2891776->8122367] (req 2891776->8122367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.937533:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.937538:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.937633:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.937642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.937651:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468238720
00000100:00100000:1.0:1651532110.937654:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468238656
00000100:00100000:1.0:1651532110.937712:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3915
00000100:00100000:1.0:1651532110.937714:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6eb996c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468238720:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532110.937721:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.937721:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3916
00000100:00100000:0.0:1651532110.937723:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005707ba64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468238656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532110.937726:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532110.937727:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.937730:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532110.937731:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937732:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937738:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532110.937739:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937753:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532110.937754:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.937758:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937759:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.937762:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937762:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.937780:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.937787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.937818:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.937826:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468238784
00000100:00100000:0.0:1651532110.937835:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468238848
00000100:00100000:0.0:1651532110.937838:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468238912
00000100:00100000:0.0:1651532110.937840:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2632
00000100:00100000:0.0:1651532110.937842:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000086bdfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468238784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.937845:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.937849:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d93f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488f3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.937856:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d93f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488f3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.937860:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d93f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488f3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532110.937871:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2633
00000100:00100000:1.0:1651532110.937874:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1a53c01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468238848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.937874:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532110.937879:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532110.937887:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000086bdfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468238784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.937890:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2632
00010000:00010000:1.0:1651532110.937893:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d946 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4488fa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532110.937895:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2634
00000100:00100000:0.0:1651532110.937896:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000020c3a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468238912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.937899:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.937902:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d94d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448901 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.937907:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d946 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488fa expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.937908:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d94d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448901 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.937912:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d946 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4488fa expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.937913:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d94d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448901 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.937916:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532110.937916:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532110.937921:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000020c3a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468238912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.937923:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2634
00000100:00100000:1.0:1651532110.937926:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1a53c01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468238848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.937929:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2633
00000100:00100000:0.0:1651532110.938282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.938296:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532110.938302:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468239040
00000100:00100000:0.0:1651532110.938303:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468239104
00000100:00100000:1.0:1651532110.938320:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2635
00000100:00100000:1.0:1651532110.938322:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62aec33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468239040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532110.938325:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2636
00010000:00010000:1.0:1651532110.938326:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532110.938327:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468239104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532110.938329:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d954 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448908 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.938331:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.938334:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d95b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44890f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532110.938337:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d954 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448908 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.938341:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d954 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448908 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.938342:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d95b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44890f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532110.938345:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532110.938346:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d95b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44890f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.938349:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532110.938355:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62aec33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468239040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.938357:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468239104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532110.938358:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2635
00000100:00100000:0.0:1651532110.938360:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2636
00000100:00100000:0.0:1651532110.938583:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532110.938589:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468239296
00000100:00100000:0.0:1651532110.938596:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2637
00000100:00100000:0.0:1651532110.938598:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468239296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532110.938601:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532110.938604:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d962 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448916 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532110.938611:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d962 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448916 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.938615:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d962 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448916 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532110.938628:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532110.938643:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468239296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532110.938645:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2637
00000001:00080000:1.0:1651532111.062198:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793613 is committed
00010000:00010000:1.0:1651532111.062214:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062219:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.062243:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468233728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 732512us (732556us total) trans 158913793613 rc 0/0
00000100:00100000:1.0:1651532111.062247:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3908
00010000:00010000:1.0:1651532111.062254:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062269:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532111.062270:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062273:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062278:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.062279:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.062288:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062292:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062304:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062307:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d84a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4939776->9310207] (req 4939776->9310207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.062326:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.062332:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.062659:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.062673:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.062679:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468239552
00000100:00100000:0.0:1651532111.062680:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.062687:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.062693:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468239488
00000100:00100000:1.0:1651532111.062702:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3917
00000100:00100000:1.0:1651532111.062704:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468239552:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532111.062707:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3918
00000100:00100000:0.0:1651532111.062709:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468239488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532111.062711:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062718:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532111.062718:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062719:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062722:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532111.062723:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.062729:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532111.062731:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.062734:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532111.062735:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062749:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.062750:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062752:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.062753:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.062761:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468239680
00000100:00100000:1.0:1651532111.062766:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468239808
00000100:00100000:0.0:1651532111.062770:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2638
00000100:00100000:0.0:1651532111.062771:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468239680:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532111.062774:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2639
00010000:00010000:0.0:1651532111.062774:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532111.062776:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468239808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.062777:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d977 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44891d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.062778:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.062781:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d97e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448924 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.062785:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d977 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44891d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.062789:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d97e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448924 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.062789:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d977 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44891d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.062793:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d97e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448924 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.062793:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532111.062799:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532111.062820:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468239680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (139us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.062823:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2638
00000100:00100000:1.0:1651532111.062827:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468239808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.062830:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2639
00000001:00080000:1.0:1651532111.153900:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793614 is committed
00002000:00010000:0.0:1651532111.153935:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532109 -> 1651532110
00002000:00010000:0.0:1651532111.153937:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532109 -> 1651532110
00010000:00010000:0.0:1651532111.153948:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.153952:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.153971:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468234816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 604115us (604197us total) trans 158913793614 rc 0/0
00000100:00100000:0.0:1651532111.153975:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3909
00010000:00010000:0.0:1651532111.153982:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.153985:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.153987:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.153989:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.153995:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.153995:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.153996:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.153999:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154006:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154022:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40d874 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9289727] (req 1622016->9289727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154028:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154031:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154236:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154241:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.154262:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468234944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 604371us (604431us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532111.154265:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3910
00010000:00010000:0.0:1651532111.154272:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154275:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.154276:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154279:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154294:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.154295:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.154296:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154299:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154306:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154309:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40d87b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->7663615] (req 2904064->7663615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154324:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154327:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.154479:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.154508:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.154526:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468240000
00000100:00100000:0.0:1651532111.154531:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468240192
00000100:00100000:1.0:1651532111.154544:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2640
00000100:00100000:1.0:1651532111.154547:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468240000:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532111.154551:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2641
00000100:00100000:0.0:1651532111.154553:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468240192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.154554:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.154557:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.154559:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d985 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44892b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154561:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d98c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448932 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154569:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d98c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448932 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.154584:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d985 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44892b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.154589:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d985 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44892b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.154590:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d98c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448932 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.154593:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532111.154594:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532111.154606:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468240000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (128us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.154609:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2640
00000100:00100000:0.0:1651532111.154628:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468240192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 73us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.154631:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2641
00000100:00100000:1.0:1651532111.154641:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.154663:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468240256
00000100:00100000:0.0:1651532111.154673:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3919
00000100:00100000:0.0:1651532111.154675:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468240256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532111.154681:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.154683:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532111.154686:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532111.154693:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154696:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532111.154697:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154701:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154705:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.154716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.154729:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468240320
00000100:00100000:0.0:1651532111.154741:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3920
00000100:00100000:0.0:1651532111.154742:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468240320:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532111.154747:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154751:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532111.154752:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154755:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532111.154756:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154760:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154763:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.154770:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468240448
00000100:00100000:0.0:1651532111.154778:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2642
00000100:00100000:0.0:1651532111.154780:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468240448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.154782:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.154785:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448939 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.154801:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448939 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.154822:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448939 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.154826:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532111.154839:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468240448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.154842:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2642
00000001:00080000:1.0:1651532111.270568:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793615 is committed
00010000:00010000:0.0:1651532111.270606:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.270611:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.270634:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468235392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 489890us (490033us total) trans 158913793615 rc 0/0
00010000:00010000:1.0:1651532111.270635:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.270637:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3911
00010000:00010000:1.0:1651532111.270640:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532111.270641:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270645:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270651:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.270651:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.270652:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270655:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270659:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.270659:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.270660:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270663:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270680:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.270680:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.270684:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270692:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40d897 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1224704->8523775] (req 1224704->8523775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270698:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270701:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.270868:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.270881:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.270898:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468235456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 490111us (490274us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532111.270901:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3912
00010000:00010000:0.0:1651532111.270908:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.270911:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.270912:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.270915:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.270921:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.270923:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40d89e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->6565887] (req 53248->6565887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270975:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.270979:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.270999:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.271003:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468236544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 381805us (381967us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532111.271006:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3913
00010000:00010000:0.0:1651532111.271008:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.271009:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271020:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271025:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.271025:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.271026:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271029:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271037:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271040:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40d8e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [757760->9039871] (req 757760->9039871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271045:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271048:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.271218:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.271232:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468240960
00000100:00100000:0.0:1651532111.271241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.271251:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468240896
00000100:00100000:0.0:1651532111.271256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.271258:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3921
00000100:00100000:1.0:1651532111.271260:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468240960:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532111.271264:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532111.271267:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.271277:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532111.271278:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532111.271279:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.271282:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.271289:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468241024
00000100:00100000:1.0:1651532111.271295:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468241088
00000100:00100000:1.0:1651532111.271299:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2643
00000100:00100000:1.0:1651532111.271300:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468241024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.271303:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.271306:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d9af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448940 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.271325:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d9af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448940 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.271330:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d9af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448940 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.271333:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532111.271342:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3922
00000100:00100000:1.0:1651532111.271347:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468241024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.271352:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2643
00000100:00100000:0.0:1651532111.271356:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468240896:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532111.271360:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2644
00000100:00100000:1.0:1651532111.271362:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468241088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.271365:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.271367:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.271370:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532111.271371:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271374:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271376:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532111.271377:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271381:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.271383:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d9bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448947 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271384:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.271387:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.271393:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d9bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448947 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.271411:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d9bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448947 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.271414:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532111.271430:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468241088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (158us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.271433:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2644
00000100:00100000:0.0:1651532111.271648:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.271667:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468241344
00000100:00100000:1.0:1651532111.271674:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2645
00000100:00100000:1.0:1651532111.271676:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468241344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.271679:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.271682:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d9c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44894e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.271684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532111.271702:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d9c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44894e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.271706:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d9c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44894e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.271710:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532111.271723:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468241344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.271725:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2645
00000100:00100000:1.0:1651532111.271730:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468241472
00000100:00100000:1.0:1651532111.271737:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2646
00000100:00100000:1.0:1651532111.271739:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468241472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.271748:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.271751:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448955 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.271757:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448955 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.271761:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448955 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.271764:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532111.271775:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468241472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.271778:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2646
00000001:00080000:1.0:1651532111.362246:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793616 is committed
00010000:00010000:0.0:1651532111.362282:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362297:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362329:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.362330:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468236480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 473098us (473286us total) trans 158913793616 rc 0/0
00000100:00100000:0.0:1651532111.362333:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3914
00010000:00010000:1.0:1651532111.362335:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532111.362336:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362350:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362356:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.362357:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.362358:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362361:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362379:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362382:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40d8eb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1019904->9424895] (req 1019904->9424895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362388:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362391:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.362737:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.362747:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.362757:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.362758:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468241856
00000100:00100000:0.0:1651532111.362766:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.362784:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468241792
00000100:00100000:0.0:1651532111.362788:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3923
00000100:00100000:0.0:1651532111.362790:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468241856:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532111.362793:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3924
00000100:00100000:1.0:1651532111.362795:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468241792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532111.362799:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362814:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.362815:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362823:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532111.362824:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362826:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362828:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362830:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532111.362831:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362834:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532111.362835:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362838:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362839:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362843:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.362852:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468241920
00000100:00100000:1.0:1651532111.362858:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468241984
00000100:00100000:0.0:1651532111.362860:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2647
00000100:00100000:0.0:1651532111.362862:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468241920:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532111.362867:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2648
00000100:00100000:1.0:1651532111.362869:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468241984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.362870:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.362872:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.362874:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40d9e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44895c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362875:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d9e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448963 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362880:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.362881:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.362884:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40d9e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44895c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.362885:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d9e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448963 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.362889:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40d9e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44895c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.362892:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40d9e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448963 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.362892:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532111.362896:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532111.362903:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468241920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (145us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.362905:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468241984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (139us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.362906:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2647
00000100:00100000:1.0:1651532111.362908:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2648
00010000:00010000:1.0:1651532111.362921:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.362925:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.362953:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6eb996c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468238720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425238us (425320us total) trans 0 rc 57344/57344
00010000:00010000:0.0:1651532111.362954:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.362956:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3915
00010000:00010000:0.0:1651532111.362958:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.362959:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362962:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362975:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.362976:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.362977:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362980:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362987:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362990:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40d931 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10403839] (req 1589248->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362995:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.362998:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.363398:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.363419:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468242368
00000100:00100000:1.0:1651532111.363434:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2649
00000100:00100000:1.0:1651532111.363436:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468242368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.363440:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.363444:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d9ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44896a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.363451:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d9ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44896a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.363458:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40d9ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44896a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.363462:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532111.363469:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.363496:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468242368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.363499:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2649
00000100:00100000:1.0:1651532111.363505:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468242560
00000100:00100000:1.0:1651532111.363511:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2650
00000100:00100000:1.0:1651532111.363513:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468242560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.363515:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.363518:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d9f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448971 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.363532:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d9f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448971 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.363536:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40d9f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448971 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.363539:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532111.363551:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468242560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.363553:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2650
00000100:00100000:0.0:1651532111.363850:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.363867:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468242816
00000100:00100000:1.0:1651532111.363878:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2651
00000100:00100000:1.0:1651532111.363879:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468242816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.363883:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.363886:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d9fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448978 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.363893:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d9fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448978 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.363897:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40d9fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448978 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.363900:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532111.363912:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468242816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.363915:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2651
00000100:00100000:0.0:1651532111.364132:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.364150:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468242944
00000100:00100000:1.0:1651532111.364160:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2652
00000100:00100000:1.0:1651532111.364161:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468242944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.364164:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.364174:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da03 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44897f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.364182:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da03 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44897f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.364194:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da03 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44897f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.364197:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532111.364208:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468242944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.364211:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2652
00000001:00080000:1.0:1651532111.428993:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793617 is committed
00010000:00010000:0.0:1651532111.429025:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.429031:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.429058:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005707ba64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468238656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491334us (491416us total) trans 158913793617 rc 0/0
00000100:00100000:0.0:1651532111.429062:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3916
00010000:00010000:0.0:1651532111.429070:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.429073:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.429074:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.429077:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.429082:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.429083:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.429084:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.429087:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.429099:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.429102:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40d938 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9314303] (req 229376->9314303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429111:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429116:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429324:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429329:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.429356:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468239552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366651us (366697us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532111.429360:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3917
00010000:00010000:1.0:1651532111.429368:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429374:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532111.429376:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429379:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429392:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.429393:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.429394:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429397:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429407:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429410:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40d969 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->8863743] (req 1028096->8863743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.429410:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.429415:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.429617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.429628:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.429629:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468243136
00000100:00100000:0.0:1651532111.429635:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.429644:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.429645:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468243200
00000100:00100000:0.0:1651532111.429650:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.429655:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3925
00000100:00100000:1.0:1651532111.429657:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468243136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532111.429663:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.429663:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532111.429670:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532111.429670:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468243328
00010000:00010000:1.0:1651532111.429671:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429674:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532111.429675:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.429676:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468243520
00010000:00010000:1.0:1651532111.429679:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.429679:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468243584
00000100:00100000:0.0:1651532111.429681:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468243648
00010000:00010000:1.0:1651532111.429682:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.429683:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2653
00000100:00100000:0.0:1651532111.429685:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468243328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.429689:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532111.429690:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3926
00000100:00100000:1.0:1651532111.429692:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468243200:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532111.429693:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40da11 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448986 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429696:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429700:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532111.429701:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429703:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532111.429704:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.429708:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.429709:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40da11 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448986 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.429713:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40da11 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448986 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.429717:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532111.429719:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.429728:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2654
00000100:00100000:1.0:1651532111.429729:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468243520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.429732:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.429735:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40da1f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44898d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.429736:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468243328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.429739:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2653
00010000:00010000:1.0:1651532111.429742:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40da1f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44898d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532111.429744:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2655
00010000:00010000:1.0:1651532111.429746:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40da1f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44898d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532111.429746:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468243584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.429749:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.429750:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532111.429752:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40da26 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448994 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.429759:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468243520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (115us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532111.429759:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40da26 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448994 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532111.429762:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2654
00010000:00010000:0.0:1651532111.429763:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40da26 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448994 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.429766:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532111.429767:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2656
00000100:00100000:1.0:1651532111.429769:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468243648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.429771:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532111.429772:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468243584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (121us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532111.429773:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40da2d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44899b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.429774:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2655
00010000:00010000:1.0:1651532111.429781:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40da2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44899b expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.429785:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40da2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44899b expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.429788:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532111.429793:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468243648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (131us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.429796:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2656
00000100:00100000:0.0:1651532111.430226:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.430237:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.430238:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468243776
00000100:00100000:0.0:1651532111.430246:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.430255:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.430258:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468243840
00000100:00100000:1.0:1651532111.430262:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468244032
00000100:00100000:1.0:1651532111.430264:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468244096
00000100:00100000:1.0:1651532111.430267:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2657
00000100:00100000:1.0:1651532111.430269:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468243776:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532111.430271:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2658
00010000:00010000:1.0:1651532111.430272:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532111.430274:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468243840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.430276:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da34 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489a2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.430278:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.430283:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da34 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489a2 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.430287:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da34 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489a2 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.430289:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40da3b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489a9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.430293:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532111.430297:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40da3b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489a9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.430301:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40da3b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489a9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532111.430307:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468243776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.430310:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2657
00010000:00010000:0.0:1651532111.430319:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532111.430324:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2659
00000100:00100000:1.0:1651532111.430325:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468244032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.430328:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532111.430329:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468243840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (92us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532111.430331:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40da42 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489b0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.430332:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2658
00010000:00010000:1.0:1651532111.430337:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40da42 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489b0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532111.430338:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2660
00000100:00100000:0.0:1651532111.430340:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468244096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.430341:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40da42 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489b0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.430342:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.430344:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532111.430345:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da49 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489b7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.430350:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468244032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (104us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532111.430351:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da49 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489b7 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532111.430353:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2659
00010000:00010000:0.0:1651532111.430355:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da49 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489b7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.430358:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532111.430363:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468244096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.430373:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2660
00000100:00100000:0.0:1651532111.430716:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.430724:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.430738:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468244288
00000100:00100000:1.0:1651532111.430742:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468244416
00000100:00100000:0.0:1651532111.430749:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2661
00000100:00100000:0.0:1651532111.430750:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468244288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.430754:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532111.430755:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2662
00000100:00100000:1.0:1651532111.430757:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468244416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.430758:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da50 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489be expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.430760:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.430764:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da57 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489c5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.430765:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da50 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489be expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.430770:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da50 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489be expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.430771:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da57 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489c5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.430774:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532111.430775:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da57 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489c5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.430778:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532111.430783:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468244288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.430786:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468244416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.430786:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2661
00000100:00100000:1.0:1651532111.430788:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2662
00000001:00080000:1.0:1651532111.520690:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793618 is committed
00010000:00010000:0.0:1651532111.520722:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.520727:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.520757:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468239488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 458047us (458084us total) trans 158913793618 rc 0/0
00000100:00100000:0.0:1651532111.520760:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3918
00010000:00010000:0.0:1651532111.520767:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.520771:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.520772:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.520775:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.520780:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.520781:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.520782:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.520784:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.520791:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.520794:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40d970 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->2433023] (req 237568->2433023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.520799:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.520827:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.521191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.521205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.521213:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468244864
00000100:00100000:1.0:1651532111.521214:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468244800
00000100:00100000:1.0:1651532111.521229:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3927
00000100:00100000:1.0:1651532111.521236:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468244800:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532111.521239:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3928
00000100:00100000:0.0:1651532111.521242:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468244864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532111.521245:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.521250:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532111.521251:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.521251:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.521254:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532111.521255:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.521268:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532111.521269:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.521272:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532111.521273:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.521277:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.521278:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.521281:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.521282:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532111.629029:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793619 is committed
00002000:00010000:0.0:1651532111.629059:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532110 -> 1651532111
00002000:00010000:0.0:1651532111.629061:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532110 -> 1651532111
00010000:00010000:0.0:1651532111.629064:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629079:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.629099:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468240256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474423us (474458us total) trans 158913793619 rc 0/0
00000100:00100000:0.0:1651532111.629103:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3919
00010000:00010000:0.0:1651532111.629110:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629114:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.629115:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629118:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629123:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.629124:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.629125:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629128:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629131:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.629131:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.629132:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629145:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629159:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629162:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40d993 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10457087] (req 2285568->10457087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629167:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629170:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629170:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629175:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629391:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629395:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.629414:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468240320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474670us (474731us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532111.629417:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3920
00010000:00010000:1.0:1651532111.629434:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629439:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532111.629440:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629443:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629460:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629463:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40d99a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6381568->7311359] (req 6381568->7311359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629475:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629479:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629491:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.629500:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468240960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358239us (358282us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532111.629504:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3921
00010000:00010000:0.0:1651532111.629508:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.629509:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629512:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629518:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.629519:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532111.629521:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532111.629530:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629533:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629541:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629544:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40d9a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2785280->3915775] (req 2785280->3915775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629550:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.629553:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.629559:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.629568:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468245056
00000100:00100000:1.0:1651532111.629575:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468245120
00000100:00100000:1.0:1651532111.629589:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2663
00000100:00100000:1.0:1651532111.629591:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468245056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.629595:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.629599:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40da6c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489cc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.629610:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2664
00010000:00010000:1.0:1651532111.629614:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40da6c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489cc expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.629619:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40da6c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489cc expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532111.629619:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468245120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.629622:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532111.629624:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.629628:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40da73 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489d3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.629636:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468245056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.629639:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2663
00010000:00010000:0.0:1651532111.629642:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40da73 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489d3 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.629647:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40da73 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489d3 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.629650:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532111.629659:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468245120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.629661:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2664
00000100:00100000:0.0:1651532111.629716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.629737:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468245184
00000100:00100000:1.0:1651532111.629751:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3929
00000100:00100000:1.0:1651532111.629753:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468245184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532111.629760:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629764:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532111.629765:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629768:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532111.629769:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629774:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.629790:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.630032:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.630036:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.630057:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.630069:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468245312
00000100:00100000:1.0:1651532111.630075:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468245440
00000100:00100000:0.0:1651532111.630081:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3930
00000100:00100000:0.0:1651532111.630082:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468245312:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532111.630083:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468245568
00000100:00100000:1.0:1651532111.630087:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2665
00000100:00100000:1.0:1651532111.630089:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468245440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.630090:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da81 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.630094:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.630094:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.630095:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.630096:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10452992->10457087] (req 10452992->10457087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.630098:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40da88 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489da expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.630101:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [10452992->10457087] (req 10452992->10457087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.630106:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40da88 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489da expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.630111:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40da88 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489da expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.630114:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532111.630125:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468245440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.630127:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2665
00000100:00100000:1.0:1651532111.630132:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2666
00000100:00100000:1.0:1651532111.630134:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468245568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.630136:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.630138:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40da8f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489e1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.630144:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40da8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489e1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.630147:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40da8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489e1 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.630153:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532111.630159:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468245568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.630161:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2666
00000100:00100000:0.0:1651532111.630414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.630434:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468245760
00000100:00100000:1.0:1651532111.630442:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2667
00000100:00100000:1.0:1651532111.630444:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468245760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.630447:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.630450:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40da96 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489e8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.630457:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40da96 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489e8 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.630461:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40da96 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489e8 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.630464:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532111.630473:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468245760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.630476:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2667
00000001:00080000:1.0:1651532111.687424:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793621 is committed
00010000:00010000:0.0:1651532111.687455:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687459:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.687477:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468240896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 416120us (416236us total) trans 158913793620 rc 0/0
00000100:00100000:0.0:1651532111.687480:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3922
00010000:00010000:0.0:1651532111.687487:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687490:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.687491:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687494:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687499:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.687500:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.687501:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687515:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687523:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687526:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40d9b6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->9404415] (req 2019328->9404415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687531:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687534:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687565:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10452992->10457087] (req 10452992->10457087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687569:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da81 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10452992->10457087] (req 10452992->10457087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.687583:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468245312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 57500us (57548us total) trans 158913793621 rc 0/0
00000100:00100000:0.0:1651532111.687586:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3930
00010000:00010000:1.0:1651532111.687611:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da81 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10452992->10457087] (req 10452992->10457087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.687619:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532111.687633:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da81 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10452992->10457087] (req 10452992->10457087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.687636:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da81 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10452992->10457087] (req 10452992->10457087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.687642:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da81 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10452992->10457087] (req 10452992->10457087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.687645:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40da81 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [10452992->10457087] (req 10452992->10457087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687755:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687769:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.687786:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754468241856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 324995us (325070us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532111.687789:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3923
00010000:00010000:0.0:1651532111.687796:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687799:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.687800:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687819:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687824:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.687825:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.687826:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687829:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687837:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.687840:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.687840:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40d9d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2461696->9736191] (req 2461696->9736191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.687845:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.687967:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.687976:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.687982:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.687992:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468246144
00000100:00100000:1.0:1651532111.688002:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2668
00000100:00100000:1.0:1651532111.688004:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468246144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.688007:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.688011:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40da9d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489ef expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.688017:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532111.688037:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40da9d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489ef expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532111.688038:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468246016
00010000:00010000:1.0:1651532111.688041:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40da9d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489ef expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.688045:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532111.688049:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468245952
00000100:00100000:0.0:1651532111.688054:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3931
00000100:00100000:1.0:1651532111.688058:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468246144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.688061:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2668
00000100:00100000:0.0:1651532111.688062:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468246016:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532111.688067:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468246208
00010000:00010000:0.0:1651532111.688070:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.688074:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2669
00000100:00100000:1.0:1651532111.688076:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468246208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.688079:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.688080:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532111.688081:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.688082:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40daab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489f6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.688083:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532111.688084:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.688089:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40daab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489f6 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.688089:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.688092:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.688093:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40daab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489f6 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.688096:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532111.688102:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468246208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.688104:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2669
00000100:00100000:0.0:1651532111.688125:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3932
00000100:00100000:0.0:1651532111.688127:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468245952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532111.688142:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.688145:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532111.688146:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.688149:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532111.688149:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.688154:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.688157:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.688183:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.688218:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468246272
00000100:00100000:0.0:1651532111.688228:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3933
00000100:00100000:0.0:1651532111.688230:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468246272:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532111.688236:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dab9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.688240:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.688240:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.688241:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dab9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10432512->10436607] (req 10432512->10436607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.688256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532111.688256:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dab9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10432512->10436607] (req 10432512->10436607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.688265:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468246336
00000100:00100000:1.0:1651532111.688278:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2670
00000100:00100000:1.0:1651532111.688280:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468246336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.688284:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.688287:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40dac0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4489fd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.688295:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40dac0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489fd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.688299:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40dac0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4489fd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.688302:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532111.688323:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468246336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.688325:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2670
00000100:00100000:1.0:1651532111.688560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.688571:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.688571:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468246464
00000100:00100000:1.0:1651532111.688578:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468246656
00000100:00100000:0.0:1651532111.688584:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2671
00000100:00100000:0.0:1651532111.688585:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468246464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.688589:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532111.688591:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2672
00000100:00100000:1.0:1651532111.688593:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468246656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.688593:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dac7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a04 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.688596:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.688600:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dace lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a0b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.688602:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dac7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a04 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.688606:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dac7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a04 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.688610:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dace lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a0b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.688610:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532111.688614:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dace lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a0b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.688618:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532111.688621:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468246464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.688624:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2671
00000100:00100000:1.0:1651532111.688626:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468246656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.688628:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2672
00000100:00100000:0.0:1651532111.688688:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.688694:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468246784
00000100:00100000:1.0:1651532111.688701:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2673
00000100:00100000:1.0:1651532111.688703:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468246784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.688706:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.688709:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dad5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a12 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.688716:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dad5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a12 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.688719:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dad5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a12 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.688723:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532111.688732:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468246784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (44us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.688744:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2673
00000100:00100000:0.0:1651532111.688922:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.688936:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.688947:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468246912
00000100:00100000:1.0:1651532111.688954:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468246976
00000100:00100000:1.0:1651532111.688962:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2674
00000100:00100000:1.0:1651532111.688963:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468246912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532111.688965:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2675
00010000:00010000:1.0:1651532111.688967:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532111.688968:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468246976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.688970:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40dadc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a19 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.688977:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40dadc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a19 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.688980:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.688981:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40dadc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a19 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.688983:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dae3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a20 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.688984:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532111.688991:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dae3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a20 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532111.688994:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468246912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (73us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532111.688995:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dae3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a20 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532111.688997:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2674
00010000:00010000:0.0:1651532111.688999:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532111.689007:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468246976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.689009:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2675
00000001:00080000:1.0:1651532111.820776:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793623 is committed
00010000:00010000:1.0:1651532111.820800:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.820817:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.820822:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dab9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10432512->10436607] (req 10432512->10436607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.820827:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dab9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10432512->10436607] (req 10432512->10436607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.820838:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468241792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 458042us (458090us total) trans 158913793622 rc 0/0
00000100:00100000:0.0:1651532111.820847:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468246272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 132617us (132665us total) trans 158913793623 rc 0/0
00000100:00100000:1.0:1651532111.820850:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3924
00000100:00100000:0.0:1651532111.820851:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3933
00010000:00010000:1.0:1651532111.820858:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.820859:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dab9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10432512->10436607] (req 10432512->10436607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.820862:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.820862:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532111.820863:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.820866:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.820871:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.820872:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.820873:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.820876:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.820880:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dab9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10432512->10436607] (req 10432512->10436607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.820883:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.820883:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dab9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10432512->10436607] (req 10432512->10436607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.820886:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40d9d9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->7720959] (req 5021696->7720959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.820889:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dab9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10432512->10436607] (req 10432512->10436607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.820892:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.820892:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dab9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10432512->10436607] (req 10432512->10436607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.820895:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.821282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.821294:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.821294:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468247360
00000100:00100000:1.0:1651532111.821302:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.821322:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3934
00000100:00100000:0.0:1651532111.821322:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468247296
00000100:00100000:1.0:1651532111.821325:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468247360:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532111.821330:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3935
00000100:00100000:0.0:1651532111.821332:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468247296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532111.821334:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.821339:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.821340:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532111.821342:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.821345:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532111.821346:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.821351:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.821354:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.821358:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532111.821359:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.821362:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532111.821363:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.821368:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.821382:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.821395:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468247488
00000100:00100000:0.0:1651532111.821399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.821412:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468247616
00000100:00100000:0.0:1651532111.821414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.821417:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468247680
00000100:00100000:1.0:1651532111.821420:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2676
00000100:00100000:1.0:1651532111.821422:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468247488:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532111.821427:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2677
00000100:00100000:0.0:1651532111.821429:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468247616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.821432:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.821434:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.821436:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40daf8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a2e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.821438:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40daff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a27 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.821443:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40daf8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a2e expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.821446:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40daff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a27 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.821448:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40daf8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a2e expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.821450:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40daff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a27 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.821451:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532111.821454:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532111.821464:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468247616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.821467:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2677
00000100:00100000:1.0:1651532111.821471:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468247488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (168us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.821473:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2678
00000100:00100000:1.0:1651532111.821475:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2676
00000100:00100000:0.0:1651532111.821475:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468247680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.821477:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.821491:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db06 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a35 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.821498:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db06 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a35 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.821502:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db06 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a35 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.821505:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532111.821514:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468247680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.821517:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2678
00000001:00080000:1.0:1651532111.954090:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793624 is committed
00010000:00010000:1.0:1651532111.954106:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954110:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.954133:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468243136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524476us (524516us total) trans 158913793624 rc 0/0
00010000:00010000:0.0:1651532111.954133:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.954137:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3925
00010000:00010000:0.0:1651532111.954138:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532111.954139:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.954142:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.954148:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.954148:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.954149:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.954152:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.954167:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.954170:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40da0a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->9150463] (req 1933312->9150463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954178:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954193:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.954587:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.954595:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.954605:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.954607:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468247936
00000100:00100000:1.0:1651532111.954614:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.954620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.954623:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468248000
00000100:00100000:1.0:1651532111.954625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.954633:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3936
00000100:00100000:0.0:1651532111.954635:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468247936:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532111.954642:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468248128
00010000:00010000:0.0:1651532111.954642:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.954646:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532111.954647:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00000100:00100000:1.0:1651532111.954648:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468248192
00010000:00010000:0.0:1651532111.954648:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.954651:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468248256
00010000:00010000:0.0:1651532111.954651:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.954653:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468248320
00000100:00100000:1.0:1651532111.954656:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2679
00000100:00100000:1.0:1651532111.954658:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468248128:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532111.954658:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3937
00000100:00100000:0.0:1651532111.954659:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468248000:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532111.954661:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.954664:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954665:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40db1b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a3c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.954667:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.954668:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.954671:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532111.954672:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954675:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.954677:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954678:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40db1b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a3c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.954681:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954683:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40db1b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a3c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.954686:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532111.954688:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2680
00000100:00100000:0.0:1651532111.954689:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468248192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.954692:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.954694:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40db22 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a43 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.954699:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532111.954701:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40db22 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a43 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.954705:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40db22 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a43 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532111.954709:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468248128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.954712:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2679
00010000:00010000:0.0:1651532111.954716:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532111.954717:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2681
00000100:00100000:1.0:1651532111.954719:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468248256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.954722:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.954725:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40db29 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a4a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.954726:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468248192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (112us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.954729:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2680
00010000:00010000:1.0:1651532111.954730:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.954732:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40db29 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a4a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532111.954735:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2682
00010000:00010000:1.0:1651532111.954736:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40db29 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a4a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532111.954736:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468248320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.954739:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532111.954739:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.954741:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40db30 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a51 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.954745:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468248256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (125us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532111.954746:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532111.954748:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2681
00010000:00010000:0.0:1651532111.954748:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40db30 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a51 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.954751:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40db30 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a51 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.954755:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532111.954760:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468248320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (135us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532111.954761:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532111.954762:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2682
00010000:00010000:1.0:1651532111.954765:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.954776:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468243200:12345-10.240.43.64@tcp:3:fio.0 Request processed in 525084us (525148us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532111.954787:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3926
00010000:00010000:1.0:1651532111.954794:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954835:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532111.954837:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954840:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954846:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.954846:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532111.954847:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954850:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954858:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954861:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40da18 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9474047] (req 483328->9474047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954867:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.954870:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532111.955255:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.955270:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.955275:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468248448
00000100:00100000:0.0:1651532111.955286:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468248768
00000100:00100000:0.0:1651532111.955293:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2683
00000100:00100000:0.0:1651532111.955295:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468248448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.955298:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.955302:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40db37 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a58 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.955322:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40db37 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a58 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.955327:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40db37 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a58 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.955330:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532111.955341:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468248448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.955344:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2683
00000100:00100000:0.0:1651532111.955348:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2684
00000100:00100000:0.0:1651532111.955350:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468248768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.955353:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532111.955355:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40db3e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a5f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.955361:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40db3e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a5f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.955365:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40db3e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a5f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.955368:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532111.955372:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468248768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.955375:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2684
00000100:00100000:1.0:1651532111.955639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.955651:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532111.955651:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468249024
00000100:00100000:0.0:1651532111.955662:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468249088
00000100:00100000:0.0:1651532111.955669:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2685
00000100:00100000:0.0:1651532111.955670:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468249024:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532111.955674:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2686
00010000:00010000:0.0:1651532111.955674:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532111.955676:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468249088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532111.955677:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db45 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a66 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.955680:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.955684:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40db4c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a6d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532111.955684:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db45 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a66 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.955688:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db45 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a66 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.955692:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40db4c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a6d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532111.955692:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532111.955697:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40db4c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a6d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.955700:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532111.955702:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468249024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532111.955704:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2685
00000100:00100000:1.0:1651532111.955709:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468249088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.955711:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2686
00000100:00100000:1.0:1651532111.955984:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532111.955992:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468249280
00000100:00100000:1.0:1651532111.955999:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2687
00000100:00100000:1.0:1651532111.956001:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468249280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532111.956005:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532111.956009:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db53 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a74 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532111.956016:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db53 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a74 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.956020:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db53 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a74 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532111.956023:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532111.956036:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468249280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532111.956039:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2687
00000001:00080000:1.0:1651532112.120724:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793625 is committed
00010000:00010000:1.0:1651532112.120739:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.120743:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.120767:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468244800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599535us (599561us total) trans 158913793625 rc 0/0
00000100:00100000:1.0:1651532112.120770:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3927
00010000:00010000:0.0:1651532112.120771:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.120776:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532112.120777:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.120790:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.120796:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.120797:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.120798:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.120801:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.120820:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.120823:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40da5e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->10051583] (req 745472->10051583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.120829:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.120831:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.121181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.121196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.121203:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.121209:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.121214:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.121232:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468249472
00010000:00010000:0.0:1651532112.121240:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.121242:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468249536
00010000:00010000:0.0:1651532112.121245:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.121247:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3938
00000100:00100000:1.0:1651532112.121249:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0dbb280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468249472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532112.121256:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.121261:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532112.121262:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.121264:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.121264:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468244864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 600022us (600074us total) trans 0 rc 40960/40960
00010000:00010000:1.0:1651532112.121267:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532112.121268:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.121268:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3928
00010000:00010000:1.0:1651532112.121272:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.121273:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3939
00010000:00010000:1.0:1651532112.121275:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.121275:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025404360 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468249536:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532112.121278:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.121282:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.121286:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.121287:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.121288:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468249664
00010000:00010000:0.0:1651532112.121290:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532112.121290:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.121296:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468249728
00000100:00100000:1.0:1651532112.121299:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468249792
00000100:00100000:1.0:1651532112.121302:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2688
00010000:00010000:0.0:1651532112.121302:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.121303:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468249664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.121306:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.121306:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.121309:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40db68 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a7b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.121324:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.121324:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.121327:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40db68 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a7b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.121328:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532112.121331:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40db68 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a7b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.121335:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532112.121336:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.121339:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.121343:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468249664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (139us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532112.121344:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532112.121345:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2688
00010000:00010000:0.0:1651532112.121345:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.121346:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.121349:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.121350:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2689
00000100:00100000:1.0:1651532112.121352:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468249728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.121354:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.121358:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.121361:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40da65 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [798720->9388031] (req 798720->9388031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.121364:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40db6f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a82 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.121370:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2690
00000100:00100000:0.0:1651532112.121371:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468249792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.121373:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40db6f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a82 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.121375:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.121377:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40db6f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a82 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.121378:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40db76 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a89 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.121380:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532112.121385:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40db76 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a89 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532112.121386:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468249728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (177us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.121389:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2689
00010000:00010000:1.0:1651532112.121397:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.121399:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40db76 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a89 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.121401:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.121403:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532112.121411:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468249792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (196us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.121414:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2690
00000100:00100000:0.0:1651532112.121902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.121912:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.121913:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468249920
00000100:00100000:0.0:1651532112.121919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.121927:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468249984
00000100:00100000:0.0:1651532112.121929:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.121931:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468250176
00000100:00100000:1.0:1651532112.121933:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468250304
00000100:00100000:0.0:1651532112.121935:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2691
00000100:00100000:0.0:1651532112.121937:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468249920:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532112.121938:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2692
00000100:00100000:1.0:1651532112.121940:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468249984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.121941:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.121944:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.121945:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40db7d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a90 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.121947:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40db84 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a97 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.121952:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40db7d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a90 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.121957:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40db7d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a90 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.121958:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40db84 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a97 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.121961:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532112.121962:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40db84 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a97 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.121966:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532112.121973:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468249920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.121976:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2691
00000100:00100000:1.0:1651532112.121981:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468249984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.121981:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2693
00000100:00100000:0.0:1651532112.121983:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468250176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532112.121984:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2692
00010000:00010000:0.0:1651532112.121985:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.121988:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40db8b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448a9e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.121989:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2694
00000100:00100000:1.0:1651532112.121991:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468250304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.121993:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.121994:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40db8b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a9e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.121996:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40db92 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448aa5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.121997:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40db8b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448a9e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.122001:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40db92 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448aa5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.122001:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532112.122005:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40db92 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448aa5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532112.122006:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468250176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (87us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532112.122008:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532112.122008:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2693
00000100:00100000:1.0:1651532112.122014:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468250304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.122026:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2694
00000100:00100000:0.0:1651532112.122389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.122403:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.122409:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468250432
00000100:00100000:0.0:1651532112.122410:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468250560
00000100:00100000:1.0:1651532112.122420:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2695
00000100:00100000:1.0:1651532112.122422:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468250432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.122425:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532112.122427:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2696
00010000:00010000:1.0:1651532112.122429:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40db99 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448aac expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.122429:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468250560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.122432:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.122436:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40db99 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448aac expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.122436:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dba0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ab3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.122440:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40db99 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448aac expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.122443:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532112.122453:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468250432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532112.122454:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dba0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ab3 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532112.122455:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2695
00010000:00010000:0.0:1651532112.122458:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dba0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ab3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.122461:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532112.122470:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468250560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.122472:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2696
00000100:00100000:0.0:1651532112.122694:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.122700:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468250880
00000100:00100000:0.0:1651532112.122707:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2697
00000100:00100000:0.0:1651532112.122709:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468250880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.122712:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.122716:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dba7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448aba expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.122723:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dba7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448aba expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.122727:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dba7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448aba expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.122730:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532112.122746:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468250880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.122749:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2697
00000001:00080000:1.0:1651532112.212406:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793626 is committed
00010000:00010000:1.0:1651532112.212421:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212425:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.212447:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468245184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582693us (582731us total) trans 158913793626 rc 0/0
00000100:00100000:1.0:1651532112.212451:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3929
00010000:00010000:1.0:1651532112.212458:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212462:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532112.212463:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212466:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212471:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.212472:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.212472:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212476:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212482:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212491:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212494:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40da7a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1921024->6860799] (req 1921024->6860799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212496:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.212765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.212776:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.212784:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468251072
00000100:00100000:0.0:1651532112.212784:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.212795:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468251008
00000100:00100000:0.0:1651532112.212797:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468251136
00000100:00100000:1.0:1651532112.212800:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3940
00000100:00100000:1.0:1651532112.212802:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468251072:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532112.212818:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2698
00000100:00100000:0.0:1651532112.212820:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468251136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.212822:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212823:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.212826:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.212826:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532112.212827:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212827:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dbb5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ac1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212830:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212833:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.212836:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dbb5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ac1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532112.212839:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3941
00010000:00010000:0.0:1651532112.212840:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dbb5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ac1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532112.212841:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468251008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532112.212843:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532112.212845:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212848:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532112.212849:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212852:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.212856:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468251136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.212859:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2698
00010000:00010000:1.0:1651532112.212860:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532112.212861:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212866:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212871:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212875:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212879:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.212883:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.212886:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468246016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 524824us (524921us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532112.212889:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3931
00010000:00010000:0.0:1651532112.212895:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212898:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532112.212899:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212902:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212907:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.212907:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.212908:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212911:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212921:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212924:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40daa4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->7417855] (req 69632->7417855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212929:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.212932:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.213163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.213180:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.213191:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468251264
00000100:00100000:1.0:1651532112.213201:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468251328
00000100:00100000:1.0:1651532112.213205:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2699
00000100:00100000:1.0:1651532112.213207:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000086bdfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468251264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.213210:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.213214:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dbc3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ac8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.213221:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dbc3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ac8 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.213225:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dbc3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ac8 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.213228:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532112.213241:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000086bdfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468251264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.213245:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2699
00000100:00100000:1.0:1651532112.213250:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2700
00000100:00100000:1.0:1651532112.213251:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000020c3a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468251328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.213254:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.213256:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dbca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448acf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.213261:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dbca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448acf expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.213265:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dbca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448acf expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.213268:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532112.213286:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000020c3a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468251328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.213289:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2700
00000100:00100000:0.0:1651532112.213511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.213526:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.213531:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468251456
00000100:00100000:0.0:1651532112.213533:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468251520
00000100:00100000:1.0:1651532112.213543:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2701
00000100:00100000:1.0:1651532112.213544:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468251456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.213548:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532112.213549:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2702
00010000:00010000:1.0:1651532112.213551:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbd1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ad6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.213551:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468251520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.213554:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.213558:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbd1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ad6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.213559:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbd8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448add expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.213566:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbd8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448add expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.213570:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbd1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ad6 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.213570:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbd8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448add expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.213573:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532112.213584:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468251456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (74us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532112.213586:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532112.213587:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2701
00000100:00100000:0.0:1651532112.213595:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468251520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.213597:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2702
00000001:00080000:1.0:1651532112.440780:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793627 is committed
00010000:00010000:0.0:1651532112.440819:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.440824:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.440842:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468245952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 752714us (752866us total) trans 158913793627 rc 0/0
00000100:00100000:0.0:1651532112.440845:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3932
00010000:00010000:0.0:1651532112.440852:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.440856:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532112.440857:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.440860:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.440865:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.440866:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.440867:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.440870:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.440882:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.440885:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dab2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3104768->8626175] (req 3104768->8626175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.440894:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.440899:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.441240:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.441250:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.441256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.441274:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.441282:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468251840
00010000:00010000:1.0:1651532112.441285:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.441290:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.441295:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468251776
00000100:00100000:0.0:1651532112.441303:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3942
00000100:00100000:0.0:1651532112.441305:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468251840:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532112.441322:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.441326:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.441327:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.441330:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468247360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 620004us (620048us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532112.441330:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532112.441331:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.441333:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3934
00010000:00010000:0.0:1651532112.441338:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.441340:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3943
00000100:00100000:1.0:1651532112.441342:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468251776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532112.441342:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.441349:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468251968
00000100:00100000:0.0:1651532112.441355:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468252096
00010000:00010000:1.0:1651532112.441358:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.441363:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2703
00000100:00100000:0.0:1651532112.441365:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468251968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.441368:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.441369:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532112.441370:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.441370:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dbed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ae4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.441373:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532112.441374:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.441377:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.441380:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.441380:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dbed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ae4 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.441383:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.441385:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dbed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ae4 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.441388:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532112.441390:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.441394:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532112.441394:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.441396:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468251968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (140us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532112.441397:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.441399:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2703
00010000:00010000:1.0:1651532112.441402:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.441403:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532112.441403:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2704
00010000:00010000:1.0:1651532112.441404:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.441407:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.441410:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.441410:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.441411:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.441413:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.441413:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468252096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.441416:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.441418:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dbf4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448aeb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.441423:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.441426:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40daea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [479232->7213055] (req 479232->7213055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.441433:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dbf4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448aeb expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.441437:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dbf4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448aeb expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.441440:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532112.441447:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468252096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (173us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.441449:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2704
00010000:00010000:0.0:1651532112.441457:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.441460:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.441480:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.441483:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.441845:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.441856:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468252480
00000100:00100000:1.0:1651532112.441868:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2705
00000100:00100000:0.0:1651532112.441871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.441876:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468252480:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532112.441879:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468252544
00010000:00010000:1.0:1651532112.441880:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.441883:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dbfb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448af2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.441890:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2706
00000100:00100000:0.0:1651532112.441892:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754468252544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.441896:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.441897:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dbfb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448af2 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.441907:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc02 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448af9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.441913:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dbfb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448af2 expref: 23 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.441916:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc02 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448af9 expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.441917:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532112.441920:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc02 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448af9 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.441923:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532112.441928:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468252480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.441931:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2705
00000100:00100000:0.0:1651532112.441932:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468252544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.441935:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2706
00000001:00080000:1.0:1651532112.637216:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793629 is committed
00010000:00010000:0.0:1651532112.637248:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637252:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.637270:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468247936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 682634us (682683us total) trans 158913793629 rc 0/0
00000100:00100000:0.0:1651532112.637273:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3936
00010000:00010000:0.0:1651532112.637280:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637283:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532112.637285:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637287:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637293:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637295:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40db0d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8048640->9195519] (req 8048640->9195519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637305:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637309:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.637333:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468247296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 816001us (816039us total) trans 158913793628 rc 0/0
00000100:00100000:0.0:1651532112.637336:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3935
00010000:00010000:0.0:1651532112.637343:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637346:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532112.637347:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637350:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637354:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.637355:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.637356:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637359:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637365:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637368:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40daf1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->6172671] (req 4947968->6172671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637373:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637376:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637585:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637598:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.637613:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.637617:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754468248000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 682956us (683021us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532112.637618:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532112.637619:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.637620:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3937
00010000:00010000:1.0:1651532112.637622:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.637628:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.637628:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.637629:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.637632:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.637640:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637651:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.637655:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40db14 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [688128->6131711] (req 688128->6131711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637655:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.637723:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.637732:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468252864
00000100:00100000:1.0:1651532112.637740:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.637750:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468252928
00000100:00100000:0.0:1651532112.637760:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3944
00000100:00100000:0.0:1651532112.637762:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1a53c01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468252864:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532112.637769:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3945
00010000:00010000:0.0:1651532112.637769:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.637771:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62aec33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468252928:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532112.637773:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532112.637774:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637777:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532112.637778:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.637780:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.637784:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532112.637785:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.637788:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532112.637789:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637793:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.637794:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.637797:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.637797:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.638011:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.638023:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.638028:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.638038:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.638046:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468253056
00000100:00100000:0.0:1651532112.638052:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468253248
00000100:00100000:1.0:1651532112.638053:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468253376
00000100:00100000:1.0:1651532112.638056:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2707
00000100:00100000:1.0:1651532112.638058:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468253056:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532112.638060:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2708
00000100:00100000:0.0:1651532112.638061:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468253376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.638062:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.638065:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40dc17 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b00 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.638065:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.638069:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc1e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b0e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.638073:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40dc17 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b00 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.638076:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc1e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b0e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.638077:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40dc17 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b00 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.638080:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532112.638081:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc1e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b0e expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.638084:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532112.638090:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468253056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.638092:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468253376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.638093:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2707
00000100:00100000:0.0:1651532112.638095:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2708
00000100:00100000:1.0:1651532112.638098:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2709
00000100:00100000:1.0:1651532112.638099:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468253248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.638102:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532112.638103:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468253120
00010000:00010000:1.0:1651532112.638104:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc25 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b07 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.638109:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc25 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b07 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532112.638111:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3946
00000100:00100000:0.0:1651532112.638113:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468253120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532112.638116:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc25 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b07 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.638118:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.638119:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532112.638122:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532112.638123:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.638125:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468253248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (97us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532112.638126:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532112.638126:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.638127:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2709
00010000:00010000:0.0:1651532112.638131:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.638134:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532112.745576:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793630 is committed
00010000:00010000:0.0:1651532112.745606:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745611:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.745628:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0dbb280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468249472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 624378us (624448us total) trans 158913793630 rc 0/0
00000100:00100000:0.0:1651532112.745631:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3938
00010000:00010000:0.0:1651532112.745638:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745650:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532112.745652:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745655:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745660:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.745661:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.745661:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745664:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745668:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.745668:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.745669:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745671:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745684:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745687:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40db5a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->9121791] (req 2179072->9121791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.745695:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745696:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745699:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.745700:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745915:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745920:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.745953:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025404360 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468249536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 624677us (624756us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532112.745957:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3939
00010000:00010000:0.0:1651532112.745964:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745967:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532112.745968:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745971:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745976:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.745990:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40db61 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1413120->9691135] (req 1413120->9691135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746011:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746015:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.746032:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754468251072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533229us (533268us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532112.746035:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3940
00010000:00010000:1.0:1651532112.746042:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746057:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532112.746059:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746062:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746067:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.746068:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.746068:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746072:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746079:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746082:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40dbae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [811008->8556543] (req 811008->8556543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746087:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746090:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.746224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.746236:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468253632
00000100:00100000:0.0:1651532112.746236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.746256:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468253568
00000100:00100000:1.0:1651532112.746276:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3947
00000100:00100000:1.0:1651532112.746278:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468253632:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532112.746285:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746290:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532112.746291:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532112.746291:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.746297:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532112.746301:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.746342:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.746347:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3948
00000100:00100000:0.0:1651532112.746349:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468253568:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532112.746351:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.746356:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532112.746357:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.746368:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532112.746369:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.746372:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.746374:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00000100:00100000:1.0:1651532112.746375:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532112.746375:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.746379:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.746382:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.746388:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.746395:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468253824
00000100:00100000:0.0:1651532112.746401:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468253760
00000100:00100000:0.0:1651532112.746403:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468254016
00000100:00100000:0.0:1651532112.746406:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468254080
00000100:00100000:0.0:1651532112.746408:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2710
00000100:00100000:0.0:1651532112.746410:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468253824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.746413:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.746415:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dc41 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b1c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.746423:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dc41 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b1c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.746427:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dc41 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b1c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.746430:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532112.746440:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468253824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (144us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.746443:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2710
00000100:00100000:0.0:1651532112.746447:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2711
00000100:00100000:0.0:1651532112.746449:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468253760:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532112.746452:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2712
00010000:00010000:0.0:1651532112.746453:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532112.746454:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468254016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.746455:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40dc48 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b15 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746457:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.746461:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40dc4f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b23 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.746461:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40dc48 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b15 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.746465:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40dc48 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b15 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.746468:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532112.746470:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40dc4f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b23 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532112.746473:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468253760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (137us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532112.746474:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40dc4f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b23 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532112.746475:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2711
00010000:00010000:1.0:1651532112.746478:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532112.746479:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2713
00000100:00100000:0.0:1651532112.746480:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468254080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.746482:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.746484:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dc56 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b2a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.746486:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468254016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (136us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.746489:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2712
00010000:00010000:0.0:1651532112.746489:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dc56 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b2a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.746493:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dc56 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b2a expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532112.746498:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468254144
00000100:00100000:1.0:1651532112.746507:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3949
00000100:00100000:1.0:1651532112.746509:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468254144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532112.746509:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532112.746514:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.746518:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532112.746519:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00000100:00100000:0.0:1651532112.746519:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468254080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (163us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532112.746520:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.746522:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2713
00010000:00010000:1.0:1651532112.746523:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.747011:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.747019:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.747029:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.747030:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468254272
00000100:00100000:1.0:1651532112.747038:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468254336
00000100:00100000:0.0:1651532112.747045:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468254528
00000100:00100000:0.0:1651532112.747049:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2714
00000100:00100000:0.0:1651532112.747051:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468254272:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532112.747052:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2715
00000100:00100000:1.0:1651532112.747053:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468254336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.747054:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.747057:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.747058:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dc64 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b31 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.747060:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dc6b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b38 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.747065:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dc64 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b31 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.747068:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dc6b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b38 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.747069:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dc64 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b31 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.747072:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dc6b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b38 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.747072:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532112.747076:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532112.747082:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468254272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.747084:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468254336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.747085:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2714
00000100:00100000:1.0:1651532112.747087:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2715
00000100:00100000:0.0:1651532112.747090:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2716
00000100:00100000:0.0:1651532112.747091:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468254528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.747095:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.747097:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40dc72 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b3f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.747102:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40dc72 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b3f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.747106:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40dc72 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b3f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.747109:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532112.747114:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468254528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.747116:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2716
00000100:00100000:1.0:1651532112.747333:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.747344:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468254720
00000100:00100000:1.0:1651532112.747346:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.747354:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468254784
00000100:00100000:0.0:1651532112.747361:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2717
00000100:00100000:0.0:1651532112.747362:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468254720:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532112.747366:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2718
00010000:00010000:0.0:1651532112.747366:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532112.747368:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468254784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.747369:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dc79 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b46 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.747372:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.747375:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dc80 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b4d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.747376:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dc79 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b46 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.747380:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dc79 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b46 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.747382:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dc80 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b4d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.747383:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532112.747386:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dc80 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b4d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.747390:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532112.747395:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468254720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.747398:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2717
00000100:00100000:1.0:1651532112.747409:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468254784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.747412:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2718
00000100:00100000:1.0:1651532112.747473:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.747480:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468254976
00000100:00100000:1.0:1651532112.747487:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2719
00000100:00100000:1.0:1651532112.747489:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468254976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.747492:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.747495:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dc87 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b54 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.747502:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dc87 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b54 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.747506:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dc87 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b54 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.747509:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532112.747518:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468254976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (45us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.747521:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2719
00000100:00100000:1.0:1651532112.747695:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.747703:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.747708:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468255168
00000100:00100000:1.0:1651532112.747714:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468255232
00000100:00100000:1.0:1651532112.747723:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2720
00000100:00100000:1.0:1651532112.747724:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468255168:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532112.747727:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2721
00000100:00100000:0.0:1651532112.747729:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468255232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.747732:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.747734:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.747736:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dc8e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b62 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.747738:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dc95 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b5b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.747743:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dc8e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b62 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.747745:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dc95 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b5b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.747747:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dc8e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b62 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.747749:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dc95 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b5b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.747750:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532112.747752:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532112.747764:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468255232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.747766:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2721
00000100:00100000:1.0:1651532112.747768:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468255168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.747771:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2720
00000100:00100000:1.0:1651532112.748025:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.748033:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468255616
00000100:00100000:1.0:1651532112.748039:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2722
00000100:00100000:1.0:1651532112.748041:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468255616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.748044:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.748047:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dc9c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b69 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.748054:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dc9c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b69 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.748058:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dc9c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b69 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.748062:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532112.748071:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468255616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.748073:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2722
00000100:00100000:1.0:1651532112.748281:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.748288:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468255744
00000100:00100000:1.0:1651532112.748294:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2723
00000100:00100000:1.0:1651532112.748296:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468255744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.748299:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.748302:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40dca3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b70 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.748309:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40dca3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b70 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.748324:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40dca3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b70 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.748328:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532112.748337:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468255744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.748340:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2723
00000001:00080000:1.0:1651532112.845639:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793631 is committed
00010000:00010000:1.0:1651532112.845654:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.845661:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.845683:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468251008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 632840us (632906us total) trans 158913793631 rc 0/0
00010000:00010000:0.0:1651532112.845684:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.845686:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3941
00010000:00010000:0.0:1651532112.845689:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532112.845690:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.845701:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.845707:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.845708:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.845708:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.845711:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.845719:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.845723:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40dbbc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->9547775] (req 2547712->9547775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.845728:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.845731:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.846068:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.846076:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.846087:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.846088:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468255872
00000100:00100000:1.0:1651532112.846093:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.846100:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468255936
00000100:00100000:1.0:1651532112.846107:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468256000
00000100:00100000:0.0:1651532112.846115:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3950
00000100:00100000:1.0:1651532112.846119:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468256064
00000100:00100000:1.0:1651532112.846127:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2724
00000100:00100000:1.0:1651532112.846128:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468256000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.846136:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532112.846136:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468255872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532112.846140:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40dcaa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b77 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.846144:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846146:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.846149:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40dcaa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b77 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.846149:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532112.846150:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.846153:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.846156:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532112.846156:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846160:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40dcaa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b77 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.846161:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846163:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532112.846163:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.846167:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.846175:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3951
00000100:00100000:0.0:1651532112.846176:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468255936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532112.846181:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.846182:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468256000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.846185:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2724
00010000:00010000:0.0:1651532112.846187:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.846187:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.846190:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2725
00010000:00010000:0.0:1651532112.846190:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532112.846191:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.846192:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468256064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.846194:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846195:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.846197:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dcbf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b7e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.846197:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846202:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.846204:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dcbf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b7e expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.846207:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.846210:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846213:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dcbf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b7e expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.846223:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532112.846227:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468251840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 404922us (404988us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532112.846229:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468256064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.846230:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3942
00000100:00100000:1.0:1651532112.846232:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2725
00010000:00010000:1.0:1651532112.846240:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846243:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532112.846244:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846258:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846263:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.846263:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532112.846264:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846267:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846275:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846278:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40dbdf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->9592831] (req 1982464->9592831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846283:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846286:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.846326:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.846345:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468256192
00000100:00100000:1.0:1651532112.846347:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.846352:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468256256
00000100:00100000:0.0:1651532112.846361:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2726
00000100:00100000:0.0:1651532112.846362:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468256192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.846367:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.846370:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40dcc6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b85 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.846378:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40dcc6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b85 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.846381:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40dcc6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b85 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.846385:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532112.846397:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468256192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.846399:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2726
00000100:00100000:0.0:1651532112.846404:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2727
00000100:00100000:0.0:1651532112.846405:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468256256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532112.846408:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.846410:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dccd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b8c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.846415:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dccd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b8c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.846419:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dccd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b8c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.846433:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532112.846457:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468256256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.846460:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2727
00000100:00100000:1.0:1651532112.846774:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.846785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.846786:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468256384
00000100:00100000:1.0:1651532112.846794:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.846818:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468256576
00000100:00100000:0.0:1651532112.846821:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468256640
00000100:00100000:1.0:1651532112.846823:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2728
00000100:00100000:1.0:1651532112.846826:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468256384:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532112.846827:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2729
00000100:00100000:0.0:1651532112.846828:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468256576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.846829:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532112.846831:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.846833:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dcd4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b93 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.846835:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcdb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448b9a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846841:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dcd4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b93 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.846843:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcdb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b9a expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.846846:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dcd4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b93 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532112.846847:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcdb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448b9a expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.846849:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532112.846850:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532112.846859:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468256384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532112.846859:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468256576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.846861:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2728
00000100:00100000:0.0:1651532112.846863:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2729
00000100:00100000:1.0:1651532112.846867:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2730
00000100:00100000:1.0:1651532112.846869:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468256640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.846871:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.846873:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dce2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ba1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.846879:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dce2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ba1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.846883:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dce2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ba1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.846886:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532112.846891:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468256640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.846894:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2730
00000100:00100000:1.0:1651532112.847128:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.847135:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468256832
00000100:00100000:1.0:1651532112.847142:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2731
00000100:00100000:1.0:1651532112.847144:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468256832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.847147:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.847150:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dce9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ba8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.847157:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dce9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ba8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.847161:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dce9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ba8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.847165:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532112.847173:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468256832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.847176:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2731
00000100:00100000:1.0:1651532112.847231:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.847238:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468256896
00000100:00100000:1.0:1651532112.847244:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2732
00000100:00100000:1.0:1651532112.847255:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468256896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532112.847258:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532112.847261:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dcf0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448baf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.847268:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dcf0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448baf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.847272:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dcf0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448baf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.847276:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532112.847285:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468256896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532112.847287:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2732
00000001:00080000:1.0:1651532112.937331:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793632 is committed
00002000:00010000:1.0:1651532112.937344:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532111 -> 1651532112
00010000:00010000:1.0:1651532112.937347:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.937351:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.937373:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468251776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 496030us (496123us total) trans 158913793632 rc 0/0
00010000:00010000:0.0:1651532112.937373:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.937376:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3943
00010000:00010000:0.0:1651532112.937381:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532112.937382:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937385:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937390:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.937391:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532112.937392:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937395:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937402:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937405:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dbe6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4571136->6725631] (req 4571136->6725631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.937407:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532112.937427:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.937723:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.937733:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532112.937747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532112.937750:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468257472
00000100:00100000:1.0:1651532112.937755:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468257600
00000100:00100000:0.0:1651532112.937764:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468257408
00000100:00100000:1.0:1651532112.937768:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2733
00000100:00100000:1.0:1651532112.937770:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468257600:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532112.937771:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3952
00010000:00010000:1.0:1651532112.937773:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532112.937773:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468257472:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532112.937777:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dcf7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448bb6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937780:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937787:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532112.937788:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937791:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532112.937798:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3953
00000100:00100000:0.0:1651532112.937799:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468257408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532112.937800:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dcf7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bb6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.937818:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dcf7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bb6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532112.937821:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532112.937824:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937829:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532112.937830:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.937832:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468257600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (85us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532112.937832:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532112.937835:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2733
00010000:00010000:0.0:1651532112.937835:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532112.937836:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937840:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937842:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532112.937851:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532113.170524:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793633 is committed
00010000:00010000:1.0:1651532113.170540:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170560:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.170583:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1a53c01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468252864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532820us (532861us total) trans 158913793633 rc 0/0
00010000:00010000:0.0:1651532113.170583:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.170587:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3944
00010000:00010000:0.0:1651532113.170588:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532113.170589:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.170592:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.170598:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.170598:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.170599:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.170602:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.170612:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.170615:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40dc09 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9469951] (req 1454080->9469951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170622:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170626:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170826:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170831:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.170844:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62aec33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468252928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533072us (533104us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532113.170847:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3945
00010000:00010000:1.0:1651532113.170854:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170857:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532113.170858:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170869:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170875:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532113.170876:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532113.170876:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170879:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170883:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532113.170883:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532113.170884:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170887:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170900:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170903:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dc10 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9207807] (req 2134016->9207807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.170907:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170908:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.170911:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.170912:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.170951:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.170991:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468257984
00000100:00100000:1.0:1651532113.171015:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2734
00000100:00100000:1.0:1651532113.171017:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468257984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.171026:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.171030:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd0c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448bc4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.171048:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd0c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bc4 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.171052:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd0c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bc4 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.171055:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532113.171065:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468257984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.171068:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2734
00000100:00100000:1.0:1651532113.171082:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.171116:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.171126:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468258048
00000100:00100000:0.0:1651532113.171133:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468257920
00010000:00010000:1.0:1651532113.171135:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.171138:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2735
00010000:00010000:1.0:1651532113.171139:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.171139:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468258048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.171143:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.171147:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40dd13 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448bcb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.171158:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468253632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424879us (424934us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532113.171161:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3947
00010000:00010000:0.0:1651532113.171162:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40dd13 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bcb expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.171166:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40dd13 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bcb expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532113.171169:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2736
00000100:00100000:1.0:1651532113.171170:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468257920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.171170:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532113.171173:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.171176:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd1a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448bbd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.171180:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468258048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (98us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532113.171183:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd1a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bbd expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532113.171183:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2735
00010000:00010000:1.0:1651532113.171187:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd1a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bbd expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.171190:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532113.171190:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.171194:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532113.171196:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468257920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.171198:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2736
00010000:00010000:0.0:1651532113.171229:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.171233:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.171239:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.171242:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40dc33 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6950912->9908223] (req 6950912->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.171262:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.171292:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.171300:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468258112
00000100:00100000:1.0:1651532113.171309:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468258176
00000100:00100000:1.0:1651532113.171329:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3954
00000100:00100000:1.0:1651532113.171331:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468258112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532113.171339:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.171343:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532113.171344:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.171347:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532113.171348:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.171352:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.171356:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.171363:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3955
00000100:00100000:1.0:1651532113.171365:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468258176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532113.171370:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.171373:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532113.171374:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.171377:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532113.171377:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.171383:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.171386:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.171411:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.171422:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468258368
00000100:00100000:0.0:1651532113.171431:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2737
00000100:00100000:0.0:1651532113.171433:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468258368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.171436:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.171439:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40dd2f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448bd2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.171447:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40dd2f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bd2 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.171451:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40dd2f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bd2 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.171454:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532113.171471:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468258368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.171483:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2737
00000100:00100000:1.0:1651532113.171627:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.171638:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468258624
00000100:00100000:1.0:1651532113.171639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.171654:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468258752
00000100:00100000:1.0:1651532113.171655:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2738
00000100:00100000:1.0:1651532113.171657:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468258624:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532113.171659:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2739
00010000:00010000:1.0:1651532113.171660:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532113.171661:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468258752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.171664:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd36 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448bd9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.171664:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.171667:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd3d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448be0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.171672:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd36 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bd9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.171675:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd3d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448be0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.171676:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd36 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bd9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.171678:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd3d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448be0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.171679:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532113.171682:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532113.171689:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468258624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.171690:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468258752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.171692:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2738
00000100:00100000:0.0:1651532113.171693:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2739
00000100:00100000:1.0:1651532113.171736:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.171746:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468258880
00000100:00100000:0.0:1651532113.171753:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2740
00000100:00100000:0.0:1651532113.171754:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468258880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.171757:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.171760:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd44 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448be7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.171770:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd44 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448be7 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.171774:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd44 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448be7 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.171777:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532113.171790:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468258880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.171792:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2740
00000100:00100000:1.0:1651532113.171981:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.171992:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468259072
00000100:00100000:0.0:1651532113.171998:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2741
00000100:00100000:0.0:1651532113.172000:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468259072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.172003:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.172006:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd4b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448bee expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.172013:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd4b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bee expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.172017:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd4b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bee expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.172020:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532113.172033:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468259072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.172043:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2741
00000001:00080000:1.0:1651532113.365441:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793634 is committed
00002000:00010000:0.0:1651532113.365476:0:330054:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532111 -> 1651532112
00010000:00010000:0.0:1651532113.365480:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365483:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.365505:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468253120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 727392us (727489us total) trans 158913793634 rc 0/0
00000100:00100000:0.0:1651532113.365509:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3946
00010000:00010000:0.0:1651532113.365516:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365519:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532113.365520:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365523:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365529:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.365529:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.365530:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365533:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365539:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.365540:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.365540:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365543:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365554:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.365557:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365557:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dc2c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4759552->4763647] (req 4759552->4763647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365562:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.365567:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365572:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.365877:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.365887:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468259328
00000100:00100000:1.0:1651532113.365898:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.365907:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468259392
00000100:00100000:0.0:1651532113.365915:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3956
00000100:00100000:1.0:1651532113.365916:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.365917:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468259328:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532113.365927:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3957
00010000:00010000:0.0:1651532113.365929:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.365930:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468259392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532113.365934:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532113.365938:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365943:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365946:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532113.365947:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.365951:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532113.365952:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.365955:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532113.365956:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365960:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.365961:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.365964:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.365964:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.366022:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468259456
00000100:00100000:0.0:1651532113.366031:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2742
00000100:00100000:0.0:1651532113.366033:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468259456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.366036:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.366039:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd60 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448bf5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.366047:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd60 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bf5 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.366051:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd60 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bf5 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.366055:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532113.366072:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468259456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (159us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.366075:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2742
00000001:00080000:1.0:1651532113.432164:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793636 is committed
00010000:00010000:1.0:1651532113.432185:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.432189:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432196:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432200:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.432206:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468254144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 685696us (685830us total) trans 158913793636 rc 0/0
00000100:00100000:1.0:1651532113.432209:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3949
00010000:00010000:1.0:1651532113.432216:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.432216:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468253568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 685867us (685980us total) trans 158913793635 rc 0/0
00010000:00010000:1.0:1651532113.432220:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532113.432220:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3948
00010000:00010000:1.0:1651532113.432221:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.432224:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432227:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.432229:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432231:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532113.432232:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dc5d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7614464->9441279] (req 7614464->9441279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432232:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432235:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432240:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.432240:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.432241:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432244:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432254:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432257:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dc3a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->7196671] (req 2400256->7196671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.432272:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.432277:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.432678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.432691:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468259584
00000100:00100000:0.0:1651532113.432706:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3958
00000100:00100000:0.0:1651532113.432707:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468259584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532113.432716:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.432717:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532113.432720:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.432727:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.432730:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.432735:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468259904
00000100:00100000:1.0:1651532113.432747:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2743
00000100:00100000:1.0:1651532113.432749:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468259904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.432753:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.432758:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd6e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448bfc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.432767:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd6e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bfc expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.432772:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd6e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448bfc expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.432776:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532113.432788:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468259904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.432791:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2743
00000001:00080000:1.0:1651532113.498886:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793637 is committed
00010000:00010000:1.0:1651532113.498902:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.498909:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.498933:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468255872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 652797us (652865us total) trans 158913793637 rc 0/0
00010000:00010000:0.0:1651532113.498933:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.498936:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3950
00010000:00010000:0.0:1651532113.498937:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532113.498938:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.498941:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.498947:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.498947:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.498948:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.498951:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.498954:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.498955:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.498955:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.498958:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.498965:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.498968:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40dcb1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10227711] (req 2711552->10227711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.498974:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.498977:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.498985:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.498989:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.499457:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.499466:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.499474:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.499490:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.499501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.499502:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468260224
00000100:00100000:0.0:1651532113.499522:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468260352
00000100:00100000:0.0:1651532113.499525:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468260416
00000100:00100000:1.0:1651532113.499528:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468260096
00000100:00100000:0.0:1651532113.499529:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2744
00000100:00100000:0.0:1651532113.499530:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468260224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.499534:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.499537:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dd75 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c03 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.499539:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468260160
00010000:00010000:0.0:1651532113.499543:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532113.499545:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3959
00010000:00010000:0.0:1651532113.499546:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dd75 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c03 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532113.499547:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468260096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532113.499550:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40dd75 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c03 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.499553:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532113.499555:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499560:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532113.499561:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.499566:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468260224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.499569:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2744
00010000:00010000:1.0:1651532113.499574:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532113.499575:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499580:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499583:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.499591:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2745
00000100:00100000:1.0:1651532113.499593:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468260352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.499596:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.499598:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dd83 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c0a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.499598:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2746
00000100:00100000:0.0:1651532113.499600:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468260416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.499603:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.499604:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.499606:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dd8a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c11 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499607:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dd83 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c0a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.499610:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532113.499611:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40dd83 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c0a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.499613:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dd8a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c11 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.499615:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532113.499617:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40dd8a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c11 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.499620:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532113.499623:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468260352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (133us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.499626:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468260416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.499628:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2745
00000100:00100000:0.0:1651532113.499630:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2746
00000100:00100000:1.0:1651532113.499636:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3960
00000100:00100000:1.0:1651532113.499638:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468260160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532113.499642:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499645:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499645:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499649:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532113.499649:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532113.499650:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499661:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.499661:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468255936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 653484us (653584us total) trans 0 rc 57344/57344
00000100:00100000:0.0:1651532113.499664:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3951
00010000:00010000:1.0:1651532113.499668:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499671:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532113.499672:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499675:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499680:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499681:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.499683:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40dcb8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [954368->10293247] (req 954368->10293247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499685:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.499695:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468257472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 561922us (561973us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532113.499698:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3952
00010000:00010000:0.0:1651532113.499713:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499717:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532113.499718:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499721:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499725:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.499726:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.499727:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499730:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499736:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499739:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40dcfe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->8699903] (req 3178496->8699903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499744:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.499747:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.500145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.500163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.500178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.500186:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.500195:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.500204:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.500212:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468260672
00000100:00100000:1.0:1651532113.500219:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468260928
00000100:00100000:1.0:1651532113.500221:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468260992
00000100:00100000:1.0:1651532113.500223:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468261120
00000100:00100000:1.0:1651532113.500226:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2747
00000100:00100000:1.0:1651532113.500228:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468260672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.500232:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.500236:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dd98 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c18 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.500243:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468260864
00010000:00010000:1.0:1651532113.500244:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dd98 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c18 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.500248:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40dd98 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c18 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.500252:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532113.500253:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468260736
00000100:00100000:0.0:1651532113.500263:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3961
00000100:00100000:0.0:1651532113.500265:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468260864:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532113.500270:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468260672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (126us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532113.500272:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.500273:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2747
00010000:00010000:0.0:1651532113.500276:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532113.500277:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.500278:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2748
00000100:00100000:1.0:1651532113.500280:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468260928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.500280:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532113.500281:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.500282:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.500285:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40dda6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c1f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.500285:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.500288:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.500291:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40dda6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c1f expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.500295:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40dda6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c1f expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532113.500296:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3962
00000100:00100000:0.0:1651532113.500297:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468260736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532113.500298:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532113.500302:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.500304:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468260928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (117us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532113.500305:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532113.500306:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2748
00000100:00100000:1.0:1651532113.500310:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2749
00000100:00100000:1.0:1651532113.500311:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468260992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.500323:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.500326:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.500326:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.500329:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ddb4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c26 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.500329:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532113.500330:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.500333:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.500336:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.500339:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.500347:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ddb4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c26 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.500352:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ddb4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c26 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.500355:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532113.500362:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468260992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (167us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.500362:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2750
00000100:00100000:0.0:1651532113.500364:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468261120:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532113.500365:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2749
00010000:00010000:0.0:1651532113.500367:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.500370:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ddbb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c2d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.500377:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ddbb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c2d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.500393:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ddbb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c2d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.500396:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532113.500410:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468261120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (206us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.500413:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2750
00000100:00100000:1.0:1651532113.500764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.500772:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.500785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.500794:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.500796:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468261312
00000100:00100000:1.0:1651532113.500801:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468261440
00000100:00100000:0.0:1651532113.500813:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468261248
00000100:00100000:0.0:1651532113.500821:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468261568
00000100:00100000:1.0:1651532113.500823:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2751
00000100:00100000:1.0:1651532113.500825:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468261312:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532113.500826:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2752
00000100:00100000:0.0:1651532113.500828:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468261248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.500829:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.500831:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.500832:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ddc2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c3b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.500834:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ddc9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c34 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.500840:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ddc2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c3b expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.500842:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ddc9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c34 expref: 23 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.500844:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ddc2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c3b expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.500846:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ddc9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c34 expref: 23 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.500847:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532113.500849:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532113.500858:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468261312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (94us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.500858:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468261248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.500860:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2751
00000100:00100000:0.0:1651532113.500862:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2752
00000100:00100000:1.0:1651532113.500865:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2753
00000100:00100000:1.0:1651532113.500867:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468261440:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532113.500868:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2754
00000100:00100000:0.0:1651532113.500869:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468261568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.500870:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.500872:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ddd0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c42 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.500872:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.500874:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ddd7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c49 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.500878:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ddd0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c42 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.500879:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ddd7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c49 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.500881:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ddd0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c42 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.500883:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ddd7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c49 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.500885:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532113.500886:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532113.500890:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468261440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.500891:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468261568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.500892:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2753
00000100:00100000:0.0:1651532113.500894:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2754
00000100:00100000:1.0:1651532113.501290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.501304:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.501309:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468261760
00000100:00100000:1.0:1651532113.501311:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.501331:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468261888
00000100:00100000:1.0:1651532113.501333:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.501335:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468261696
00000100:00100000:0.0:1651532113.501337:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468262016
00000100:00100000:0.0:1651532113.501340:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2755
00000100:00100000:1.0:1651532113.501342:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2756
00000100:00100000:0.0:1651532113.501342:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468261760:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532113.501344:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468261888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.501345:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.501348:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.501348:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ddde lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c57 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.501352:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dde5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c5e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.501358:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ddde lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c57 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.501360:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dde5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c5e expref: 23 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.501362:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ddde lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c57 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.501364:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40dde5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c5e expref: 23 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.501365:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532113.501368:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532113.501378:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468261760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.501381:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2755
00000100:00100000:1.0:1651532113.501384:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468261888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532113.501385:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2757
00000100:00100000:1.0:1651532113.501387:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2756
00000100:00100000:0.0:1651532113.501387:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468261696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.501389:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.501392:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40ddec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c50 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.501393:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2758
00000100:00100000:1.0:1651532113.501394:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468262016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.501397:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532113.501398:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40ddec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c50 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.501399:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ddf3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c65 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.501401:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40ddec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c50 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.501404:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:1.0:1651532113.501405:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ddf3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c65 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.501409:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ddf3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c65 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532113.501410:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468261696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (99us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532113.501412:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532113.501413:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2757
00000100:00100000:1.0:1651532113.501418:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468262016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.501420:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2758
00000100:00100000:1.0:1651532113.501822:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.501830:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.501842:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.501852:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468262208
00000100:00100000:0.0:1651532113.501853:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468262400
00000100:00100000:1.0:1651532113.501862:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468262464
00000100:00100000:1.0:1651532113.501865:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2759
00000100:00100000:1.0:1651532113.501867:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468262208:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532113.501868:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2760
00010000:00010000:1.0:1651532113.501870:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532113.501870:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468262400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532113.501873:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.501874:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40ddfa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c6c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.501881:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40ddfa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c6c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.501884:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de01 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c73 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.501885:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40ddfa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c6c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.501889:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532113.501891:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de01 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c73 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532113.501895:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de01 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c73 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532113.501898:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468262208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (77us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532113.501899:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532113.501901:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2759
00000100:00100000:1.0:1651532113.501905:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2761
00000100:00100000:1.0:1651532113.501907:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468262464:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532113.501907:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468262400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (77us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532113.501909:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532113.501910:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2760
00010000:00010000:1.0:1651532113.501912:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de08 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c7a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.501917:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de08 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c7a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.501922:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de08 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c7a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.501924:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532113.501929:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468262464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.501932:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2761
00000100:00100000:1.0:1651532113.502243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.502250:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468262720
00000100:00100000:1.0:1651532113.502261:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2762
00000100:00100000:1.0:1651532113.502263:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468262720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.502266:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.502270:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de0f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c81 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.502277:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de0f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c81 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.502281:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de0f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c81 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.502285:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532113.502294:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468262720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.502298:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2762
00000001:00080000:1.0:1651532113.598936:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793638 is committed
00010000:00010000:0.0:1651532113.598967:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.598971:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.598994:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468257408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 661193us (661260us total) trans 158913793638 rc 0/0
00000100:00100000:0.0:1651532113.599006:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3953
00010000:00010000:0.0:1651532113.599014:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.599017:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532113.599018:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.599021:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.599026:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.599027:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.599028:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.599031:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.599037:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.599040:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40dd05 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->9609215] (req 65536->9609215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.599055:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.599060:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.599418:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532113.599427:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468263040
00000100:00100000:1.0:1651532113.599438:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2763
00000100:00100000:1.0:1651532113.599440:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468263040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.599444:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.599448:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de16 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c88 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.599456:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de16 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c88 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.599460:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de16 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c88 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.599463:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532113.599474:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468263040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.599476:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2763
00000001:00080000:1.0:1651532113.807395:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793639 is committed
00002000:00010000:1.0:1651532113.807409:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532112 -> 1651532113
00002000:00010000:1.0:1651532113.807410:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532112 -> 1651532113
00010000:00010000:1.0:1651532113.807413:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.807416:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.807439:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468258112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 636107us (636177us total) trans 158913793639 rc 0/0
00010000:00010000:0.0:1651532113.807439:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.807442:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3954
00010000:00010000:0.0:1651532113.807444:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532113.807445:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807448:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807454:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.807454:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.807455:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807458:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807467:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807470:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40dd21 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4378624->8146943] (req 4378624->8146943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807480:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807483:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807498:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807501:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532113.807523:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468258176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 636158us (636231us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532113.807527:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3955
00010000:00010000:0.0:1651532113.807549:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807553:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532113.807554:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807557:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807562:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.807562:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532113.807563:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807566:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807573:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807576:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40dd28 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7417856->7421951] (req 7417856->7421951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807581:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807593:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.807874:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532113.807885:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468263296
00000100:00100000:0.0:1651532113.807905:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3963
00000100:00100000:0.0:1651532113.807907:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468263296:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532113.807912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532113.807915:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.807925:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532113.807925:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532113.807926:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807929:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532113.807930:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.807933:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468263232
00010000:00010000:0.0:1651532113.807934:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532113.807937:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.807944:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3964
00000100:00100000:1.0:1651532113.807946:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468263232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532113.807953:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.807958:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532113.807959:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.807963:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.807968:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532113.807969:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.807973:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.807976:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.807980:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532113.807987:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468263424
00000100:00100000:1.0:1651532113.807997:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2764
00000100:00100000:1.0:1651532113.807999:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468263424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532113.808002:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532113.808004:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de2b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c8f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532113.808011:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de2b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c8f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.808016:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de2b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c8f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532113.808022:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532113.808032:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468263424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532113.808035:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2764
00000001:00080000:1.0:1651532114.073690:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793640 is committed
00010000:00010000:0.0:1651532114.073721:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.073726:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.073755:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468259328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 707837us (707879us total) trans 158913793640 rc 0/0
00010000:00010000:1.0:1651532114.073758:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.073759:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3956
00010000:00010000:1.0:1651532114.073763:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532114.073764:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.073767:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.073773:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.073774:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.073775:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.073778:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.073781:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.073781:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.073782:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.073787:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.073814:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.073818:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.073824:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.073828:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40dd52 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3796992->7651327] (req 3796992->7651327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.073833:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.073836:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.073840:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.073845:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.073870:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468259584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 641162us (641193us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532114.073873:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3958
00010000:00010000:0.0:1651532114.073881:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.073885:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.073886:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.073889:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.073904:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.073907:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40dd67 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1331200->1335295] (req 1331200->1335295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.074127:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.074134:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.074166:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.074182:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468263680
00000100:00100000:0.0:1651532114.074192:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468263744
00010000:00010000:1.0:1651532114.074194:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.074201:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3965
00000100:00100000:0.0:1651532114.074203:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468263680:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532114.074204:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074210:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074221:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532114.074222:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.074225:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468259392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 708295us (708327us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532114.074225:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532114.074226:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.074229:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3957
00010000:00010000:0.0:1651532114.074230:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074234:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.074235:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3966
00000100:00100000:1.0:1651532114.074237:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468263744:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532114.074249:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074252:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.074253:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074255:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074256:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074260:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.074262:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532114.074262:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074266:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.074267:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.074267:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074270:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074273:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.074274:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.074274:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074277:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074281:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074285:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074291:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40dd59 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->9420799] (req 413696->9420799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074294:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074297:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074303:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074305:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074336:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074340:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.074358:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468260160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 574719us (574891us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532114.074361:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3960
00000100:00100000:0.0:1651532114.074369:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468263872
00000100:00100000:0.0:1651532114.074376:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2765
00000100:00100000:0.0:1651532114.074378:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468263872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.074381:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.074384:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40de40 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c96 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074392:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40de40 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c96 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.074397:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40de40 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c96 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.074400:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074400:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532114.074405:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532114.074406:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.074412:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468263872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (246us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.074414:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2765
00010000:00010000:1.0:1651532114.074416:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074425:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074442:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40dd91 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8286208->8290303] (req 8286208->8290303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.074722:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.074750:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.074759:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.074765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.074770:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.074777:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.074783:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468264000
00000100:00100000:0.0:1651532114.074792:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468264320
00000100:00100000:0.0:1651532114.074801:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3967
00000100:00100000:0.0:1651532114.074815:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468264000:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532114.074819:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3968
00000100:00100000:1.0:1651532114.074821:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468264320:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532114.074822:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074826:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532114.074827:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074830:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074831:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074836:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532114.074837:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074840:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.074842:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074845:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532114.074845:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074849:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074850:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074852:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074854:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074856:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.074863:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468264192
00000100:00100000:0.0:1651532114.074867:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468264128
00000100:00100000:1.0:1651532114.074870:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468264384
00000100:00100000:0.0:1651532114.074870:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468264256
00000100:00100000:0.0:1651532114.074872:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2766
00000100:00100000:0.0:1651532114.074874:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468264192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.074876:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532114.074878:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2767
00000100:00100000:1.0:1651532114.074879:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468264128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.074879:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40de55 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ca4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074882:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.074886:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40de5c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448c9d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074886:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40de55 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ca4 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.074890:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40de55 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ca4 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.074893:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40de5c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c9d expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.074898:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40de5c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448c9d expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.074901:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532114.074905:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532114.074912:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468264128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.074914:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468264192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (154us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.074915:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2767
00000100:00100000:0.0:1651532114.074917:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2766
00000100:00100000:1.0:1651532114.074921:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2768
00000100:00100000:1.0:1651532114.074922:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468264256:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532114.074922:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2769
00000100:00100000:0.0:1651532114.074924:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468264384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.074925:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.074927:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40de63 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cab expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.074927:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.074930:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40de6a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cb2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.074932:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40de63 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cab expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.074936:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40de63 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cab expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.074936:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40de6a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cb2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.074940:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532114.074940:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40de6a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cb2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.074943:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532114.074945:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468264256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (168us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.074948:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468264384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (178us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.074950:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2769
00000100:00100000:1.0:1651532114.074957:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2768
00000100:00100000:0.0:1651532114.075202:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.075209:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468264512
00000100:00100000:0.0:1651532114.075223:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2770
00000100:00100000:0.0:1651532114.075224:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468264512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.075229:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.075233:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40de71 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cb9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.075240:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40de71 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cb9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.075244:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40de71 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cb9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.075247:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532114.075258:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468264512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.075261:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2770
00000100:00100000:0.0:1651532114.075328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.075336:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.075345:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.075349:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468264640
00000100:00100000:0.0:1651532114.075351:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468264768
00000100:00100000:1.0:1651532114.075361:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468264896
00000100:00100000:1.0:1651532114.075365:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2771
00000100:00100000:1.0:1651532114.075367:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468264640:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532114.075367:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2772
00000100:00100000:0.0:1651532114.075369:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468264768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.075370:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.075372:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.075374:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40de78 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cc0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.075375:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de7f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cc7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.075383:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40de78 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cc0 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.075383:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de7f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cc7 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.075387:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40de78 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cc0 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.075391:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532114.075399:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de7f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cc7 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532114.075401:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468264640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (73us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532114.075403:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532114.075404:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2771
00000100:00100000:1.0:1651532114.075409:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2773
00000100:00100000:1.0:1651532114.075410:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468264896:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532114.075411:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468264768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (75us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532114.075413:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532114.075414:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2772
00010000:00010000:1.0:1651532114.075415:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de86 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cce expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.075421:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de86 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cce expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.075434:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de86 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cce expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.075437:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532114.075444:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468264896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.075447:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2773
00000001:00080000:1.0:1651532114.190376:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793641 is committed
00010000:00010000:1.0:1651532114.190392:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.190396:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.190419:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468260096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 690871us (690962us total) trans 158913793641 rc 0/0
00000100:00100000:1.0:1651532114.190422:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3959
00010000:00010000:0.0:1651532114.190422:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190426:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.190427:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190430:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190436:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.190436:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.190437:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190440:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190448:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190453:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40dd7c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->6406143] (req 1527808->6406143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.190471:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.190477:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.190824:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.190833:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.190844:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.190844:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468265280
00000100:00100000:0.0:1651532114.190855:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468265344
00000100:00100000:1.0:1651532114.190856:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.190869:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3969
00000100:00100000:0.0:1651532114.190870:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468265280:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532114.190871:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3970
00000100:00100000:1.0:1651532114.190873:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468265344:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532114.190877:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190881:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532114.190882:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190882:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532114.190883:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.190886:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.190888:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.190891:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532114.190891:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190895:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.190896:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.190899:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.190904:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468265408
00010000:00010000:1.0:1651532114.190909:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.190909:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468265472
00010000:00010000:1.0:1651532114.190913:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.190913:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2774
00000100:00100000:0.0:1651532114.190915:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468265408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.190917:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.190925:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40de9b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cd5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190930:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532114.190931:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468260864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 690666us (690769us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532114.190933:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40de9b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cd5 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532114.190934:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3961
00010000:00010000:0.0:1651532114.190937:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40de9b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cd5 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.190941:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532114.190943:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2775
00000100:00100000:1.0:1651532114.190944:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468265472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.190947:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.190950:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40dea2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cdc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.190950:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468265408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.190952:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2774
00010000:00010000:1.0:1651532114.190955:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.190958:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40dea2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cdc expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.190960:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.190962:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40dea2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cdc expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.190963:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.190964:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.190966:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532114.190967:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190971:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532114.190972:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468265472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (116us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532114.190972:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.190973:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.190975:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2775
00010000:00010000:0.0:1651532114.190975:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190982:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190985:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40dd9f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3436544->7229439] (req 3436544->7229439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190990:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.190993:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.191354:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.191362:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468265664
00000100:00100000:1.0:1651532114.191370:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2776
00000100:00100000:1.0:1651532114.191372:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468265664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.191375:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.191379:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40dea9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ce3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.191387:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40dea9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ce3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.191404:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40dea9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ce3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.191408:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532114.191419:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468265664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.191421:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2776
00000001:00080000:1.0:1651532114.282046:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793642 is committed
00010000:00010000:0.0:1651532114.282077:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282082:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.282102:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468260736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 781804us (781923us total) trans 158913793642 rc 0/0
00010000:00010000:1.0:1651532114.282105:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.282105:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3962
00010000:00010000:1.0:1651532114.282109:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532114.282110:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282114:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282119:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.282120:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.282121:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282124:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282134:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282144:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282149:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282156:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ddad lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2387968->8871935] (req 2387968->8871935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.282509:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.282519:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.282529:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.282531:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266048
00000100:00100000:1.0:1651532114.282552:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266112
00000100:00100000:0.0:1651532114.282554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.282564:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3971
00000100:00100000:1.0:1651532114.282566:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000086bdfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468266048:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532114.282568:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532114.282573:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.282576:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3972
00010000:00010000:1.0:1651532114.282578:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532114.282578:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000020c3a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468266112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532114.282579:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282582:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282584:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532114.282585:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282586:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282589:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282590:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.282592:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282595:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532114.282595:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282599:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282600:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282603:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282605:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.282613:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266240
00010000:00010000:0.0:1651532114.282614:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282617:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.282621:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266304
00000100:00100000:1.0:1651532114.282624:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266176
00000100:00100000:1.0:1651532114.282627:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2777
00000100:00100000:1.0:1651532114.282629:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468266240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.282631:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.282634:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40debe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cf1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.282639:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532114.282643:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468263296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474735us (474770us total) trans 0 rc 69632/69632
00010000:00010000:1.0:1651532114.282648:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40debe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cf1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.282652:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40debe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cf1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532114.282654:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3963
00010000:00010000:1.0:1651532114.282656:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:0.0:1651532114.282663:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2778
00000100:00100000:1.0:1651532114.282665:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468266240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.282665:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468266304:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532114.282668:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2777
00010000:00010000:0.0:1651532114.282668:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.282671:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40dec5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cf8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.282673:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2779
00000100:00100000:1.0:1651532114.282674:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468266176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.282677:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.282678:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.282679:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40dec5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cf8 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.282681:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40decc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cea expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282684:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40dec5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cf8 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.282685:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.282687:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40decc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cea expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.282687:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:1.0:1651532114.282691:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40decc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cea expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.282694:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:0.0:1651532114.282694:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468266304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (146us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.282697:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2778
00000100:00100000:1.0:1651532114.282700:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468266176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (132us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.282702:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2779
00010000:00010000:0.0:1651532114.282703:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282706:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.282707:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282710:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282715:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.282716:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.282717:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282720:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282729:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282732:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40de1d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->10305535] (req 32768->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282744:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.282747:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.283141:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.283149:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.283163:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.283172:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266432
00000100:00100000:1.0:1651532114.283175:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266496
00000100:00100000:0.0:1651532114.283180:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266560
00000100:00100000:0.0:1651532114.283183:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2780
00000100:00100000:0.0:1651532114.283185:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468266432:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532114.283186:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2781
00010000:00010000:0.0:1651532114.283188:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532114.283189:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468266496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.283192:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40ded3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448cff expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.283194:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.283199:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40deda lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d06 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.283210:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40deda lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d06 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.283214:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40deda lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d06 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.283218:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00010000:00010000:0.0:1651532114.283228:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40ded3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cff expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.283232:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40ded3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448cff expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.283236:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532114.283247:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468266432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.283248:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468266496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.283249:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2780
00000100:00100000:1.0:1651532114.283251:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2781
00000100:00100000:0.0:1651532114.283255:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2782
00000100:00100000:0.0:1651532114.283257:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468266560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.283259:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.283262:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dee1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d0d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.283268:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dee1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d0d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.283272:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dee1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d0d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532114.283284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532114.283296:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532114.283303:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468266560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (140us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.283306:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2782
00000100:00100000:0.0:1651532114.283311:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266752
00000100:00100000:0.0:1651532114.283329:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2783
00000100:00100000:0.0:1651532114.283331:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468266752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.283334:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.283337:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dee8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d14 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.283344:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dee8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d14 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.283347:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dee8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d14 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.283351:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532114.283361:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468266752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.283364:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2783
00000100:00100000:1.0:1651532114.283562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.283569:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266944
00000100:00100000:1.0:1651532114.283577:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2784
00000100:00100000:1.0:1651532114.283578:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468266944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.283582:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.283586:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40deef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d22 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.283593:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40deef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d22 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.283597:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40deef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d22 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.283601:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532114.283615:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468266944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.283618:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2784
00000100:00100000:1.0:1651532114.283673:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.283680:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.283687:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.283697:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468266880
00000100:00100000:0.0:1651532114.283698:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468267072
00000100:00100000:1.0:1651532114.283707:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468267008
00000100:00100000:1.0:1651532114.283710:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2785
00000100:00100000:1.0:1651532114.283712:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468266880:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532114.283714:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2786
00010000:00010000:1.0:1651532114.283715:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532114.283716:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468267072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.283719:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40def6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d1b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.283719:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.283722:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40defd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d30 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.283726:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40def6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d1b expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.283730:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40def6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d1b expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.283730:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40defd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d30 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.283734:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00010000:00010000:0.0:1651532114.283734:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40defd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d30 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.283738:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532114.283745:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468266880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.283748:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2785
00000100:00100000:0.0:1651532114.283752:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468267072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.283753:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2787
00000100:00100000:1.0:1651532114.283754:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468267008:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532114.283755:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2786
00010000:00010000:1.0:1651532114.283757:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.283767:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df04 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d29 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.283773:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df04 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d29 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.283781:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df04 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d29 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.283796:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532114.283823:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468267008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (136us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.283828:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2787
00000100:00100000:0.0:1651532114.283904:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.283921:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468267264
00000100:00100000:1.0:1651532114.283934:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2788
00000100:00100000:1.0:1651532114.283936:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468267264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.283939:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.283943:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40df0b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d37 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.283950:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40df0b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d37 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.283954:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40df0b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d37 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.283957:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532114.283967:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468267264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.283970:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2788
00000100:00100000:0.0:1651532114.284133:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.284145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.284147:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468267456
00000100:00100000:1.0:1651532114.284163:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468267392
00000100:00100000:0.0:1651532114.284166:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2789
00000100:00100000:1.0:1651532114.284173:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2790
00000100:00100000:0.0:1651532114.284173:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468267456:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532114.284175:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468267392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.284176:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.284178:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.284180:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df12 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d45 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.284182:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df19 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d3e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.284188:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df12 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d45 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.284189:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df19 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d3e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.284192:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df12 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d45 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.284193:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df19 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d3e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.284195:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:1.0:1651532114.284197:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:0.0:1651532114.284208:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468267456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.284212:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2789
00000100:00100000:1.0:1651532114.284213:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468267392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.284216:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2790
00000001:00080000:1.0:1651532114.390426:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793643 is committed
00010000:00010000:0.0:1651532114.390460:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390464:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.390482:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468263232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582535us (582570us total) trans 158913793643 rc 0/0
00000100:00100000:0.0:1651532114.390485:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3964
00010000:00010000:0.0:1651532114.390492:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390495:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.390496:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390499:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390504:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.390505:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.390506:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390509:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390515:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.390515:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.390516:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390519:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390532:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390535:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40de24 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [290816->9916415] (req 290816->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390541:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.390543:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390544:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.390548:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.390565:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.390579:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390592:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390596:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.390597:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.390600:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.390612:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468263744:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316373us (316476us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651532114.390615:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.390616:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3966
00010000:00010000:0.0:1651532114.390618:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40de39 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9043968->9048063] (req 9043968->9048063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.390974:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.390983:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.390995:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468267904
00000100:00100000:1.0:1651532114.390996:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.391003:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468267968
00000100:00100000:0.0:1651532114.391008:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3973
00000100:00100000:0.0:1651532114.391009:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468267904:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532114.391018:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3974
00000100:00100000:1.0:1651532114.391020:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468267968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532114.391023:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.391027:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532114.391028:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.391028:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.391031:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532114.391032:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.391036:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532114.391038:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.391043:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532114.391044:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.391054:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.391054:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.391058:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.391058:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.391075:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468268160
00000100:00100000:1.0:1651532114.391083:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2791
00000100:00100000:1.0:1651532114.391085:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b5f0484 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468268160:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532114.391085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532114.391088:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.391091:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40df2e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d53 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.391094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532114.391098:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40df2e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d53 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532114.391101:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532114.391103:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40df2e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d53 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.391106:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:0.0:1651532114.391106:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468268352
00000100:00100000:0.0:1651532114.391112:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468268096
00000100:00100000:0.0:1651532114.391114:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468268416
00000100:00100000:1.0:1651532114.391117:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b5f0484 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468268160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.391117:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2792
00000100:00100000:0.0:1651532114.391118:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468268352:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532114.391120:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2791
00010000:00010000:0.0:1651532114.391122:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.391125:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40df35 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d5a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.391133:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40df35 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d5a expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.391137:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40df35 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d5a expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.391140:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532114.391147:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2793
00000100:00100000:1.0:1651532114.391148:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468268096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532114.391149:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468268352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532114.391151:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532114.391152:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2792
00010000:00010000:1.0:1651532114.391154:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df3c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d4c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.391157:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2794
00000100:00100000:0.0:1651532114.391158:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468268416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.391160:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df3c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d4c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.391161:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.391163:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40df43 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d61 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.391167:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df3c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d4c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.391170:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00010000:00010000:0.0:1651532114.391171:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40df43 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d61 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.391175:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40df43 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d61 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532114.391176:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468268096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (82us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532114.391178:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532114.391179:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2793
00000100:00100000:0.0:1651532114.391183:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468268416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.391186:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2794
00000100:00100000:0.0:1651532114.391557:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.391564:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.391570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.391583:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468268608
00000100:00100000:0.0:1651532114.391592:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468268672
00000100:00100000:0.0:1651532114.391595:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468268928
00000100:00100000:1.0:1651532114.391600:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2795
00000100:00100000:1.0:1651532114.391602:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468268608:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532114.391602:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2796
00000100:00100000:0.0:1651532114.391604:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468268672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.391606:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.391607:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.391610:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df4a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d68 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.391610:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40df51 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d6f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.391618:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df4a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d68 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.391619:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40df51 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d6f expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.391622:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df4a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d68 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.391623:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40df51 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d6f expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.391626:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00010000:00010000:0.0:1651532114.391627:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532114.391636:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468268608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.391636:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468268672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.391639:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2796
00000100:00100000:1.0:1651532114.391640:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2795
00000100:00100000:0.0:1651532114.391643:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2797
00000100:00100000:0.0:1651532114.391645:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468268928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.391647:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.391649:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df58 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d76 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.391655:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df58 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d76 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.391658:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df58 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d76 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.391661:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532114.391666:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468268928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.391668:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2797
00000100:00100000:0.0:1651532114.391936:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.391944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.391950:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468269056
00000100:00100000:0.0:1651532114.391963:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468269120
00000100:00100000:0.0:1651532114.391967:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2798
00000100:00100000:0.0:1651532114.391969:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468269056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.391972:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532114.391974:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2799
00000100:00100000:1.0:1651532114.391976:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468269120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.391976:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df5f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d7d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.391980:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.391983:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d7d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.391984:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40df66 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d84 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.391987:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d7d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.391990:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:1.0:1651532114.391991:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40df66 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d84 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.391995:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40df66 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d84 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.391999:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:0.0:1651532114.392003:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468269056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.392005:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2798
00000100:00100000:1.0:1651532114.392014:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468269120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.392017:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2799
00000001:00080000:1.0:1651532114.545816:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793644 is committed
00010000:00010000:0.0:1651532114.545847:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.545852:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.545869:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468263680:12345-10.240.43.64@tcp:4:fio.0 Request processed in 471665us (471743us total) trans 158913793644 rc 0/0
00000100:00100000:0.0:1651532114.545872:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3965
00010000:00010000:0.0:1651532114.545879:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.545885:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.545886:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.545889:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.545894:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.545894:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.545895:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.545898:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.545905:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.545908:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40de32 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6823935] (req 937984->6823935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.545913:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.545916:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.546301:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.546328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.546335:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.546345:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.546351:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.546352:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468269504
00000100:00100000:0.0:1651532114.546358:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468269376
00000100:00100000:1.0:1651532114.546364:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468269568
00000100:00100000:1.0:1651532114.546367:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468269632
00000100:00100000:1.0:1651532114.546371:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2800
00000100:00100000:1.0:1651532114.546373:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468269504:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532114.546374:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468269440
00010000:00010000:1.0:1651532114.546377:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532114.546380:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3975
00010000:00010000:1.0:1651532114.546381:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40df6d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d8b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.546382:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468269376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532114.546389:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40df6d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d8b expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.546389:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.546394:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532114.546395:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.546398:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532114.546398:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.546403:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.546405:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40df6d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d8b expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.546406:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.546408:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:0.0:1651532114.546413:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3976
00000100:00100000:0.0:1651532114.546415:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468269440:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532114.546420:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468269504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (84us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532114.546420:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.546423:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2800
00000100:00100000:1.0:1651532114.546428:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2801
00000100:00100000:1.0:1651532114.546430:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468269568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.546432:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532114.546433:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.546433:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.546435:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df82 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d92 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.546436:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532114.546436:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.546441:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.546442:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df82 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d92 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.546444:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.546445:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df82 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d92 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.546449:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532114.546453:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468269568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.546454:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2802
00000100:00100000:0.0:1651532114.546455:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468269632:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532114.546456:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2801
00010000:00010000:0.0:1651532114.546458:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.546461:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40df89 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448d99 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.546468:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40df89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d99 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.546472:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40df89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448d99 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.546475:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532114.546487:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468269632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.546490:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2802
00000100:00100000:1.0:1651532114.546758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.546775:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468269760
00000100:00100000:1.0:1651532114.546786:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2803
00000100:00100000:1.0:1651532114.546788:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468269760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.546791:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.546795:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df90 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448da0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.546821:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df90 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448da0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.546825:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df90 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448da0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.546829:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532114.546842:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468269760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.546844:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2803
00000001:00080000:1.0:1651532114.648734:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793645 is committed
00002000:00010000:0.0:1651532114.648763:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532113 -> 1651532114
00002000:00010000:0.0:1651532114.648765:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532113 -> 1651532114
00010000:00010000:0.0:1651532114.648768:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648772:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.648795:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468264000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 573992us (574074us total) trans 158913793645 rc 0/0
00000100:00100000:0.0:1651532114.648799:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3967
00010000:00010000:0.0:1651532114.648817:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648821:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.648822:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648825:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648830:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.648831:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.648832:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648837:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648841:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.648841:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.648842:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648844:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648855:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648858:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40de47 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5840896->9134079] (req 5840896->9134079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648863:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648866:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.648873:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.648878:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.648896:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.648901:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648934:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.648938:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468264320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 574115us (574187us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651532114.648939:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.648940:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.648941:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3968
00010000:00010000:0.0:1651532114.648943:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648949:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.648952:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40de4e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8536064->8540159] (req 8536064->8540159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.649182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.649191:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468270016
00000100:00100000:1.0:1651532114.649204:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2804
00000100:00100000:1.0:1651532114.649206:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468270016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.649210:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.649214:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df97 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448da7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.649222:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df97 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448da7 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.649226:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40df97 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448da7 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.649230:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532114.649244:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468270016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.649248:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2804
00000100:00100000:0.0:1651532114.649307:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.649330:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468270144
00000100:00100000:1.0:1651532114.649344:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3977
00000100:00100000:1.0:1651532114.649346:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468270144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532114.649354:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.649359:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.649360:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.649363:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532114.649363:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.649368:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.649372:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.649380:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.649389:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468270208
00000100:00100000:1.0:1651532114.649395:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.649401:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468270272
00000100:00100000:0.0:1651532114.649401:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3978
00000100:00100000:0.0:1651532114.649403:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468270208:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532114.649411:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2805
00000100:00100000:1.0:1651532114.649413:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468270272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.649416:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.649416:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.649418:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448dae expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.649421:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532114.649422:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.649425:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532114.649426:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.649432:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dae expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.649432:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.649438:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.649440:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dae expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.649443:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532114.649454:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468270272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.649457:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2805
00000001:00080000:1.0:1651532114.748748:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793646 is committed
00010000:00010000:0.0:1651532114.748778:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.748782:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.748817:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468265280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557945us (557992us total) trans 158913793646 rc 0/0
00000100:00100000:0.0:1651532114.748820:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3969
00010000:00010000:0.0:1651532114.748827:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.748830:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.748832:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.748834:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.748839:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.748840:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.748841:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.748846:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.748856:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.748859:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40de8d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5464064->8265727] (req 5464064->8265727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.748864:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.748869:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.749150:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.749155:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.749176:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.749179:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468265344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 558305us (558345us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532114.749183:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3970
00010000:00010000:0.0:1651532114.749184:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.749186:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.749189:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.749194:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.749194:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.749195:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.749198:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.749207:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.749211:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40de94 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1826816->10379263] (req 1826816->10379263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.749215:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.749221:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.749593:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.749601:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.749612:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.749612:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468270720
00000100:00100000:1.0:1651532114.749619:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468270656
00000100:00100000:0.0:1651532114.749624:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3979
00000100:00100000:0.0:1651532114.749626:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468270720:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532114.749633:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3980
00000100:00100000:1.0:1651532114.749635:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468270656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532114.749638:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.749643:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.749643:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532114.749644:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532114.749645:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.749649:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532114.749650:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.749653:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.749656:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532114.749657:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.749660:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.749661:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.749664:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.749673:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468270784
00010000:00010000:1.0:1651532114.749676:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.749680:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2806
00000100:00100000:0.0:1651532114.749681:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468270784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.749684:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.749687:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40dfc1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448db5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.749695:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40dfc1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448db5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.749702:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40dfc1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448db5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.749705:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532114.749716:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468270784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (104us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.749718:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2806
00000100:00100000:1.0:1651532114.749946:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.749956:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468271040
00000100:00100000:0.0:1651532114.749967:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2807
00000100:00100000:0.0:1651532114.749969:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468271040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.749972:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.749986:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfc8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448dbc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.749993:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfc8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dbc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.749998:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfc8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dbc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.750001:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532114.750011:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468271040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.750014:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2807
00000001:00080000:1.0:1651532114.815482:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793647 is committed
00010000:00010000:1.0:1651532114.815497:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.815501:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815520:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.815525:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000086bdfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468266048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532958us (533016us total) trans 158913793647 rc 0/0
00010000:00010000:0.0:1651532114.815525:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.815526:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.815528:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3971
00010000:00010000:0.0:1651532114.815529:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815535:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.815535:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.815536:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815539:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815547:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815550:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40deb0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->9678847] (req 811008->9678847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815555:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815558:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815749:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815754:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.815770:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000020c3a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468266112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533191us (533251us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532114.815773:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3972
00010000:00010000:0.0:1651532114.815780:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815784:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.815785:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815788:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815792:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.815793:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.815793:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815796:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815819:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.815823:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40deb7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->3235839] (req 569344->3235839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.815835:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.815839:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.816195:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.816206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.816207:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468271488
00000100:00100000:1.0:1651532114.816215:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.816218:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468271424
00000100:00100000:1.0:1651532114.816225:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3981
00000100:00100000:1.0:1651532114.816228:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468271488:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532114.816230:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3982
00000100:00100000:0.0:1651532114.816232:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468271424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532114.816237:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.816240:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.816244:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532114.816245:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.816248:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532114.816249:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.816253:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532114.816254:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.816257:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532114.816258:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.816262:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.816263:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.816266:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.816266:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.816278:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468271616
00000100:00100000:1.0:1651532114.816287:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2808
00000100:00100000:1.0:1651532114.816288:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468271616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.816292:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.816294:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40dfdd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448dc3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.816302:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40dfdd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dc3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.816307:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40dfdd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dc3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.816324:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532114.816338:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468271616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (123us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.816341:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2808
00000001:00080000:1.0:1651532114.882196:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793648 is committed
00010000:00010000:1.0:1651532114.882212:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.882216:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.882239:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468267904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491228us (491265us total) trans 158913793648 rc 0/0
00010000:00010000:0.0:1651532114.882239:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.882242:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3973
00010000:00010000:0.0:1651532114.882244:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.882245:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882249:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882254:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.882255:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.882255:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882258:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882268:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882271:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40df20 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->10059775] (req 122880->10059775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882281:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882284:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.882683:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.882700:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468271872
00010000:00010000:0.0:1651532114.882705:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.882709:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2809
00010000:00010000:0.0:1651532114.882710:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.882711:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468271872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.882715:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.882719:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40dfe4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448dca expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.882725:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532114.882728:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40dfe4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dca expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.882736:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40dfe4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dca expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532114.882736:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468267968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491716us (491753us total) trans 0 rc 57344/57344
00010000:00010000:1.0:1651532114.882739:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:0.0:1651532114.882740:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3974
00000100:00100000:1.0:1651532114.882747:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468271872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (65us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532114.882747:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.882750:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2809
00010000:00010000:0.0:1651532114.882750:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532114.882751:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882754:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882759:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.882760:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532114.882760:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882763:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882770:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882773:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40df27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9781247] (req 270336->9781247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882778:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.882788:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.883245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.883253:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.883263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.883266:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468272192
00000100:00100000:0.0:1651532114.883272:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.883281:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.883294:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468272128
00000100:00100000:0.0:1651532114.883295:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532114.883307:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3983
00000100:00100000:1.0:1651532114.883309:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468272192:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532114.883309:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3984
00000100:00100000:0.0:1651532114.883312:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468272128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532114.883326:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.883331:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532114.883331:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.883332:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.883337:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532114.883338:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.883341:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.883343:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532114.883344:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.883347:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.883348:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.883354:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.883355:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468272320
00010000:00010000:0.0:1651532114.883358:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.883360:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468272448
00000100:00100000:1.0:1651532114.883362:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468272576
00000100:00100000:1.0:1651532114.883364:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468272640
00000100:00100000:1.0:1651532114.883367:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2810
00000100:00100000:1.0:1651532114.883369:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468272320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.883372:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532114.883372:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2811
00000100:00100000:0.0:1651532114.883373:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468272448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.883375:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40dff9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448dd1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.883376:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.883382:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40dff9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dd1 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.883386:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40dff9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dd1 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.883387:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e000 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448dd8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532114.883390:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532114.883395:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e000 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dd8 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.883400:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e000 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dd8 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532114.883401:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754468272320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (137us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532114.883403:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532114.883404:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2810
00000100:00100000:1.0:1651532114.883408:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2812
00000100:00100000:1.0:1651532114.883410:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468272576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.883412:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532114.883413:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468272448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (141us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532114.883414:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e007 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ddf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532114.883416:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2811
00010000:00010000:1.0:1651532114.883420:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e007 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ddf expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532114.883422:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2813
00010000:00010000:1.0:1651532114.883424:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e007 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ddf expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532114.883424:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468272640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.883428:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532114.883430:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532114.883430:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e00e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448de6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.883436:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468272576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (156us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532114.883436:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e00e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448de6 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532114.883439:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2812
00010000:00010000:0.0:1651532114.883440:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e00e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448de6 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.883443:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532114.883448:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468272640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (153us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.883451:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2813
00000100:00100000:0.0:1651532114.883747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.883754:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468272768
00000100:00100000:0.0:1651532114.883762:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2814
00000100:00100000:0.0:1651532114.883763:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468272768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.883767:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.883770:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e015 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ded expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.883777:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e015 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ded expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.883781:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e015 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ded expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.883785:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532114.883829:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468272768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.883832:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2814
00000100:00100000:0.0:1651532114.883847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.883864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532114.883870:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468272832
00000100:00100000:0.0:1651532114.883881:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468273024
00000100:00100000:0.0:1651532114.883885:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2815
00000100:00100000:0.0:1651532114.883887:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468272832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532114.883890:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532114.883893:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2816
00010000:00010000:0.0:1651532114.883894:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e01c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448df4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532114.883895:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468273024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532114.883899:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532114.883901:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e01c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448df4 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.883903:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e023 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448dfb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532114.883905:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e01c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448df4 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532114.883908:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:1.0:1651532114.883911:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e023 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dfb expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532114.883915:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e023 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448dfb expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532114.883920:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468272832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532114.883923:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2815
00010000:00010000:1.0:1651532114.883925:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532114.883933:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468273024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532114.883936:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2816
00000001:00080000:1.0:1651532115.007233:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793649 is committed
00010000:00010000:0.0:1651532115.007263:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007268:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.007284:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468269376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 460901us (460984us total) trans 158913793649 rc 0/0
00000100:00100000:0.0:1651532115.007287:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3975
00010000:00010000:0.0:1651532115.007294:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007297:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.007298:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007301:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007306:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.007306:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.007307:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007310:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007329:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007333:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40df74 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->9543679] (req 823296->9543679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007338:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007341:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007558:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007562:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.007583:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468269440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 461166us (461254us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532115.007586:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3976
00010000:00010000:0.0:1651532115.007593:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007596:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.007597:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007600:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007605:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.007605:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.007607:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007610:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007619:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007622:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40df7b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [966656->9547775] (req 966656->9547775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.007637:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.007642:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.007819:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.007831:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.007849:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468273472
00000100:00100000:1.0:1651532115.007867:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468273408
00000100:00100000:1.0:1651532115.007877:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2817
00000100:00100000:1.0:1651532115.007878:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468273472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.007882:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.007886:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e02a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e09 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.007898:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2818
00000100:00100000:0.0:1651532115.007900:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468273408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.007904:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.007907:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e031 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e02 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.007916:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e031 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e02 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.007918:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e02a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e09 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.007920:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e031 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e02 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.007923:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e02a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e09 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.007924:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:1.0:1651532115.007926:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:0.0:1651532115.007934:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468273408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.007937:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2818
00000100:00100000:1.0:1651532115.007938:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468273472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.007943:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2817
00000100:00100000:0.0:1651532115.007951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.007978:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468273792
00000100:00100000:0.0:1651532115.007989:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3985
00000100:00100000:0.0:1651532115.007990:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468273792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532115.007996:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.008001:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.008002:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.008005:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532115.008005:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.008009:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.008013:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.008026:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.008038:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468273856
00000100:00100000:1.0:1651532115.008046:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2819
00000100:00100000:0.0:1651532115.008047:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.008048:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468273856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.008056:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532115.008057:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532115.008060:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e03f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e10 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.008065:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468273984
00010000:00010000:1.0:1651532115.008070:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e03f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e10 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532115.008071:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2820
00000100:00100000:0.0:1651532115.008073:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468273984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.008074:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e03f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e10 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.008077:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.008078:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532115.008080:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e046 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e17 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.008087:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e046 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e17 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532115.008088:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468273856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.008091:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2819
00010000:00010000:0.0:1651532115.008091:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e046 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e17 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.008094:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532115.008098:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468273920
00000100:00100000:0.0:1651532115.008102:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468273984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (44us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.008104:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2820
00000100:00100000:1.0:1651532115.008111:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3986
00000100:00100000:1.0:1651532115.008113:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468273920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532115.008119:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.008123:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532115.008124:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.008127:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532115.008128:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.008132:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.008138:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.008202:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.008214:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468274112
00000100:00100000:1.0:1651532115.008229:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2821
00000100:00100000:1.0:1651532115.008231:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468274112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.008236:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.008241:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e054 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e1e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.008256:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e054 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e1e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.008261:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e054 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e1e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.008264:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532115.008277:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468274112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.008280:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2821
00000100:00100000:0.0:1651532115.008301:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.008327:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468274240
00000100:00100000:1.0:1651532115.008338:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2822
00000100:00100000:1.0:1651532115.008339:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468274240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.008343:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.008346:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e05b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e25 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.008353:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e05b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e25 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.008357:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e05b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e25 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.008360:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532115.008368:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468274240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.008370:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2822
00000100:00100000:0.0:1651532115.008604:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.008624:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468274624
00000100:00100000:1.0:1651532115.008638:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2823
00000100:00100000:1.0:1651532115.008640:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468274624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.008643:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.008647:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e062 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e2c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.008654:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e062 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e2c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.008658:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e062 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e2c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.008661:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532115.008672:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468274624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.008674:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2823
00000001:00080000:1.0:1651532115.049177:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793650 is committed
00010000:00010000:1.0:1651532115.049193:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.049197:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.049218:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468270144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 399871us (399912us total) trans 158913793650 rc 0/0
00000100:00100000:1.0:1651532115.049221:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3977
00010000:00010000:0.0:1651532115.049221:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049226:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.049227:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049230:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049238:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.049239:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.049240:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049243:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049246:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.049246:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.049247:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049250:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049257:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049260:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40df9e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4300800->4304895] (req 4300800->4304895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049266:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049268:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049295:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049299:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049535:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049539:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.049565:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468270720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 299938us (299973us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532115.049568:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3979
00010000:00010000:1.0:1651532115.049573:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.049578:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.049578:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049582:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.049585:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.049589:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.049593:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468270208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 400190us (400213us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532115.049595:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.049596:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3978
00010000:00010000:1.0:1651532115.049598:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40dfb3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->8818687] (req 946176->8818687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049601:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049604:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.049605:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049617:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049622:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.049622:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.049623:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049626:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049635:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.049638:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40dfa5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->7340031] (req 1204224->7340031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.049652:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.049656:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.049949:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.049961:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.049962:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468274880
00000100:00100000:1.0:1651532115.049971:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.049980:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468274944
00000100:00100000:1.0:1651532115.049983:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.049991:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3987
00000100:00100000:1.0:1651532115.049993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.049993:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468274880:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532115.050003:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3988
00010000:00010000:0.0:1651532115.050004:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.050006:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468274944:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532115.050009:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.050010:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.050014:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.050023:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532115.050024:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.050028:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532115.050030:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.050033:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532115.050033:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.050037:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.050038:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.050040:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.050044:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.050050:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468275072
00000100:00100000:0.0:1651532115.050058:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468275264
00000100:00100000:0.0:1651532115.050061:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468275136
00000100:00100000:0.0:1651532115.050064:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2824
00000100:00100000:0.0:1651532115.050065:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468275072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.050068:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.050071:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e077 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e33 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.050079:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e077 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e33 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.050083:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e077 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e33 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.050086:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532115.050099:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468275072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.050101:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2824
00000100:00100000:0.0:1651532115.050106:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2825
00000100:00100000:0.0:1651532115.050108:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468275264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.050110:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.050113:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e07e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e41 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.050116:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2826
00000100:00100000:1.0:1651532115.050118:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468275136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.050118:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e07e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e41 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.050122:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.050122:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e07e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e41 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.050125:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e085 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e3a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.050125:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532115.050130:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468275264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (152us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.050132:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2825
00010000:00010000:1.0:1651532115.050133:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e085 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e3a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.050137:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e085 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e3a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.050141:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532115.050150:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468275136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (157us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.050153:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2826
00000001:00080000:1.0:1651532115.115670:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793651 is committed
00010000:00010000:1.0:1651532115.115685:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.115689:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.115723:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468270656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 366087us (366122us total) trans 158913793651 rc 0/0
00000100:00100000:1.0:1651532115.115727:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3980
00010000:00010000:0.0:1651532115.115734:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.115739:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.115740:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.115743:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.115750:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.115750:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.115751:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.115754:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.115762:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.115765:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40dfba lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->8880127] (req 1306624->8880127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.115770:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.115774:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.116103:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.116110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.116120:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.116126:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.116135:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468275584
00000100:00100000:1.0:1651532115.116145:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468275648
00000100:00100000:1.0:1651532115.116152:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2827
00000100:00100000:1.0:1651532115.116153:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468275584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.116157:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.116161:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e08c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e48 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.116169:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e08c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e48 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.116174:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e08c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e48 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.116177:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532115.116187:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468275584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.116190:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2827
00000100:00100000:0.0:1651532115.116194:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468275456
00000100:00100000:1.0:1651532115.116203:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2828
00000100:00100000:1.0:1651532115.116205:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468275648:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532115.116206:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468275520
00010000:00010000:1.0:1651532115.116208:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.116210:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e093 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e4f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.116212:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3989
00000100:00100000:0.0:1651532115.116214:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468275456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532115.116216:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e093 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e4f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.116220:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e093 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e4f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.116221:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.116224:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00010000:00010000:0.0:1651532115.116225:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.116226:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.116229:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:1.0:1651532115.116230:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468275648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (103us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532115.116230:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.116232:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2828
00010000:00010000:0.0:1651532115.116234:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.116238:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.116239:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3990
00000100:00100000:1.0:1651532115.116241:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468275520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532115.116246:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.116251:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532115.116252:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.116254:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532115.116255:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.116260:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.116264:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.116540:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.116551:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468275776
00000100:00100000:0.0:1651532115.116559:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2829
00000100:00100000:0.0:1651532115.116561:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468275776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.116564:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.116568:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e0a8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e56 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.116576:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e0a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e56 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.116580:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e0a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e56 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.116583:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532115.116598:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468275776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.116602:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2829
00000100:00100000:1.0:1651532115.168093:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532115.168117:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231680
00000100:00100000:0.0:1651532115.168127:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 59
00000100:00100000:0.0:1651532115.168129:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231680:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532115.168135:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 544768 granted 351658560 pending 315392 free 81138851840 avail 76965588992
00000100:00100000:0.0:1651532115.168152:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231680:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 22us (60us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532115.168155:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 59
00000001:00080000:1.0:1651532115.241903:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793652 is committed
00010000:00010000:0.0:1651532115.241937:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.241941:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.241961:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468271424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 425728us (425754us total) trans 158913793652 rc 0/0
00010000:00010000:1.0:1651532115.241964:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.241964:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3982
00010000:00010000:1.0:1651532115.241969:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532115.241970:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.241974:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.241979:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.241980:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.241981:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.241984:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.241987:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.241988:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.241988:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.241991:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.241999:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.242014:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40dfd6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9621503] (req 1052672->9621503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.242023:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.242027:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.242043:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.242046:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242072:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.242074:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468272192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358764us (358829us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651532115.242076:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532115.242080:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3983
00010000:00010000:1.0:1651532115.242088:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242090:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.242092:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242094:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242112:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242115:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40dfeb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5394432->5398527] (req 5394432->5398527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.242380:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.242387:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.242393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.242411:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468275968
00010000:00010000:1.0:1651532115.242431:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.242436:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.242455:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468276096
00000100:00100000:0.0:1651532115.242459:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468276160
00000100:00100000:0.0:1651532115.242462:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2830
00000100:00100000:0.0:1651532115.242464:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468275968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.242467:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.242477:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e0af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e5d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.242480:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468271488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 426252us (426286us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532115.242483:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532115.242484:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3981
00010000:00010000:0.0:1651532115.242485:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e0af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e5d expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.242490:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e0af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e5d expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532115.242493:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2831
00010000:00010000:0.0:1651532115.242493:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532115.242495:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468276096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.242498:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.242502:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e0b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e64 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.242502:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468275968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (123us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532115.242508:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.242511:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e0b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e64 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532115.242514:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2830
00010000:00010000:1.0:1651532115.242515:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e0b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e64 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.242518:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:0.0:1651532115.242519:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2832
00000100:00100000:0.0:1651532115.242521:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468276160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.242524:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532115.242525:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468276096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.242527:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2831
00010000:00010000:0.0:1651532115.242527:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e0bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e6b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242531:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.242534:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e0bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e6b expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.242537:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e0bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e6b expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.242540:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532115.242543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.242547:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468276160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (154us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.242549:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2832
00010000:00010000:0.0:1651532115.242556:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242559:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.242560:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242563:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.242567:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532115.242568:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.242569:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.242570:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242573:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242580:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242583:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40dfcf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1310720->9101311] (req 1310720->9101311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242587:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242590:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.242675:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468276288
00000100:00100000:1.0:1651532115.242690:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468276224
00000100:00100000:0.0:1651532115.242695:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3991
00000100:00100000:0.0:1651532115.242697:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468276288:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532115.242704:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3992
00000100:00100000:1.0:1651532115.242707:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468276224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532115.242709:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.242717:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242725:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.242726:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532115.242727:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.242732:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.242734:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532115.242735:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.242741:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.242741:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.243030:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.243041:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.243042:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468276416
00000100:00100000:1.0:1651532115.243050:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.243059:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.243063:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468276544
00000100:00100000:0.0:1651532115.243066:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468276480
00000100:00100000:0.0:1651532115.243068:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468276736
00000100:00100000:1.0:1651532115.243071:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2833
00000100:00100000:1.0:1651532115.243073:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468276416:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532115.243075:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2834
00000100:00100000:0.0:1651532115.243076:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468276544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.243077:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.243080:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.243081:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e0d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e72 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.243084:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e0d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e80 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.243091:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e0d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e80 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.243096:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e0d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e80 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.243098:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e0d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e72 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.243099:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:1.0:1651532115.243102:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e0d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e72 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.243106:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:0.0:1651532115.243110:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468276544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.243113:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2834
00000100:00100000:1.0:1651532115.243115:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468276416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.243117:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2833
00000100:00100000:0.0:1651532115.243119:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2835
00000100:00100000:0.0:1651532115.243121:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468276480:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532115.243123:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2836
00010000:00010000:0.0:1651532115.243123:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532115.243125:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468276736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.243126:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e0e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e79 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.243128:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.243130:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e0e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e87 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.243131:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e0e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e79 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.243135:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e0e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e79 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.243136:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e0e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e87 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.243138:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:1.0:1651532115.243140:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e0e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e87 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.243143:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:0.0:1651532115.243143:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468276480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.243146:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2835
00000100:00100000:1.0:1651532115.243148:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468276736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.243158:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2836
00000100:00100000:1.0:1651532115.243460:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.243491:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.243504:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468276864
00000100:00100000:1.0:1651532115.243506:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468276928
00000100:00100000:0.0:1651532115.243513:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2837
00000100:00100000:1.0:1651532115.243520:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2838
00000100:00100000:0.0:1651532115.243520:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468276864:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532115.243522:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002860f824 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468276928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.243523:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.243525:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.243526:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e0ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e8e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.243529:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e0f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e95 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.243534:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e0ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e8e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.243537:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e0f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e95 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.243538:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e0ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e8e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.243541:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e0f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e95 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.243544:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:1.0:1651532115.243545:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532115.243555:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002860f824 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468276928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.243555:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468276864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.243557:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2837
00000100:00100000:1.0:1651532115.243559:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2838
00000100:00100000:1.0:1651532115.243792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.243800:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468277184
00000100:00100000:1.0:1651532115.243822:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2839
00000100:00100000:1.0:1651532115.243824:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468277184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.243827:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.243837:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e0fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448e9c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.243845:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e0fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e9c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.243849:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e0fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448e9c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.243852:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532115.243864:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468277184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.243867:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2839
00000001:00080000:1.0:1651532115.374010:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793653 is committed
00010000:00010000:0.0:1651532115.374042:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.374047:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.374068:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468272128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490756us (490814us total) trans 158913793653 rc 0/0
00010000:00010000:1.0:1651532115.374071:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.374071:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3984
00010000:00010000:1.0:1651532115.374076:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532115.374077:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.374081:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.374087:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.374087:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.374088:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.374101:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.374117:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.374118:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.374121:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.374124:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40dff2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5021696->9707519] (req 5021696->9707519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.374526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.374537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.374544:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.374553:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.374557:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468277440
00000100:00100000:0.0:1651532115.374560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.374570:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468277568
00000100:00100000:1.0:1651532115.374573:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468277696
00000100:00100000:0.0:1651532115.374573:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468277376
00000100:00100000:1.0:1651532115.374577:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2840
00000100:00100000:1.0:1651532115.374578:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468277440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.374582:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532115.374586:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468277312
00000100:00100000:0.0:1651532115.374593:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3993
00010000:00010000:1.0:1651532115.374608:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e103 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ea3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.374612:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468277376:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532115.374617:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e103 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ea3 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.374620:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.374621:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e103 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ea3 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.374624:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00010000:00010000:0.0:1651532115.374625:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.374626:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532115.374627:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.374630:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.374638:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468277440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.374641:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2840
00000100:00100000:0.0:1651532115.374645:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3994
00000100:00100000:1.0:1651532115.374646:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2841
00000100:00100000:0.0:1651532115.374647:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468277312:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532115.374648:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468277568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.374651:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.374652:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.374653:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e118 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448eaa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.374656:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.374657:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.374660:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.374662:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.374665:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532115.374665:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.374670:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e118 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448eaa expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.374670:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.374673:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.374674:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e118 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448eaa expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.374676:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.374677:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00010000:00010000:0.0:1651532115.374679:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.374683:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468277568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.374685:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2841
00000100:00100000:0.0:1651532115.374687:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2842
00000100:00100000:0.0:1651532115.374689:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468277696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.374691:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.374694:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e11f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448eb1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.374700:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e11f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448eb1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.374704:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e11f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448eb1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.374708:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532115.374727:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468277696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (166us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.374730:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2842
00000100:00100000:0.0:1651532115.375008:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.375015:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468277952
00000100:00100000:0.0:1651532115.375030:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2843
00000100:00100000:0.0:1651532115.375032:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468277952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.375035:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.375039:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e126 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448eb8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.375047:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e126 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448eb8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.375051:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e126 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448eb8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.375054:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532115.375064:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468277952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.375067:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2843
00000001:00080000:1.0:1651532115.515617:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793654 is committed
00002000:00010000:0.0:1651532115.515647:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532114 -> 1651532115
00002000:00010000:0.0:1651532115.515649:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532114 -> 1651532115
00010000:00010000:0.0:1651532115.515651:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.515655:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.515680:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468273792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507689us (507729us total) trans 158913793654 rc 0/0
00000100:00100000:0.0:1651532115.515684:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3985
00010000:00010000:0.0:1651532115.515691:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.515694:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.515695:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.515698:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.515703:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.515704:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.515704:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.515707:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.515719:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.515722:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e038 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10428415] (req 585728->10428415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.515732:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.515736:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.516057:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.516089:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.516099:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.516112:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.516119:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468278144
00000100:00100000:1.0:1651532115.516123:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468278272
00000100:00100000:0.0:1651532115.516125:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468278336
00000100:00100000:0.0:1651532115.516127:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468278208
00000100:00100000:0.0:1651532115.516131:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2844
00000100:00100000:0.0:1651532115.516132:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468278144:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532115.516133:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2845
00000100:00100000:1.0:1651532115.516135:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468278336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.516136:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.516139:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.516140:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e12d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ebf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516143:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e134 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ed4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.516146:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.516148:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e12d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ebf expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.516149:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.516151:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e134 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ed4 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.516153:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e12d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ebf expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.516155:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e134 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ed4 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.516156:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532115.516159:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:0.0:1651532115.516166:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468278144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.516167:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468278336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.516169:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2844
00000100:00100000:1.0:1651532115.516170:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2845
00000100:00100000:0.0:1651532115.516173:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2846
00000100:00100000:1.0:1651532115.516175:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2847
00000100:00100000:0.0:1651532115.516175:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468278272:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532115.516177:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468278208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.516178:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.516179:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.516180:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e13b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ecd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516181:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e142 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ec6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.516184:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.516186:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.516186:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e13b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ecd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.516188:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e142 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ec6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.516190:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e13b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ecd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.516191:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e142 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ec6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.516194:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:1.0:1651532115.516195:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:0.0:1651532115.516199:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468278272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.516200:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468278208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.516202:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2846
00000100:00100000:1.0:1651532115.516203:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2847
00010000:00010000:1.0:1651532115.516216:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516219:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.516248:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468273920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508133us (508200us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532115.516252:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3986
00010000:00010000:0.0:1651532115.516260:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.516264:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.516265:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.516268:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.516273:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.516274:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.516275:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.516278:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.516285:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.516288:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e04d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9871359] (req 1953792->9871359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.516293:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.516296:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.516714:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.516726:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468278528
00000100:00100000:0.0:1651532115.516726:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.516735:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.516748:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468278464
00000100:00100000:0.0:1651532115.516749:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.516751:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468278720
00000100:00100000:1.0:1651532115.516760:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2848
00000100:00100000:0.0:1651532115.516760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.516762:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468278528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.516765:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532115.516767:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468278912
00010000:00010000:1.0:1651532115.516769:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e149 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ee2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.516779:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468278976
00010000:00010000:1.0:1651532115.516782:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e149 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ee2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532115.516787:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3995
00000100:00100000:0.0:1651532115.516789:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468278912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532115.516791:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e149 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ee2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.516794:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00010000:00010000:0.0:1651532115.516796:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.516820:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468278528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (106us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532115.516821:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.516822:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.516823:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2848
00010000:00010000:0.0:1651532115.516825:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532115.516826:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.516828:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2849
00000100:00100000:1.0:1651532115.516830:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468278464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.516830:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516833:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.516834:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516835:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e157 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448edb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516842:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e157 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448edb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.516846:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e157 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448edb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.516849:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532115.516854:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468278464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (128us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.516857:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2849
00000100:00100000:1.0:1651532115.516860:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2850
00000100:00100000:1.0:1651532115.516862:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468278720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.516864:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.516865:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e15e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ee9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516880:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e15e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ee9 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.516884:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e15e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ee9 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.516887:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532115.516893:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468278720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (158us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.516895:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2850
00000100:00100000:1.0:1651532115.516903:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3996
00000100:00100000:1.0:1651532115.516905:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468278976:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532115.516911:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516915:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532115.516916:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516919:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516922:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532115.516922:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516950:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516953:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.516957:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.517270:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.517278:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468279168
00000100:00100000:0.0:1651532115.517286:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2851
00000100:00100000:0.0:1651532115.517287:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468279168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.517291:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.517295:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e16c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ef0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.517303:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e16c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ef0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.517307:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e16c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ef0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.517322:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532115.517334:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468279168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.517337:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2851
00000100:00100000:0.0:1651532115.517570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.517577:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468279424
00000100:00100000:0.0:1651532115.517584:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2852
00000100:00100000:0.0:1651532115.517586:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468279424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.517589:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.517592:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e173 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ef7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.517600:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e173 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ef7 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.517604:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e173 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ef7 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.517607:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532115.517616:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468279424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (47us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.517619:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2852
00000001:00080000:1.0:1651532115.607389:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793655 is committed
00010000:00010000:0.0:1651532115.607420:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.607427:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.607448:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468274880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557454us (557499us total) trans 158913793655 rc 0/0
00010000:00010000:1.0:1651532115.607450:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.607451:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3987
00010000:00010000:1.0:1651532115.607454:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532115.607455:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.607459:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.607464:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.607465:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.607466:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.607469:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.607479:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.607494:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e069 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->10452991] (req 1761280->10452991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.607503:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.607506:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.607877:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.607885:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.607890:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.607906:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468279680
00000100:00100000:0.0:1651532115.607916:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468279552
00000100:00100000:0.0:1651532115.607918:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468279744
00000100:00100000:0.0:1651532115.607921:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2853
00010000:00010000:1.0:1651532115.607922:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.607923:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468279680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.607927:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.607927:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.607930:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e17a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f05 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.607942:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.607945:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e17a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f05 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532115.607949:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468274944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 557942us (557987us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532115.607952:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3988
00010000:00010000:0.0:1651532115.607954:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e17a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f05 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.607958:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532115.607961:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2854
00000100:00100000:1.0:1651532115.607963:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468279552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.607966:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.607970:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e181 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448efe expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.607975:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468279680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (99us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532115.607978:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532115.607978:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2853
00010000:00010000:1.0:1651532115.607981:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e181 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448efe expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532115.607983:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2855
00010000:00010000:1.0:1651532115.607985:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e181 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448efe expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532115.607985:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468279744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.607988:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00010000:00010000:0.0:1651532115.607988:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.607991:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e188 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f0c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.607994:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468279552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (110us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532115.607995:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532115.607997:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2854
00010000:00010000:0.0:1651532115.607998:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e188 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f0c expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.608002:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e188 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f0c expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.608005:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:1.0:1651532115.608010:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.608010:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468279744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (120us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.608013:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2855
00010000:00010000:1.0:1651532115.608014:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532115.608015:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608018:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608022:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.608023:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.608024:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608026:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.608052:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.608056:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608078:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608083:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e070 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->10239999] (req 2289664->10239999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.608430:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.608469:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.608479:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.608483:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468280064
00000100:00100000:0.0:1651532115.608487:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.608497:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468280128
00000100:00100000:1.0:1651532115.608504:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3997
00000100:00100000:1.0:1651532115.608507:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468280064:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532115.608513:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3998
00000100:00100000:0.0:1651532115.608515:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468280128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532115.608517:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608523:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532115.608525:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608528:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532115.608529:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608534:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.608536:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608537:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.608541:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.608542:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.608545:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532115.608545:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.608550:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.608553:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.608555:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468280000
00000100:00100000:0.0:1651532115.608562:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468280192
00000100:00100000:1.0:1651532115.608570:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2856
00000100:00100000:0.0:1651532115.608576:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2857
00000100:00100000:1.0:1651532115.608578:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468280000:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532115.608578:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468280192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.608581:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.608581:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.608584:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e19d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f13 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.608584:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1a4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f1a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.608592:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f1a expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.608593:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e19d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f13 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.608596:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f1a expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.608597:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e19d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f13 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.608600:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532115.608601:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:0.0:1651532115.608610:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468280192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (123us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.608611:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468280000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (181us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.608613:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2857
00000100:00100000:1.0:1651532115.608615:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2856
00000100:00100000:0.0:1651532115.608627:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.608637:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468280256
00000100:00100000:1.0:1651532115.608644:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2858
00000100:00100000:1.0:1651532115.608645:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468280256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.608648:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.608651:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e1ab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f21 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608672:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e1ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f21 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.608676:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e1ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f21 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.608680:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532115.608695:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468280256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.608698:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2858
00000100:00100000:0.0:1651532115.608940:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.608953:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468280448
00000100:00100000:1.0:1651532115.608962:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2859
00000100:00100000:1.0:1651532115.608963:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468280448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.608966:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.608970:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e1b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f28 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.608977:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e1b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f28 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.608981:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e1b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f28 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.608984:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532115.608999:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468280448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.609001:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2859
00000100:00100000:0.0:1651532115.609074:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.609086:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468280640
00000100:00100000:1.0:1651532115.609094:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2860
00000100:00100000:1.0:1651532115.609096:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468280640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.609100:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.609104:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1b9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f2f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.609111:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f2f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.609114:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f2f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.609118:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532115.609131:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468280640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.609134:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2860
00000100:00100000:0.0:1651532115.609358:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.609377:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468280896
00000100:00100000:1.0:1651532115.609386:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2861
00000100:00100000:1.0:1651532115.609387:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468280896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.609390:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.609394:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e1c0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f36 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.609401:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e1c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f36 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.609404:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e1c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f36 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.609411:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532115.609425:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468280896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.609428:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2861
00000001:00080000:1.0:1651532115.724011:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793656 is committed
00010000:00010000:0.0:1651532115.724042:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724047:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.724064:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468275456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 607849us (607962us total) trans 158913793656 rc 0/0
00000100:00100000:0.0:1651532115.724067:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3989
00010000:00010000:0.0:1651532115.724073:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724079:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.724081:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724084:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724088:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.724089:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.724090:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724092:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724096:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.724096:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.724097:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724100:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724103:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.724103:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.724104:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724106:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724109:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.724110:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.724111:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724113:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724128:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724131:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e09a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->9138175] (req 3813376->9138175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724136:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724139:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724139:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724144:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724161:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724164:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724166:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724169:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724430:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724446:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724450:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724460:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.724465:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468277376:12345-10.240.43.64@tcp:3:fio.0 Request processed in 349869us (349939us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532115.724468:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3993
00000100:00100000:1.0:1651532115.724476:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468275520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 608234us (608365us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532115.724479:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3990
00010000:00010000:0.0:1651532115.724479:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724482:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724488:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.724492:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468276288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 481795us (481950us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532115.724493:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532115.724494:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.724495:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3991
00010000:00010000:1.0:1651532115.724499:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724500:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724509:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724512:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e10a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3002368->9691135] (req 3002368->9691135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724516:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724519:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.724519:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532115.724520:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724520:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724523:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724524:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724526:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724529:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.724532:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e0c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [372736->6991871] (req 372736->6991871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724538:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.724538:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724542:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724549:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724552:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e0a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4644864->6012927] (req 4644864->6012927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724558:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.724561:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.724600:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.724624:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281088
00000100:00100000:1.0:1651532115.724668:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2862
00000100:00100000:1.0:1651532115.724670:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468281088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.724674:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.724677:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e1c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f3d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.724688:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e1c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f3d expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.724695:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e1c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f3d expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.724699:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532115.724717:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468281088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (116us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.724721:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2862
00000100:00100000:0.0:1651532115.724996:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.725012:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.725024:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281152
00000100:00100000:0.0:1651532115.725028:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.725037:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.725047:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281216
00000100:00100000:0.0:1651532115.725051:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.725061:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281536
00000100:00100000:1.0:1651532115.725069:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3999
00000100:00100000:1.0:1651532115.725070:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468281152:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532115.725071:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.725082:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4000
00000100:00100000:0.0:1651532115.725084:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468281216:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532115.725095:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725102:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532115.725103:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725106:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532115.725106:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.725107:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725111:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.725112:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.725113:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.725116:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532115.725117:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725120:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.725121:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.725125:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.725129:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281408
00000100:00100000:0.0:1651532115.725132:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4001
00000100:00100000:0.0:1651532115.725134:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468281536:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532115.725140:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281344
00000100:00100000:1.0:1651532115.725145:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281472
00010000:00010000:0.0:1651532115.725146:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.725148:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2863
00000100:00100000:1.0:1651532115.725149:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468281408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.725150:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.725151:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725152:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.725154:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532115.725154:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725155:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e1e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f4b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.725158:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725162:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e1e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f4b expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.725162:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.725171:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2864
00000100:00100000:0.0:1651532115.725172:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754468281344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.725175:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.725177:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e1e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f4b expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.725178:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e1ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f44 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725181:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00010000:00010000:0.0:1651532115.725185:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e1ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f44 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.725190:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e1ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f44 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532115.725194:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754468281408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (166us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.725197:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2863
00010000:00010000:0.0:1651532115.725200:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532115.725202:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2865
00000100:00100000:1.0:1651532115.725204:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468281472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.725206:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.725209:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e1f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f52 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.725209:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468281344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (172us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.725212:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2864
00010000:00010000:1.0:1651532115.725215:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e1f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f52 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.725219:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e1f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f52 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.725221:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532115.725228:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468281472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (162us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.725229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.725230:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2865
00000100:00100000:1.0:1651532115.725234:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281728
00000100:00100000:1.0:1651532115.725246:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2866
00000100:00100000:1.0:1651532115.725247:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468281728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.725250:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.725252:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e1f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f59 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725271:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e1f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f59 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.725276:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e1f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f59 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.725280:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532115.725294:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468281728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.725297:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2866
00000100:00100000:0.0:1651532115.725536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.725550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.725559:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.725563:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281920
00000100:00100000:0.0:1651532115.725566:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281856
00000100:00100000:1.0:1651532115.725573:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468281984
00000100:00100000:1.0:1651532115.725578:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2867
00000100:00100000:1.0:1651532115.725580:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468281920:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532115.725580:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2868
00010000:00010000:1.0:1651532115.725583:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.725586:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e1ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f67 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.725590:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c031ba3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754468281856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.725594:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e1ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f67 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.725594:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.725602:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e206 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f60 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725608:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e1ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f67 expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.725610:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e206 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f60 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.725612:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532115.725614:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e206 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f60 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.725618:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532115.725625:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468281920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.725627:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2867
00000100:00100000:0.0:1651532115.725632:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c031ba3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468281856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.725633:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2869
00000100:00100000:1.0:1651532115.725634:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afa5d0ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468281984:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532115.725635:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2868
00010000:00010000:1.0:1651532115.725637:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.725639:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e20d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f6e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725645:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e20d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f6e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.725649:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e20d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f6e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.725652:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532115.725658:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afa5d0ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468281984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.725660:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2869
00000100:00100000:0.0:1651532115.725914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.725935:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468282176
00000100:00100000:1.0:1651532115.725948:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2870
00000100:00100000:1.0:1651532115.725950:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c48da76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468282176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.725953:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.725957:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e214 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f75 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.725964:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e214 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f75 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532115.725965:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.725973:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468282304
00000100:00100000:0.0:1651532115.725981:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2871
00010000:00010000:1.0:1651532115.725982:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e214 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f75 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532115.725982:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468282304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.725985:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00010000:00010000:0.0:1651532115.725986:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.725990:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e21b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f7c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.726001:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c48da76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468282176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.726004:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2870
00010000:00010000:0.0:1651532115.726004:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e21b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f7c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.726018:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e21b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f7c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.726022:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532115.726031:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468282304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.726034:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2871
00000100:00100000:0.0:1651532115.726285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.726292:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468282560
00000100:00100000:0.0:1651532115.726298:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2872
00000100:00100000:0.0:1651532115.726300:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468282560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.726303:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.726306:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40e222 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f83 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.726313:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40e222 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f83 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.726327:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40e222 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f83 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.726331:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532115.726341:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468282560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.726346:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2872
00000100:00100000:0.0:1651532115.726551:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.726558:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468282688
00000100:00100000:0.0:1651532115.726564:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2873
00000100:00100000:0.0:1651532115.726566:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468282688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.726569:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.726572:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e229 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f8a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.726579:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e229 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f8a expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.726583:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e229 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f8a expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.726586:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532115.726595:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468282688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (44us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.726597:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2873
00000001:00080000:1.0:1651532115.849015:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793658 is committed
00010000:00010000:1.0:1651532115.849037:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.849041:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849046:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849051:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.849060:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468276224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 606353us (606493us total) trans 158913793657 rc 0/0
00000100:00100000:1.0:1651532115.849063:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3992
00010000:00010000:1.0:1651532115.849070:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.849073:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468277312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474425us (474536us total) trans 158913793658 rc 0/0
00010000:00010000:1.0:1651532115.849074:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532115.849075:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.849077:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3994
00010000:00010000:1.0:1651532115.849078:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.849084:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849084:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.849086:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e0cb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9785344->9789439] (req 9785344->9789439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849088:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532115.849089:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849092:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849097:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.849098:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532115.849098:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849101:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849108:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849111:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e111 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2875392->5185535] (req 2875392->5185535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849116:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849119:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.849514:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.849526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.849536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.849539:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468282816
00000100:00100000:0.0:1651532115.849542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532115.849553:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468282880
00000100:00100000:1.0:1651532115.849562:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4002
00000100:00100000:1.0:1651532115.849564:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468282816:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532115.849565:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532115.849576:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.849577:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4003
00000100:00100000:0.0:1651532115.849579:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468282880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532115.849581:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532115.849582:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.849585:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532115.849586:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849588:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849601:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.849603:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849605:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532115.849606:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.849610:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849611:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.849614:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849614:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532115.849622:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468283008
00000100:00100000:0.0:1651532115.849623:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468282944
00000100:00100000:1.0:1651532115.849628:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468283072
00000100:00100000:0.0:1651532115.849629:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2874
00000100:00100000:0.0:1651532115.849631:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468283008:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532115.849632:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2875
00000100:00100000:1.0:1651532115.849633:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468282944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.849634:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.849636:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.849636:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40e23e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f98 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.849639:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e245 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f91 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849643:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40e23e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f98 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.849646:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e245 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f91 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.849648:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40e23e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f98 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.849650:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e245 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f91 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.849651:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:1.0:1651532115.849653:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:0.0:1651532115.849665:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468283008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.849668:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2874
00000100:00100000:1.0:1651532115.849670:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468282944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (127us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.849673:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2875
00000100:00100000:0.0:1651532115.849675:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2876
00000100:00100000:0.0:1651532115.849677:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468283072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.849679:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.849682:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e24c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448f9f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849687:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e24c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f9f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.849691:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e24c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448f9f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.849705:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532115.849714:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468283072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (150us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.849717:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2876
00000100:00100000:1.0:1651532115.849961:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.849972:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468283200
00000100:00100000:0.0:1651532115.849981:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2877
00000100:00100000:0.0:1651532115.849982:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468283200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.849986:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.849989:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e253 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fa6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.849996:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e253 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fa6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.850000:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e253 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fa6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.850004:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532115.850014:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468283200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.850016:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2877
00000001:00080000:1.0:1651532115.949035:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793659 is committed
00010000:00010000:0.0:1651532115.949072:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949077:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.949104:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468278912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432314us (432355us total) trans 158913793659 rc 0/0
00010000:00010000:1.0:1651532115.949107:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.949107:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3995
00010000:00010000:1.0:1651532115.949112:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532115.949113:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949116:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949122:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.949122:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.949123:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949126:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949134:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949137:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f40e150 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [720896->7946239] (req 720896->7946239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949142:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949146:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949348:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949353:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.949372:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468278976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 432467us (432612us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532115.949373:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.949375:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3996
00010000:00010000:1.0:1651532115.949377:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532115.949378:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949384:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949389:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.949390:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532115.949391:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949394:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949416:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949420:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e165 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3489792->10276863] (req 3489792->10276863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949426:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949428:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.949437:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.949445:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.949454:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468283456
00000100:00100000:0.0:1651532115.949467:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2878
00000100:00100000:0.0:1651532115.949469:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468283456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.949472:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.949476:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e25a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fad expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949521:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e25a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fad expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.949525:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f40e25a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fad expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.949529:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532115.949538:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468283456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.949540:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2878
00000100:00100000:0.0:1651532115.949549:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468283392
00000100:00100000:0.0:1651532115.949557:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4004
00000100:00100000:0.0:1651532115.949559:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468283392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532115.949565:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949569:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.949570:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532115.949570:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949574:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.949588:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.949602:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.949624:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468283584
00000100:00100000:0.0:1651532115.949633:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468283520
00000100:00100000:1.0:1651532115.949651:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2879
00000100:00100000:1.0:1651532115.949654:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468283584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532115.949657:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532115.949662:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e268 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fbb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.949667:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2880
00000100:00100000:0.0:1651532115.949669:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468283520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.949672:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.949676:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40e26f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fb4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532115.949682:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e268 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fbb expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.949684:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40e26f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fb4 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.949686:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e268 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fbb expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.949688:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f40e26f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fb4 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532115.949690:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00010000:00010000:0.0:1651532115.949691:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532115.949699:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468283520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.949702:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2880
00000100:00100000:1.0:1651532115.949703:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468283584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532115.949708:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2879
00000100:00100000:0.0:1651532115.949764:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.949780:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.949851:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468283776
00000100:00100000:0.0:1651532115.949864:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4005
00000100:00100000:0.0:1651532115.949865:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edc3418e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468283776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532115.949872:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949876:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532115.949878:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949881:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949883:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532115.949884:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949889:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949891:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949910:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532115.949934:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468283712
00000100:00100000:0.0:1651532115.949941:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2881
00000100:00100000:0.0:1651532115.949943:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468283712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.949946:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.949949:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e27d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fc2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.949955:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e27d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fc2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.949962:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f40e27d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fc2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.949966:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532115.949974:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468283712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (194us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.949976:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2881
00000100:00100000:0.0:1651532115.949991:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.950018:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468283904
00000100:00100000:0.0:1651532115.950025:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2882
00000100:00100000:0.0:1651532115.950027:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468283904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.950030:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.950033:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e284 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fc9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.950040:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e284 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fc9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.950044:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f40e284 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fc9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.950047:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532115.950055:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468283904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.950060:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2882
00000100:00100000:0.0:1651532115.950325:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.950333:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468284224
00000100:00100000:0.0:1651532115.950339:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2883
00000100:00100000:0.0:1651532115.950341:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468284224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.950344:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.950348:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40e28b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fd0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.950355:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40e28b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fd0 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.950359:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f40e28b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fd0 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.950362:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532115.950371:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468284224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.950374:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2883
00000100:00100000:0.0:1651532115.950611:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.950618:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468284352
00000100:00100000:0.0:1651532115.950625:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2884
00000100:00100000:0.0:1651532115.950626:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468284352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.950629:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.950633:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e292 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fd7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.950640:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e292 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fd7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.950644:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f40e292 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fd7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.950647:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532115.950656:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468284352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (45us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.950658:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2884
00000100:00100000:0.0:1651532115.950893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.950900:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468284480
00000100:00100000:0.0:1651532115.950906:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2885
00000100:00100000:0.0:1651532115.950908:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020d04d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468284480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.950911:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.950914:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e299 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fde expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.950921:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e299 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fde expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.950925:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f40e299 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fde expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.950928:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532115.950948:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020d04d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468284480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.950951:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2885
00000100:00100000:0.0:1651532115.951185:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532115.951192:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468284608
00000100:00100000:0.0:1651532115.951198:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2886
00000100:00100000:0.0:1651532115.951200:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468284608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532115.951203:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532115.951207:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e2a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fe5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532115.951214:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e2a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fe5 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.951218:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e2a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fe5 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532115.951221:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532115.951230:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468284608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532115.951233:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2886
00000001:00080000:1.0:1651532116.076560:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793660 is committed
00010000:00010000:1.0:1651532116.076577:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.076582:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.076609:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468280064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 468101us (468139us total) trans 158913793660 rc 0/0
00010000:00010000:0.0:1651532116.076611:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.076613:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3997
00010000:00010000:0.0:1651532116.076615:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532116.076616:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.076630:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.076636:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.076636:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.076637:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.076640:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.076648:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.076651:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e18f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->10244095] (req 1609728->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.076657:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.076659:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.077110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.077134:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.077143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.077155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.077163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.077167:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468284928
00000100:00100000:1.0:1651532116.077178:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468284736
00000100:00100000:0.0:1651532116.077182:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468285120
00000100:00100000:0.0:1651532116.077185:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468285248
00000100:00100000:0.0:1651532116.077189:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2887
00000100:00100000:0.0:1651532116.077190:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468284928:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532116.077197:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468284800
00010000:00010000:0.0:1651532116.077199:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532116.077206:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4006
00010000:00010000:0.0:1651532116.077207:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e2a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448fec expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.077208:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468284736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532116.077213:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.077215:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.077216:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e2a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fec expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.077221:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.077222:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077225:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532116.077225:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.077229:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e2a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448fec expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.077230:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077233:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.077233:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532116.077241:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4007
00000100:00100000:1.0:1651532116.077243:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468284800:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532116.077244:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468284928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.077246:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2887
00010000:00010000:1.0:1651532116.077247:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077251:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532116.077251:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2888
00010000:00010000:1.0:1651532116.077252:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.077253:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468285120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.077255:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.077257:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532116.077258:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.077258:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e2bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ff3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077261:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.077263:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.077264:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.077265:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e2bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ff3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.077268:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e2bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ff3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532116.077271:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2889
00000100:00100000:1.0:1651532116.077273:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468285248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.077274:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532116.077275:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.077278:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e2c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db448ffa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.077279:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468285120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.077282:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2888
00010000:00010000:1.0:1651532116.077283:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.077285:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e2c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ffa expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.077290:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e2c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db448ffa expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.077292:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077293:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00010000:00010000:0.0:1651532116.077296:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.077310:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468285248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (139us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.077311:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468280128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 468795us (468831us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532116.077323:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3998
00000100:00100000:1.0:1651532116.077335:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2889
00010000:00010000:1.0:1651532116.077344:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077347:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.077348:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077351:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077377:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.077378:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.077379:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077388:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077396:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077399:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f40e196 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4890624->9449471] (req 4890624->9449471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077405:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.077408:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.077765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.077778:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.077784:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468285440
00000100:00100000:1.0:1651532116.077786:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.077796:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468285632
00000100:00100000:0.0:1651532116.077799:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468285504
00000100:00100000:0.0:1651532116.077812:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2890
00000100:00100000:0.0:1651532116.077815:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468285440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.077818:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.077822:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e2ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449008 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.077829:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e2ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449008 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.077833:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e2ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449008 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.077837:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532116.077846:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468285440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.077849:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2890
00000100:00100000:0.0:1651532116.077854:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2891
00000100:00100000:0.0:1651532116.077855:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468285632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.077858:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.077860:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44900f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.077863:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2892
00010000:00010000:0.0:1651532116.077865:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44900f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532116.077866:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468285504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.077869:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.077869:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44900f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.077872:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532116.077873:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e2d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449001 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.077877:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468285632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.077879:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2891
00010000:00010000:1.0:1651532116.077881:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e2d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449001 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.077886:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e2d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449001 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.077889:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532116.077898:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468285504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.077901:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2892
00000100:00100000:1.0:1651532116.078167:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.078175:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468285824
00000100:00100000:1.0:1651532116.078187:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2893
00000100:00100000:1.0:1651532116.078189:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468285824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.078192:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.078196:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449016 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.078203:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449016 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.078207:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449016 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.078210:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532116.078222:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468285824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.078225:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2893
00000001:00080000:1.0:1651532116.182865:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793661 is committed
00010000:00010000:1.0:1651532116.182880:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.182884:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.182901:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468281152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457830us (457906us total) trans 158913793661 rc 0/0
00000100:00100000:1.0:1651532116.182905:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3999
00010000:00010000:1.0:1651532116.182911:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.182914:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.182916:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.182919:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.182924:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.182925:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.182926:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.182929:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.182942:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.182945:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e1ce lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3538944->9588735] (req 3538944->9588735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.182954:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.182959:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.183251:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.183260:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.183279:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468286144
00000100:00100000:0.0:1651532116.183282:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468286208
00000100:00100000:1.0:1651532116.183293:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4008
00000100:00100000:1.0:1651532116.183295:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468286144:12345-10.240.43.64@tcp:4:fio.
00000100:00100000:0.0:1651532116.183299:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4009
00000100:00100000:0.0:1651532116.183301:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468286208:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532116.183302:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.183306:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.183307:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183308:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.183313:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532116.183324:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183329:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.183330:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183333:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532116.183334:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.183338:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183339:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.183342:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183342:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183356:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183359:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.183375:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468281216:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458290us (458362us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532116.183386:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4000
00010000:00010000:0.0:1651532116.183393:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183397:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532116.183398:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183401:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183406:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.183406:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.183407:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183410:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183417:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183419:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f40e1d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8925183] (req 2543616->8925183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183424:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.183427:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.183757:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.183768:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468286528
00000100:00100000:1.0:1651532116.183779:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2894
00000100:00100000:1.0:1651532116.183781:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468286528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.183785:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.183788:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e2f4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44901d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.183796:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e2f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44901d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.183800:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e2f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44901d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.183815:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532116.183827:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468286528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.183831:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2894
00000001:00080000:1.0:1651532116.265812:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793662 is committed
00010000:00010000:0.0:1651532116.265842:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.265847:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.265868:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468281536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 540733us (540817us total) trans 158913793662 rc 0/0
00010000:00010000:1.0:1651532116.265870:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.265872:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4001
00010000:00010000:1.0:1651532116.265874:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.265875:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.265879:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.265884:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.265885:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.265886:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.265889:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.265896:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.265899:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f40e1dc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1196032->6086655] (req 1196032->6086655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.265903:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.265907:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.266210:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.266221:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.266229:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468286848
00000100:00100000:1.0:1651532116.266231:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.266238:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468286912
00000100:00100000:0.0:1651532116.266244:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468286784
00000100:00100000:0.0:1651532116.266251:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4010
00000100:00100000:1.0:1651532116.266255:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2895
00000100:00100000:1.0:1651532116.266257:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468286912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532116.266258:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468286848:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532116.266261:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.266265:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e2fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449024 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.266273:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e2fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449024 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.266274:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.266277:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e2fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449024 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.266279:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.266280:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532116.266280:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.266286:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.266293:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468286912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.266296:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2895
00000100:00100000:0.0:1651532116.266301:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4011
00000100:00100000:0.0:1651532116.266302:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468286784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532116.266307:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.266311:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532116.266312:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.266325:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.266328:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532116.266328:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.266333:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.266336:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.266339:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.266624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.266631:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468287040
00000100:00100000:1.0:1651532116.266638:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2896
00000100:00100000:1.0:1651532116.266640:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468287040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.266643:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.266646:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e310 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44902b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.266654:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e310 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44902b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.266658:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e310 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44902b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.266662:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532116.266677:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468287040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.266680:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2896
00000001:00080000:1.0:1651532116.332506:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793663 is committed
00010000:00010000:0.0:1651532116.332536:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.332540:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.332560:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468282816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482996us (483047us total) trans 158913793663 rc 0/0
00010000:00010000:1.0:1651532116.332564:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.332564:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4002
00010000:00010000:1.0:1651532116.332569:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.332570:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.332574:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.332579:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.332580:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.332581:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.332584:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.332587:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.332588:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.332588:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.332591:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.332614:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.332618:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e230 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5591040->6176767] (req 5591040->6176767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.332620:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.332625:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.332628:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.332631:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.332942:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.332960:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468287296
00000100:00100000:0.0:1651532116.332961:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.332982:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468287232
00010000:00010000:0.0:1651532116.332986:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.332990:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2897
00000100:00100000:1.0:1651532116.332992:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468287296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.332994:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.332995:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.332999:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e317 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449039 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333004:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.333007:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e317 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449039 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532116.333009:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468283392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 383449us (383572us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532116.333012:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4004
00010000:00010000:1.0:1651532116.333014:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e317 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449039 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.333018:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532116.333026:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468287296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.333029:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2898
00000100:00100000:1.0:1651532116.333031:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2897
00000100:00100000:0.0:1651532116.333031:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468287232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.333034:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.333038:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e31e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449032 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333044:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333047:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333051:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.333054:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e31e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449032 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.333058:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e31e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449032 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532116.333059:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468282880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483479us (483533us total) trans 0 rc 49152/49152
00000100:00100000:1.0:1651532116.333061:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4003
00010000:00010000:0.0:1651532116.333062:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532116.333067:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.333069:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468287232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (108us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532116.333070:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.333071:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.333072:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2898
00010000:00010000:1.0:1651532116.333074:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333079:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333082:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333082:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532116.333083:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333085:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f40e261 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4001792->10461183] (req 4001792->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333086:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333091:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.333099:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.333100:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333103:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333111:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333114:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f40e237 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1032192->8835071] (req 1032192->8835071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333119:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333122:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.333674:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.333685:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.333686:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468287552
00000100:00100000:0.0:1651532116.333693:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.333702:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468287616
00000100:00100000:0.0:1651532116.333707:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4012
00000100:00100000:1.0:1651532116.333709:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4013
00000100:00100000:0.0:1651532116.333709:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468287552:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532116.333711:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468287616:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532116.333717:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333717:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333721:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.333722:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333726:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532116.333726:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333731:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.333732:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333735:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532116.333735:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333739:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333740:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333743:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.333743:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.333751:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468287744
00000100:00100000:1.0:1651532116.333757:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2899
00000100:00100000:1.0:1651532116.333759:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468287744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.333762:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.333764:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e333 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449040 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333771:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e333 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449040 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.333775:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e333 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449040 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.333778:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532116.333792:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468287744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.333795:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2899
00000100:00100000:0.0:1651532116.333823:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.333831:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468287936
00000100:00100000:1.0:1651532116.333838:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2900
00000100:00100000:1.0:1651532116.333839:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468287936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.333842:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.333845:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e33a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449047 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.333861:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e33a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449047 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.333865:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e33a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449047 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.333869:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532116.333884:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468287936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.333886:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2900
00000100:00100000:0.0:1651532116.334180:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.334197:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468288192
00000100:00100000:1.0:1651532116.334204:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2901
00000100:00100000:1.0:1651532116.334206:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468288192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.334209:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.334212:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e341 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44904e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.334219:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e341 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44904e expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.334222:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e341 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44904e expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.334226:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532116.334238:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468288192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.334241:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2901
00000001:00080000:1.0:1651532116.374477:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793664 is committed
00010000:00010000:0.0:1651532116.374506:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.374511:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.374529:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.374531:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edc3418e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468283776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 424665us (424767us total) trans 158913793664 rc 0/0
00000100:00100000:0.0:1651532116.374534:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4005
00010000:00010000:1.0:1651532116.374537:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.374538:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.374541:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.374547:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.374547:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.374548:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.374551:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.374558:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.374561:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f40e276 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7663616->7667711] (req 7663616->7667711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.374565:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.374569:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.374859:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.374878:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.374888:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468288448
00000100:00100000:0.0:1651532116.374889:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468288384
00000100:00100000:1.0:1651532116.374902:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4014
00000100:00100000:1.0:1651532116.374909:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468288448:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532116.374911:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4015
00000100:00100000:0.0:1651532116.374913:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468288384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532116.374915:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.374921:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.374922:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.374923:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532116.374924:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.374930:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532116.374931:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.374934:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.374937:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532116.374937:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.374940:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.374942:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.374944:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.374948:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532116.467252:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793665 is committed
00010000:00010000:0.0:1651532116.467282:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467287:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.467308:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.467309:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468284736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 390100us (390199us total) trans 158913793665 rc 0/0
00010000:00010000:1.0:1651532116.467312:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532116.467312:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4006
00010000:00010000:1.0:1651532116.467314:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.467325:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.467331:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.467331:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.467332:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.467335:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.467343:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.467346:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e2ae lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->9838591] (req 888832->9838591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467354:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467357:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467567:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467571:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.467586:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468284800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 390342us (390458us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532116.467589:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4007
00010000:00010000:0.0:1651532116.467595:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467609:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532116.467610:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467613:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467619:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.467619:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.467620:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467623:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467634:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467638:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e2b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->10330111] (req 1949696->10330111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.467642:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.467646:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.467686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.467696:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468288576
00000100:00100000:1.0:1651532116.467704:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2902
00000100:00100000:1.0:1651532116.467706:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468288576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.467716:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.467720:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e356 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449055 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.467727:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e356 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449055 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.467732:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e356 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449055 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.467735:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532116.467750:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468288576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.467753:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2902
00000100:00100000:0.0:1651532116.467876:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.467884:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468288768
00000100:00100000:0.0:1651532116.467895:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4016
00000100:00100000:0.0:1651532116.467897:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468288768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532116.467904:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467908:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532116.467909:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467912:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532116.467913:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467917:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.467920:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.468002:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.468011:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468288896
00000100:00100000:0.0:1651532116.468012:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.468023:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468288960
00000100:00100000:0.0:1651532116.468027:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2903
00000100:00100000:0.0:1651532116.468029:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468288896:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532116.468030:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2904
00000100:00100000:1.0:1651532116.468032:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468288960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.468033:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.468035:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.468037:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e364 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44905c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.468039:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e36b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449063 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.468044:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e364 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44905c expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.468047:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e36b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449063 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.468049:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e364 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44905c expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.468051:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e36b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449063 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.468054:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00010000:00010000:0.0:1651532116.468055:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532116.468067:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468288960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.468070:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2904
00000100:00100000:0.0:1651532116.468072:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468288896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.468075:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2903
00000100:00100000:0.0:1651532116.468313:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.468330:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468289216
00000100:00100000:0.0:1651532116.468337:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2905
00000100:00100000:0.0:1651532116.468339:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468289216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.468342:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.468346:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e372 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44906a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.468353:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e372 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44906a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.468357:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e372 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44906a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.468360:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532116.468370:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468289216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.468372:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2905
00000100:00100000:0.0:1651532116.468613:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.468620:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468289408
00000100:00100000:0.0:1651532116.468626:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2906
00000100:00100000:0.0:1651532116.468628:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468289408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.468631:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.468635:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e379 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449071 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.468642:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e379 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449071 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.468646:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e379 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449071 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.468649:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532116.468658:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468289408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.468660:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2906
00000100:00100000:0.0:1651532116.468900:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.468907:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468289600
00000100:00100000:0.0:1651532116.468913:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2907
00000100:00100000:0.0:1651532116.468915:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468289600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.468918:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.468921:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e380 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449078 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.468928:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e380 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449078 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.468935:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e380 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449078 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.468938:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532116.468947:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468289600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.468949:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2907
00000001:00080000:1.0:1651532116.575601:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793666 is committed
00010000:00010000:1.0:1651532116.575617:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575621:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.575643:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468286144:12345-10.240.43.64@tcp:4:fio. Request processed in 392347us (392392us total) trans 158913793666 rc 0/0
00000100:00100000:1.0:1651532116.575648:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4008
00010000:00010000:1.0:1651532116.575656:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575659:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.575660:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575663:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575668:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.575669:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.575670:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575673:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575685:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.575685:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.575686:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575689:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575701:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575714:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e2e6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->10358783] (req 462848->10358783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.575714:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.575719:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575724:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575727:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575741:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575745:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.575759:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468286848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 309500us (309549us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532116.575761:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4010
00010000:00010000:1.0:1651532116.575768:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575771:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.575772:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575775:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575826:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.575830:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e302 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6696960->6701055] (req 6696960->6701055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.576047:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.576060:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.576072:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468289792
00010000:00010000:0.0:1651532116.576077:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.576081:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.576086:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468289856
00000100:00100000:1.0:1651532116.576093:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4017
00000100:00100000:1.0:1651532116.576094:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468289792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532116.576101:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576122:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.576123:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576126:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532116.576126:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.576126:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468286208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 392824us (392865us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532116.576130:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4009
00010000:00010000:1.0:1651532116.576131:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576134:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.576135:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4018
00000100:00100000:0.0:1651532116.576137:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468289856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532116.576144:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576146:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.576148:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532116.576149:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.576152:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532116.576153:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576156:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.576157:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.576158:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576160:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.576161:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576165:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.576165:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.576166:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576169:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576178:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576181:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e2ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->8593407] (req 45056->8593407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576190:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.576190:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532116.576193:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.576218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.576229:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468290048
00000100:00100000:0.0:1651532116.576243:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468289984
00000100:00100000:1.0:1651532116.576244:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2908
00000100:00100000:1.0:1651532116.576246:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468290048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.576249:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532116.576254:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2909
00000100:00100000:0.0:1651532116.576256:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468289984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.576257:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e395 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449086 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.576259:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.576262:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e39c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44907f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576265:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e395 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449086 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.576270:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e395 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449086 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.576270:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e39c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44907f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.576273:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00010000:00010000:0.0:1651532116.576277:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e39c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44907f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.576281:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532116.576287:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468290048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.576290:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2908
00000100:00100000:0.0:1651532116.576309:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468289984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.576312:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2909
00000100:00100000:0.0:1651532116.576540:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.576550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.576552:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468290304
00000100:00100000:0.0:1651532116.576558:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.576567:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468290432
00000100:00100000:1.0:1651532116.576571:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4019
00000100:00100000:0.0:1651532116.576575:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468290496
00000100:00100000:1.0:1651532116.576578:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468290304:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532116.576581:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2910
00000100:00100000:0.0:1651532116.576583:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468290432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.576587:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.576590:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e3a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44908d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.576597:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e3a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44908d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.576601:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e3a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44908d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.576605:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532116.576606:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576611:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.576612:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576615:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:0.0:1651532116.576615:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468290432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.576617:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2910
00000100:00100000:0.0:1651532116.576622:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2911
00000100:00100000:0.0:1651532116.576623:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468290496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.576624:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.576626:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.576628:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e3b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449094 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576629:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576633:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.576634:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e3b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449094 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.576637:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e3b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449094 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.576641:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532116.576645:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468290496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.576647:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2911
00000100:00100000:0.0:1651532116.576698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.576706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.576715:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468290624
00000100:00100000:0.0:1651532116.576716:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468290752
00000100:00100000:1.0:1651532116.576728:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2912
00000100:00100000:1.0:1651532116.576730:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468290624:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532116.576730:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2913
00000100:00100000:0.0:1651532116.576732:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468290752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.576733:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.576735:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.576736:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44909b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.576738:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e3bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490a2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.576744:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44909b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.576748:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44909b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.576751:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532116.576753:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e3bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490a2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.576757:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e3bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490a2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.576761:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532116.576766:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468290624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.576769:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2912
00000100:00100000:0.0:1651532116.576775:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468290752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.576778:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2913
00000100:00100000:0.0:1651532116.577025:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.577032:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468291008
00000100:00100000:0.0:1651532116.577046:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2914
00000100:00100000:0.0:1651532116.577048:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468291008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.577051:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.577054:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e3c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490a9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.577062:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e3c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490a9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.577065:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e3c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490a9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.577069:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532116.577078:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468291008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.577081:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2914
00000100:00100000:0.0:1651532116.577288:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.577295:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468291328
00000100:00100000:0.0:1651532116.577309:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2915
00000100:00100000:0.0:1651532116.577311:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468291328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.577314:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.577325:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e3cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490b0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.577338:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e3cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490b0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.577342:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e3cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490b0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.577345:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532116.577355:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468291328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.577357:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2915
00000100:00100000:1.0:1651532116.668875:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1651532116.668882:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006efc17ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966863552:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651532116.669140:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006efc17ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966863552:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:1.0:1651532116.708935:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793667 is committed
00010000:00010000:1.0:1651532116.708950:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.708954:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.708977:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468286784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 442673us (442755us total) trans 158913793667 rc 0/0
00000100:00100000:1.0:1651532116.708980:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4011
00010000:00010000:1.0:1651532116.708987:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.708991:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.708992:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.708995:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.709000:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.709000:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.709001:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.709004:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.709033:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.709036:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e309 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->9969663] (req 196608->9969663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.709041:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.709046:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.709426:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.709436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.709445:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.709448:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468291584
00000100:00100000:0.0:1651532116.709452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.709460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.709468:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468291520
00000100:00100000:1.0:1651532116.709474:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4020
00000100:00100000:1.0:1651532116.709476:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468291584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532116.709483:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.709487:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.709488:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.709491:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532116.709492:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.709496:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.709499:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.709507:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4021
00000100:00100000:1.0:1651532116.709517:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468291520:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532116.709520:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468291648
00010000:00010000:1.0:1651532116.709522:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.709526:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.709526:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.709531:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468291712
00000100:00100000:0.0:1651532116.709533:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468291840
00010000:00010000:1.0:1651532116.709535:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532116.709536:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.709537:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2916
00000100:00100000:0.0:1651532116.709539:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468291648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.709540:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.709542:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.709543:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.709546:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e3e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490b7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.709554:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e3e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490b7 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532116.709561:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2917
00000100:00100000:1.0:1651532116.709563:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468291712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.709566:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.709569:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e3e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490be expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.709569:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e3e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490b7 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.709573:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532116.709576:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e3e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490be expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.709580:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e3e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490be expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532116.709584:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468291648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (139us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.709587:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2916
00010000:00010000:1.0:1651532116.709590:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:0.0:1651532116.709592:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2918
00000100:00100000:0.0:1651532116.709594:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468291840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.709597:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.709599:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e3f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490c5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.709600:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468291712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (148us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.709603:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2917
00010000:00010000:0.0:1651532116.709606:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e3f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490c5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.709609:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e3f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490c5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.709612:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532116.709618:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468291840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (157us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.709620:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2918
00000100:00100000:0.0:1651532116.709884:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.709891:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468291968
00000100:00100000:0.0:1651532116.709905:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2919
00000100:00100000:0.0:1651532116.709906:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468291968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.709910:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.709913:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e3f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490cc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.709920:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e3f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490cc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.709924:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e3f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490cc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.709936:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532116.709947:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468291968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.709950:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2919
00000100:00100000:0.0:1651532116.710201:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.710208:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468292160
00000100:00100000:0.0:1651532116.710222:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2920
00000100:00100000:0.0:1651532116.710224:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468292160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.710227:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.710230:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e3fe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490d3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.710238:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e3fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490d3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.710241:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e3fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490d3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.710245:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532116.710254:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468292160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.710257:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2920
00000001:00080000:1.0:1651532116.821439:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793668 is committed
00010000:00010000:0.0:1651532116.821478:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.821492:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.821514:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c433569 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468287552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 487804us (487840us total) trans 158913793668 rc 0/0
00010000:00010000:1.0:1651532116.821515:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.821517:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4012
00010000:00010000:1.0:1651532116.821519:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.821520:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821523:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821529:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.821530:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.821530:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821533:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821537:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.821537:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.821538:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821557:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821566:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821569:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e325 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->7491583] (req 790528->7491583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821575:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821578:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821606:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821610:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821881:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821885:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.821905:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468288448:12345-10.240.43.64@tcp:3:fio.0 Request processed in 446996us (447058us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532116.821915:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4014
00010000:00010000:1.0:1651532116.821933:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821942:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.821944:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821947:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821952:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821955:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e348 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->7716863] (req 200704->7716863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821964:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.821967:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.821985:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b1bc2e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468287616:12345-10.240.43.64@tcp:3:fio.0 Request processed in 488273us (488300us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532116.821988:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4013
00010000:00010000:1.0:1651532116.821994:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822003:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532116.822011:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822014:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822019:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.822019:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.822020:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822023:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822032:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822035:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e32c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3244032->10358783] (req 3244032->10358783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.822039:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.822044:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.822158:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.822167:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468292608
00000100:00100000:1.0:1651532116.822177:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4022
00000100:00100000:1.0:1651532116.822179:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c031ba3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468292608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532116.822192:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822199:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.822200:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822203:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532116.822204:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822208:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822211:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.822263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.822272:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468292480
00000100:00100000:0.0:1651532116.822274:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.822284:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4023
00000100:00100000:1.0:1651532116.822286:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afa5d0ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468292480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532116.822291:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822295:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.822296:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822299:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532116.822299:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822306:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822309:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.822332:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468292672
00000100:00100000:1.0:1651532116.822339:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2921
00000100:00100000:1.0:1651532116.822340:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c48da76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468292672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.822343:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.822346:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e413 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490da expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822353:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e413 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490da expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.822358:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e413 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490da expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.822361:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532116.822369:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c48da76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468292672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.822372:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2921
00000100:00100000:0.0:1651532116.822397:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.822409:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468292800
00000100:00100000:1.0:1651532116.822415:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2922
00000100:00100000:1.0:1651532116.822416:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468292800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.822427:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532116.822427:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532116.822430:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e41a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490e1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.822437:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532116.822456:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e41a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490e1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.822460:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e41a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490e1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.822463:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532116.822475:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468292800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.822478:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2922
00000100:00100000:1.0:1651532116.822483:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468292864
00000100:00100000:1.0:1651532116.822486:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468292928
00000100:00100000:1.0:1651532116.822489:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2923
00000100:00100000:1.0:1651532116.822491:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468292864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.822493:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.822496:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e421 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490e8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822510:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e421 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490e8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.822514:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e421 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490e8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.822518:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532116.822529:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468292864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.822531:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2923
00000100:00100000:1.0:1651532116.822536:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2924
00000100:00100000:1.0:1651532116.822537:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468292928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.822540:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.822542:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e428 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490ef expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822547:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e428 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490ef expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.822569:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e428 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490ef expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.822573:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532116.822582:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468292928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (145us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.822585:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2924
00000100:00100000:0.0:1651532116.822818:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.822828:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468293184
00000100:00100000:1.0:1651532116.822836:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2925
00000100:00100000:1.0:1651532116.822837:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468293184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.822841:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.822844:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e42f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490f6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.822851:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e42f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490f6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.822854:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e42f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490f6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.822858:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532116.822870:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468293184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.822873:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2925
00000001:00080000:1.0:1651532116.908992:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793669 is committed
00010000:00010000:0.0:1651532116.909023:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.909028:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.909049:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468288384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 534135us (534171us total) trans 158913793669 rc 0/0
00010000:00010000:1.0:1651532116.909050:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909054:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532116.909054:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4015
00010000:00010000:1.0:1651532116.909055:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909058:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909064:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.909064:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532116.909065:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909078:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.909094:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909096:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909099:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e34f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9351167] (req 126976->9351167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.909099:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.909433:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.909440:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.909452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.909461:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468293504
00000100:00100000:1.0:1651532116.909471:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468293376
00000100:00100000:1.0:1651532116.909477:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4024
00000100:00100000:1.0:1651532116.909479:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468293504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532116.909485:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909490:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.909491:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909493:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532116.909494:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909498:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909502:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.909518:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4025
00000100:00100000:1.0:1651532116.909520:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468293376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532116.909525:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909528:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532116.909529:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909531:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532116.909532:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909536:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909539:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.909539:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.909550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.909559:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468293632
00000100:00100000:0.0:1651532116.909559:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.909569:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468293696
00000100:00100000:1.0:1651532116.909572:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468293568
00000100:00100000:0.0:1651532116.909574:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468293760
00000100:00100000:1.0:1651532116.909575:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2926
00000100:00100000:1.0:1651532116.909576:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468293632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.909579:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532116.909581:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2927
00010000:00010000:1.0:1651532116.909582:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e444 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449104 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.909583:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468293696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.909587:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.909591:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e44b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44910b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.909601:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e444 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449104 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.909605:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e444 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449104 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.909608:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00010000:00010000:0.0:1651532116.909612:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e44b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44910b expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.909617:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e44b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44910b expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532116.909622:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754468293632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (169us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.909624:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2926
00010000:00010000:0.0:1651532116.909627:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532116.909630:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2928
00000100:00100000:1.0:1651532116.909631:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468293568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.909634:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.909636:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e452 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4490fd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.909636:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468293696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.909639:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2927
00010000:00010000:1.0:1651532116.909642:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e452 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490fd expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532116.909645:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2929
00010000:00010000:1.0:1651532116.909646:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e452 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4490fd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532116.909647:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468293760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.909649:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00010000:00010000:0.0:1651532116.909650:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.909652:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e459 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449112 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532116.909655:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468293568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.909658:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2928
00010000:00010000:0.0:1651532116.909658:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e459 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449112 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.909662:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e459 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449112 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.909665:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532116.909671:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468293760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (112us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.909673:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2929
00000100:00100000:0.0:1651532116.909983:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.909990:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468293952
00000100:00100000:0.0:1651532116.910004:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2930
00000100:00100000:0.0:1651532116.910006:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468293952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.910010:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.910013:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e460 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449119 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.910023:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e460 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449119 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.910027:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e460 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449119 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.910031:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532116.910041:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468293952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.910043:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2930
00000100:00100000:0.0:1651532116.910097:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.910105:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.910114:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468294080
00000100:00100000:1.0:1651532116.910121:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468294208
00000100:00100000:0.0:1651532116.910124:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532116.910125:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2931
00000100:00100000:1.0:1651532116.910127:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468294080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.910130:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532116.910131:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468294336
00010000:00010000:1.0:1651532116.910133:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e467 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449120 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532116.910137:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2932
00000100:00100000:0.0:1651532116.910138:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047d3441e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468294208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.910140:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e467 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449120 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.910142:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.910144:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e467 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449120 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.910145:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e46e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449127 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532116.910147:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00010000:00010000:0.0:1651532116.910153:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e46e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449127 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.910157:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e46e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449127 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532116.910161:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468294080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.910164:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2931
00000100:00100000:1.0:1651532116.910168:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2933
00000100:00100000:1.0:1651532116.910170:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468294336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532116.910173:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532116.910175:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e475 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44912e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.910177:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532116.910181:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e475 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44912e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532116.910185:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e475 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44912e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532116.910186:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047d3441e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468294208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (81us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532116.910188:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:0.0:1651532116.910188:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2932
00000100:00100000:1.0:1651532116.910194:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468294336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532116.910196:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2933
00000100:00100000:0.0:1651532116.910502:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.910509:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468294656
00000100:00100000:0.0:1651532116.910524:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2934
00000100:00100000:0.0:1651532116.910525:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468294656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.910529:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.910533:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e47c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449135 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.910540:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e47c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449135 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.910544:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e47c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449135 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.910547:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532116.910557:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468294656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.910559:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2934
00000100:00100000:0.0:1651532116.910777:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532116.910784:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468294784
00000100:00100000:0.0:1651532116.910798:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2935
00000100:00100000:0.0:1651532116.910820:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468294784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532116.910823:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532116.910827:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e483 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44913c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532116.910834:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e483 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44913c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.910837:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e483 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44913c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532116.910841:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532116.910850:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468294784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532116.910853:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2935
00000001:00080000:1.0:1651532117.009045:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793670 is committed
00002000:00010000:0.0:1651532117.009074:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532115 -> 1651532116
00002000:00010000:0.0:1651532117.009076:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532115 -> 1651532116
00010000:00010000:0.0:1651532117.009078:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.009082:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.009103:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468288768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541205us (541227us total) trans 158913793670 rc 0/0
00010000:00010000:1.0:1651532117.009105:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.009106:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4016
00010000:00010000:1.0:1651532117.009110:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.009111:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.009114:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.009119:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.009120:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.009121:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.009124:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.009131:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.009135:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e35d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->10051583] (req 40960->10051583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.009137:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.009141:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.009498:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.009505:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468295040
00000100:00100000:0.0:1651532117.009518:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2936
00000100:00100000:0.0:1651532117.009519:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468295040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.009523:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.009527:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e48a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449143 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.009535:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e48a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449143 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.009539:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e48a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449143 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.009542:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532117.009552:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468295040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.009555:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2936
00000001:00080000:1.0:1651532117.142374:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793671 is committed
00010000:00010000:0.0:1651532117.142403:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142408:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.142429:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468289792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566333us (566382us total) trans 158913793671 rc 0/0
00010000:00010000:1.0:1651532117.142431:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.142432:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4017
00010000:00010000:1.0:1651532117.142436:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.142437:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142441:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142446:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.142447:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.142448:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142451:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142460:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142469:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142471:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e387 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->9736191] (req 1011712->9736191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142474:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.142773:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.142781:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.142791:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468295232
00000100:00100000:0.0:1651532117.142820:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468295296
00000100:00100000:0.0:1651532117.142827:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4026
00000100:00100000:0.0:1651532117.142829:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468295232:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532117.142832:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4027
00000100:00100000:1.0:1651532117.142834:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468295296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532117.142837:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142841:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532117.142843:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142843:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142845:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532117.142846:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142851:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.142852:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142855:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532117.142856:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142859:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142860:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142863:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142871:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142883:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142886:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142906:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142910:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532117.142910:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468289856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566771us (566850us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532117.142911:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.142913:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4018
00010000:00010000:1.0:1651532117.142914:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142927:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.142927:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.142928:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142931:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142938:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142944:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.142948:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e38e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4587520->9162751] (req 4587520->9162751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.142948:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.143212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.143220:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468295616
00000100:00100000:0.0:1651532117.143234:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2937
00000100:00100000:0.0:1651532117.143236:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468295616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.143240:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.143244:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e49f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44914a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.143263:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e49f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44914a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.143267:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e49f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44914a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.143271:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532117.143297:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468295616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.143300:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2937
00000100:00100000:0.0:1651532117.143534:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.143541:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468295808
00000100:00100000:0.0:1651532117.143555:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2938
00000100:00100000:0.0:1651532117.143557:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468295808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.143560:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.143564:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449151 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.143571:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449151 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.143575:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449151 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.143579:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532117.143588:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468295808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.143591:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2938
00000001:00080000:1.0:1651532117.298387:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793672 is committed
00010000:00010000:0.0:1651532117.298424:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.298429:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.298454:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.298457:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468290304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 721882us (721917us total) trans 158913793672 rc 0/0
00010000:00010000:1.0:1651532117.298458:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.298459:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.298461:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4019
00010000:00010000:1.0:1651532117.298463:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.298469:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.298470:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.298471:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.298474:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.298483:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.298485:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e3aa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->10145791] (req 2764800->10145791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.298491:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.298494:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.298856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.298894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.298905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.298911:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.298927:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468296192
00000100:00100000:0.0:1651532117.298929:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468296064
00000100:00100000:1.0:1651532117.298937:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468296256
00000100:00100000:0.0:1651532117.298940:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468296000
00000100:00100000:1.0:1651532117.298942:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2939
00000100:00100000:1.0:1651532117.298944:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468296192:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532117.298949:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4028
00000100:00100000:0.0:1651532117.298950:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468296064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532117.298953:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.298958:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e4ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449158 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.298959:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.298964:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532117.298965:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.298970:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532117.298973:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.298975:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e4ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449158 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532117.298982:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4029
00010000:00010000:1.0:1651532117.298983:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e4ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449158 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532117.298983:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468296000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532117.298986:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00010000:00010000:0.0:1651532117.298988:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.298991:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532117.298992:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.298995:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.298999:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468296192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.299002:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2939
00010000:00010000:0.0:1651532117.299004:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532117.299005:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.299008:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2940
00000100:00100000:1.0:1651532117.299009:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468296256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.299009:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299012:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.299012:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299014:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e4c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44915f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.299016:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299019:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.299021:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e4c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44915f expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.299025:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e4c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44915f expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.299028:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532117.299033:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468296256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.299035:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2940
00010000:00010000:1.0:1651532117.299078:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299082:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.299101:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468291584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 589624us (589676us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532117.299104:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4020
00010000:00010000:1.0:1651532117.299111:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299114:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.299116:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299125:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299130:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.299131:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.299132:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299135:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299142:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299147:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e3d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->9842687] (req 294912->9842687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299153:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.299156:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.299292:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.299300:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468296384
00000100:00100000:0.0:1651532117.299308:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2941
00000100:00100000:0.0:1651532117.299309:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468296384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.299313:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.299341:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e4c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449166 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.299350:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e4c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449166 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.299354:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e4c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449166 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.299358:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532117.299368:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468296384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.299371:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2941
00000100:00100000:0.0:1651532117.299631:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.299639:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468296704
00000100:00100000:0.0:1651532117.299645:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2942
00000100:00100000:0.0:1651532117.299647:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468296704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.299650:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.299654:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e4d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44916d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.299661:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e4d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44916d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.299668:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e4d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44916d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.299671:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532117.299680:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468296704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.299683:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2942
00000100:00100000:0.0:1651532117.299910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.299917:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468297024
00000100:00100000:0.0:1651532117.299923:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2943
00000100:00100000:0.0:1651532117.299925:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468297024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.299928:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.299931:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449174 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.299938:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449174 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.299942:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449174 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.299945:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532117.299954:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468297024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (45us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.299958:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2943
00000001:00080000:1.0:1651532117.448333:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793673 is committed
00010000:00010000:1.0:1651532117.448350:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448355:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.448379:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468291520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 738861us (738942us total) trans 158913793673 rc 0/0
00000100:00100000:1.0:1651532117.448383:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4021
00010000:00010000:1.0:1651532117.448390:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448394:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.448395:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448398:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448404:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.448405:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.448406:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448409:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448426:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448429:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e3db lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->8675327] (req 778240->8675327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448435:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448437:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.448737:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.448764:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468297280
00000100:00100000:0.0:1651532117.448771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.448781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.448786:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468297152
00000100:00100000:1.0:1651532117.448799:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4030
00000100:00100000:1.0:1651532117.448801:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468297280:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532117.448813:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4031
00000100:00100000:0.0:1651532117.448815:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468297152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532117.448818:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448822:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.448824:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.448825:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448827:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532117.448827:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.448831:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532117.448833:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.448836:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532117.448836:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448840:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.448841:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448843:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.448845:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.448852:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468297216
00010000:00010000:1.0:1651532117.448855:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448859:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.448860:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2944
00000100:00100000:0.0:1651532117.448862:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468297216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.448865:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.448867:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e4ec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44917b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.448873:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532117.448877:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c031ba3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468292608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 626697us (626720us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532117.448880:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4022
00010000:00010000:0.0:1651532117.448882:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e4ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44917b expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.448887:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e4ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44917b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.448888:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.448890:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532117.448891:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.448892:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.448899:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468297216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.448902:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2944
00010000:00010000:1.0:1651532117.448905:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448910:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.448910:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.448911:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448914:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448921:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448924:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e405 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->7311359] (req 425984->7311359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448929:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.448932:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.449247:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.449255:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.449261:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468297600
00000100:00100000:0.0:1651532117.449272:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468297536
00000100:00100000:0.0:1651532117.449277:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2945
00000100:00100000:0.0:1651532117.449278:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468297600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.449282:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532117.449284:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2946
00010000:00010000:0.0:1651532117.449286:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e4f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449189 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.449287:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468297536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.449293:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.449294:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e4f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449189 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.449298:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e4fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449182 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.449298:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e4f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449189 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.449301:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532117.449311:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468297600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.449314:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2945
00010000:00010000:1.0:1651532117.449330:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e4fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449182 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.449335:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e4fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449182 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.449339:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532117.449364:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468297536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 76us (108us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.449367:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2946
00000100:00100000:0.0:1651532117.449591:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.449610:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468297792
00000100:00100000:0.0:1651532117.449615:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.449627:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468297856
00000100:00100000:1.0:1651532117.449636:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2947
00000100:00100000:1.0:1651532117.449637:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468297792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.449641:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532117.449641:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2948
00000100:00100000:0.0:1651532117.449643:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468297856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.449647:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.449650:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e508 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449197 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.449651:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e501 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449190 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.449658:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e508 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449197 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.449660:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e501 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449190 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.449662:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e508 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449197 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.449664:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e501 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449190 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.449665:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532117.449667:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:0.0:1651532117.449674:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468297856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.449676:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468297792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.449677:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2948
00000100:00100000:1.0:1651532117.449679:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2947
00000100:00100000:0.0:1651532117.449914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.449928:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.449932:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468298048
00000100:00100000:0.0:1651532117.449936:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468298112
00000100:00100000:1.0:1651532117.449947:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2949
00000100:00100000:1.0:1651532117.449949:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468298048:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532117.449949:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2950
00000100:00100000:0.0:1651532117.449951:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468298112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.449952:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.449955:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.449956:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e50f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44919e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.449958:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e516 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491a5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.449963:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e50f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44919e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.449966:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e516 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491a5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.449967:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e50f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44919e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.449970:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00010000:00010000:0.0:1651532117.449970:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e516 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491a5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.449973:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532117.449983:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468298048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.449986:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2949
00000100:00100000:0.0:1651532117.449988:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468298112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.449991:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2950
00000100:00100000:0.0:1651532117.450232:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.450239:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468298368
00000100:00100000:0.0:1651532117.450245:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2951
00000100:00100000:0.0:1651532117.450247:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468298368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.450250:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.450253:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e51d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491ac expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.450260:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e51d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491ac expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.450277:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e51d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491ac expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.450281:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532117.450291:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468298368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.450294:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2951
00000001:00080000:1.0:1651532117.515089:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793674 is committed
00010000:00010000:1.0:1651532117.515105:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515109:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.515135:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afa5d0ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468292480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 692848us (692872us total) trans 158913793674 rc 0/0
00000100:00100000:1.0:1651532117.515139:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4023
00010000:00010000:1.0:1651532117.515147:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515150:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.515151:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515154:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515159:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.515160:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.515161:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515164:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515182:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515185:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e40c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9764863] (req 593920->9764863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515191:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515203:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.515442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.515454:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.515471:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468298560
00000100:00100000:0.0:1651532117.515475:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468298624
00000100:00100000:1.0:1651532117.515483:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4032
00000100:00100000:0.0:1651532117.515489:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4033
00000100:00100000:1.0:1651532117.515490:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468298560:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532117.515491:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468298624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532117.515498:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.515499:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515502:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532117.515503:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515506:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532117.515507:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.515510:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532117.515511:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.515539:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532117.515540:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515544:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.515545:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515548:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.515559:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515560:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515564:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.515588:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.515592:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468293504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 606112us (606160us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532117.515595:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4024
00010000:00010000:1.0:1651532117.515602:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515606:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.515607:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515610:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515614:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532117.515619:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468298752
00010000:00010000:1.0:1651532117.515622:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.515623:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515627:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.515627:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2952
00000100:00100000:0.0:1651532117.515628:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468298752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.515631:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.515634:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.515635:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e532 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491b3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515637:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e436 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1355776->10174463] (req 1355776->10174463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.515643:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e532 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491b3 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.515647:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e532 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491b3 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.515650:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532117.515653:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.515656:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.515659:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468298752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.515662:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2952
00000100:00100000:0.0:1651532117.515998:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.516005:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468299072
00000100:00100000:0.0:1651532117.516012:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2953
00000100:00100000:0.0:1651532117.516014:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468299072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.516027:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.516031:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e539 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491ba expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.516038:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e539 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491ba expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.516042:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e539 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491ba expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.516045:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532117.516055:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468299072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.516058:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2953
00000100:00100000:0.0:1651532117.516288:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.516295:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468299200
00000100:00100000:0.0:1651532117.516302:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2954
00000100:00100000:0.0:1651532117.516303:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468299200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.516307:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.516310:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e540 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491c1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.516327:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e540 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491c1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.516331:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e540 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491c1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.516335:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532117.516346:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468299200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.516348:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2954
00000100:00100000:0.0:1651532117.516563:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.516569:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468299328
00000100:00100000:0.0:1651532117.516575:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2955
00000100:00100000:0.0:1651532117.516577:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468299328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.516580:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.516583:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e547 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491c8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.516590:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e547 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491c8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.516594:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e547 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491c8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.516597:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532117.516606:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468299328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (44us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.516609:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2955
00000001:00080000:1.0:1651532117.606793:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793675 is committed
00010000:00010000:1.0:1651532117.606823:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.606828:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.606854:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468293376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 697333us (697413us total) trans 158913793675 rc 0/0
00000100:00100000:1.0:1651532117.606858:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4025
00010000:00010000:1.0:1651532117.606867:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.606870:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.606871:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.606874:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.606880:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.606897:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.606899:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.606902:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.606915:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.606918:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e43d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5668864->5742591] (req 5668864->5742591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.606924:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.606932:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.607173:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.607184:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.607193:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468299456
00000100:00100000:0.0:1651532117.607193:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.607207:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468299520
00000100:00100000:1.0:1651532117.607214:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4034
00000100:00100000:1.0:1651532117.607216:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468299456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532117.607224:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.607230:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532117.607231:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.607234:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532117.607235:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.607240:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.607246:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.607254:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4035
00000100:00100000:1.0:1651532117.607256:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468299520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532117.607261:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.607262:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468299648
00010000:00010000:1.0:1651532117.607265:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532117.607266:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.607269:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532117.607269:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.607271:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2956
00010000:00010000:1.0:1651532117.607272:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.607273:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468299648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.607275:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.607277:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.607280:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e55c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491cf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.607288:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e55c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491cf expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.607293:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e55c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491cf expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.607296:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532117.607307:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468299648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.607309:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2956
00000001:00080000:1.0:1651532117.673477:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793676 is committed
00002000:00010000:0.0:1651532117.673502:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532116 -> 1651532117
00010000:00010000:0.0:1651532117.673506:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.673510:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.673532:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468295232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 530702us (530759us total) trans 158913793676 rc 0/0
00010000:00010000:1.0:1651532117.673534:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.673536:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4026
00010000:00010000:1.0:1651532117.673540:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.673541:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673545:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673551:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.673552:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.673553:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673556:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673559:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.673560:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.673560:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673563:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673584:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673587:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e491 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->10432511] (req 962560->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.673592:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673593:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.673596:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673600:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.673838:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.673842:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673854:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673858:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.673859:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673863:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673869:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.673871:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e4b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4870144->5214207] (req 4870144->5214207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.673873:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468296064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 374921us (375017us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532117.673876:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4028
00000100:00100000:0.0:1651532117.673890:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.673925:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532117.673933:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.673935:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468299840
00010000:00010000:1.0:1651532117.673937:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.673941:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468299776
00000100:00100000:0.0:1651532117.673948:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2957
00000100:00100000:0.0:1651532117.673950:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468299840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.673954:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.673958:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e563 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491dd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.673962:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468295296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 531127us (531180us total) trans 0 rc 45056/45056
00000100:00100000:1.0:1651532117.673968:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4027
00010000:00010000:0.0:1651532117.673969:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532117.673972:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e563 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491dd expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.673976:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e563 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491dd expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532117.673978:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2958
00000100:00100000:1.0:1651532117.673980:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468299776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.673980:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532117.673984:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.673988:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e56a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491d6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.673988:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468299840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.673990:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2957
00010000:00010000:1.0:1651532117.673993:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.673996:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e56a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491d6 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.674001:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e56a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491d6 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.674004:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532117.674011:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468299776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.674014:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2958
00010000:00010000:1.0:1651532117.674044:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.674053:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.674055:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.674058:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.674063:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.674063:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.674064:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.674067:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.674078:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.674080:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e498 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [921600->9609215] (req 921600->9609215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.674084:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.674088:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.674165:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.674175:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468299904
00000100:00100000:1.0:1651532117.674196:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4036
00000100:00100000:1.0:1651532117.674198:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468299904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532117.674204:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.674208:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532117.674209:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532117.674210:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.674213:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.674218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.674228:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468299968
00000100:00100000:0.0:1651532117.674229:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.674236:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4037
00000100:00100000:1.0:1651532117.674238:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468299968:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532117.674241:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468300096
00010000:00010000:1.0:1651532117.674244:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.674251:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2959
00000100:00100000:0.0:1651532117.674253:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468300096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.674254:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532117.674255:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532117.674256:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.674258:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.674259:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.674262:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e57f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491e4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.674286:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e57f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491e4 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.674291:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e57f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491e4 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.674295:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532117.674303:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468300096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.674305:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2959
00000100:00100000:0.0:1651532117.674468:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.674477:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.674490:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468300224
00000100:00100000:1.0:1651532117.674495:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468300288
00000100:00100000:0.0:1651532117.674498:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2960
00000100:00100000:0.0:1651532117.674500:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468300224:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532117.674507:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2961
00000100:00100000:1.0:1651532117.674509:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468300288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.674509:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.674512:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.674513:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e586 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491eb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.674515:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e58d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491f2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.674521:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e586 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491eb expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.674523:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e58d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491f2 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.674527:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e58d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491f2 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.674533:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532117.674542:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468300288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (66us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532117.674542:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e586 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491eb expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532117.674545:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2961
00010000:00010000:0.0:1651532117.674546:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532117.674555:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468300224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.674558:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2960
00000100:00100000:0.0:1651532117.674604:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.674629:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468300480
00000100:00100000:0.0:1651532117.674636:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2962
00000100:00100000:0.0:1651532117.674638:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468300480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.674641:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.674645:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e594 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4491f9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.674667:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e594 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491f9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.674671:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e594 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4491f9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.674674:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532117.674682:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468300480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.674686:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2962
00000100:00100000:0.0:1651532117.674702:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.674727:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468300608
00000100:00100000:0.0:1651532117.674734:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2963
00000100:00100000:0.0:1651532117.674735:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468300608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.674738:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.674742:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e59b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449200 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.674748:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e59b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449200 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.674753:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e59b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449200 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.674756:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532117.674764:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468300608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.674767:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2963
00000100:00100000:0.0:1651532117.674944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.674951:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468300736
00000100:00100000:0.0:1651532117.674957:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2964
00000100:00100000:0.0:1651532117.674959:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468300736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.674962:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.674966:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e5a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449207 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.674973:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e5a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449207 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.674977:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e5a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449207 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.674980:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532117.674989:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468300736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.674992:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2964
00000100:00100000:0.0:1651532117.675111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.675118:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468300928
00000100:00100000:0.0:1651532117.675124:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2965
00000100:00100000:0.0:1651532117.675126:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468300928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.675129:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.675132:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44920e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.675139:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44920e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.675143:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44920e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.675146:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532117.675155:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468300928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (44us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.675158:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2965
00000100:00100000:0.0:1651532117.675262:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.675270:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468301120
00000100:00100000:0.0:1651532117.675276:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2966
00000100:00100000:0.0:1651532117.675278:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468301120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.675281:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.675284:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449215 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.675291:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449215 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.675295:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449215 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.675298:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532117.675307:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468301120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.675310:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2966
00000001:00080000:1.0:1651532117.740184:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793677 is committed
00010000:00010000:0.0:1651532117.740215:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740220:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.740244:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468296000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 441259us (441349us total) trans 158913793677 rc 0/0
00010000:00010000:1.0:1651532117.740246:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.740247:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4029
00010000:00010000:1.0:1651532117.740250:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.740251:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740255:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740260:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.740261:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.740262:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740265:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740272:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740275:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e4bb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10387455] (req 114688->10387455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740278:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740282:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740473:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740477:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740495:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.740498:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468297280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 291696us (291762us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532117.740499:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.740500:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.740501:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4030
00010000:00010000:1.0:1651532117.740503:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740507:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.740508:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.740509:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740511:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740520:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740524:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e4de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9617407] (req 208896->9617407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740530:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740534:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.740853:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.740860:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.740867:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.740873:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.740879:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.740886:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468301440
00000100:00100000:0.0:1651532117.740902:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468301504
00000100:00100000:0.0:1651532117.740909:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4038
00000100:00100000:0.0:1651532117.740911:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468301440:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532117.740912:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4039
00000100:00100000:1.0:1651532117.740915:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468301504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532117.740918:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740923:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740923:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532117.740924:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740927:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740930:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740932:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532117.740933:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740937:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532117.740938:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740941:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532117.740941:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740945:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740946:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740948:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740949:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740954:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.740957:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.740963:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468301632
00000100:00100000:1.0:1651532117.740971:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468301696
00000100:00100000:1.0:1651532117.740974:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468301824
00000100:00100000:1.0:1651532117.740977:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2967
00000100:00100000:1.0:1651532117.740978:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468301632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.740981:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.740984:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e5c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44921c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.740991:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e5c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44921c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.740996:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e5c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44921c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.741000:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532117.741015:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468301632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (148us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.741018:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2967
00000100:00100000:1.0:1651532117.741022:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2968
00000100:00100000:1.0:1651532117.741024:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468301696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.741027:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.741029:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e5cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449223 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.741035:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e5cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449223 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.741039:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e5cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449223 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.741042:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532117.741047:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468301696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (175us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.741050:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2968
00000100:00100000:1.0:1651532117.741053:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2969
00000100:00100000:1.0:1651532117.741054:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468301824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.741057:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.741058:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e5d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44922a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.741093:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e5d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44922a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.741097:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e5d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44922a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.741100:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532117.741112:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468301824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (233us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.741115:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2969
00000100:00100000:0.0:1651532117.741355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.741367:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.741373:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468302016
00000100:00100000:0.0:1651532117.741375:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.741383:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468301952
00000100:00100000:1.0:1651532117.741386:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468302080
00000100:00100000:1.0:1651532117.741389:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2970
00000100:00100000:1.0:1651532117.741391:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468302016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532117.741393:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2971
00010000:00010000:1.0:1651532117.741394:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532117.741395:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468301952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.741397:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e5da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449238 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.741399:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.741404:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e5da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449238 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.741404:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449231 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.741408:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e5da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449238 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.741412:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449231 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.741414:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00010000:00010000:0.0:1651532117.741416:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449231 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.741419:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532117.741426:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468302016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.741429:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2970
00000100:00100000:1.0:1651532117.741434:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2972
00000100:00100000:0.0:1651532117.741434:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468301952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.741435:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468302080:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532117.741437:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2971
00010000:00010000:1.0:1651532117.741438:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.741440:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e5e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44923f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.741446:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e5e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44923f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.741450:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e5e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44923f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.741453:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532117.741458:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468302080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.741460:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2972
00000100:00100000:0.0:1651532117.741722:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.741738:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468302272
00000100:00100000:1.0:1651532117.741748:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2973
00000100:00100000:1.0:1651532117.741749:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468302272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.741752:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.741755:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e5ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449246 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.741762:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e5ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449246 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.741766:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e5ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449246 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.741769:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532117.741780:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468302272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.741783:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2973
00000001:00080000:1.0:1651532117.865196:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793678 is committed
00010000:00010000:0.0:1651532117.865227:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.865231:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.865253:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.865253:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468297152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 416437us (416482us total) trans 158913793678 rc 0/0
00000100:00100000:0.0:1651532117.865256:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4031
00010000:00010000:1.0:1651532117.865258:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.865259:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.865263:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.865268:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.865269:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.865270:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.865275:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.865283:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.865287:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.865291:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.865293:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e4e5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1974272->10199039] (req 1974272->10199039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.865656:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.865689:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.865697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.865708:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468302656
00000100:00100000:0.0:1651532117.865708:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.865716:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468302592
00000100:00100000:1.0:1651532117.865721:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468302848
00000100:00100000:1.0:1651532117.865728:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2974
00000100:00100000:1.0:1651532117.865729:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468302656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.865733:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.865736:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e5f6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44924d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.865744:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e5f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44924d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532117.865747:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468302720
00010000:00010000:1.0:1651532117.865748:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e5f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44924d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.865751:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:0.0:1651532117.865759:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4040
00000100:00100000:0.0:1651532117.865761:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468302592:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532117.865772:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468302656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (74us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532117.865774:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.865776:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2974
00010000:00010000:0.0:1651532117.865779:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532117.865781:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2975
00000100:00100000:1.0:1651532117.865783:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468302848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.865786:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.865788:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.865791:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532117.865792:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.865795:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e604 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449254 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.865797:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.865801:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.865802:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e604 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449254 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.865822:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e604 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449254 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.865825:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:0.0:1651532117.865826:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4041
00000100:00100000:0.0:1651532117.865828:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468302720:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532117.865832:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468302848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (124us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532117.865834:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.865835:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2975
00010000:00010000:0.0:1651532117.865838:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532117.865839:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.865841:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532117.865842:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.865845:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.865849:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.865872:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.865882:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468302976
00000100:00100000:1.0:1651532117.865889:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2976
00000100:00100000:1.0:1651532117.865891:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468302976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.865894:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.865897:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e612 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44925b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.865912:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e612 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44925b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.865923:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e612 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44925b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.865927:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532117.865939:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468302976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.865942:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2976
00000100:00100000:0.0:1651532117.866146:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.866163:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468303104
00000100:00100000:1.0:1651532117.866170:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2977
00000100:00100000:1.0:1651532117.866172:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468303104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.866175:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.866178:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e619 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449262 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.866184:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e619 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449262 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.866188:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e619 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449262 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.866191:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532117.866204:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468303104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.866207:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2977
00000100:00100000:0.0:1651532117.866242:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.866250:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468303360
00000100:00100000:1.0:1651532117.866257:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2978
00000100:00100000:1.0:1651532117.866258:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468303360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.866261:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.866264:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e620 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449269 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.866270:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e620 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449269 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.866274:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e620 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449269 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.866277:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532117.866290:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468303360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.866292:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2978
00000100:00100000:0.0:1651532117.866534:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.866551:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468303552
00000100:00100000:1.0:1651532117.866558:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2979
00000100:00100000:1.0:1651532117.866560:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f672076b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468303552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.866563:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.866566:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e627 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449270 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.866572:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e627 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449270 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.866588:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e627 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449270 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.866591:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532117.866603:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f672076b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468303552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.866606:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2979
00000001:00080000:1.0:1651532117.981857:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793679 is committed
00010000:00010000:0.0:1651532117.981888:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.981892:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.981914:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.981914:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468298560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466428us (466472us total) trans 158913793679 rc 0/0
00000100:00100000:0.0:1651532117.981917:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4032
00010000:00010000:1.0:1651532117.981919:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.981920:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.981923:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.981929:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.981930:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.981930:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.981933:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.981944:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.981954:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.981958:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.981959:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e524 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [204800->6410239] (req 204800->6410239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.982242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.982259:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468303744
00000100:00100000:1.0:1651532117.982269:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2980
00000100:00100000:0.0:1651532117.982270:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532117.982271:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468303744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.982284:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.982287:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.982288:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.982291:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e62e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449277 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.982296:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.982304:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e62e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449277 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532117.982308:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468298624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466817us (466854us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532117.982309:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e62e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449277 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.982312:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:0.0:1651532117.982312:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4033
00000100:00100000:1.0:1651532117.982333:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468303744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532117.982336:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2980
00000100:00100000:1.0:1651532117.982341:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468303808
00000100:00100000:0.0:1651532117.982357:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2981
00000100:00100000:0.0:1651532117.982359:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468303808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.982363:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.982367:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e635 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44927e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.982373:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532117.982376:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e635 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44927e expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532117.982380:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.982380:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e635 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44927e expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.982383:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532117.982384:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532117.982385:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.982388:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.982392:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468303808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (123us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532117.982393:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.982394:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532117.982395:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.982395:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2981
00010000:00010000:1.0:1651532117.982398:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.982405:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.982408:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e52b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->6610943] (req 581632->6610943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.982412:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.982415:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.982756:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.982763:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.982769:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.982776:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468303936
00000100:00100000:0.0:1651532117.982788:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468304000
00000100:00100000:0.0:1651532117.982797:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4042
00000100:00100000:0.0:1651532117.982798:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468303936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532117.982820:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.982825:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532117.982826:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.982829:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532117.982829:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.982834:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.982837:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532117.982841:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4043
00000100:00100000:1.0:1651532117.982844:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468304000:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532117.982846:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468304128
00010000:00010000:1.0:1651532117.982851:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532117.982852:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2982
00000100:00100000:0.0:1651532117.982854:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468304128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532117.982856:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532117.982857:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.982857:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532117.982860:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532117.982861:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.982865:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532117.982869:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.982875:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e64a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449285 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.982882:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e64a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449285 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.982899:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e64a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449285 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.982903:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532117.982912:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468304128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (142us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.982915:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2982
00000100:00100000:0.0:1651532117.982931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.982956:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468304256
00000100:00100000:0.0:1651532117.982963:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2983
00000100:00100000:0.0:1651532117.982965:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468304256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.982968:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.982971:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e651 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44928c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.982978:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e651 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44928c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.982982:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e651 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44928c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.982985:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532117.982994:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468304256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.983006:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2983
00000100:00100000:0.0:1651532117.983213:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.983220:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468304448
00000100:00100000:0.0:1651532117.983227:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2984
00000100:00100000:0.0:1651532117.983229:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468304448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.983232:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.983236:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e658 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449293 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.983243:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e658 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449293 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.983247:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e658 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449293 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.983250:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532117.983259:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468304448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.983262:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2984
00000100:00100000:0.0:1651532117.983513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532117.983520:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468304704
00000100:00100000:0.0:1651532117.983527:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2985
00000100:00100000:0.0:1651532117.983529:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468304704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532117.983532:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532117.983535:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e65f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44929a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532117.983543:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e65f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44929a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.983547:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e65f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44929a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532117.983550:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532117.983559:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468304704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (47us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532117.983562:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2985
00000001:00080000:1.0:1651532118.083411:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793680 is committed
00010000:00010000:1.0:1651532118.083426:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083430:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.083453:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468299456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 476236us (476280us total) trans 158913793680 rc 0/0
00000100:00100000:1.0:1651532118.083456:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4034
00010000:00010000:1.0:1651532118.083463:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083467:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532118.083468:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083471:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083476:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.083476:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.083477:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083480:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083483:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.083484:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.083485:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083496:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083500:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.083500:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.083501:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083504:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083512:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083516:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e54e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1249280->7634943] (req 1249280->7634943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083521:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083524:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083551:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083555:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083566:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083569:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.083581:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468299968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 409342us (409363us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532118.083585:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4037
00010000:00010000:1.0:1651532118.083591:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083597:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532118.083603:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.083608:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083620:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083628:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083634:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083636:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e578 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->1667071] (req 1662976->1667071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.083824:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.083832:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532118.083852:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.083853:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468305024
00010000:00010000:1.0:1651532118.083856:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.083874:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468299520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 476617us (476690us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532118.083877:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4035
00000100:00100000:0.0:1651532118.083889:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468304960
00000100:00100000:0.0:1651532118.083896:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2986
00000100:00100000:0.0:1651532118.083898:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468305024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532118.083902:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532118.083906:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2987
00010000:00010000:0.0:1651532118.083906:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e666 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492a8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.083908:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468304960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.083912:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.083915:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e66d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492a1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.083917:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e666 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492a8 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.083921:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e666 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492a8 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.083923:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e66d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492a1 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.083924:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532118.083927:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e66d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492a1 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.083930:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:0.0:1651532118.083933:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468305024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.083935:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2986
00000100:00100000:1.0:1651532118.083938:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468304960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.083940:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2987
00010000:00010000:1.0:1651532118.083947:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083950:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532118.083951:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083954:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.083959:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.083960:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532118.083961:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e555 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3465216->5795839] (req 3465216->5795839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.083978:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468305216
00000100:00100000:0.0:1651532118.083978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.083991:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468305152
00000100:00100000:1.0:1651532118.083997:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4044
00000100:00100000:1.0:1651532118.083999:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468305216:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532118.084011:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.084011:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4045
00000100:00100000:0.0:1651532118.084013:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468305152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532118.084016:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532118.084017:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.084020:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.084021:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.084026:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532118.084027:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.084030:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.084032:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532118.084033:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.084038:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.084041:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.084044:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.084300:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.084315:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.084335:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468305280
00000100:00100000:1.0:1651532118.084346:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468305408
00000100:00100000:1.0:1651532118.084351:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2988
00000100:00100000:1.0:1651532118.084352:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468305280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.084355:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532118.084357:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2989
00010000:00010000:1.0:1651532118.084358:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e682 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492af expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.084359:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468305408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532118.084362:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.084365:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e682 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492af expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.084366:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e689 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492b6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.084369:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e682 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492af expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.084373:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00010000:00010000:0.0:1651532118.084374:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e689 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492b6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.084378:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e689 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492b6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.084381:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532118.084386:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468305280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.084389:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2988
00000100:00100000:0.0:1651532118.084397:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468305408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.084400:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2989
00000100:00100000:0.0:1651532118.084738:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.084746:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.084752:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468305664
00000100:00100000:0.0:1651532118.084765:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468305600
00000100:00100000:0.0:1651532118.084773:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2990
00000100:00100000:0.0:1651532118.084774:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468305664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532118.084777:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532118.084778:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2991
00000100:00100000:1.0:1651532118.084780:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468305600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532118.084781:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e690 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492c4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.084784:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.084787:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e697 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492bd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.084788:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e690 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492c4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.084792:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e690 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492c4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.084794:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e697 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492bd expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.084795:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532118.084798:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e697 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492bd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.084801:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:0.0:1651532118.084818:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468305664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.084819:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468305600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.084821:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2990
00000100:00100000:1.0:1651532118.084823:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2991
00000001:00080000:1.0:1651532118.131968:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793681 is committed
00010000:00010000:0.0:1651532118.131999:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.132003:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.132026:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468299904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457828us (457862us total) trans 158913793681 rc 0/0
00010000:00010000:1.0:1651532118.132028:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.132030:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4036
00010000:00010000:1.0:1651532118.132033:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532118.132034:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132037:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132043:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.132043:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.132044:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132047:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132057:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.132066:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132067:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e571 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2621440->2625535] (req 2621440->2625535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.132071:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.132283:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.132291:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.132302:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468305984
00000100:00100000:1.0:1651532118.132312:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468305920
00000100:00100000:1.0:1651532118.132331:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4046
00000100:00100000:1.0:1651532118.132333:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468305984:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532118.132340:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132344:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532118.132345:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132351:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532118.132352:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132356:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132360:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.132367:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4047
00000100:00100000:1.0:1651532118.132369:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468305920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532118.132373:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132376:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532118.132377:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132380:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532118.132380:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132383:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.132386:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532118.232038:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793682 is committed
00010000:00010000:0.0:1651532118.232068:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232073:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232094:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.232094:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468301440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491183us (491242us total) trans 158913793682 rc 0/0
00010000:00010000:1.0:1651532118.232098:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532118.232098:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4038
00010000:00010000:1.0:1651532118.232099:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232103:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232108:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.232109:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.232109:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232112:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232120:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232123:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e5b7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->9797631] (req 438272->9797631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232129:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232133:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232365:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232378:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232389:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232396:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532118.232396:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468301504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491481us (491536us total) trans 0 rc 40960/40960
00010000:00010000:1.0:1651532118.232397:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232400:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.232400:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4039
00010000:00010000:1.0:1651532118.232404:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.232404:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.232405:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232408:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232417:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232420:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e5be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9875455] (req 335872->9875455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232430:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232434:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.232498:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.232509:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468306112
00000100:00100000:0.0:1651532118.232511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.232521:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468306304
00000100:00100000:1.0:1651532118.232526:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2992
00000100:00100000:1.0:1651532118.232527:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468306112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.232531:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.232534:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e6ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492cb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.232545:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2993
00000100:00100000:0.0:1651532118.232548:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468306304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.232551:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e6ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492cb expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.232552:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.232555:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e6ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492cb expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.232556:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e6b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492d2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232559:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532118.232573:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468306112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.232576:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2992
00010000:00010000:0.0:1651532118.232594:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e6b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492d2 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.232598:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e6b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492d2 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.232604:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532118.232613:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468306304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.232616:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2993
00000100:00100000:0.0:1651532118.232677:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.232754:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468306496
00000100:00100000:0.0:1651532118.232765:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4048
00000100:00100000:0.0:1651532118.232767:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468306496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532118.232774:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232779:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532118.232780:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232782:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532118.232783:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232825:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232829:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.232859:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.232869:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.232878:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468306624
00000100:00100000:0.0:1651532118.232879:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468306688
00000100:00100000:1.0:1651532118.232891:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2994
00000100:00100000:1.0:1651532118.232893:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468306624:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532118.232894:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2995
00000100:00100000:0.0:1651532118.232895:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468306688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.232897:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532118.232899:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.232900:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e6c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492d9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.232902:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492e0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.232907:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e6c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492d9 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.232910:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492e0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.232911:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e6c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492d9 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.232914:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492e0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.232915:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00010000:00010000:0.0:1651532118.232918:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532118.232928:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468306624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.232933:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468306688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.232936:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2995
00000100:00100000:1.0:1651532118.232938:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2994
00000100:00100000:0.0:1651532118.232975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.232984:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468306816
00000100:00100000:1.0:1651532118.232990:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2996
00000100:00100000:1.0:1651532118.232992:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468306816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.232995:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.232998:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e6cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492e7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.233012:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e6cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492e7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.233016:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e6cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492e7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.233019:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532118.233036:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468306816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.233039:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2996
00000100:00100000:0.0:1651532118.233263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.233281:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468307008
00000100:00100000:1.0:1651532118.233287:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2997
00000100:00100000:1.0:1651532118.233289:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468307008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.233292:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.233295:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492ee expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.233302:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492ee expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.233306:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492ee expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.233309:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532118.233330:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468307008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.233332:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2997
00000001:00080000:1.0:1651532118.473526:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793683 is committed
00010000:00010000:0.0:1651532118.473556:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.473561:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.473582:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468302592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 607820us (607927us total) trans 158913793683 rc 0/0
00010000:00010000:1.0:1651532118.473584:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.473586:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4040
00010000:00010000:1.0:1651532118.473589:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532118.473590:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.473594:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.473599:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.473600:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.473601:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.473604:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.473613:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.473622:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.473624:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e5fd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->6467583] (req 1499136->6467583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.473626:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.474015:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.474048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.474059:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.474066:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468307392
00000100:00100000:0.0:1651532118.474068:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.474076:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.474089:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468307328
00000100:00100000:1.0:1651532118.474099:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4049
00000100:00100000:1.0:1651532118.474100:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468307392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532118.474104:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474108:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.474108:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474112:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.474113:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474122:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532118.474122:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.474126:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468302720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 608298us (608437us total) trans 0 rc 28672/28672
00010000:00010000:1.0:1651532118.474127:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474130:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.474130:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4041
00000100:00100000:0.0:1651532118.474135:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4050
00010000:00010000:1.0:1651532118.474136:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.474137:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468307328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532118.474142:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532118.474143:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.474143:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474146:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.474148:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532118.474149:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.474152:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532118.474153:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474158:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.474159:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.474160:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474163:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.474166:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474170:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474173:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e60b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2646016->9789439] (req 2646016->9789439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.474176:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.474181:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468307520
00010000:00010000:0.0:1651532118.474183:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.474186:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.474188:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468307456
00000100:00100000:1.0:1651532118.474191:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468307648
00000100:00100000:1.0:1651532118.474194:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2998
00000100:00100000:1.0:1651532118.474195:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468307520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.474198:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.474201:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e6eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492fc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474208:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e6eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492fc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.474212:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e6eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492fc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532118.474214:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2999
00010000:00010000:1.0:1651532118.474215:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:0.0:1651532118.474216:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468307456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532118.474219:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532118.474222:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e6f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4492f5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.474224:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468307520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (165us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.474227:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2998
00010000:00010000:0.0:1651532118.474230:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e6f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492f5 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532118.474231:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3000
00000100:00100000:1.0:1651532118.474233:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468307648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532118.474234:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e6f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4492f5 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.474235:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.474237:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e6f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449303 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.474238:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532118.474243:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e6f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449303 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532118.474244:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468307456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (177us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532118.474247:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e6f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449303 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532118.474247:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2999
00010000:00010000:1.0:1651532118.474250:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532118.474255:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468307648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (179us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.474257:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3000
00000100:00100000:0.0:1651532118.474661:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.474676:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.474686:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468307840
00000100:00100000:1.0:1651532118.474694:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468307776
00000100:00100000:1.0:1651532118.474701:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3001
00000100:00100000:1.0:1651532118.474703:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468307840:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532118.474705:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3002
00010000:00010000:1.0:1651532118.474706:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532118.474707:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468307776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532118.474711:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532118.474715:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e707 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44930a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.474717:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e700 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449311 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.474723:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e707 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44930a expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.474725:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e700 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449311 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.474727:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e707 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44930a expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.474729:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e700 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449311 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.474731:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532118.474732:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532118.474741:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468307840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.474741:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468307776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.474744:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3002
00000100:00100000:1.0:1651532118.474746:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3001
00000100:00100000:0.0:1651532118.475051:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.475065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.475074:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468308096
00000100:00100000:1.0:1651532118.475081:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468308032
00000100:00100000:1.0:1651532118.475090:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3003
00000100:00100000:1.0:1651532118.475091:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468308096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532118.475093:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3004
00010000:00010000:1.0:1651532118.475095:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532118.475095:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468308032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.475098:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e70e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44931f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.475099:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532118.475103:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e715 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449318 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.475110:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e715 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449318 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.475115:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e715 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449318 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.475117:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e70e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44931f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.475118:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532118.475121:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e70e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44931f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.475124:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:0.0:1651532118.475128:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468308032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.475130:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3004
00000100:00100000:1.0:1651532118.475132:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468308096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.475135:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3003
00000100:00100000:0.0:1651532118.475428:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.475446:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468308288
00000100:00100000:1.0:1651532118.475453:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3005
00000100:00100000:1.0:1651532118.475455:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468308288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.475458:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.475460:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e71c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449326 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.475467:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e71c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449326 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.475471:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e71c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449326 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.475474:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532118.475490:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468308288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.475499:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3005
00000001:00080000:1.0:1651532118.657495:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793684 is committed
00002000:00010000:0.0:1651532118.657524:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532116 -> 1651532117
00010000:00010000:0.0:1651532118.657534:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.657538:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.657559:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468303936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 674759us (674804us total) trans 158913793684 rc 0/0
00010000:00010000:1.0:1651532118.657561:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.657562:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4042
00010000:00010000:1.0:1651532118.657566:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532118.657567:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657571:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657576:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.657577:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.657578:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657581:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657584:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.657585:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.657585:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657588:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657605:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657609:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e63c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6766592->10248191] (req 6766592->10248191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657615:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657618:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657646:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.657650:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.657995:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.658005:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.658011:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.658027:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468308736
00000100:00100000:0.0:1651532118.658034:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468308544
00000100:00100000:1.0:1651532118.658041:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3006
00000100:00100000:1.0:1651532118.658042:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468308736:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532118.658044:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468308480
00010000:00010000:1.0:1651532118.658046:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.658049:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e723 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44932d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.658050:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4051
00000100:00100000:0.0:1651532118.658052:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468308544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532118.658055:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.658058:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e723 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44932d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.658059:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658062:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e723 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44932d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.658063:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532118.658064:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658066:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00010000:00010000:0.0:1651532118.658068:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532118.658068:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658073:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658076:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.658080:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468308736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.658083:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3006
00000100:00100000:0.0:1651532118.658090:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4052
00000100:00100000:0.0:1651532118.658092:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468308480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532118.658096:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658097:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658100:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658104:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532118.658105:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658107:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532118.658108:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658111:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.658112:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468305216:12345-10.240.43.64@tcp:3:fio.0 Request processed in 574112us (574152us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532118.658114:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4044
00010000:00010000:0.0:1651532118.658114:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658123:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658126:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.658136:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468304000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 675292us (675373us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532118.658138:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4043
00010000:00010000:1.0:1651532118.658143:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658156:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658159:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532118.658160:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658163:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658169:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658172:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40e643 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [679936->10436607] (req 679936->10436607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658173:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532118.658175:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658178:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658183:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.658184:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.658185:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658188:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658197:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658200:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e674 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8257535] (req 679936->8257535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658201:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658204:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.658572:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.658583:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468308864
00000100:00100000:0.0:1651532118.658583:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.658589:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.658600:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4053
00000100:00100000:1.0:1651532118.658602:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468308864:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532118.658603:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532118.658613:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658617:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532118.658618:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658624:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532118.658625:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658629:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658632:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.658639:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468308800
00000100:00100000:1.0:1651532118.658648:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468308992
00000100:00100000:1.0:1651532118.658651:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468309056
00000100:00100000:1.0:1651532118.658654:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3007
00000100:00100000:1.0:1651532118.658655:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468308800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.658658:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.658660:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e73f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449334 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658667:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e73f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449334 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.658671:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e73f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449334 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.658675:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:0.0:1651532118.658683:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3008
00000100:00100000:1.0:1651532118.658687:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468308800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.658690:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3007
00000100:00100000:0.0:1651532118.658691:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468308992:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532118.658695:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3009
00010000:00010000:0.0:1651532118.658695:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532118.658696:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468309056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.658699:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532118.658699:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e746 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44933b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.658701:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e74d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449342 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.658707:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e746 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44933b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.658708:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e74d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449342 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.658712:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e74d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449342 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.658712:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e746 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44933b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.658715:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00010000:00010000:0.0:1651532118.658715:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532118.658721:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468309056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.658723:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3009
00000100:00100000:0.0:1651532118.658724:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468308992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.658739:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3008
00000100:00100000:0.0:1651532118.659130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.659138:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468309248
00000100:00100000:0.0:1651532118.659152:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3010
00000100:00100000:0.0:1651532118.659154:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468309248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532118.659158:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532118.659161:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e754 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449349 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.659169:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e754 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449349 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.659173:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e754 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449349 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.659176:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532118.659187:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468309248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.659189:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3010
00000001:00080000:1.0:1651532118.740179:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793685 is committed
00002000:00010000:0.0:1651532118.740208:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532117 -> 1651532118
00002000:00010000:0.0:1651532118.740210:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532117 -> 1651532118
00010000:00010000:0.0:1651532118.740212:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740216:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.740247:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468305152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 656234us (656269us total) trans 158913793685 rc 0/0
00010000:00010000:1.0:1651532118.740248:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.740251:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4045
00010000:00010000:1.0:1651532118.740252:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532118.740253:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740259:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740265:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.740265:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.740266:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740269:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740277:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740280:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e67b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7614463] (req 634880->7614463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740282:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740286:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.740616:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.740627:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.740634:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.740644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.740656:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468309440
00000100:00100000:1.0:1651532118.740660:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468309632
00000100:00100000:0.0:1651532118.740666:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468309504
00000100:00100000:1.0:1651532118.740668:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468309760
00000100:00100000:0.0:1651532118.740674:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4054
00000100:00100000:0.0:1651532118.740676:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468309440:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532118.740678:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3011
00000100:00100000:1.0:1651532118.740680:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468309632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.740683:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532118.740684:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740686:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e762 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449350 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740688:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532118.740689:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740692:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532118.740693:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740699:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532118.740701:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740702:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e762 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449350 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.740705:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.740712:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4055
00000100:00100000:0.0:1651532118.740714:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468309504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532118.740717:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e762 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449350 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.740718:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740720:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00010000:00010000:0.0:1651532118.740721:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532118.740722:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740725:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532118.740725:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740729:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.740734:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468309632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.740737:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3011
00010000:00010000:0.0:1651532118.740738:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.740742:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3012
00000100:00100000:1.0:1651532118.740744:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468309760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.740747:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.740749:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e770 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449357 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740750:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740756:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740759:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.740761:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e770 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449357 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.740765:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e770 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449357 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.740768:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:0.0:1651532118.740770:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468305984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 608436us (608488us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532118.740773:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4046
00000100:00100000:1.0:1651532118.740774:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468309760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.740776:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3012
00010000:00010000:0.0:1651532118.740779:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740782:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532118.740783:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740786:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532118.740791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532118.740792:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740795:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740820:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740821:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.740824:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.740825:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40e69e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [765952->9482239] (req 765952->9482239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.741128:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.741138:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468309888
00000100:00100000:1.0:1651532118.741147:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3013
00000100:00100000:1.0:1651532118.741149:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468309888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.741152:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.741156:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e777 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44935e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.741163:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e777 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44935e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.741167:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e777 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44935e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.741170:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532118.741185:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468309888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.741188:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3013
00000100:00100000:0.0:1651532118.741220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.741229:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468310016
00000100:00100000:1.0:1651532118.741235:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3014
00000100:00100000:1.0:1651532118.741237:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468310016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.741240:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.741243:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e77e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449365 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.741250:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e77e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449365 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.741253:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e77e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449365 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.741257:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532118.741269:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468310016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.741272:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3014
00000100:00100000:0.0:1651532118.741313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.741328:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468310080
00000100:00100000:1.0:1651532118.741335:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3015
00000100:00100000:1.0:1651532118.741337:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468310080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.741340:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.741343:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e785 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44936c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.741349:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e785 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44936c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.741353:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e785 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44936c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.741356:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532118.741369:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468310080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.741372:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3015
00000100:00100000:0.0:1651532118.741607:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.741625:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468310464
00000100:00100000:1.0:1651532118.741632:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3016
00000100:00100000:1.0:1651532118.741634:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468310464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.741637:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.741640:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e78c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449373 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.741646:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e78c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449373 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.741650:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e78c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449373 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.741653:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532118.741666:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468310464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.741669:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3016
00000001:00080000:1.0:1651532118.840249:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793686 is committed
00010000:00010000:1.0:1651532118.840265:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840269:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.840303:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468305920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 707933us (708012us total) trans 158913793686 rc 0/0
00000100:00100000:1.0:1651532118.840306:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4047
00010000:00010000:1.0:1651532118.840314:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840327:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532118.840328:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840331:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840336:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.840337:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.840338:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840341:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840360:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.840361:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840363:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e6a5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3887104->7835647] (req 3887104->7835647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.840366:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.840548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.840559:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468310656
00000100:00100000:0.0:1651532118.840559:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.840577:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468310592
00000100:00100000:1.0:1651532118.840585:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4056
00000100:00100000:1.0:1651532118.840587:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468310656:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532118.840594:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840598:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532118.840599:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532118.840599:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840603:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.840609:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4057
00000100:00100000:1.0:1651532118.840618:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468310592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532118.840624:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840627:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532118.840628:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840631:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840636:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532118.840637:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840641:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840643:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840647:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.840668:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.840679:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468310720
00000100:00100000:1.0:1651532118.840686:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3017
00000100:00100000:1.0:1651532118.840687:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468310720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.840690:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.840693:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44937a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.840700:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44937a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.840704:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44937a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.840710:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532118.840724:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468310720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.840727:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3017
00000100:00100000:0.0:1651532118.840961:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.840978:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468310848
00000100:00100000:1.0:1651532118.840986:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3018
00000100:00100000:1.0:1651532118.840987:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468310848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.840990:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.840993:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7a8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449381 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.841001:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449381 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.841005:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449381 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.841008:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532118.841021:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468310848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.841024:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3018
00000001:00080000:1.0:1651532118.973562:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793687 is committed
00010000:00010000:0.0:1651532118.973592:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.973597:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.973614:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468306496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 740846us (740937us total) trans 158913793687 rc 0/0
00000100:00100000:0.0:1651532118.973617:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4048
00010000:00010000:0.0:1651532118.973624:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.973628:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532118.973637:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.973641:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.973646:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532118.973647:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532118.973648:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.973651:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.973663:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.973666:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e6ba lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [598016->10125311] (req 598016->10125311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.973675:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.973689:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.973932:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.973937:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.973955:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468307392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499854us (499940us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532118.973959:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4049
00010000:00010000:1.0:1651532118.973966:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.973969:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532118.973970:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.973980:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.973986:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.973987:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532118.973988:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974001:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974010:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974013:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e6dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4620288->8577023] (req 4620288->8577023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.974013:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.974032:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532118.974065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.974077:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468311040
00000100:00100000:1.0:1651532118.974084:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3019
00000100:00100000:1.0:1651532118.974086:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468311040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.974096:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.974100:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449388 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974107:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449388 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.974111:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449388 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532118.974114:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532118.974127:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468311040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.974130:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3019
00000100:00100000:0.0:1651532118.974449:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.974461:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.974466:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468311232
00000100:00100000:0.0:1651532118.974468:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.974478:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532118.974480:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468311168
00000100:00100000:1.0:1651532118.974486:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4058
00000100:00100000:1.0:1651532118.974488:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468311232:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532118.974494:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974498:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532118.974499:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974502:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532118.974503:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974507:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974510:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.974518:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4059
00000100:00100000:1.0:1651532118.974519:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468311168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532118.974523:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974527:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532118.974528:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974533:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532118.974533:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974537:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974540:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.974546:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468311360
00000100:00100000:1.0:1651532118.974551:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468311488
00000100:00100000:1.0:1651532118.974559:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3020
00000100:00100000:1.0:1651532118.974561:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468311360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.974563:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.974566:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e7c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44938f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532118.974572:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e7c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44938f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532118.974573:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3021
00000100:00100000:0.0:1651532118.974575:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468311488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532118.974576:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e7c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44938f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.974579:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532118.974580:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00010000:00010000:0.0:1651532118.974584:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449396 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532118.974587:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468311360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532118.974590:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3020
00010000:00010000:0.0:1651532118.974592:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449396 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.974597:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449396 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.974600:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532118.974609:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468311488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (131us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.974612:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3021
00000100:00100000:0.0:1651532118.974629:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.974658:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468311616
00000100:00100000:0.0:1651532118.974667:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3022
00000100:00100000:0.0:1651532118.974669:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468311616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532118.974672:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532118.974675:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e7d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44939d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.974682:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e7d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44939d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.974690:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e7d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44939d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.974693:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532118.974702:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468311616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.974705:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3022
00000100:00100000:0.0:1651532118.974919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532118.974926:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468311808
00000100:00100000:0.0:1651532118.974933:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3023
00000100:00100000:0.0:1651532118.974934:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468311808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532118.974938:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532118.974941:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e7d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493a4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532118.974949:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e7d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493a4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.974953:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e7d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493a4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532118.974956:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532118.974965:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468311808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (47us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532118.974969:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3023
00000001:00080000:1.0:1651532119.090793:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793688 is committed
00010000:00010000:0.0:1651532119.090824:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.090828:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.090849:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468307328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616711us (616801us total) trans 158913793688 rc 0/0
00010000:00010000:1.0:1651532119.090852:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.090852:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4050
00010000:00010000:1.0:1651532119.090858:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532119.090859:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.090863:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.090869:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.090870:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.090871:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.090874:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.090881:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.090891:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.090892:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40e6e4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [348160->8720383] (req 348160->8720383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.090895:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.091228:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.091237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.091259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532119.091273:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.091277:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.091280:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468312064
00000100:00100000:1.0:1651532119.091290:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468312000
00000100:00100000:0.0:1651532119.091292:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007633b865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468308544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433239us (433298us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532119.091294:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468312320
00000100:00100000:0.0:1651532119.091297:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4051
00000100:00100000:1.0:1651532119.091298:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3024
00000100:00100000:1.0:1651532119.091300:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468312064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.091304:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532119.091304:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3025
00000100:00100000:0.0:1651532119.091306:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468312000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.091307:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e7e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493b2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.091309:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.091312:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e7e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493ab expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091313:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.091329:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.091331:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e7e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493b2 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.091332:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e7e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493ab expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.091336:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e7e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493b2 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.091336:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e7e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493ab expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.091339:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532119.091341:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:0.0:1651532119.091346:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468312000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.091349:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3025
00000100:00100000:1.0:1651532119.091351:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468312064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.091354:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3026
00000100:00100000:0.0:1651532119.091355:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000343d5776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468312320:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532119.091356:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3024
00010000:00010000:0.0:1651532119.091358:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.091360:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e7ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493b9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.091365:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.091367:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e7ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493b9 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.091370:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.091370:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e7ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493b9 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.091373:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532119.091373:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532119.091374:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091377:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.091378:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000343d5776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468312320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (120us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.091380:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3026
00010000:00010000:1.0:1651532119.091382:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.091393:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.091394:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091397:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091407:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091410:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40e72a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8101887] (req 73728->8101887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091420:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091423:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.091772:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.091780:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.091786:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468312512
00000100:00100000:0.0:1651532119.091796:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4060
00000100:00100000:0.0:1651532119.091798:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468312512:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532119.091825:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.091830:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468312448
00010000:00010000:0.0:1651532119.091830:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532119.091831:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.091834:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532119.091834:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.091839:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.091843:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4061
00000100:00100000:1.0:1651532119.091845:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468312448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532119.091845:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091852:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091856:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532119.091857:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091860:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532119.091869:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091875:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091878:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.091922:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.091930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.091940:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468312576
00000100:00100000:0.0:1651532119.091940:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.091949:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468312704
00000100:00100000:1.0:1651532119.091952:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468312640
00000100:00100000:0.0:1651532119.091955:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3027
00000100:00100000:0.0:1651532119.091957:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468312576:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532119.091958:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3028
00000100:00100000:1.0:1651532119.091959:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468312704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.091961:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.091963:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.091971:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e803 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493c0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.091972:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e80a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493ce expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.091979:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e803 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493c0 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.091981:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e80a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493ce expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.091984:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e803 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493c0 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.091986:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e80a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493ce expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.091987:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532119.091990:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:0.0:1651532119.091997:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468312576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.091999:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468312704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.092000:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3027
00000100:00100000:1.0:1651532119.092002:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3028
00000100:00100000:0.0:1651532119.092005:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3029
00000100:00100000:0.0:1651532119.092007:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468312640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.092017:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.092020:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e811 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493c7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.092025:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e811 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493c7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.092029:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e811 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493c7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.092032:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532119.092039:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468312640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.092041:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3029
00000100:00100000:0.0:1651532119.092429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.092437:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.092450:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468312896
00000100:00100000:1.0:1651532119.092454:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468312960
00000100:00100000:0.0:1651532119.092460:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3030
00000100:00100000:0.0:1651532119.092461:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468312896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.092465:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532119.092467:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3031
00010000:00010000:0.0:1651532119.092468:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e818 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493d5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.092469:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468312960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.092472:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.092475:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e81f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493dc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.092476:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e818 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493d5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.092483:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e81f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493dc expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.092483:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e818 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493d5 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.092486:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532119.092487:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e81f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493dc expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.092491:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:0.0:1651532119.092496:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468312896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.092498:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468312960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.092498:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3030
00000100:00100000:1.0:1651532119.092501:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3031
00000001:00080000:1.0:1651532119.140273:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793689 is committed
00010000:00010000:1.0:1651532119.140288:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.140292:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.140315:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a200fed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468308480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482222us (482309us total) trans 158913793689 rc 0/0
00000100:00100000:1.0:1651532119.140329:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4052
00010000:00010000:1.0:1651532119.140337:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.140340:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532119.140341:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.140344:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.140349:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.140350:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.140351:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.140354:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.140371:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.140374:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40e731 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4800512->9986047] (req 4800512->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.140379:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.140382:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.140663:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.140697:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468313344
00000100:00100000:1.0:1651532119.140711:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3032
00000100:00100000:1.0:1651532119.140713:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468313344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.140717:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.140720:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e826 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493e3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.140728:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e826 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493e3 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.140732:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e826 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493e3 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.140735:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532119.140752:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468313344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.140754:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3032
00000001:00080000:1.0:1651532119.331605:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793690 is committed
00010000:00010000:1.0:1651532119.331620:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.331624:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.331648:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c3c457b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468308864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 673045us (673076us total) trans 158913793690 rc 0/0
00000100:00100000:1.0:1651532119.331651:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4053
00010000:00010000:1.0:1651532119.331659:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.331663:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532119.331664:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.331667:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.331671:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.331672:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.331673:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.331676:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.331696:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.331699:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e738 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->8605695] (req 1347584->8605695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.331705:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.331711:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.332003:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.332014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.332015:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468313600
00000100:00100000:0.0:1651532119.332023:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.332031:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.332039:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468313536
00000100:00100000:1.0:1651532119.332047:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4062
00000100:00100000:1.0:1651532119.332049:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468313600:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532119.332056:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.332064:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532119.332065:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.332067:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532119.332068:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.332072:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.332076:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.332083:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4063
00000100:00100000:1.0:1651532119.332085:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468313536:12345-10.240.43.64@tcp:4:fio.
00010000:00010000:1.0:1651532119.332090:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.332093:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532119.332094:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.332097:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532119.332097:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.332100:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.332104:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.332110:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468313728
00000100:00100000:1.0:1651532119.332116:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468313664
00000100:00100000:0.0:1651532119.332119:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3033
00000100:00100000:0.0:1651532119.332121:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468313728:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532119.332127:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3034
00000100:00100000:1.0:1651532119.332128:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468313664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.332131:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.332132:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.332134:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e83b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493ea expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.332136:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e842 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493f1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.332141:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e83b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493ea expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.332145:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e83b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493ea expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.332145:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e842 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493f1 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.332149:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00010000:00010000:0.0:1651532119.332149:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e842 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493f1 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.332153:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532119.332162:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468313664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.332165:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3034
00000100:00100000:0.0:1651532119.332169:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468313728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.332172:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3033
00000100:00100000:0.0:1651532119.332510:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.332517:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468313856
00000100:00100000:0.0:1651532119.332533:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3035
00000100:00100000:0.0:1651532119.332535:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468313856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.332538:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.332542:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e849 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493f8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.332549:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e849 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493f8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.332553:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e849 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493f8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.332557:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532119.332567:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468313856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.332580:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3035
00000001:00080000:1.0:1651532119.440225:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793691 is committed
00010000:00010000:0.0:1651532119.440258:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.440262:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.440284:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468309440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 699607us (699688us total) trans 158913793691 rc 0/0
00010000:00010000:1.0:1651532119.440285:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.440288:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4054
00010000:00010000:1.0:1651532119.440290:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532119.440291:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440294:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440300:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.440301:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.440302:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440305:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440308:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.440308:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.440309:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440312:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440342:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440346:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e75b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->9117695] (req 1900544->9117695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440352:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.440357:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440358:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.440361:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.440734:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.440742:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.440759:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468314048
00010000:00010000:0.0:1651532119.440764:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.440768:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468314176
00010000:00010000:0.0:1651532119.440768:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.440772:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3036
00000100:00100000:1.0:1651532119.440774:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468314048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.440783:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532119.440786:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce56aed2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468309504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 700071us (700159us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532119.440787:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e850 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4493ff expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.440789:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4055
00010000:00010000:1.0:1651532119.440793:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.440796:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e850 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493ff expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.440800:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e850 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4493ff expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.440821:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:0.0:1651532119.440822:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3037
00000100:00100000:0.0:1651532119.440824:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468314176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.440828:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532119.440830:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468314048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (97us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532119.440831:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e857 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449406 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.440833:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3036
00010000:00010000:0.0:1651532119.440837:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.440840:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e857 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449406 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.440844:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e857 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449406 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.440847:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.440847:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532119.440850:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.440855:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468314176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.440857:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3037
00000100:00100000:1.0:1651532119.440873:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468310656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 600285us (600326us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532119.440876:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4056
00010000:00010000:1.0:1651532119.440882:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440886:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532119.440887:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440890:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.440903:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.440907:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532119.440908:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.440912:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.440917:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.440921:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40e793 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->6971391] (req 221184->6971391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440924:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.440925:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.440926:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440929:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440937:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440940:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e769 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [327680->6860799] (req 327680->6860799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440946:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.440956:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.441163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.441170:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468314368
00000100:00100000:0.0:1651532119.441177:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3038
00000100:00100000:0.0:1651532119.441179:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468314368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.441182:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.441186:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e85e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44940d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.441193:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e85e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44940d expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.441197:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e85e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44940d expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.441200:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532119.441210:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468314368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.441212:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3038
00000100:00100000:0.0:1651532119.441273:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.441282:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.441291:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.441292:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468314560
00000100:00100000:0.0:1651532119.441298:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468314496
00000100:00100000:1.0:1651532119.441307:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4064
00000100:00100000:1.0:1651532119.441309:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468314560:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532119.441314:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4065
00010000:00010000:1.0:1651532119.441325:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.441325:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468314496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532119.441330:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532119.441331:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.441333:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.441334:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532119.441334:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.441338:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532119.441339:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.441342:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532119.441343:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.441346:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.441347:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.441350:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.441351:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.441361:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468314624
00000100:00100000:0.0:1651532119.441368:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3039
00000100:00100000:0.0:1651532119.441369:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468314624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.441372:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.441374:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e873 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449414 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.441381:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e873 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449414 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.441388:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e873 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449414 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.441391:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532119.441418:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468314624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.441421:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3039
00000100:00100000:0.0:1651532119.441436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.441461:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468314688
00000100:00100000:0.0:1651532119.441469:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3040
00000100:00100000:0.0:1651532119.441470:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468314688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.441473:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.441477:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e87a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44941b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.441484:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e87a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44941b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.441488:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e87a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44941b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.441491:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532119.441500:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468314688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.441504:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3040
00000100:00100000:0.0:1651532119.441558:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.441564:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468314944
00000100:00100000:0.0:1651532119.441571:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3041
00000100:00100000:0.0:1651532119.441572:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468314944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.441575:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.441579:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e881 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449422 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.441585:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e881 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449422 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.441589:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e881 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449422 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.441593:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532119.441601:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468314944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (44us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.441604:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3041
00000100:00100000:0.0:1651532119.441735:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.441742:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468315072
00000100:00100000:0.0:1651532119.441748:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3042
00000100:00100000:0.0:1651532119.441750:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468315072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.441753:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.441756:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e888 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449429 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.441764:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e888 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449429 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.441767:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e888 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449429 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.441771:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532119.441779:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468315072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (45us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.441782:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3042
00000100:00100000:0.0:1651532119.441959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.441967:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.441973:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468315264
00000100:00100000:0.0:1651532119.441979:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468315328
00000100:00100000:0.0:1651532119.441988:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3043
00000100:00100000:0.0:1651532119.441990:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468315264:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532119.441991:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3044
00010000:00010000:0.0:1651532119.441993:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532119.441994:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468315328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.441997:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.441997:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e88f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449430 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.442001:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e896 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449437 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.442003:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e88f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449430 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.442008:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e88f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449430 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.442010:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e896 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449437 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.442014:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e896 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449437 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.442014:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532119.442017:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:0.0:1651532119.442024:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468315264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.442026:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468315328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.442026:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3043
00000100:00100000:1.0:1651532119.442029:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3044
00000100:00100000:0.0:1651532119.442278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.442296:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468315520
00000100:00100000:1.0:1651532119.442307:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3045
00000100:00100000:1.0:1651532119.442309:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468315520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.442312:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.442315:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e89d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44943e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.442331:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e89d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44943e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.442335:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e89d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44943e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.442338:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532119.442350:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468315520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.442353:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3045
00000100:00100000:0.0:1651532119.442539:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.442556:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468315712
00000100:00100000:1.0:1651532119.442566:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3046
00000100:00100000:1.0:1651532119.442567:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468315712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.442570:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.442573:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8a4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449445 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.442581:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449445 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.442584:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449445 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.442588:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532119.442599:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468315712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.442602:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3046
00000001:00080000:1.0:1651532119.507033:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793692 is committed
00010000:00010000:1.0:1651532119.507049:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507053:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.507079:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468310592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 666467us (666519us total) trans 158913793692 rc 0/0
00000100:00100000:1.0:1651532119.507082:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4057
00010000:00010000:1.0:1651532119.507089:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507093:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532119.507094:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507097:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507102:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.507102:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.507103:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507106:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507123:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507126:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e79a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2650112->10199039] (req 2650112->10199039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507134:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507137:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.507546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.507558:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.507566:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.507575:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468315968
00000100:00100000:0.0:1651532119.507575:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.507591:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468315904
00000100:00100000:0.0:1651532119.507596:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4066
00000100:00100000:1.0:1651532119.507603:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4067
00000100:00100000:0.0:1651532119.507603:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468315968:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532119.507605:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c48da76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468315904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532119.507611:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507612:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507615:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.507616:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507619:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532119.507620:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507624:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.507625:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507628:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532119.507629:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507633:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507633:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507637:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507646:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507650:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.507653:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.507655:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468316096
00000100:00100000:0.0:1651532119.507668:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468316288
00000100:00100000:1.0:1651532119.507673:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468311232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533184us (533224us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532119.507675:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4058
00000100:00100000:0.0:1651532119.507678:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3047
00000100:00100000:0.0:1651532119.507679:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468316096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.507682:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532119.507684:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3048
00010000:00010000:0.0:1651532119.507685:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8b9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44944c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.507686:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468316288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.507689:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.507690:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.507691:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e8c0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449453 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507693:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44944c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.507696:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.507698:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44944c expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.507699:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e8c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449453 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.507701:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532119.507703:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e8c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449453 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.507706:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:0.0:1651532119.507710:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468316096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (143us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.507713:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468316288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.507713:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3047
00000100:00100000:1.0:1651532119.507717:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3048
00010000:00010000:0.0:1651532119.507719:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507722:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532119.507732:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507735:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507740:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.507741:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.507742:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507745:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507754:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507757:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40e7b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7962624->8835071] (req 7962624->8835071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507767:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.507770:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.508062:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.508071:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468316608
00000100:00100000:1.0:1651532119.508078:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3049
00000100:00100000:1.0:1651532119.508080:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468316608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.508083:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.508086:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44945a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.508094:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44945a expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.508098:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44945a expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.508101:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532119.508115:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468316608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.508117:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3049
00000001:00080000:1.0:1651532119.606958:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793693 is committed
00010000:00010000:0.0:1651532119.606989:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.606994:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.607014:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468311168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 632494us (632552us total) trans 158913793693 rc 0/0
00010000:00010000:1.0:1651532119.607017:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.607017:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4059
00010000:00010000:1.0:1651532119.607023:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532119.607024:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607039:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607045:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.607046:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.607047:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607058:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607071:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607074:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e7bd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->9809919] (req 2068480->9809919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.607085:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.607089:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.607402:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.607414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.607423:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.607425:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468316736
00000100:00100000:0.0:1651532119.607440:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.607442:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468316800
00000100:00100000:1.0:1651532119.607457:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4068
00000100:00100000:1.0:1651532119.607459:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468316736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532119.607465:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607466:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.607469:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607475:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532119.607480:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.607488:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468312512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 515689us (515716us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532119.607491:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4060
00010000:00010000:1.0:1651532119.607494:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532119.607495:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.607497:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4069
00000100:00100000:0.0:1651532119.607499:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468316800:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532119.607500:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607503:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.607506:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.607510:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.607511:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.607511:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.607514:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532119.607514:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607517:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532119.607519:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.607519:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607522:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.607522:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607527:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.607527:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.607528:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607531:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607545:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607548:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e7f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->7942143] (req 446464->7942143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607554:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607556:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.607572:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468316928
00000100:00100000:0.0:1651532119.607583:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468317056
00000100:00100000:0.0:1651532119.607587:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3050
00000100:00100000:0.0:1651532119.607589:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468316928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.607592:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532119.607601:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3051
00000100:00100000:1.0:1651532119.607603:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468317056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.607603:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e8dc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449461 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607606:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.607610:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e8e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449468 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.607611:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e8dc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449461 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.607616:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e8dc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449461 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.607617:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e8e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449468 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.607621:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e8e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449468 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.607622:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532119.607625:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532119.607631:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468317056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (192us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.607631:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468316928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (207us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.607634:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3050
00000100:00100000:1.0:1651532119.607635:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3051
00000100:00100000:0.0:1651532119.607756:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.607773:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468317120
00000100:00100000:1.0:1651532119.607785:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3052
00000100:00100000:1.0:1651532119.607786:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468317120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.607789:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.607792:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e8ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44946f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.607799:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e8ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44946f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.607824:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e8ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44946f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.607827:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532119.607844:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468317120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.607847:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3052
00000100:00100000:0.0:1651532119.607982:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.607997:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.608004:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468317248
00000100:00100000:0.0:1651532119.608014:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468317312
00000100:00100000:0.0:1651532119.608019:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3053
00000100:00100000:0.0:1651532119.608020:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468317248:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532119.608022:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3054
00000100:00100000:1.0:1651532119.608024:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468317312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.608024:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.608027:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e8f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449476 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.608028:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.608032:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e8f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44947d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.608035:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e8f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449476 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.608040:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e8f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44947d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.608040:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e8f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449476 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.608043:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532119.608044:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e8f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44947d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.608047:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:0.0:1651532119.608053:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468317248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.608055:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3053
00000100:00100000:1.0:1651532119.608056:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468317312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.608058:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3054
00000100:00100000:0.0:1651532119.608098:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.608121:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468317504
00000100:00100000:0.0:1651532119.608131:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3055
00000100:00100000:0.0:1651532119.608133:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468317504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.608136:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.608139:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e8ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449484 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.608146:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e8ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449484 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.608150:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e8ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449484 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.608153:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532119.608163:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468317504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.608165:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3055
00000001:00080000:1.0:1651532119.665397:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793694 is committed
00002000:00010000:1.0:1651532119.665411:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532118 -> 1651532119
00002000:00010000:1.0:1651532119.665413:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532118 -> 1651532119
00010000:00010000:1.0:1651532119.665415:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.665419:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.665441:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468312448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 573595us (573660us total) trans 158913793694 rc 0/0
00010000:00010000:0.0:1651532119.665443:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.665444:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4061
00010000:00010000:0.0:1651532119.665447:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532119.665448:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665452:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665460:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.665461:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.665462:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665465:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665474:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665477:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e7fc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->8671231] (req 831488->8671231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665486:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665490:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.665876:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.665884:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.665899:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.665907:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468317888
00000100:00100000:1.0:1651532119.665915:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468317760
00000100:00100000:0.0:1651532119.665923:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4070
00000100:00100000:0.0:1651532119.665925:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468317888:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532119.665928:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4071
00000100:00100000:1.0:1651532119.665930:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468317760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532119.665941:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665945:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.665946:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665947:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.665951:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532119.665952:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.665955:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.665958:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532119.665959:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665962:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.665963:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.665966:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.665969:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665975:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.665978:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.665981:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468318144
00000100:00100000:1.0:1651532119.665994:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3056
00000100:00100000:1.0:1651532119.665996:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468318144:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532119.665997:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468313600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 333947us (333994us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532119.665999:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532119.666000:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4062
00010000:00010000:1.0:1651532119.666001:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e914 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44948b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.666014:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.666017:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e914 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44948b expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.666021:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e914 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44948b expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.666024:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532119.666030:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.666035:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532119.666036:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.666039:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.666043:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468318144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (144us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532119.666044:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.666044:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.666045:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.666046:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3056
00010000:00010000:0.0:1651532119.666059:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.666068:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.666071:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e82d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->10104831] (req 131072->10104831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.666080:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.666082:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.666398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.666429:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468318272
00000100:00100000:1.0:1651532119.666457:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3057
00000100:00100000:1.0:1651532119.666459:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468318272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.666464:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.666468:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e91b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449492 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.666478:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e91b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449492 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.666483:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e91b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449492 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.666487:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532119.666501:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468318272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.666504:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3057
00000100:00100000:0.0:1651532119.666762:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.666783:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468318464
00000100:00100000:1.0:1651532119.666793:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3058
00000100:00100000:1.0:1651532119.666795:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468318464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.666798:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.666802:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e922 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449499 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.666827:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e922 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449499 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.666832:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e922 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449499 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.666835:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532119.666846:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468318464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.666849:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3058
00000001:00080000:1.0:1651532119.732136:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793695 is committed
00010000:00010000:0.0:1651532119.732166:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732171:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.732192:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468313536:12345-10.240.43.64@tcp:4:fio. Request processed in 400106us (400178us total) trans 158913793695 rc 0/0
00010000:00010000:1.0:1651532119.732195:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.732196:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4063
00010000:00010000:1.0:1651532119.732200:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532119.732201:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732207:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732213:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.732213:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.732214:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732218:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732236:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732242:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e834 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->7548927] (req 151552->7548927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732250:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732253:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.732555:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.732578:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.732585:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.732607:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468318848
00000100:00100000:0.0:1651532119.732624:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.732626:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3059
00000100:00100000:1.0:1651532119.732633:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468318848:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532119.732635:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532119.732637:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.732641:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e929 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494a7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732647:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.732650:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e929 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494a7 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532119.732652:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.732660:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468318656
00010000:00010000:1.0:1651532119.732665:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e929 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494a7 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532119.732672:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468318592
00010000:00010000:1.0:1651532119.732677:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:0.0:1651532119.732679:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4072
00000100:00100000:0.0:1651532119.732681:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468318656:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532119.732688:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.732690:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468318848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (104us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532119.732692:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532119.732693:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3059
00010000:00010000:0.0:1651532119.732693:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532119.732694:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732697:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.732699:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468318912
00000100:00100000:1.0:1651532119.732703:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468318784
00000100:00100000:0.0:1651532119.732703:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4073
00000100:00100000:1.0:1651532119.732705:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468318976
00000100:00100000:0.0:1651532119.732705:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468318592:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532119.732708:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3060
00010000:00010000:0.0:1651532119.732709:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.732710:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468318912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.732713:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.732713:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532119.732713:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732716:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e93e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494ae expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732719:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732722:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532119.732722:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732728:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.732731:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e93e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494ae expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.732731:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732733:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732735:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e93e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494ae expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.732737:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732738:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532119.732745:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468318912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (121us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.732745:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3061
00000100:00100000:0.0:1651532119.732746:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468318784:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532119.732748:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3060
00010000:00010000:0.0:1651532119.732749:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532119.732752:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3062
00010000:00010000:0.0:1651532119.732752:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e945 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494a0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.732754:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468318976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.732756:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.732757:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.732758:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e94c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494b5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732759:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e945 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494a0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.732763:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.732764:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e94c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494b5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.732768:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e94c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494b5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.732771:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532119.732774:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e945 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494a0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532119.732776:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468318976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (124us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.732778:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3062
00010000:00010000:0.0:1651532119.732778:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532119.732787:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468318784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (152us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.732790:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3061
00010000:00010000:1.0:1651532119.732791:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.732795:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.732829:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468314560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 291519us (291547us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532119.732832:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4064
00010000:00010000:0.0:1651532119.732832:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732836:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532119.732837:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732840:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732845:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.732845:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.732846:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732849:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732856:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732869:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40e865 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1478656->8359935] (req 1478656->8359935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732875:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.732877:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.733189:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.733201:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468319168
00000100:00100000:1.0:1651532119.733209:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.733210:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3063
00000100:00100000:0.0:1651532119.733217:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468319168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.733221:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.733225:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e953 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494c3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.733233:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e953 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494c3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.733237:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e953 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494c3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.733240:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532119.733251:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468319168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.733254:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3063
00000100:00100000:0.0:1651532119.733268:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468319104
00000100:00100000:0.0:1651532119.733279:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3064
00000100:00100000:0.0:1651532119.733281:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468319104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.733283:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.733287:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e95a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494bc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.733293:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e95a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494bc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.733297:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e95a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494bc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.733300:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532119.733307:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468319104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.733309:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3064
00000100:00100000:0.0:1651532119.733375:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.733383:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468319360
00000100:00100000:0.0:1651532119.733390:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3065
00000100:00100000:0.0:1651532119.733391:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468319360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.733395:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.733398:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e961 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494ca expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.733405:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e961 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494ca expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.733420:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e961 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494ca expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.733423:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532119.733434:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468319360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.733437:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3065
00000100:00100000:1.0:1651532119.733627:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.733639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.733639:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468319552
00000100:00100000:0.0:1651532119.733651:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468319616
00000100:00100000:0.0:1651532119.733659:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3066
00000100:00100000:0.0:1651532119.733660:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468319552:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532119.733663:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3067
00010000:00010000:0.0:1651532119.733664:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532119.733665:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468319616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.733667:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e968 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494d1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.733669:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.733674:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e96f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494d8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.733674:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e968 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494d1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.733678:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e968 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494d1 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.733682:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e96f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494d8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.733682:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532119.733686:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e96f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494d8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.733690:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:0.0:1651532119.733692:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468319552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.733694:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3066
00000100:00100000:1.0:1651532119.733698:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468319616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.733701:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3067
00000001:00080000:1.0:1651532119.857719:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793696 is committed
00010000:00010000:0.0:1651532119.857749:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.857753:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.857775:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468314496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 416458us (416483us total) trans 158913793696 rc 0/0
00000100:00100000:0.0:1651532119.857779:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4065
00010000:00010000:0.0:1651532119.857786:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.857789:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532119.857790:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.857793:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.857798:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.857798:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.857799:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.857813:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.857821:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.857826:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e86c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->9936895] (req 229376->9936895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.857835:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.857840:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.858214:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532119.858227:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.858227:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468320000
00000100:00100000:1.0:1651532119.858235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.858240:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468319936
00000100:00100000:0.0:1651532119.858247:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4074
00000100:00100000:0.0:1651532119.858249:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468320000:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532119.858253:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4075
00000100:00100000:1.0:1651532119.858255:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468319936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532119.858255:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.858259:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.858260:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.858263:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532119.858264:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.858264:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.858268:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.858269:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532119.858270:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.858273:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532119.858274:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.858277:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.858279:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.858282:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.858291:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468320128
00010000:00010000:1.0:1651532119.858295:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.858297:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3068
00000100:00100000:0.0:1651532119.858299:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468320128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.858310:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.858312:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.858313:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e984 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494df expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.858328:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.858331:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e984 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494df expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.858336:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e984 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494df expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532119.858342:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d82aebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468315968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350738us (350797us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532119.858345:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4066
00010000:00010000:0.0:1651532119.858345:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532119.858353:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.858355:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468320128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (120us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532119.858356:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532119.858357:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.858358:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3068
00010000:00010000:1.0:1651532119.858360:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.858365:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.858366:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532119.858367:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.858370:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.858377:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.858380:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40e8ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3911680->9318399] (req 3911680->9318399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.858393:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.858397:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.858609:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.858647:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468320384
00000100:00100000:0.0:1651532119.858655:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3069
00000100:00100000:0.0:1651532119.858667:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468320384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.858671:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.858675:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e98b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494ed expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.858693:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532119.858696:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e98b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494ed expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.858705:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e98b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494ed expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.858708:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532119.858714:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.858717:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468320384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.858726:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3069
00000100:00100000:0.0:1651532119.858731:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468320320
00000100:00100000:0.0:1651532119.858735:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468320512
00000100:00100000:0.0:1651532119.858737:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3070
00000100:00100000:0.0:1651532119.858739:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468320320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.858742:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.858745:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e992 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494e6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.858751:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e992 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494e6 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.858755:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e992 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494e6 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.858758:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532119.858770:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468320320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.858773:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3070
00000100:00100000:1.0:1651532119.858776:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3071
00000100:00100000:1.0:1651532119.858778:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468320512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.858782:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532119.858786:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e999 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494f4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.858795:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e999 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494f4 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.858799:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e999 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494f4 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.858816:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532119.858826:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468320512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.858829:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3071
00000100:00100000:1.0:1651532119.859177:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.859188:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468320768
00000100:00100000:0.0:1651532119.859202:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3072
00000100:00100000:0.0:1651532119.859203:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468320768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.859207:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.859210:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4494fb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.859218:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494fb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.859222:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4494fb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.859225:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532119.859236:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468320768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.859239:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3072
00000001:00080000:1.0:1651532119.957145:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793697 is committed
00010000:00010000:0.0:1651532119.957175:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957180:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.957201:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c48da76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468315904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449595us (449642us total) trans 158913793697 rc 0/0
00000100:00100000:0.0:1651532119.957204:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4067
00010000:00010000:0.0:1651532119.957211:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957215:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532119.957216:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957219:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957224:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.957224:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532119.957225:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957228:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957238:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957241:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40e8b2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [491520->5574655] (req 491520->5574655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.957258:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.957263:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.957569:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.957576:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.957588:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.957604:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468321088
00000100:00100000:0.0:1651532119.957614:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468321024
00000100:00100000:0.0:1651532119.957619:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4076
00000100:00100000:0.0:1651532119.957621:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468321088:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532119.957628:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957632:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532119.957633:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957636:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532119.957637:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.957638:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4077
00000100:00100000:1.0:1651532119.957641:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468321024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532119.957641:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.957653:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.957658:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532119.957659:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.957662:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532119.957663:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957666:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.957667:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532119.957671:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532119.957676:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468321152
00000100:00100000:0.0:1651532119.957685:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3073
00000100:00100000:0.0:1651532119.957687:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c387898 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468321152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.957690:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.957693:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9b5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449502 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.957697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532119.957700:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449502 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.957711:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449502 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.957715:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532119.957721:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532119.957724:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c387898 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468321152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.957733:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3073
00000100:00100000:0.0:1651532119.957761:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468321216
00000100:00100000:1.0:1651532119.957764:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468321344
00000100:00100000:0.0:1651532119.957766:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3074
00000100:00100000:0.0:1651532119.957767:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468321216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532119.957770:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532119.957773:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3075
00010000:00010000:0.0:1651532119.957773:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e9bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449509 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532119.957775:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468321344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532119.957778:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532119.957780:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e9bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449509 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.957782:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e9c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449510 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532119.957784:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e9bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449509 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532119.957787:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532119.957800:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468321216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532119.957816:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3074
00010000:00010000:1.0:1651532119.957817:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e9c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449510 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.957821:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e9c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449510 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532119.957825:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532119.957834:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468321344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532119.957837:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3075
00000001:00080000:1.0:1651532120.015533:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793698 is committed
00010000:00010000:1.0:1651532120.015549:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015553:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.015576:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d480d739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468316736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 408116us (408174us total) trans 158913793698 rc 0/0
00000100:00100000:1.0:1651532120.015579:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4068
00010000:00010000:1.0:1651532120.015586:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015590:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532120.015591:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015595:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015600:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.015600:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.015601:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015605:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015622:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.015623:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.015624:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015627:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015641:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015644:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40e8ce lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3633152->9891839] (req 3633152->9891839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.015653:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015655:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015658:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.015658:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.015923:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.015928:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.015940:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.015946:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468316800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408446us (408531us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532120.015949:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4069
00010000:00010000:1.0:1651532120.015951:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.015956:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.015960:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532120.015975:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468317888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350049us (350099us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532120.015979:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4070
00010000:00010000:0.0:1651532120.015980:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.015983:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.015989:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.015992:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40e8d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->10461183] (req 155648->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.015995:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532120.015996:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.015999:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.016000:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016002:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016006:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.016006:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.016007:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.016010:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532120.016010:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016013:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.016014:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.016014:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016017:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016027:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016033:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40e906 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [430080->8830975] (req 430080->8830975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016039:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016042:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016050:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016055:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.016085:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468321664
00000100:00100000:0.0:1651532120.016108:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468321792
00000100:00100000:1.0:1651532120.016112:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3076
00000100:00100000:1.0:1651532120.016114:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468321664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.016117:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532120.016117:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3077
00000100:00100000:0.0:1651532120.016118:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468321792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.016121:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e9ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449517 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016122:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.016125:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e9d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44951e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016133:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e9ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449517 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.016133:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e9d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44951e expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.016138:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40e9d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44951e expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.016145:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40e9ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449517 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.016149:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532120.016156:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532120.016164:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468321664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (169us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.016167:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3076
00000100:00100000:0.0:1651532120.016171:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468321792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (161us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.016174:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3077
00000100:00100000:1.0:1651532120.016382:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.016390:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.016401:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468321920
00000100:00100000:0.0:1651532120.016418:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468321984
00000100:00100000:0.0:1651532120.016424:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4078
00000100:00100000:0.0:1651532120.016426:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468321920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532120.016433:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016437:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532120.016438:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016441:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532120.016441:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016445:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016449:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016459:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016462:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.016481:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4079
00000100:00100000:0.0:1651532120.016481:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468318656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 283799us (283926us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532120.016485:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468321984:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532120.016486:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4072
00010000:00010000:1.0:1651532120.016496:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016501:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532120.016502:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016505:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532120.016513:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016518:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016522:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.016530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.016555:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.016562:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468322240
00010000:00010000:1.0:1651532120.016567:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.016568:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468322304
00010000:00010000:1.0:1651532120.016571:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532120.016572:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.016576:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3078
00000100:00100000:0.0:1651532120.016577:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468322240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.016580:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016581:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.016584:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e9e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449525 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016586:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016589:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40e930 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [724992->1888255] (req 724992->1888255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016591:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e9e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449525 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.016596:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40e9e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449525 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532120.016597:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3079
00000100:00100000:1.0:1651532120.016599:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468322304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.016599:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532120.016603:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.016606:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e9ed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44952c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.016608:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468322240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.016611:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3078
00010000:00010000:1.0:1651532120.016613:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e9ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44952c expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.016617:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40e9ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44952c expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.016621:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532120.016630:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468322304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.016633:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3079
00000100:00100000:0.0:1651532120.016841:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.016852:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468322432
00000100:00100000:0.0:1651532120.016852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.016862:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468322496
00000100:00100000:1.0:1651532120.016867:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4080
00000100:00100000:1.0:1651532120.016869:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468322432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532120.016877:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.016878:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4081
00000100:00100000:0.0:1651532120.016879:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468322496:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532120.016881:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532120.016882:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016885:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532120.016886:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016890:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016893:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.016894:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016897:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532120.016899:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016902:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532120.016902:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016907:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.016936:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.016963:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.016971:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468322688
00000100:00100000:1.0:1651532120.016983:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3080
00000100:00100000:1.0:1651532120.016985:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468322688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.016988:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.016999:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea02 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449533 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.017007:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea02 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449533 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.017012:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea02 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449533 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.017015:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532120.017028:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468322688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.017030:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3080
00000100:00100000:1.0:1651532120.017277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.017285:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468322880
00000100:00100000:1.0:1651532120.017296:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3081
00000100:00100000:1.0:1651532120.017298:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468322880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.017302:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.017305:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea09 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44953a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.017312:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea09 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44953a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.017328:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea09 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44953a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.017332:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532120.017344:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468322880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.017346:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3081
00000100:00100000:1.0:1651532120.017566:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.017574:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468323072
00000100:00100000:1.0:1651532120.017585:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3082
00000100:00100000:1.0:1651532120.017587:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468323072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.017591:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.017594:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea10 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449541 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.017601:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea10 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449541 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.017605:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea10 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449541 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.017608:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532120.017620:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468323072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.017632:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3082
00000001:00080000:1.0:1651532120.123894:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793699 is committed
00010000:00010000:1.0:1651532120.123910:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.123914:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.123937:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.123938:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468317760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 458006us (458053us total) trans 158913793699 rc 0/0
00000100:00100000:1.0:1651532120.123941:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4071
00010000:00010000:0.0:1651532120.123942:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.123943:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.123946:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.123952:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.123952:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.123960:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.123963:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.123972:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.123975:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40e90d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2211840->10239999] (req 2211840->10239999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.123990:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.123995:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.124283:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.124293:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.124304:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468323328
00000100:00100000:0.0:1651532120.124312:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468323392
00000100:00100000:0.0:1651532120.124329:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3083
00000100:00100000:0.0:1651532120.124331:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468323328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.124335:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.124339:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ea17 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449548 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.124347:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ea17 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449548 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.124351:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ea17 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449548 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.124355:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532120.124365:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468323328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.124377:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3083
00000100:00100000:1.0:1651532120.124382:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3084
00000100:00100000:1.0:1651532120.124384:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468323392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.124388:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.124392:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea1e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44954f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.124400:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea1e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44954f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.124427:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea1e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44954f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.124431:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532120.124444:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468323392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (151us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.124447:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3084
00000100:00100000:0.0:1651532120.124686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.124706:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468323584
00000100:00100000:1.0:1651532120.124720:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3085
00000100:00100000:1.0:1651532120.124722:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468323584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.124725:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.124729:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea25 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449556 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.124737:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea25 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449556 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.124741:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea25 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449556 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.124744:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532120.124755:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468323584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.124758:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3085
00000001:00080000:1.0:1651532120.248911:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793700 is committed
00010000:00010000:1.0:1651532120.248927:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.248931:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.248953:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468318592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516247us (516375us total) trans 158913793700 rc 0/0
00010000:00010000:0.0:1651532120.248955:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.248956:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4073
00010000:00010000:0.0:1651532120.248959:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.248961:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.248964:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.248969:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.248970:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.248970:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.248973:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.248981:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.248984:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40e937 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.248989:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249003:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.249412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.249421:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.249428:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.249434:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.249445:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.249446:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468323712
00000100:00100000:1.0:1651532120.249454:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.249463:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468323904
00000100:00100000:0.0:1651532120.249466:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468324032
00000100:00100000:0.0:1651532120.249468:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468324096
00000100:00100000:0.0:1651532120.249471:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3086
00000100:00100000:0.0:1651532120.249473:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468323712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.249481:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.249485:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ea2c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44955d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249491:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532120.249492:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468323776
00010000:00010000:0.0:1651532120.249494:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ea2c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44955d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.249498:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ea2c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44955d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.249501:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532120.249508:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468323840
00000100:00100000:1.0:1651532120.249515:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4082
00000100:00100000:1.0:1651532120.249517:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468323776:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532120.249520:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468323712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.249523:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3086
00010000:00010000:1.0:1651532120.249529:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.249529:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3087
00000100:00100000:0.0:1651532120.249530:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468323904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.249533:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.249534:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532120.249535:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249536:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ea3a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449564 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.249538:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532120.249538:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249542:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.249544:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249544:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ea3a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449564 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.249548:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249548:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ea3a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449564 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.249552:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532120.249555:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4083
00000100:00100000:1.0:1651532120.249557:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468323840:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532120.249557:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468323904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.249560:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3087
00010000:00010000:1.0:1651532120.249562:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.249564:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3088
00010000:00010000:1.0:1651532120.249565:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532120.249565:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468324032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.249566:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249567:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.249568:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532120.249569:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249569:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ea48 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44956b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.249572:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249574:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.249575:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249575:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ea48 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44956b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.249579:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ea48 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44956b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532120.249582:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3089
00000100:00100000:1.0:1651532120.249584:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468324096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.249587:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.249589:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea4f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449572 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249593:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532120.249594:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.249597:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea4f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449572 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.249601:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea4f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449572 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532120.249602:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468324032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (157us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532120.249605:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:0.0:1651532120.249605:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3088
00000100:00100000:1.0:1651532120.249614:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468324096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (159us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.249616:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3089
00010000:00010000:0.0:1651532120.249618:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249621:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.249638:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468320000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391389us (391425us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532120.249641:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4074
00010000:00010000:0.0:1651532120.249652:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249656:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.249657:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249660:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249665:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.249665:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.249666:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249679:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249688:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.249691:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40e976 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9818111] (req 700416->9818111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.249734:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.249739:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.249973:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.249986:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468324288
00000100:00100000:0.0:1651532120.249994:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3090
00000100:00100000:0.0:1651532120.249996:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468324288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.249999:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.250003:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ea56 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449579 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.250010:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ea56 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449579 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.250014:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ea56 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449579 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.250017:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532120.250032:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468324288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.250035:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3090
00000100:00100000:1.0:1651532120.250114:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.250125:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468324352
00000100:00100000:0.0:1651532120.250132:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3091
00000100:00100000:0.0:1651532120.250134:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468324352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.250137:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.250140:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ea5d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449580 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.250147:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ea5d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449580 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.250151:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ea5d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449580 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.250154:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532120.250168:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468324352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.250170:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3091
00000100:00100000:1.0:1651532120.250218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.250229:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468324544
00000100:00100000:0.0:1651532120.250235:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3092
00000100:00100000:0.0:1651532120.250237:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468324544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.250240:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.250243:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ea64 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449587 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.250250:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ea64 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449587 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.250265:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ea64 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449587 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.250268:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532120.250283:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468324544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.250285:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3092
00000100:00100000:1.0:1651532120.250473:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.250484:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468324800
00000100:00100000:0.0:1651532120.250491:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3093
00000100:00100000:0.0:1651532120.250492:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468324800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.250496:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.250499:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ea6b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44958e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.250506:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ea6b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44958e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.250510:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ea6b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44958e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.250513:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532120.250526:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468324800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.250529:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3093
00000100:00100000:1.0:1651532120.250644:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.250654:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468324928
00000100:00100000:0.0:1651532120.250661:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3094
00000100:00100000:0.0:1651532120.250663:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468324928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.250666:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.250669:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea72 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449595 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.250676:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea72 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449595 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.250680:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea72 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449595 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.250683:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532120.250695:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468324928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.250698:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3094
00000100:00100000:1.0:1651532120.288110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532120.288135:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231936
00000100:00100000:0.0:1651532120.288146:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 60
00000100:00100000:0.0:1651532120.288148:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231936:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532120.288154:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 716800 granted 351257152 pending 143360 free 81138851840 avail 76966592512
00000100:00100000:0.0:1651532120.288171:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231936:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (62us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532120.288174:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 60
00000001:00080000:1.0:1651532120.357246:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793701 is committed
00010000:00010000:1.0:1651532120.357262:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.357266:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.357289:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468319936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499034us (499062us total) trans 158913793701 rc 0/0
00010000:00010000:0.0:1651532120.357289:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.357293:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4075
00010000:00010000:0.0:1651532120.357297:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.357298:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357301:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357307:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.357307:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.357308:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357311:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357329:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357332:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40e97d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->8933375] (req 712704->8933375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.357350:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.357354:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.357664:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.357673:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.357687:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.357698:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468325248
00000100:00100000:1.0:1651532120.357701:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.357713:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468325312
00010000:00010000:1.0:1651532120.357714:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.357718:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.357723:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4084
00000100:00100000:0.0:1651532120.357725:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468325248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532120.357736:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.357742:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468321088:12345-10.240.43.64@tcp:3:fio.0 Request processed in 400120us (400174us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532120.357744:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532120.357745:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4076
00010000:00010000:0.0:1651532120.357745:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357747:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532120.357748:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357752:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357756:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.357759:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4085
00000100:00100000:1.0:1651532120.357761:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468325312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532120.357763:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357766:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.357767:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.357769:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357770:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.357775:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.357776:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.357779:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532120.357780:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357783:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.357784:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.357784:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357790:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.357793:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357797:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357800:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40e9a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [528384->8437759] (req 528384->8437759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.357813:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.357820:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.357820:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468325440
00010000:00010000:1.0:1651532120.357823:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.357829:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468325568
00000100:00100000:0.0:1651532120.357834:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3095
00000100:00100000:0.0:1651532120.357835:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468325440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.357838:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.357841:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ea87 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44959c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.357849:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ea87 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44959c expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532120.357852:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3096
00010000:00010000:0.0:1651532120.357853:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ea87 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44959c expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532120.357854:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468325568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.357856:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532120.357857:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532120.357865:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468325440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (178us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532120.357869:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ea8e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495a3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.357869:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3095
00010000:00010000:1.0:1651532120.357877:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ea8e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495a3 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.357881:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ea8e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495a3 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.357885:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532120.357893:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468325568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (191us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.357895:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3096
00000100:00100000:1.0:1651532120.358298:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.358309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.358329:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468325696
00000100:00100000:0.0:1651532120.358331:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468325760
00000100:00100000:1.0:1651532120.358342:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3097
00000100:00100000:1.0:1651532120.358344:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468325696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532120.358347:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3098
00010000:00010000:1.0:1651532120.358348:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532120.358349:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468325760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.358353:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ea95 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495aa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.358353:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.358357:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ea9c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495b1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.358363:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ea95 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495aa expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.358365:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ea9c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495b1 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.358368:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ea95 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495aa expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.358370:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ea9c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495b1 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.358373:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532120.358384:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:0.0:1651532120.358388:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468325760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.358391:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3098
00000100:00100000:1.0:1651532120.358401:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468325696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.358405:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3097
00000100:00100000:1.0:1651532120.358720:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.358727:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468326080
00000100:00100000:1.0:1651532120.358743:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3099
00000100:00100000:1.0:1651532120.358745:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468326080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.358749:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.358753:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaa3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495b8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.358761:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaa3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495b8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.358766:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaa3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495b8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.358769:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532120.358780:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468326080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.358782:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3099
00000001:00080000:1.0:1651532120.448950:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793702 is committed
00010000:00010000:1.0:1651532120.448967:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.448974:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.448999:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468321024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491358us (491422us total) trans 158913793702 rc 0/0
00010000:00010000:0.0:1651532120.448999:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.449003:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4077
00010000:00010000:0.0:1651532120.449003:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.449005:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449008:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449014:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.449015:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.449016:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449019:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449026:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449029:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40e9ae lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9928703] (req 208896->9928703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449037:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449043:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.449433:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.449451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.449459:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.449467:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.449478:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468326336
00000100:00100000:0.0:1651532120.449480:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468326464
00000100:00100000:1.0:1651532120.449488:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468326272
00000100:00100000:0.0:1651532120.449490:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468326528
00000100:00100000:1.0:1651532120.449497:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4086
00000100:00100000:1.0:1651532120.449499:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468326336:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532120.449502:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3100
00000100:00100000:0.0:1651532120.449504:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468326464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.449507:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449508:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.449512:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532120.449512:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eab1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495bf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.449513:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532120.449514:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.449518:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.449525:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4087
00000100:00100000:1.0:1651532120.449526:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468326272:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532120.449531:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449532:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eab1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495bf expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.449535:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532120.449535:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.449538:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.449541:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532120.449541:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449545:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eab1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495bf expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.449546:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.449548:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.449549:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532120.449552:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.449559:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3101
00000100:00100000:0.0:1651532120.449563:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468326464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.449567:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468326528:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532120.449567:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3100
00010000:00010000:1.0:1651532120.449570:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.449573:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40eabf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495c6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.449584:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40eabf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495c6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.449588:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40eabf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495c6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.449591:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532120.449600:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468326528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (133us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.449603:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3101
00000100:00100000:1.0:1651532120.449959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.449967:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468326720
00000100:00100000:1.0:1651532120.449981:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3102
00000100:00100000:1.0:1651532120.449983:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468326720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.449986:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.449990:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eac6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495cd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.449997:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eac6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495cd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.450001:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eac6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495cd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.450005:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532120.450015:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468326720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.450018:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3102
00000001:00080000:1.0:1651532120.548984:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793703 is committed
00002000:00010000:0.0:1651532120.549014:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532119 -> 1651532120
00002000:00010000:0.0:1651532120.549016:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532119 -> 1651532120
00010000:00010000:0.0:1651532120.549018:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549022:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.549046:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468321920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532619us (532670us total) trans 158913793703 rc 0/0
00000100:00100000:0.0:1651532120.549050:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4078
00010000:00010000:0.0:1651532120.549057:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549061:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.549070:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549073:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549080:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.549081:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.549082:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549087:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549101:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549104:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40e9d8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->5865471] (req 266240->5865471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549105:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549111:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549297:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549302:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549314:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549328:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.549329:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.549333:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468321984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 532848us (532942us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532120.549333:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.549337:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4079
00010000:00010000:0.0:1651532120.549341:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.549341:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.549342:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549346:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549360:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549374:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549378:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549386:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40e9df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5480448->8036351] (req 5480448->8036351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.549411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.549443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.549457:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.549468:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468326912
00000100:00100000:0.0:1651532120.549470:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468326976
00000100:00100000:1.0:1651532120.549478:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468327040
00000100:00100000:1.0:1651532120.549482:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3103
00000100:00100000:1.0:1651532120.549484:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468326912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532120.549485:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3104
00000100:00100000:0.0:1651532120.549486:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468326976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.549487:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.549490:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.549491:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eacd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495d4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549494:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ead4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495db expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549500:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eacd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495d4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.549503:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ead4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495db expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.549504:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eacd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495d4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.549507:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ead4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495db expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.549508:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00010000:00010000:0.0:1651532120.549513:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532120.549517:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468326912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.549520:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3103
00000100:00100000:0.0:1651532120.549523:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468326976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.549525:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3105
00000100:00100000:1.0:1651532120.549527:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468327040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532120.549527:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3104
00010000:00010000:1.0:1651532120.549529:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.549531:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40eadb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495e2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549537:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40eadb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495e2 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.549544:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40eadb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495e2 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.549547:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532120.549552:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468327040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.549555:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3105
00000100:00100000:1.0:1651532120.549661:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.549669:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.549678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.549680:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468327168
00000100:00100000:0.0:1651532120.549691:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468327104
00000100:00100000:0.0:1651532120.549701:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4088
00000100:00100000:0.0:1651532120.549703:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468327168:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532120.549710:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549715:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532120.549716:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549719:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532120.549720:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549724:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549727:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.549735:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4089
00000100:00100000:0.0:1651532120.549736:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468327104:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532120.549749:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468327232
00010000:00010000:0.0:1651532120.549750:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549754:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532120.549755:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549757:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532120.549758:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.549765:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3106
00000100:00100000:1.0:1651532120.549768:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468327232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.549768:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.549771:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549773:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.549779:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eaf0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495e9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549791:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eaf0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495e9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.549795:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eaf0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495e9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.549799:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532120.549842:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468327232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 73us (163us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.549846:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3106
00000100:00100000:1.0:1651532120.549862:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.549895:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468327424
00000100:00100000:1.0:1651532120.549907:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3107
00000100:00100000:1.0:1651532120.549913:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468327424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.549917:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.549921:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40eaf7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495f7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.549928:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40eaf7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495f7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.549932:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40eaf7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495f7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.549935:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532120.549943:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468327424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.549945:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3107
00000100:00100000:1.0:1651532120.549960:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.549992:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468327360
00000100:00100000:1.0:1651532120.550003:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3108
00000100:00100000:1.0:1651532120.550005:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468327360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.550008:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.550011:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eafe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495f0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.550018:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eafe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495f0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.550021:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eafe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495f0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.550025:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532120.550034:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468327360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.550037:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3108
00000001:00080000:1.0:1651532120.657351:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793704 is committed
00010000:00010000:1.0:1651532120.657367:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.657371:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.657395:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468322432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 640525us (640554us total) trans 158913793704 rc 0/0
00010000:00010000:0.0:1651532120.657395:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.657399:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4080
00010000:00010000:0.0:1651532120.657400:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.657401:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657404:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657410:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.657411:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.657419:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657423:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657433:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657438:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40e9f4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9097215] (req 3026944->9097215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.657443:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.657447:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.657633:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.657637:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657650:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657654:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532120.657655:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468322496:12345-10.240.43.64@tcp:3:fio.0 Request processed in 640775us (640802us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532120.657655:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.657658:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4081
00010000:00010000:0.0:1651532120.657660:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657668:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.657669:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.657670:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657698:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.657709:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532120.657711:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657714:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40e9fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3289088->10358783] (req 3289088->10358783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.657721:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.657724:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.657728:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468327808
00000100:00100000:0.0:1651532120.657736:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3109
00000100:00100000:0.0:1651532120.657738:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468327808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.657742:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.657753:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eb05 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4495fe expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.657761:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eb05 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495fe expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.657767:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eb05 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4495fe expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.657773:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532120.657790:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468327808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.657793:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3109
00000100:00100000:1.0:1651532120.658113:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.658119:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.658125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.658137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.658138:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468328064
00000100:00100000:0.0:1651532120.658147:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468328128
00000100:00100000:0.0:1651532120.658151:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3110
00000100:00100000:0.0:1651532120.658153:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468328064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.658157:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.658160:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb0c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449605 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.658168:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb0c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449605 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.658172:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb0c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449605 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.658176:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532120.658190:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468328064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.658193:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3110
00000100:00100000:0.0:1651532120.658198:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3111
00000100:00100000:0.0:1651532120.658200:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468328128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.658203:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.658205:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eb13 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44960c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.658206:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468328000
00010000:00010000:0.0:1651532120.658211:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eb13 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44960c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.658215:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eb13 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44960c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532120.658220:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468327936
00010000:00010000:0.0:1651532120.658221:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532120.658226:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468328128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.658229:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3111
00000100:00100000:1.0:1651532120.658232:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4090
00000100:00100000:1.0:1651532120.658235:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468328000:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532120.658243:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4091
00000100:00100000:0.0:1651532120.658245:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468327936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532120.658246:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.658251:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.658255:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532120.658256:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.658258:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532120.658259:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.658264:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532120.658266:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.658269:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532120.658270:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.658273:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.658277:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.658288:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.658292:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532120.715721:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793705 is committed
00010000:00010000:1.0:1651532120.715737:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.715741:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.715765:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.715766:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468323776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466248us (466354us total) trans 158913793705 rc 0/0
00000100:00100000:1.0:1651532120.715769:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4082
00010000:00010000:0.0:1651532120.715773:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.715774:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.715777:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.715783:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.715783:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.715784:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.715787:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.715797:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.715815:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ea33 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3694592->10100735] (req 3694592->10100735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.715824:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.715829:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.716172:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.716180:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.716191:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468328384
00010000:00010000:1.0:1651532120.716198:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.716199:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468328512
00010000:00010000:1.0:1651532120.716202:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.716204:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3112
00000100:00100000:0.0:1651532120.716206:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468328384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.716215:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532120.716219:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468323840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466661us (466798us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532120.716219:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eb28 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449613 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.716223:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4083
00000100:00100000:1.0:1651532120.716230:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3113
00000100:00100000:1.0:1651532120.716232:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468328512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.716232:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.716235:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eb28 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449613 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.716236:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.716239:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40eb2f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44961a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716239:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eb28 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449613 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.716243:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532120.716245:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.716248:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40eb2f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44961a expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.716252:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40eb2f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44961a expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532120.716252:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468328384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.716255:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3112
00010000:00010000:1.0:1651532120.716256:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532120.716262:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468328512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (83us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532120.716263:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.716265:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3113
00010000:00010000:0.0:1651532120.716266:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.716267:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716270:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716274:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.716275:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.716276:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716279:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716286:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716289:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ea41 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->10039295] (req 1138688->10039295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716294:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716298:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.716709:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.716727:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.716735:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.716753:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.716762:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.716770:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468328576
00000100:00100000:1.0:1651532120.716783:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468328640
00000100:00100000:0.0:1651532120.716794:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4092
00000100:00100000:1.0:1651532120.716797:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4093
00000100:00100000:0.0:1651532120.716797:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468328576:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532120.716799:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468328640:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532120.716819:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716819:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716824:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532120.716825:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716828:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532120.716828:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.716832:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532120.716834:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.716837:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532120.716837:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.716842:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716842:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.716846:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716849:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.716864:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468328704
00000100:00100000:1.0:1651532120.716865:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468328832
00000100:00100000:1.0:1651532120.716874:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468328896
00000100:00100000:1.0:1651532120.716878:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3114
00000100:00100000:1.0:1651532120.716879:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468328832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.716882:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532120.716882:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3115
00000100:00100000:0.0:1651532120.716883:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468328704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.716885:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40eb44 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449628 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.716886:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.716889:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eb4b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449621 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.716893:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40eb44 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449628 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.716897:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40eb44 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449628 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.716897:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eb4b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449621 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.716901:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00010000:00010000:0.0:1651532120.716901:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eb4b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449621 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.716904:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532120.716911:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468328832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (170us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.716914:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3114
00000100:00100000:0.0:1651532120.716914:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468328704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (178us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.716916:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3115
00000100:00100000:1.0:1651532120.716919:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3116
00000100:00100000:1.0:1651532120.716921:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468328896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.716923:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.716925:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eb52 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44962f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.716931:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eb52 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44962f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.716943:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eb52 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44962f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.716946:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532120.716953:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468328896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (191us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.716956:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3116
00000100:00100000:1.0:1651532120.717224:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.717232:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468329088
00000100:00100000:1.0:1651532120.717248:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3117
00000100:00100000:1.0:1651532120.717250:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468329088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.717253:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.717257:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40eb59 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449636 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.717264:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40eb59 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449636 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.717268:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40eb59 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449636 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.717271:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532120.717281:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468329088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.717285:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3117
00000100:00100000:1.0:1651532120.717310:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.717358:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468329152
00000100:00100000:1.0:1651532120.717369:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3118
00000100:00100000:1.0:1651532120.717370:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468329152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.717373:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.717377:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb60 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44963d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.717384:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb60 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44963d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.717388:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb60 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44963d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.717391:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532120.717401:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468329152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.717403:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3118
00000100:00100000:1.0:1651532120.717573:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.717580:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468329344
00000100:00100000:1.0:1651532120.717591:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3119
00000100:00100000:1.0:1651532120.717593:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468329344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.717596:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.717600:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40eb67 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449644 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.717607:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40eb67 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449644 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.717611:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40eb67 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449644 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.717614:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532120.717623:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468329344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.717625:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3119
00000100:00100000:1.0:1651532120.717892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.717899:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468329536
00000100:00100000:1.0:1651532120.717912:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3120
00000100:00100000:1.0:1651532120.717914:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f253594 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468329536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.717917:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.717921:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40eb6e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44964b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.717928:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40eb6e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44964b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.717932:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40eb6e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44964b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.717935:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532120.717945:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f253594 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468329536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.717947:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3120
00000001:00080000:1.0:1651532120.853266:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793706 is committed
00010000:00010000:0.0:1651532120.853294:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853299:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.853336:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468325248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 495609us (495672us total) trans 158913793706 rc 0/0
00000100:00100000:0.0:1651532120.853340:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4084
00010000:00010000:0.0:1651532120.853349:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853352:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.853353:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853356:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853361:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.853362:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.853363:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853366:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853369:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.853370:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.853370:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853374:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853394:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853398:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ea79 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9125887] (req 36864->9125887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.853401:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.853406:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853409:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853412:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.853787:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.853796:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.853819:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468329856
00000100:00100000:1.0:1651532120.853822:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.853838:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.853840:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468329984
00000100:00100000:0.0:1651532120.853843:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468329920
00000100:00100000:0.0:1651532120.853845:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468330048
00010000:00010000:1.0:1651532120.853849:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.853849:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3121
00000100:00100000:0.0:1651532120.853851:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468329856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.853853:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853855:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.853859:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eb75 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449652 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853870:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532120.853871:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468326336:12345-10.240.43.64@tcp:3:fio.0 Request processed in 404371us (404438us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532120.853873:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eb75 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449652 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532120.853875:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4086
00010000:00010000:0.0:1651532120.853878:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eb75 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449652 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.853882:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532120.853883:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3122
00000100:00100000:1.0:1651532120.853885:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468329984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.853889:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532120.853891:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468329856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (105us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532120.853892:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40eb7c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449660 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.853894:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3121
00010000:00010000:1.0:1651532120.853898:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532120.853900:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3123
00010000:00010000:1.0:1651532120.853901:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40eb7c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449660 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532120.853901:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468329920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.853904:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.853905:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40eb7c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449660 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.853906:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eb83 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449659 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.853909:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00010000:00010000:0.0:1651532120.853910:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.853912:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eb83 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449659 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532120.853915:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468329984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (119us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532120.853916:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eb83 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449659 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532120.853918:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3122
00010000:00010000:0.0:1651532120.853919:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532120.853922:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3124
00000100:00100000:1.0:1651532120.853924:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468330048:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532120.853924:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468329920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (103us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532120.853926:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532120.853927:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3123
00010000:00010000:1.0:1651532120.853928:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40eb8a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449667 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.853932:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.853934:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40eb8a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449667 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.853938:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40eb8a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449667 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.853938:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.853941:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00010000:00010000:0.0:1651532120.853941:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.853946:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468330048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.853949:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3124
00000100:00100000:0.0:1651532120.853953:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468325312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 496192us (496280us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532120.853957:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4085
00010000:00010000:0.0:1651532120.853962:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853966:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.853967:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853970:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853975:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853977:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40eaaa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3026944->9621503] (req 3026944->9621503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853981:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853984:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.853985:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.853990:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.854009:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.854010:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.854011:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.854014:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.854027:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.854032:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ea80 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->8544255] (req 393216->8544255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.854036:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.854041:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.854386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.854393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.854414:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.854414:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468330368
00000100:00100000:1.0:1651532120.854421:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.854425:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468330432
00000100:00100000:1.0:1651532120.854427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.854431:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4094
00000100:00100000:0.0:1651532120.854433:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468330368:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532120.854434:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.854445:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4095
00010000:00010000:0.0:1651532120.854446:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.854447:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468330432:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532120.854451:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532120.854452:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.854455:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.854455:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532120.854455:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.854470:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532120.854471:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.854474:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532120.854475:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.854479:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.854480:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.854483:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.854483:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.854492:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468330304
00000100:00100000:0.0:1651532120.854497:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468330560
00000100:00100000:0.0:1651532120.854500:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468330688
00000100:00100000:0.0:1651532120.854502:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468330624
00000100:00100000:0.0:1651532120.854505:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3125
00000100:00100000:0.0:1651532120.854506:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468330304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.854509:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.854512:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40eb9f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44966e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.854519:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40eb9f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44966e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.854523:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40eb9f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44966e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.854527:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532120.854541:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468330304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (155us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.854544:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3125
00000100:00100000:0.0:1651532120.854549:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3126
00000100:00100000:0.0:1651532120.854551:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468330560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.854553:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532120.854554:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3127
00010000:00010000:0.0:1651532120.854555:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40eba6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449675 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.854556:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468330688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.854562:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.854562:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40eba6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449675 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.854566:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ebad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449683 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.854566:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40eba6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449675 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.854569:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532120.854574:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468330560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (153us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.854576:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3126
00010000:00010000:1.0:1651532120.854578:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ebad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449683 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532120.854580:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3128
00000100:00100000:0.0:1651532120.854581:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468330624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.854583:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.854585:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ebb4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44967c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.854586:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ebad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449683 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.854590:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ebb4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44967c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.854591:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532120.854594:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ebb4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44967c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.854597:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532120.854601:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468330688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (174us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.854602:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468330624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (168us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.854604:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3127
00000100:00100000:0.0:1651532120.854606:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3128
00000100:00100000:0.0:1651532120.855050:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.855058:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.855072:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468330816
00000100:00100000:1.0:1651532120.855077:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468331008
00000100:00100000:0.0:1651532120.855083:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3129
00000100:00100000:0.0:1651532120.855085:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468330816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.855089:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532120.855095:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3130
00000100:00100000:1.0:1651532120.855097:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468331008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.855098:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ebbb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44968a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.855100:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.855104:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ebc2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449691 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.855106:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ebbb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44968a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.855110:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ebbb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44968a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.855112:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ebc2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449691 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.855113:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532120.855116:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ebc2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449691 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.855119:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:0.0:1651532120.855127:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468330816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.855129:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3129
00000100:00100000:1.0:1651532120.855135:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468331008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.855137:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3130
00000100:00100000:0.0:1651532120.855496:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.855511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.855523:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468331136
00000100:00100000:1.0:1651532120.855535:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468331328
00000100:00100000:1.0:1651532120.855539:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3131
00000100:00100000:1.0:1651532120.855541:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468331136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.855544:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532120.855546:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3132
00010000:00010000:1.0:1651532120.855547:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebc9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449698 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.855548:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468331328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.855551:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.855555:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebc9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449698 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.855555:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebd0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44969f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.855559:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebc9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449698 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.855562:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00010000:00010000:0.0:1651532120.855563:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebd0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44969f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.855567:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebd0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44969f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.855570:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532120.855572:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468331136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.855575:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3131
00000100:00100000:0.0:1651532120.855578:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468331328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.855581:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3132
00000001:00080000:1.0:1651532120.924089:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793707 is committed
00010000:00010000:1.0:1651532120.924106:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924110:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924129:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.924135:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468326272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474608us (474684us total) trans 158913793707 rc 0/0
00000100:00100000:1.0:1651532120.924138:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4087
00010000:00010000:0.0:1651532120.924139:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532120.924140:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924144:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924150:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.924151:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532120.924152:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924155:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924162:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924165:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eab8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->7938047] (req 389120->7938047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924170:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924173:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924374:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924379:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924394:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.924400:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468327168:12345-10.240.43.64@tcp:3:fio.0 Request processed in 374696us (374739us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532120.924403:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532120.924403:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4088
00010000:00010000:1.0:1651532120.924404:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924408:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924413:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.924414:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532120.924415:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924418:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924428:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924431:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40eae2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1789952->10149887] (req 1789952->10149887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924432:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924444:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.924541:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.924552:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.924562:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468331520
00000100:00100000:1.0:1651532120.924582:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468331584
00000100:00100000:1.0:1651532120.924595:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4096
00000100:00100000:1.0:1651532120.924597:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468331520:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532120.924605:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4097
00000100:00100000:0.0:1651532120.924609:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468331584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532120.924610:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924614:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532120.924615:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924618:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532120.924618:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924619:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924623:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532120.924624:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924627:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532120.924628:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924631:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924632:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924635:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924636:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.924647:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.924658:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468331712
00000100:00100000:1.0:1651532120.924672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.924672:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3133
00000100:00100000:0.0:1651532120.924674:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468331712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.924677:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532120.924680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532120.924686:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468331776
00000100:00100000:1.0:1651532120.924691:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468331904
00010000:00010000:0.0:1651532120.924691:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ebe5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496a6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532120.924694:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3134
00000100:00100000:1.0:1651532120.924696:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468331776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.924699:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532120.924702:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ebec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496ad expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532120.924710:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ebec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496ad expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.924714:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ebec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496ad expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.924717:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00010000:00010000:0.0:1651532120.924735:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ebe5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496a6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.924739:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ebe5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496a6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532120.924740:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468331776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.924743:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3134
00010000:00010000:0.0:1651532120.924743:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532120.924748:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3135
00000100:00100000:1.0:1651532120.924750:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468331904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532120.924753:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532120.924753:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468331712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 79us (106us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532120.924755:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ebf3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496b4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532120.924756:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3133
00010000:00010000:1.0:1651532120.924761:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ebf3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496b4 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.924765:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ebf3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496b4 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532120.924768:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532120.924774:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468331904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532120.924777:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3135
00000100:00100000:1.0:1651532120.924791:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.924839:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468331968
00000100:00100000:0.0:1651532120.924855:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3136
00000100:00100000:0.0:1651532120.924857:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468331968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.924860:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.924864:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ebfa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496bb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.924873:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ebfa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496bb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.924880:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ebfa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496bb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.924903:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532120.924919:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468331968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.924922:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3136
00000100:00100000:1.0:1651532120.925076:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.925088:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468332224
00000100:00100000:0.0:1651532120.925099:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3137
00000100:00100000:0.0:1651532120.925101:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468332224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.925105:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.925116:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec01 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496c2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.925123:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec01 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496c2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.925128:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec01 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496c2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.925131:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532120.925144:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468332224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.925146:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3137
00000100:00100000:1.0:1651532120.925387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532120.925399:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468332416
00000100:00100000:0.0:1651532120.925410:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3138
00000100:00100000:0.0:1651532120.925412:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468332416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532120.925415:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532120.925419:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec08 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496c9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532120.925429:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec08 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496c9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.925433:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec08 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496c9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532120.925436:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532120.925448:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468332416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532120.925451:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3138
00000001:00080000:1.0:1651532121.064746:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793708 is committed
00010000:00010000:0.0:1651532121.064777:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.064781:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.064815:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468327104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 515077us (515146us total) trans 158913793708 rc 0/0
00000100:00100000:0.0:1651532121.064819:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4089
00010000:00010000:0.0:1651532121.064827:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.064831:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532121.064832:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.064838:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.064845:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.064846:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.064847:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.064853:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.064864:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.064867:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40eae9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->9297919] (req 1593344->9297919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.064872:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.064875:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.065273:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.065283:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.065292:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.065301:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.065309:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468332672
00000100:00100000:1.0:1651532121.065317:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468332800
00000100:00100000:1.0:1651532121.065337:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3139
00000100:00100000:1.0:1651532121.065339:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468332672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.065343:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.065347:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec0f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496d0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.065359:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec0f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496d0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.065364:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec0f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496d0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532121.065367:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468332608
00010000:00010000:1.0:1651532121.065368:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:0.0:1651532121.065378:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468332544
00000100:00100000:1.0:1651532121.065381:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468332672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.065384:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4098
00000100:00100000:1.0:1651532121.065386:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3139
00000100:00100000:0.0:1651532121.065386:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468332608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532121.065393:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.065395:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3140
00010000:00010000:0.0:1651532121.065398:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532121.065399:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468332800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.065399:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532121.065399:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.065403:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.065404:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.065408:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ec1d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496d7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.065409:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4099
00000100:00100000:0.0:1651532121.065410:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468332544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532121.065415:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.065417:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ec1d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496d7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.065418:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532121.065419:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.065422:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.065424:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532121.065425:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.065429:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.065435:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ec1d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496d7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.065439:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00010000:00010000:0.0:1651532121.065445:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.065447:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468332800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (146us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532121.065449:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.065450:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3140
00000100:00100000:1.0:1651532121.065743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.065751:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468332928
00000100:00100000:1.0:1651532121.065764:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3141
00000100:00100000:1.0:1651532121.065766:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468332928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.065769:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.065773:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec2b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496de expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.065780:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec2b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496de expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.065784:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec2b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496de expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.065787:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532121.065797:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468332928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.065799:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3141
00000100:00100000:1.0:1651532121.066035:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.066042:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468333120
00000100:00100000:1.0:1651532121.066053:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3142
00000100:00100000:1.0:1651532121.066054:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468333120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.066058:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.066061:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec32 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496e5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.066068:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec32 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496e5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.066072:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec32 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496e5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.066076:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532121.066085:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468333120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.066087:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3142
00000001:00080000:1.0:1651532121.173093:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793709 is committed
00010000:00010000:0.0:1651532121.173124:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173128:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.173150:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ffe51d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468327936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 514904us (515029us total) trans 158913793709 rc 0/0
00010000:00010000:1.0:1651532121.173151:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.173153:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4091
00010000:00010000:1.0:1651532121.173156:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.173157:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173161:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173167:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.173168:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.173168:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173172:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173188:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173191:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40eb21 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->6299647] (req 16384->6299647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173197:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173208:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173482:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173487:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.173507:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000515853f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468328000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 515271us (515394us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532121.173510:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4090
00010000:00010000:0.0:1651532121.173522:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173527:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532121.173528:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173532:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.173537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532121.173538:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.173539:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.173540:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173549:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173559:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173562:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40eb1a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->8155135] (req 774144->8155135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173570:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173575:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.173577:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468333440
00000100:00100000:1.0:1651532121.173588:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3143
00000100:00100000:1.0:1651532121.173590:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468333440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.173594:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.173605:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec39 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496ec expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173613:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec39 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496ec expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.173618:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec39 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496ec expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.173621:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532121.173631:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468333440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.173634:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3143
00000100:00100000:0.0:1651532121.173903:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.173919:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468333568
00000100:00100000:0.0:1651532121.173920:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.173928:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.173933:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468333504
00000100:00100000:1.0:1651532121.173942:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4100
00000100:00100000:1.0:1651532121.173944:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468333568:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532121.173948:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532121.173951:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.173959:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4101
00010000:00010000:1.0:1651532121.173961:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532121.173962:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.173962:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468333504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532121.173965:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532121.173966:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173970:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173971:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173976:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532121.173977:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173991:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532121.173992:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.173996:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.173997:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.174001:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.174004:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468333696
00000100:00100000:1.0:1651532121.174012:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468333760
00000100:00100000:1.0:1651532121.174017:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3144
00000100:00100000:1.0:1651532121.174019:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468333696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532121.174020:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3145
00010000:00010000:1.0:1651532121.174022:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532121.174022:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468333760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.174025:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ec4e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496f3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.174025:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.174028:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec55 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4496fa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.174032:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ec4e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496f3 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.174036:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ec4e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496f3 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.174036:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec55 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496fa expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.174040:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00010000:00010000:0.0:1651532121.174040:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec55 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4496fa expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.174044:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532121.174050:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468333696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.174053:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3144
00000100:00100000:0.0:1651532121.174053:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468333760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.174056:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3145
00000001:00080000:1.0:1651532121.264786:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793710 is committed
00010000:00010000:0.0:1651532121.264818:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.264822:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.264839:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468328576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 548041us (548130us total) trans 158913793710 rc 0/0
00000100:00100000:0.0:1651532121.264842:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4092
00010000:00010000:0.0:1651532121.264848:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.264852:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532121.264853:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.264856:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.264861:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.264861:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.264862:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.264865:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.264877:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.264883:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eb36 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5066752->5070847] (req 5066752->5070847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.264891:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.264895:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265078:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265082:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.265099:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468328640:12345-10.240.43.64@tcp:3:fio.0 Request processed in 548299us (548379us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532121.265102:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4093
00010000:00010000:1.0:1651532121.265108:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265112:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.265113:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265116:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265121:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.265122:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.265122:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265125:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265138:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265141:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40eb3d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->9625599] (req 860160->9625599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.265163:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.265176:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.265186:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.265202:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468334080
00000100:00100000:1.0:1651532121.265219:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3146
00000100:00100000:1.0:1651532121.265221:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468334080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.265225:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.265228:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ec5c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449701 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265244:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ec5c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449701 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.265248:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ec5c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449701 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.265252:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532121.265264:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468334080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.265267:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3146
00000100:00100000:0.0:1651532121.265527:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.265538:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468334144
00000100:00100000:0.0:1651532121.265540:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.265547:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.265551:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468334208
00000100:00100000:1.0:1651532121.265565:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4102
00000100:00100000:1.0:1651532121.265566:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468334144:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532121.265568:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532121.265574:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.265575:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4103
00010000:00010000:1.0:1651532121.265578:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532121.265578:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468334208:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532121.265580:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265582:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532121.265583:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265587:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.265587:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.265591:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532121.265592:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.265595:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532121.265596:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265599:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.265600:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.265604:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.265607:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468334336
00000100:00100000:1.0:1651532121.265612:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468334400
00000100:00100000:1.0:1651532121.265616:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3147
00000100:00100000:1.0:1651532121.265618:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468334336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.265621:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.265623:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec71 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449708 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265630:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec71 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449708 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.265637:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec71 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449708 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.265640:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532121.265650:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468334336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.265653:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3147
00000100:00100000:1.0:1651532121.265657:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3148
00000100:00100000:1.0:1651532121.265659:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468334400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.265661:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.265663:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ec78 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44970f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.265669:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ec78 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44970f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.265672:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ec78 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44970f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.265675:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532121.265682:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468334400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.265686:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3148
00000001:00080000:1.0:1651532121.348299:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793711 is committed
00010000:00010000:0.0:1651532121.348339:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348343:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.348362:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468330368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 493928us (493968us total) trans 158913793711 rc 0/0
00000100:00100000:0.0:1651532121.348365:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4094
00010000:00010000:0.0:1651532121.348372:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348375:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532121.348376:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348379:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348384:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.348385:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.348385:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348391:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348404:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348407:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eb91 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10448895] (req 729088->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.348417:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.348422:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.348749:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.348754:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348768:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348774:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532121.348775:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468330432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 494327us (494361us total) trans 0 rc 49152/49152
00010000:00010000:0.0:1651532121.348776:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.348779:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4095
00010000:00010000:0.0:1651532121.348794:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348800:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.348801:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.348801:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348819:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348837:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348841:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40eb98 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->9957375] (req 1105920->9957375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.348847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532121.348851:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.348854:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.348856:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.348867:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468334720
00000100:00100000:1.0:1651532121.348877:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468334848
00000100:00100000:1.0:1651532121.348884:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3149
00000100:00100000:1.0:1651532121.348885:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468334720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.348889:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.348893:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ec7f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449716 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.348897:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3150
00000100:00100000:0.0:1651532121.348899:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468334848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.348901:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ec7f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449716 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.348903:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.348907:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ec86 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44971d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.348909:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ec7f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449716 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.348913:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00010000:00010000:0.0:1651532121.348915:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ec86 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44971d expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.348919:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ec86 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44971d expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532121.348921:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468334720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (74us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532121.348922:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532121.348924:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3149
00000100:00100000:0.0:1651532121.348930:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468334848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.348932:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3150
00000100:00100000:1.0:1651532121.349027:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.349035:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.349047:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.349056:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468334912
00000100:00100000:0.0:1651532121.349058:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468334976
00000100:00100000:1.0:1651532121.349068:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4104
00000100:00100000:1.0:1651532121.349070:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468334912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532121.349076:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.349081:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532121.349082:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.349085:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532121.349086:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.349090:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.349104:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4105
00010000:00010000:1.0:1651532121.349105:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.349106:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468334976:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532121.349114:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.349118:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532121.349119:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.349122:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532121.349123:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.349127:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.349131:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.349138:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468335040
00000100:00100000:0.0:1651532121.349150:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3151
00000100:00100000:0.0:1651532121.349151:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468335040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.349154:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.349157:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ec9b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449724 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.349164:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ec9b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449724 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.349168:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ec9b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449724 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.349171:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532121.349184:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468335040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.349187:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3151
00000100:00100000:0.0:1651532121.349373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.349381:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.349394:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468335296
00000100:00100000:0.0:1651532121.349405:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468335232
00000100:00100000:0.0:1651532121.349417:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3152
00000100:00100000:0.0:1651532121.349420:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468335296:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532121.349426:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3153
00000100:00100000:1.0:1651532121.349430:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468335232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.349443:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.349444:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.349448:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eca2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449732 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.349450:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eca9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44972b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.349456:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eca2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449732 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.349458:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eca9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44972b expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.349460:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40eca2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449732 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.349463:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40eca9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44972b expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.349464:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532121.349466:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:0.0:1651532121.349475:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468335296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.349476:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468335232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.349478:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3153
00000100:00100000:0.0:1651532121.349487:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3152
00000100:00100000:1.0:1651532121.349527:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.349545:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468335488
00000100:00100000:0.0:1651532121.349557:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3154
00000100:00100000:0.0:1651532121.349559:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468335488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.349562:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.349566:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecb0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449739 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.349573:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecb0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449739 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.349577:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecb0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449739 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.349581:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532121.349589:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468335488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.349592:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3154
00000100:00100000:1.0:1651532121.349898:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.349909:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.349909:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468335744
00000100:00100000:1.0:1651532121.349916:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468335616
00000100:00100000:0.0:1651532121.349920:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3155
00000100:00100000:0.0:1651532121.349922:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468335744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.349926:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532121.349929:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3156
00010000:00010000:0.0:1651532121.349929:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ecb7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449747 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.349931:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468335616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.349937:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ecb7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449747 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.349941:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ecb7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449747 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.349943:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.349944:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532121.349946:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ecbe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449740 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.349954:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ecbe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449740 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532121.349955:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468335744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (58us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532121.349958:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ecbe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449740 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532121.349958:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3155
00010000:00010000:1.0:1651532121.349961:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532121.349970:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468335616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.349972:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3156
00000100:00100000:1.0:1651532121.350254:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.350261:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468335872
00000100:00100000:1.0:1651532121.350268:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3157
00000100:00100000:1.0:1651532121.350269:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468335872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.350273:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.350276:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecc5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44974e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.350283:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecc5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44974e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.350287:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecc5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44974e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.350291:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532121.350305:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468335872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.350307:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3157
00000100:00100000:1.0:1651532121.350512:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.350518:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468336064
00000100:00100000:1.0:1651532121.350525:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3158
00000100:00100000:1.0:1651532121.350526:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468336064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.350530:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.350533:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eccc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449755 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.350540:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eccc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449755 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.350543:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40eccc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449755 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.350547:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532121.350560:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468336064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.350563:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3158
00000100:00100000:1.0:1651532121.350761:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.350768:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468336192
00000100:00100000:1.0:1651532121.350774:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3159
00000100:00100000:1.0:1651532121.350776:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468336192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.350779:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.350782:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ecd3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44975c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.350788:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ecd3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44975c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.350792:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ecd3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44975c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.350796:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532121.350822:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468336192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.350824:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3159
00000001:00080000:1.0:1651532121.529639:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793712 is committed
00010000:00010000:0.0:1651532121.529671:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.529677:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.529698:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468331520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 605100us (605163us total) trans 158913793712 rc 0/0
00010000:00010000:1.0:1651532121.529701:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.529702:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4096
00010000:00010000:1.0:1651532121.529706:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.529708:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.529711:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.529717:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.529718:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.529719:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.529722:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.529725:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.529726:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.529726:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.529729:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.529746:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.529746:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.529749:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ebd7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1695744->10407935] (req 1695744->10407935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.529752:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.529759:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.529762:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.530114:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.530127:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.530136:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.530144:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468336448
00000100:00100000:1.0:1651532121.530161:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468336384
00000100:00100000:1.0:1651532121.530164:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468336576
00010000:00010000:0.0:1651532121.530166:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.530168:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3160
00000100:00100000:1.0:1651532121.530170:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468336448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.530174:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.530178:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ecda lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44976a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.530179:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530184:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.530187:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ecda lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44976a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.530191:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ecda lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44976a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.530195:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:0.0:1651532121.530195:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468332608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 464809us (464923us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532121.530199:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4098
00000100:00100000:1.0:1651532121.530204:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468336448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.530206:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3160
00010000:00010000:0.0:1651532121.530206:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.530209:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532121.530210:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.530211:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3161
00000100:00100000:1.0:1651532121.530213:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468336384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.530213:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530215:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.530217:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ece1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449763 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.530219:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530221:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.530221:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ec16 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1769472->8593407] (req 1769472->8593407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530223:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ece1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449763 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.530227:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ece1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449763 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532121.530228:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3162
00000100:00100000:0.0:1651532121.530230:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468336576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.530234:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.530237:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ece8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449771 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530239:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532121.530243:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532121.530246:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468336384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (119us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532121.530246:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ece8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449771 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532121.530249:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3161
00010000:00010000:0.0:1651532121.530250:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ece8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449771 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.530253:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532121.530260:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468336576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (124us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532121.530262:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.530263:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3162
00010000:00010000:1.0:1651532121.530266:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.530282:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468331584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 605673us (605730us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532121.530285:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4097
00010000:00010000:1.0:1651532121.530297:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530300:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.530302:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530337:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530343:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.530343:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.530344:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530355:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530366:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530369:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ebde lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3182592->9818111] (req 3182592->9818111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.530395:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.530399:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.530684:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.530695:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468336640
00000100:00100000:0.0:1651532121.530695:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.530702:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.530712:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468336704
00000100:00100000:0.0:1651532121.530718:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.530719:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4106
00000100:00100000:1.0:1651532121.530721:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468336640:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532121.530728:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532121.530733:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.530735:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532121.530737:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532121.530743:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.530745:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4107
00010000:00010000:1.0:1651532121.530746:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532121.530747:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.530747:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468336704:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532121.530751:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530755:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.530757:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.530761:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532121.530762:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.530763:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468336960
00010000:00010000:0.0:1651532121.530765:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532121.530766:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.530767:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468336896
00000100:00100000:1.0:1651532121.530769:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468336832
00000100:00100000:1.0:1651532121.530771:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468337024
00010000:00010000:0.0:1651532121.530771:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.530774:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3163
00010000:00010000:0.0:1651532121.530774:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.530775:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468336960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.530778:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.530780:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ecfd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449786 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530787:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ecfd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449786 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.530791:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ecfd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449786 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.530795:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532121.530820:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468336960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.530823:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3163
00000100:00100000:1.0:1651532121.530828:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3164
00000100:00100000:1.0:1651532121.530829:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468336896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.530832:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.530842:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ed04 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44977f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.530851:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ed04 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44977f expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.530855:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40ed04 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44977f expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532121.530857:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3165
00010000:00010000:1.0:1651532121.530858:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:0.0:1651532121.530859:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468336832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.530863:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532121.530865:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468336896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (147us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532121.530866:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ed0b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449778 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.530868:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3164
00000100:00100000:1.0:1651532121.530874:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3166
00010000:00010000:0.0:1651532121.530874:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ed0b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449778 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532121.530877:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468337024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.530878:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ed0b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449778 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.530881:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.530886:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ed12 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44978d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.530894:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532121.530896:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ed12 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44978d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.530903:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ed12 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44978d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532121.530904:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468336832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (176us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532121.530906:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:0.0:1651532121.530907:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3165
00000100:00100000:1.0:1651532121.530928:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468337024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (192us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.530931:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3166
00000100:00100000:0.0:1651532121.531185:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.531204:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468337216
00000100:00100000:1.0:1651532121.531212:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3167
00000100:00100000:1.0:1651532121.531214:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3508860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468337216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.531217:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.531220:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ed19 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449794 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.531227:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ed19 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449794 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.531231:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ed19 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449794 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.531234:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532121.531248:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3508860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468337216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.531250:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3167
00000100:00100000:0.0:1651532121.531397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.531412:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.531421:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.531423:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468337280
00000100:00100000:1.0:1651532121.531436:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468337472
00000100:00100000:1.0:1651532121.531440:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3168
00000100:00100000:1.0:1651532121.531441:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468337280:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532121.531441:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468337664
00010000:00010000:1.0:1651532121.531444:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.531448:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ed20 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44979b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.531448:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3169
00000100:00100000:0.0:1651532121.531450:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468337472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.531454:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.531457:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ed20 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44979b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.531458:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ed27 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497a2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.531461:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ed20 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44979b expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.531465:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00010000:00010000:0.0:1651532121.531466:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ed27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497a2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.531470:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ed27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497a2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532121.531476:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468337280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.531479:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3168
00010000:00010000:0.0:1651532121.531480:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532121.531484:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3170
00000100:00100000:1.0:1651532121.531485:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468337664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.531488:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532121.531489:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468337472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (77us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532121.531490:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ed2e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497a9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.531492:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3169
00010000:00010000:1.0:1651532121.531496:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ed2e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497a9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.531500:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ed2e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497a9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.531503:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532121.531508:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468337664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.531511:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3170
00000100:00100000:0.0:1651532121.531841:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.531855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.531864:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468337984
00000100:00100000:1.0:1651532121.531871:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468338112
00000100:00100000:1.0:1651532121.531878:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3171
00000100:00100000:1.0:1651532121.531880:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468337984:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532121.531882:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3172
00010000:00010000:1.0:1651532121.531883:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532121.531884:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468338112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.531886:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ed35 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497b0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.531888:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.531892:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ed3c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497b7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.531893:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ed35 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497b0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.531897:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ed35 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497b0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.531900:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ed3c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497b7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.531901:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00010000:00010000:0.0:1651532121.531904:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ed3c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497b7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.531908:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532121.531913:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468337984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.531915:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3171
00000100:00100000:0.0:1651532121.531922:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468338112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.531925:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3172
00000100:00100000:0.0:1651532121.532233:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.532241:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.532255:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468338240
00000100:00100000:1.0:1651532121.532258:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468338304
00000100:00100000:0.0:1651532121.532269:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3173
00000100:00100000:1.0:1651532121.532271:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3174
00000100:00100000:0.0:1651532121.532271:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468338240:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532121.532273:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468338304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.532274:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.532276:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.532278:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed43 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497be expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.532280:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed4a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497c5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.532289:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed4a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497c5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.532293:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed4a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497c5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.532297:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532121.532297:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed43 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497be expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.532301:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed43 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497be expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.532304:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532121.532310:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468338304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.532312:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3174
00000100:00100000:0.0:1651532121.532328:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468338240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.532331:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3173
00000100:00100000:0.0:1651532121.532624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.532632:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468338496
00000100:00100000:0.0:1651532121.532647:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3175
00000100:00100000:0.0:1651532121.532648:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468338496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.532652:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.532656:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed51 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497cc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.532663:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed51 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497cc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.532667:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed51 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497cc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.532670:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532121.532689:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468338496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.532692:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3175
00000001:00080000:1.0:1651532121.589833:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793713 is committed
00010000:00010000:0.0:1651532121.589865:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.589870:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.589891:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468332544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524480us (524607us total) trans 158913793713 rc 0/0
00010000:00010000:1.0:1651532121.589894:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.589894:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4099
00010000:00010000:1.0:1651532121.589898:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.589900:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.589903:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.589909:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.589909:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.589910:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.589913:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.589921:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.589927:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.589932:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ec24 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5767168->9785343] (req 5767168->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.589933:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.590273:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.590293:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.590301:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.590312:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468338752
00000100:00100000:0.0:1651532121.590337:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468338816
00000100:00100000:0.0:1651532121.590346:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4108
00000100:00100000:0.0:1651532121.590348:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468338752:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532121.590353:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4109
00000100:00100000:1.0:1651532121.590355:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468338816:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532121.590355:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590362:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532121.590363:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590363:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590366:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532121.590367:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.590372:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.590373:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.590376:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532121.590377:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.590381:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590381:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.590384:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590384:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590396:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.590397:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468338944
00010000:00010000:0.0:1651532121.590400:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.590405:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3176
00000100:00100000:1.0:1651532121.590407:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468338944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.590410:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.590413:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ed66 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497d3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.590415:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468333568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416470us (416514us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532121.590418:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532121.590418:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4100
00010000:00010000:1.0:1651532121.590420:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ed66 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497d3 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.590424:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ed66 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497d3 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.590424:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590427:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.590428:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532121.590429:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590432:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590436:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532121.590437:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468338944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (136us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532121.590437:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.590438:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.590439:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3176
00010000:00010000:0.0:1651532121.590441:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590447:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.590450:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40ec40 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8445951] (req 1687552->8445951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.590452:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.590455:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.590757:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.590769:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468339072
00000100:00100000:1.0:1651532121.590779:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3177
00000100:00100000:1.0:1651532121.590781:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468339072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.590784:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.590788:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ed6d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497da expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.590796:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ed6d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497da expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.590800:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ed6d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497da expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.590820:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532121.590834:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468339072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.590837:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3177
00000100:00100000:0.0:1651532121.591039:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.591058:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468339264
00000100:00100000:1.0:1651532121.591065:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3178
00000100:00100000:1.0:1651532121.591067:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468339264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.591070:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.591073:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed74 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497e1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.591080:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed74 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497e1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.591084:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed74 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497e1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.591087:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532121.591101:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468339264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.591111:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3178
00000001:00080000:1.0:1651532121.648242:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793714 is committed
00002000:00010000:1.0:1651532121.648257:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532120 -> 1651532121
00002000:00010000:1.0:1651532121.648258:0:330280:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532120 -> 1651532121
00010000:00010000:1.0:1651532121.648261:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648265:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.648288:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468333504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474325us (474368us total) trans 158913793714 rc 0/0
00000100:00100000:1.0:1651532121.648291:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4101
00010000:00010000:1.0:1651532121.648299:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648302:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.648303:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648306:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648311:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.648312:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.648313:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648342:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648351:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648353:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40ec47 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->8724479] (req 159744->8724479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648360:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648362:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.648629:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.648638:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.648647:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.648657:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.648672:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468339456
00000100:00100000:0.0:1651532121.648682:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468339520
00000100:00100000:0.0:1651532121.648691:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4110
00000100:00100000:0.0:1651532121.648693:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468339456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532121.648702:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.648705:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4111
00010000:00010000:0.0:1651532121.648707:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532121.648708:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468339520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532121.648708:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.648711:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532121.648712:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.648716:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648719:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.648720:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648727:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532121.648728:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.648728:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468339648
00010000:00010000:1.0:1651532121.648733:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00000100:00100000:0.0:1651532121.648736:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468339584
00000100:00100000:0.0:1651532121.648740:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3179
00010000:00010000:1.0:1651532121.648742:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.648742:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468339648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.648745:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.648747:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ed89 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497ef expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648751:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.648755:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ed89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497ef expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.648762:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ed89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497ef expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.648766:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532121.648767:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.648776:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468339648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.648777:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3180
00000100:00100000:1.0:1651532121.648779:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468339584:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532121.648779:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3179
00010000:00010000:1.0:1651532121.648782:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.648785:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ed90 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497e8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.648793:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ed90 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497e8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.648797:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ed90 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497e8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.648800:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532121.648834:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468339584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (176us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.648837:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3180
00000001:00080000:1.0:1651532121.748280:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793715 is committed
00010000:00010000:1.0:1651532121.748296:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748303:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.748337:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468334144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482769us (482810us total) trans 158913793715 rc 0/0
00000100:00100000:1.0:1651532121.748340:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4102
00010000:00010000:1.0:1651532121.748348:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748352:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.748353:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748356:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748361:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.748362:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.748363:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748366:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748383:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748386:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ec63 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3379200->6545407] (req 3379200->6545407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.748386:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.748391:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.748688:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.748700:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.748707:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468340032
00000100:00100000:1.0:1651532121.748718:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468340096
00010000:00010000:0.0:1651532121.748721:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.748725:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3181
00000100:00100000:1.0:1651532121.748727:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468340032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.748730:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.748730:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748734:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ed97 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497f6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748739:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.748742:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ed97 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497f6 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532121.748745:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468334208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483167us (483205us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532121.748746:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ed97 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497f6 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532121.748748:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4103
00010000:00010000:1.0:1651532121.748749:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532121.748755:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.748758:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468340032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.748760:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3181
00010000:00010000:0.0:1651532121.748761:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532121.748763:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.748765:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3182
00000100:00100000:1.0:1651532121.748766:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468340096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.748766:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748769:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.748771:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ed9e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4497fd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.748771:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.748771:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.748772:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.748775:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748780:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ed9e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497fd expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.748787:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.748790:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ec6a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4177920->7327743] (req 4177920->7327743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748791:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ed9e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4497fd expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.748795:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532121.748801:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468340096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.748816:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3182
00010000:00010000:1.0:1651532121.748823:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.748826:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.749216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.749226:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.749237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.749238:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468340288
00000100:00100000:0.0:1651532121.749247:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468340352
00000100:00100000:1.0:1651532121.749256:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4112
00000100:00100000:1.0:1651532121.749257:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468340288:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532121.749258:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4113
00000100:00100000:0.0:1651532121.749260:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468340352:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532121.749265:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.749269:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532121.749269:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.749270:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.749276:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532121.749277:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.749281:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532121.749282:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532121.749283:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.749288:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.749288:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.749292:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.749301:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468340544
00000100:00100000:1.0:1651532121.749310:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3183
00000100:00100000:1.0:1651532121.749312:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468340544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.749314:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.749317:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edb3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449804 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.749333:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edb3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449804 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.749338:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edb3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449804 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.749341:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532121.749354:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468340544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.749359:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3183
00000001:00080000:1.0:1651532121.814980:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793716 is committed
00010000:00010000:1.0:1651532121.814996:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815000:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.815024:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468334912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 465953us (465997us total) trans 158913793716 rc 0/0
00000100:00100000:1.0:1651532121.815027:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4104
00010000:00010000:1.0:1651532121.815034:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815038:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.815039:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815042:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815047:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.815048:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.815048:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815061:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815075:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815078:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ec8d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->10383359] (req 2502656->10383359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815085:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815090:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.815355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.815374:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468340736
00000100:00100000:1.0:1651532121.815386:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3184
00000100:00100000:1.0:1651532121.815387:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468340736:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532121.815392:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532121.815397:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.815401:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449812 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815406:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.815408:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815409:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449812 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.815413:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815417:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449812 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.815426:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532121.815434:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468334976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466327us (466399us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532121.815435:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468340736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.815438:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3184
00000100:00100000:0.0:1651532121.815438:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4105
00000100:00100000:1.0:1651532121.815442:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468340672
00000100:00100000:1.0:1651532121.815452:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3185
00000100:00100000:1.0:1651532121.815454:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468340672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.815457:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.815459:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edc1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44980b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815464:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.815466:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edc1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44980b expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.815470:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edc1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44980b expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.815473:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532121.815484:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.815491:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468340672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.815494:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3185
00010000:00010000:0.0:1651532121.815503:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532121.815504:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815507:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815513:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.815514:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.815515:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815518:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815528:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815532:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815532:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ec94 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6762496->9785343] (req 6762496->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815535:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.815774:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.815835:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.815846:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.815855:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468340864
00000100:00100000:0.0:1651532121.815866:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468340992
00000100:00100000:0.0:1651532121.815871:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4114
00000100:00100000:0.0:1651532121.815873:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468340864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532121.815889:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815894:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532121.815895:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815898:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815900:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532121.815901:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.815905:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4115
00010000:00010000:0.0:1651532121.815905:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.815907:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468340992:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532121.815908:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.815911:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815917:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815927:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532121.815929:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815934:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532121.815935:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815943:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815949:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.815960:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468341120
00000100:00100000:1.0:1651532121.815973:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3186
00000100:00100000:1.0:1651532121.815975:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468341120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.815978:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.815981:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40edd6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449819 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.815988:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40edd6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449819 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.815991:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40edd6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449819 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.816014:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532121.816028:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468341120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (182us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.816031:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3186
00000001:00080000:1.0:1651532121.881730:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793717 is committed
00010000:00010000:1.0:1651532121.881745:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.881749:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.881772:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468336640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 351050us (351088us total) trans 158913793717 rc 0/0
00010000:00010000:0.0:1651532121.881774:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.881775:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4106
00010000:00010000:0.0:1651532121.881779:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532121.881780:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.881786:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.881792:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.881793:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.881794:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.881797:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.881816:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.881822:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40ecef lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->8245247] (req 835584->8245247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.881830:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.881834:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.882148:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.882166:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532121.882188:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.882188:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468341312
00010000:00010000:1.0:1651532121.882192:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.882197:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468341440
00000100:00100000:0.0:1651532121.882202:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3187
00000100:00100000:0.0:1651532121.882203:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468341312:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532121.882211:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468336704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 351464us (351516us total) trans 0 rc 45056/45056
00010000:00010000:0.0:1651532121.882214:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532121.882215:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4107
00010000:00010000:0.0:1651532121.882218:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40eddd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449820 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882222:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.882224:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.882226:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.882227:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.882227:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40eddd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449820 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.882230:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882236:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.882236:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.882236:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40eddd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449820 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.882237:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.882239:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532121.882240:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882250:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882253:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40ecf6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10002431] (req 311296->10002431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.882256:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468341312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.882258:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3187
00000100:00100000:1.0:1651532121.882261:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3188
00000100:00100000:1.0:1651532121.882263:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468341440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.882265:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882266:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.882269:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ede4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449827 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.882269:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882276:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ede4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449827 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.882280:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ede4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449827 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.882284:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532121.882291:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468341440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.882294:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3188
00000100:00100000:0.0:1651532121.882651:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.882688:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468341760
00000100:00100000:1.0:1651532121.882700:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4116
00000100:00100000:1.0:1651532121.882702:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468341760:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532121.882705:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532121.882709:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882713:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532121.882714:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532121.882715:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.882715:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532121.882724:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.882725:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.882732:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468341632
00000100:00100000:0.0:1651532121.882736:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468341824
00000100:00100000:1.0:1651532121.882743:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4117
00000100:00100000:1.0:1651532121.882745:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468341632:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532121.882748:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468341952
00010000:00010000:1.0:1651532121.882750:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.882753:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3189
00010000:00010000:1.0:1651532121.882754:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532121.882754:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.882755:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468341824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.882757:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.882758:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.882759:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532121.882760:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.882763:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40edf9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44982e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882764:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882767:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882770:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.882771:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40edf9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44982e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.882776:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40edf9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44982e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532121.882777:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3190
00010000:00010000:0.0:1651532121.882779:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532121.882788:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468341952:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532121.882794:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468341824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (79us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532121.882796:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532121.882797:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3189
00010000:00010000:1.0:1651532121.882817:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee00 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449835 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.882825:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee00 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449835 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.882829:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee00 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449835 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.882832:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532121.882841:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468341952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (116us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.882844:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3190
00000100:00100000:0.0:1651532121.883142:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.883162:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468342080
00000100:00100000:1.0:1651532121.883175:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3191
00000100:00100000:1.0:1651532121.883177:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468342080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.883180:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.883184:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ee07 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44983c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.883191:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ee07 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44983c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.883195:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ee07 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44983c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.883206:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532121.883217:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468342080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.883220:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3191
00000100:00100000:0.0:1651532121.883443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.883462:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468342272
00000100:00100000:1.0:1651532121.883474:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3192
00000100:00100000:1.0:1651532121.883476:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468342272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.883479:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.883483:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee0e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449843 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.883490:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee0e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449843 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.883494:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee0e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449843 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.883497:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532121.883507:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468342272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.883509:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3192
00000100:00100000:0.0:1651532121.883716:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.883734:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468342400
00000100:00100000:1.0:1651532121.883747:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3193
00000100:00100000:1.0:1651532121.883749:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468342400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.883753:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.883757:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee15 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44984a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.883764:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee15 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44984a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.883768:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee15 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44984a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.883771:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532121.883780:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468342400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.883783:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3193
00000100:00100000:0.0:1651532121.883982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.884001:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468342528
00000100:00100000:1.0:1651532121.884012:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3194
00000100:00100000:1.0:1651532121.884013:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468342528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.884017:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.884020:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ee1c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449851 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.884027:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ee1c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449851 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.884031:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ee1c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449851 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.884037:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532121.884046:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468342528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.884049:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3194
00000001:00080000:1.0:1651532121.990062:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793718 is committed
00010000:00010000:0.0:1651532121.990089:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.990093:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.990111:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468338752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 399762us (399839us total) trans 158913793718 rc 0/0
00000100:00100000:0.0:1651532121.990114:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4108
00010000:00010000:0.0:1651532121.990121:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.990124:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532121.990125:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.990129:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.990134:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.990134:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532121.990135:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.990138:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.990152:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.990155:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ed58 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->8159231] (req 2281472->8159231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990164:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990168:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990442:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990447:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.990464:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468338816:12345-10.240.43.64@tcp:3:fio.0 Request processed in 400109us (400171us total) trans 0 rc 65536/65536
00000100:00100000:1.0:1651532121.990468:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4109
00010000:00010000:1.0:1651532121.990475:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990478:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532121.990479:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990485:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990490:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.990491:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532121.990492:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990495:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990507:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990510:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ed5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [831488->10375167] (req 831488->10375167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.990518:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.990545:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.990590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.990598:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468342848
00000100:00100000:1.0:1651532121.990618:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3195
00000100:00100000:1.0:1651532121.990620:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468342848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.990624:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.990627:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ee23 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44985f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.990635:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ee23 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44985f expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.990642:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ee23 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44985f expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.990646:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532121.990659:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468342848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.990662:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3195
00000100:00100000:1.0:1651532121.990697:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.990705:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.990715:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468342784
00000100:00100000:0.0:1651532121.990717:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468342976
00000100:00100000:1.0:1651532121.990724:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3196
00000100:00100000:1.0:1651532121.990726:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468342784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532121.990729:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532121.990731:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3197
00010000:00010000:1.0:1651532121.990732:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee2a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449858 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.990733:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468342976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.990737:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.990739:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee2a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449858 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.990743:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee2a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449858 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.990746:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532121.990751:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ee31 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449866 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.990757:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468342784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.990761:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3196
00010000:00010000:0.0:1651532121.990764:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ee31 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449866 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.990769:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40ee31 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449866 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.990772:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532121.990782:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468342976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.990785:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3197
00000100:00100000:1.0:1651532121.990962:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.990981:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.990997:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468343040
00000100:00100000:1.0:1651532121.991010:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468343104
00000100:00100000:1.0:1651532121.991017:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4118
00000100:00100000:1.0:1651532121.991019:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468343040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532121.991026:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.991030:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532121.991031:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.991034:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532121.991035:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.991039:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.991043:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532121.991043:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4119
00000100:00100000:0.0:1651532121.991046:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468343104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532121.991054:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.991059:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532121.991060:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.991063:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532121.991063:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.991068:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.991083:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532121.991145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.991157:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468343360
00000100:00100000:0.0:1651532121.991168:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3198
00000100:00100000:0.0:1651532121.991170:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468343360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.991174:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532121.991178:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee46 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44986d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.991185:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee46 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44986d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.991189:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee46 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44986d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.991193:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532121.991205:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468343360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.991207:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3198
00000100:00100000:1.0:1651532121.991259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532121.991270:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532121.991270:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468343424
00000100:00100000:1.0:1651532121.991276:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468343488
00000100:00100000:0.0:1651532121.991282:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3199
00000100:00100000:0.0:1651532121.991283:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468343424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.991287:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532121.991288:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3200
00000100:00100000:1.0:1651532121.991290:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468343488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532121.991291:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ee4d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449874 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532121.991294:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532121.991297:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ee54 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44987b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532121.991299:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ee4d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449874 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.991303:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ee4d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449874 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.991305:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ee54 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44987b expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532121.991306:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532121.991309:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ee54 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44987b expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532121.991312:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532121.991316:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468343424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532121.991330:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468343488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532121.991331:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3199
00000100:00100000:1.0:1651532121.991333:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3200
00000001:00080000:1.0:1651532122.090086:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793719 is committed
00010000:00010000:0.0:1651532122.090118:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090122:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.090145:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468339456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 441451us (441516us total) trans 158913793719 rc 0/0
00000100:00100000:0.0:1651532122.090148:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4110
00010000:00010000:0.0:1651532122.090155:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090159:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.090160:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090166:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090171:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.090172:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.090173:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090176:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090189:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.090193:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090194:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ed7b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2703360->8384511] (req 2703360->8384511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.090199:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.090491:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.090500:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.090511:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468343872
00000100:00100000:1.0:1651532122.090518:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468344000
00000100:00100000:1.0:1651532122.090528:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3201
00000100:00100000:1.0:1651532122.090530:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468343872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.090534:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.090538:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ee5b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449882 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.090539:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3202
00000100:00100000:0.0:1651532122.090541:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468344000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.090544:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.090545:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.090547:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ee5b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449882 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.090549:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ee62 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449889 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.090551:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40ee5b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449882 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.090555:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532122.090555:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.090558:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ee62 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449889 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532122.090567:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468343872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.090570:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3201
00010000:00010000:0.0:1651532122.090573:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ee62 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449889 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.090576:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532122.090583:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.090586:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468344000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (86us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532122.090587:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.090589:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3202
00000100:00100000:1.0:1651532122.090602:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468339520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441894us (441963us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532122.090603:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.090604:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4111
00010000:00010000:0.0:1651532122.090607:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.090608:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090611:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090616:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.090616:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.090617:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090620:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090623:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.090624:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.090633:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090636:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090648:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090651:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ed82 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->10014719] (req 454656->10014719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.090652:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090656:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.090658:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090659:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090883:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090889:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.090913:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468340352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341652us (341686us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532122.090917:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4113
00010000:00010000:0.0:1651532122.090977:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090993:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.090994:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.090997:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.091004:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.091006:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40edac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6225920->8413183] (req 6225920->8413183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.091094:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.091137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.091150:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468344128
00000100:00100000:0.0:1651532122.091155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.091171:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468344192
00000100:00100000:0.0:1651532122.091174:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4120
00000100:00100000:0.0:1651532122.091177:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468344128:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532122.091182:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4121
00000100:00100000:1.0:1651532122.091184:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468344192:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532122.091190:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.091191:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.091195:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532122.091196:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.091199:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532122.091199:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.091205:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.091206:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.091209:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532122.091210:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.091214:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.091214:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.091218:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.091220:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.091225:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468344320
00000100:00100000:1.0:1651532122.091231:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3203
00000100:00100000:1.0:1651532122.091233:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468344320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.091236:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.091238:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ee77 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449890 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.091252:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ee77 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449890 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.091256:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ee77 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449890 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.091260:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532122.091274:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468344320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.091276:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3203
00000100:00100000:0.0:1651532122.091287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.091329:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468344512
00000100:00100000:1.0:1651532122.091338:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3204
00000100:00100000:1.0:1651532122.091340:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468344512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.091343:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.091347:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ee7e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449897 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.091353:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ee7e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449897 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.091357:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ee7e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449897 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.091363:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532122.091375:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468344512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.091377:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3204
00000100:00100000:1.0:1651532122.091567:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.091574:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468344640
00000100:00100000:1.0:1651532122.091584:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3205
00000100:00100000:1.0:1651532122.091586:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468344640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.091589:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.091592:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee85 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44989e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.091599:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee85 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44989e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.091603:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee85 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44989e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.091607:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532122.091618:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468344640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.091620:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3205
00000001:00080000:1.0:1651532122.198439:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793720 is committed
00010000:00010000:1.0:1651532122.198455:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.198462:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.198486:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468340288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449228us (449272us total) trans 158913793720 rc 0/0
00010000:00010000:0.0:1651532122.198486:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.198490:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4112
00010000:00010000:0.0:1651532122.198491:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.198492:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198496:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198502:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.198502:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.198503:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198506:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198514:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198522:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40eda5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->6000639] (req 778240->6000639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.198532:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.198537:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.198881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.198889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.198899:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.198900:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468344960
00000100:00100000:1.0:1651532122.198906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.198915:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.198921:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468344896
00000100:00100000:1.0:1651532122.198924:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4122
00000100:00100000:1.0:1651532122.198926:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468344960:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532122.198930:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4123
00000100:00100000:0.0:1651532122.198932:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468344896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532122.198935:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198939:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.198940:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.198941:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198945:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532122.198946:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198949:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198952:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532122.198952:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.198956:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198956:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198959:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.198963:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.198972:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345024
00000100:00100000:0.0:1651532122.198982:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345088
00000100:00100000:0.0:1651532122.198985:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345152
00000100:00100000:0.0:1651532122.198988:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3206
00000100:00100000:0.0:1651532122.198989:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468345024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.198992:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.198995:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ee9a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498a5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.199003:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ee9a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498a5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.199007:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40ee9a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498a5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.199010:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532122.199022:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468345024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (123us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.199024:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3207
00000100:00100000:1.0:1651532122.199026:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468345088:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532122.199026:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3206
00010000:00010000:1.0:1651532122.199030:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532122.199031:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3208
00000100:00100000:0.0:1651532122.199032:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468345152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.199035:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40eea1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498ac expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.199035:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.199037:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eea8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498b3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.199048:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eea8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498b3 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.199049:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40eea1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498ac expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.199052:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eea8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498b3 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.199055:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532122.199057:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40eea1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498ac expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532122.199060:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468345152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (146us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532122.199061:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532122.199063:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3208
00000100:00100000:1.0:1651532122.199085:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468345088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (178us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.199088:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3207
00000100:00100000:1.0:1651532122.199343:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.199351:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345280
00000100:00100000:1.0:1651532122.199358:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3209
00000100:00100000:1.0:1651532122.199360:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468345280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.199363:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.199367:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40eeaf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498ba expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.199374:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40eeaf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498ba expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.199389:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40eeaf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498ba expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.199392:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532122.199405:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468345280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.199408:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3209
00000001:00080000:1.0:1651532122.265179:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793721 is committed
00010000:00010000:1.0:1651532122.265195:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.265199:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.265222:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468340864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449348us (449450us total) trans 158913793721 rc 0/0
00010000:00010000:0.0:1651532122.265224:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.265226:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4114
00010000:00010000:0.0:1651532122.265229:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.265230:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265233:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265239:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.265239:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.265240:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265243:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265247:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.265247:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.265248:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265251:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265263:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265269:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40edc8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->9064447] (req 1744896->9064447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.265272:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.265276:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265280:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265283:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.265583:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.265590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.265599:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.265630:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345536
00000100:00100000:1.0:1651532122.265631:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345600
00000100:00100000:1.0:1651532122.265641:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345472
00000100:00100000:1.0:1651532122.265645:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3210
00000100:00100000:1.0:1651532122.265647:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468345600:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532122.265648:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3211
00000100:00100000:0.0:1651532122.265650:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468345536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.265651:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.265654:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.265655:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40eeb6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498cf expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265658:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eebd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498c8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.265660:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532122.265663:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40eeb6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498cf expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.265667:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40eeb6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498cf expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.265671:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532122.265675:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.265678:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eebd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498c8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532122.265683:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468345600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.265686:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3210
00010000:00010000:0.0:1651532122.265689:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40eebd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498c8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532122.265690:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3212
00000100:00100000:1.0:1651532122.265692:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468345472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.265692:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532122.265695:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.265697:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40eec4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498c1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.265702:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532122.265702:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468345536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (120us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532122.265704:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40eec4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498c1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532122.265705:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3211
00010000:00010000:1.0:1651532122.265715:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40eec4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498c1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.265717:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.265719:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532122.265720:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.265725:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468345472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (126us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.265728:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3212
00000100:00100000:0.0:1651532122.265732:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deb9e3c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468341760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 383029us (383083us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532122.265735:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4116
00010000:00010000:1.0:1651532122.265740:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265740:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.265744:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265747:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.265748:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.265759:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468340992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449851us (449925us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532122.265761:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.265762:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4115
00010000:00010000:0.0:1651532122.265766:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265769:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40edeb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->10059775] (req 1093632->10059775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265772:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265775:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.265776:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265779:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265782:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.265782:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.265783:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265786:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265795:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.265799:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40edcf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6864896->10203135] (req 6864896->10203135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.265800:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.265817:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.266285:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.266297:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345728
00000100:00100000:0.0:1651532122.266302:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.266328:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4124
00000100:00100000:0.0:1651532122.266328:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.266330:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468345728:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532122.266339:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532122.266353:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.266357:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.266358:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.266359:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532122.266366:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532122.266367:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.266369:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468346048
00010000:00010000:1.0:1651532122.266372:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.266376:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.266381:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4125
00000100:00100000:0.0:1651532122.266383:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468346048:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532122.266385:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345856
00010000:00010000:0.0:1651532122.266390:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.266395:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345984
00000100:00100000:1.0:1651532122.266398:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468345792
00000100:00100000:1.0:1651532122.266401:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3213
00010000:00010000:0.0:1651532122.266401:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532122.266402:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.266403:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468345856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.266405:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.266406:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.266408:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40eed9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498dd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.266413:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3214
00010000:00010000:1.0:1651532122.266415:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40eed9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498dd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532122.266415:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee985a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468345984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.266418:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.266420:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eee0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498e4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.266422:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40eed9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498dd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.266426:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532122.266430:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eee0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498e4 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.266435:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eee0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498e4 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532122.266437:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468345856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (135us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532122.266438:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532122.266440:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3213
00000100:00100000:1.0:1651532122.266444:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3215
00000100:00100000:1.0:1651532122.266446:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b4b17ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468345792:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532122.266447:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee985a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468345984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (127us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532122.266448:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.266450:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eee7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498d6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.266450:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3214
00010000:00010000:1.0:1651532122.266456:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eee7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498d6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.266460:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eee7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498d6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.266462:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532122.266468:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b4b17ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468345792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.266471:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3215
00000001:00080000:1.0:1651532122.323582:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793722 is committed
00010000:00010000:1.0:1651532122.323598:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.323602:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.323625:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468341632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 440879us (440920us total) trans 158913793722 rc 0/0
00010000:00010000:0.0:1651532122.323627:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.323628:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4117
00010000:00010000:0.0:1651532122.323632:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.323633:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.323636:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.323642:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.323643:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.323644:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.323647:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.323657:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.323660:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40edf2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10395647] (req 933888->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.323673:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.323678:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.324006:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.324014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.324024:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.324032:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.324039:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468346496
00000100:00100000:1.0:1651532122.324049:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468346560
00000100:00100000:1.0:1651532122.324057:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4126
00000100:00100000:1.0:1651532122.324059:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a14c550a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468346496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532122.324066:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.324070:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.324071:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.324074:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.324077:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532122.324078:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.324082:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.324086:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.324086:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4127
00010000:00010000:1.0:1651532122.324089:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.324089:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abf6ae88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468346560:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532122.324098:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468346752
00010000:00010000:0.0:1651532122.324098:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.324102:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532122.324103:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.324106:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532122.324107:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.324108:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468346816
00010000:00010000:0.0:1651532122.324111:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.324117:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3216
00000100:00100000:1.0:1651532122.324120:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468346752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.324124:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.324126:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.324128:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40eefc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498eb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.324136:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3217
00000100:00100000:0.0:1651532122.324137:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e299bd9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468346816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.324140:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40eefc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498eb expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.324140:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.324144:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40eefc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498eb expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.324148:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ef03 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498f2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.324149:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532122.324156:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ef03 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498f2 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.324161:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ef03 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498f2 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532122.324163:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468346752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (139us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532122.324164:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532122.324168:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3216
00000100:00100000:0.0:1651532122.324174:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e299bd9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468346816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (142us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.324177:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3217
00000100:00100000:1.0:1651532122.324455:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.324463:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468346944
00000100:00100000:1.0:1651532122.324470:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3218
00000100:00100000:1.0:1651532122.324471:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b961ae6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468346944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.324475:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.324479:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef0a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4498f9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.324486:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef0a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498f9 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.324490:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef0a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4498f9 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.324493:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532122.324502:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b961ae6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468346944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.324505:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3218
00000100:00100000:1.0:1651532122.324734:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.324741:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468347136
00000100:00100000:1.0:1651532122.324748:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3219
00000100:00100000:1.0:1651532122.324749:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a54139d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468347136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.324753:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.324756:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ef11 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449900 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.324763:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ef11 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449900 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.324767:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ef11 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449900 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.324770:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532122.324779:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a54139d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468347136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (45us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.324781:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3219
00000001:00080000:1.0:1651532122.431928:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793723 is committed
00010000:00010000:0.0:1651532122.431960:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.431965:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.431989:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468343040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 440969us (441027us total) trans 158913793723 rc 0/0
00010000:00010000:1.0:1651532122.431992:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.431992:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4118
00010000:00010000:1.0:1651532122.431997:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532122.431998:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432002:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432008:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532122.432008:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532122.432009:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432012:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432023:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432026:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ee38 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9142271] (req 221184->9142271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.432033:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.432040:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.432400:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.432409:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468347392
00000100:00100000:0.0:1651532122.432411:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.432422:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.432434:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468347456
00000100:00100000:1.0:1651532122.432438:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468347520
00000100:00100000:1.0:1651532122.432441:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3220
00000100:00100000:1.0:1651532122.432443:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085b1d320 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468347392:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532122.432445:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532122.432447:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.432450:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ef18 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449907 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432455:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.432457:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.432461:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432466:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ef18 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449907 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.432470:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ef18 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449907 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.432474:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532122.432480:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468343104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441434us (441499us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532122.432484:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4119
00000100:00100000:1.0:1651532122.432489:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085b1d320 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468347392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (90us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532122.432491:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.432492:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3220
00010000:00010000:0.0:1651532122.432495:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.432496:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.432497:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468347648
00010000:00010000:0.0:1651532122.432499:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.432500:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3221
00000100:00100000:1.0:1651532122.432502:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e251c56c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468347456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.432504:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.432504:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.432505:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.432506:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432507:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef1f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44990e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.432509:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432514:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef1f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44990e expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.432516:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432518:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef1f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44990e expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.432519:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ee3f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3686400->9928703] (req 3686400->9928703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432521:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532122.432524:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.432527:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e251c56c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468347456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (116us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532122.432527:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.432529:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3221
00000100:00100000:1.0:1651532122.432532:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3222
00000100:00100000:1.0:1651532122.432534:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5d14c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468347520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.432536:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.432538:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef26 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449915 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.432543:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef26 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449915 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.432549:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef26 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449915 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.432552:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532122.432553:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3223
00000100:00100000:0.0:1651532122.432555:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468347648:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532122.432557:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5d14c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468347520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (136us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532122.432559:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532122.432560:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3222
00010000:00010000:0.0:1651532122.432571:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ef2d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44991c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.432579:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ef2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44991c expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.432583:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ef2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44991c expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.432587:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532122.432596:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468347648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (151us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.432601:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3223
00000100:00100000:1.0:1651532122.433042:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.433059:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468347776
00000100:00100000:1.0:1651532122.433063:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.433074:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.433082:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468347840
00000100:00100000:1.0:1651532122.433083:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.433093:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4128
00000100:00100000:0.0:1651532122.433095:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008744f71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468347776:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532122.433097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532122.433103:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.433105:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4129
00010000:00010000:0.0:1651532122.433107:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532122.433108:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000038aec961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468347840:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532122.433109:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.433111:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532122.433112:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.433117:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.433118:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.433124:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.433125:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.433128:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532122.433129:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.433133:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.433134:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.433138:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.433143:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468347904
00000100:00100000:1.0:1651532122.433145:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468348032
00000100:00100000:0.0:1651532122.433152:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468348160
00000100:00100000:0.0:1651532122.433158:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3224
00000100:00100000:0.0:1651532122.433160:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67f4078 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468347904:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532122.433161:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3225
00000100:00100000:1.0:1651532122.433162:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468348032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.433163:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.433166:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.433166:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ef42 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449923 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.433169:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40ef49 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44992a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.433173:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ef42 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449923 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.433177:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40ef49 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44992a expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.433177:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ef42 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449923 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.433181:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532122.433182:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40ef49 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44992a expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.433185:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532122.433192:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67f4078 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468347904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.433195:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468348032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.433195:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3224
00000100:00100000:0.0:1651532122.433200:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3226
00000100:00100000:0.0:1651532122.433201:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468348160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.433204:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532122.433212:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3225
00010000:00010000:0.0:1651532122.433228:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ef50 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449931 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.433236:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ef50 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449931 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.433239:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ef50 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449931 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.433243:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532122.433250:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468348160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (153us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.433252:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3226
00000100:00100000:1.0:1651532122.433605:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.433616:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.433617:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468348416
00000100:00100000:1.0:1651532122.433624:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468348480
00000100:00100000:0.0:1651532122.433630:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3227
00000100:00100000:0.0:1651532122.433631:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e06ef4b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468348416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.433635:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532122.433636:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3228
00000100:00100000:1.0:1651532122.433638:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005e31be0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468348480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.433639:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ef57 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449938 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.433642:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.433646:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ef5e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44993f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.433646:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ef57 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449938 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.433650:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ef57 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449938 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.433654:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ef5e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44993f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.433654:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532122.433658:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ef5e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44993f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.433661:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532122.433665:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e06ef4b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468348416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.433668:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3227
00000100:00100000:1.0:1651532122.433670:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005e31be0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468348480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.433672:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3228
00000001:00080000:1.0:1651532122.540264:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793724 is committed
00010000:00010000:0.0:1651532122.540296:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540301:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.540331:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468344128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449153us (449237us total) trans 158913793724 rc 0/0
00000100:00100000:0.0:1651532122.540334:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4120
00010000:00010000:0.0:1651532122.540342:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540346:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.540347:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540350:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540355:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.540356:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.540357:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540360:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540368:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.540369:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.540370:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540375:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540391:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540394:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40ee69 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->9146367] (req 585728->9146367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540399:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540403:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540405:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540408:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.540790:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.540798:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.540819:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.540829:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468348864
00000100:00100000:1.0:1651532122.540838:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468348736
00000100:00100000:0.0:1651532122.540843:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468348992
00000100:00100000:1.0:1651532122.540846:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3229
00000100:00100000:1.0:1651532122.540848:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468348864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.540852:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532122.540852:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3230
00000100:00100000:0.0:1651532122.540854:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468348736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.540855:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ef65 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44994d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540858:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.540861:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.540862:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ef6c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449946 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540864:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ef65 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44994d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.540868:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40ef65 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44994d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.540870:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532122.540872:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532122.540873:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ef6c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449946 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.540877:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40ef6c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449946 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.540881:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532122.540885:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468348864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.540888:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3229
00000100:00100000:1.0:1651532122.540893:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3231
00000100:00100000:1.0:1651532122.540895:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468348992:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532122.540896:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468348736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (98us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532122.540897:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532122.540899:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3230
00010000:00010000:1.0:1651532122.540900:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40ef73 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449954 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540904:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532122.540906:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40ef73 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449954 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.540910:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40ef73 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449954 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.540911:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.540915:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540916:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532122.540929:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468348992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.540931:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468344192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449747us (449795us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532122.540932:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3231
00000100:00100000:0.0:1651532122.540934:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4121
00010000:00010000:1.0:1651532122.540939:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540943:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532122.540944:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540947:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540952:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540954:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40ee70 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8245247] (req 163840->8245247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540966:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.540995:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541010:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.541014:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468344960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 342087us (342133us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532122.541015:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.541016:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.541018:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4122
00010000:00010000:0.0:1651532122.541026:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541054:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.541055:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.541056:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541059:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541068:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541071:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40ee8c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->6246399] (req 188416->6246399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541077:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541080:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.541384:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.541401:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.541411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.541420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.541429:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468349184
00000100:00100000:1.0:1651532122.541440:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468349120
00000100:00100000:1.0:1651532122.541449:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4130
00000100:00100000:1.0:1651532122.541450:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468349184:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532122.541457:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.541462:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.541463:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532122.541464:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.541467:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.541487:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4131
00000100:00100000:1.0:1651532122.541489:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468349120:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532122.541492:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468349312
00010000:00010000:1.0:1651532122.541494:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.541497:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.541498:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.541502:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468349248
00010000:00010000:1.0:1651532122.541507:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.541508:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3232
00000100:00100000:0.0:1651532122.541509:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468349312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.541510:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532122.541510:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541513:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.541515:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541517:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ef88 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449962 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.541537:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541538:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ef88 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449962 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.541540:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541542:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ef88 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449962 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.541546:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532122.541549:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3233
00000100:00100000:1.0:1651532122.541550:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468349248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.541553:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532122.541555:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468349312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (144us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532122.541556:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ef8f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44995b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.541558:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3232
00010000:00010000:1.0:1651532122.541563:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ef8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44995b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.541567:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40ef8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44995b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.541571:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532122.541575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.541579:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468349248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (159us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.541582:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3233
00000100:00100000:1.0:1651532122.541587:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468349632
00000100:00100000:0.0:1651532122.541590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.541603:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468349696
00000100:00100000:1.0:1651532122.541606:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3234
00000100:00100000:1.0:1651532122.541607:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a5796b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468349632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.541610:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.541612:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ef96 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449969 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.541618:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ef96 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449969 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532122.541626:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3235
00000100:00100000:0.0:1651532122.541630:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468349696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.541631:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40ef96 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449969 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.541635:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532122.541635:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.541640:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ef9d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449970 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.541646:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a5796b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468349632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.541649:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3234
00010000:00010000:0.0:1651532122.541655:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ef9d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449970 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.541660:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40ef9d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449970 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.541666:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532122.541675:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468349696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.541679:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3235
00000100:00100000:0.0:1651532122.541928:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.541953:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.541965:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468349888
00000100:00100000:0.0:1651532122.541974:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468349824
00000100:00100000:0.0:1651532122.541982:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3236
00000100:00100000:0.0:1651532122.541983:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096331adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468349888:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532122.541986:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3237
00010000:00010000:0.0:1651532122.541987:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532122.541988:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468349824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.541991:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efa4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44997e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.541994:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.541997:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449977 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.541998:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efa4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44997e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.542002:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efa4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44997e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.542004:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449977 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.542006:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532122.542008:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449977 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.542011:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532122.542018:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096331adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468349888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.542021:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3236
00000100:00100000:1.0:1651532122.542026:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468349824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.542029:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3237
00000001:00080000:1.0:1651532122.648644:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793725 is committed
00010000:00010000:0.0:1651532122.648675:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648680:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.648696:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468344896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449764us (449807us total) trans 158913793725 rc 0/0
00000100:00100000:0.0:1651532122.648699:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4123
00010000:00010000:0.0:1651532122.648706:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648710:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.648711:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648714:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648719:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.648719:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.648720:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648723:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648726:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.648727:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.648727:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648733:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648746:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648749:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ee93 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->4685823] (req 40960->4685823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648755:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.648758:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.648759:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.648763:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649023:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649027:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649040:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649044:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.649048:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468346048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 382664us (382709us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532122.649051:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4125
00000100:00100000:1.0:1651532122.649068:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754468345728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 382737us (382784us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532122.649070:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.649071:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4124
00010000:00010000:0.0:1651532122.649076:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.649077:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649080:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649086:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649089:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eed2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2547712->3239935] (req 2547712->3239935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649092:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649094:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.649095:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649098:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649103:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.649104:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.649105:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649114:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649121:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649123:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40eecb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [352256->10260479] (req 352256->10260479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649127:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649131:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.649240:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.649253:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.649254:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468350464
00000100:00100000:0.0:1651532122.649261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.649270:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468350400
00000100:00100000:1.0:1651532122.649276:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4132
00000100:00100000:1.0:1651532122.649278:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c52c0bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468350464:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532122.649284:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.649285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532122.649289:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.649290:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649293:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532122.649293:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649298:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.649298:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4133
00010000:00010000:1.0:1651532122.649301:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.649311:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468350528
00000100:00100000:1.0:1651532122.649331:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468350656
00000100:00100000:1.0:1651532122.649338:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3238
00000100:00100000:1.0:1651532122.649340:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468350528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.649343:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.649357:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40efb9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449985 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.649357:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9301923 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468350400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532122.649365:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40efb9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449985 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.649367:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649369:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40efb9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449985 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.649372:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532122.649372:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532122.649373:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649376:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532122.649377:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.649381:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.649386:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468350528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (124us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.649388:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3238
00000100:00100000:1.0:1651532122.649393:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3239
00010000:00010000:0.0:1651532122.649393:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.649395:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468350656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.649397:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.649400:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40efc7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44998c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649405:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40efc7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44998c expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.649409:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40efc7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44998c expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.649412:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532122.649418:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468350656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (133us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.649420:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3239
00000100:00100000:1.0:1651532122.649436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.649460:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.649480:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468350720
00000100:00100000:1.0:1651532122.649498:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4134
00000100:00100000:1.0:1651532122.649499:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001c0ee2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468350720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532122.649505:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649509:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.649510:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649513:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532122.649514:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649518:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649521:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.649583:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468350848
00000100:00100000:1.0:1651532122.649596:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3240
00000100:00100000:1.0:1651532122.649597:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468350848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.649600:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.649604:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40efd5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449993 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649611:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40efd5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449993 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.649614:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40efd5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449993 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.649618:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532122.649628:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468350848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (192us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.649631:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3240
00000100:00100000:0.0:1651532122.649731:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.649750:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468351168
00000100:00100000:1.0:1651532122.649762:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3241
00000100:00100000:1.0:1651532122.649763:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468351168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.649767:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.649770:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40efdc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44999a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649777:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40efdc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44999a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.649781:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40efdc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44999a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.649785:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532122.649795:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468351168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.649797:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3241
00000100:00100000:0.0:1651532122.649874:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.649885:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468351360
00000100:00100000:1.0:1651532122.649894:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3242
00000100:00100000:1.0:1651532122.649896:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468351360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.649899:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.649902:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efe3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499a1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.649909:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efe3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499a1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.649913:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efe3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499a1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.649916:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532122.649926:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468351360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.649928:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3242
00000001:00080000:1.0:1651532122.707057:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793726 is committed
00002000:00010000:1.0:1651532122.707070:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532121 -> 1651532122
00010000:00010000:1.0:1651532122.707073:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707077:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.707098:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a14c550a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468346496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 383038us (383092us total) trans 158913793726 rc 0/0
00010000:00010000:0.0:1651532122.707101:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.707102:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4126
00010000:00010000:0.0:1651532122.707106:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.707107:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707110:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707116:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.707117:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.707117:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707120:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707128:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707131:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40eeee lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10018815] (req 1036288->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707136:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707148:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.707488:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.707497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.707509:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.707521:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468351616
00000100:00100000:0.0:1651532122.707522:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468351552
00000100:00100000:1.0:1651532122.707535:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4135
00000100:00100000:1.0:1651532122.707537:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468351616:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532122.707544:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.707544:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4136
00000100:00100000:0.0:1651532122.707546:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468351552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532122.707547:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532122.707548:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707552:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532122.707552:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707554:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707557:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707559:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532122.707560:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707563:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532122.707563:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707567:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707568:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707571:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707577:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707580:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.707584:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468351808
00000100:00100000:0.0:1651532122.707590:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3243
00000100:00100000:0.0:1651532122.707591:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468351808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.707594:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532122.707595:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abf6ae88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468346560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 383506us (383581us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532122.707597:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eff8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499a8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.707598:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4127
00010000:00010000:1.0:1651532122.707604:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707607:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532122.707609:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707611:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707614:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.707617:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eff8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499a8 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.707622:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40eff8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499a8 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.707625:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.707625:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532122.707626:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532122.707627:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707630:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.707635:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468351808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (126us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532122.707639:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.707642:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40eef5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->7217151] (req 675840->7217151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.707645:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3243
00010000:00010000:0.0:1651532122.707652:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.707655:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.708018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.708025:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.708037:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468352000
00000100:00100000:1.0:1651532122.708046:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.708056:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468351936
00000100:00100000:1.0:1651532122.708062:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468352064
00000100:00100000:0.0:1651532122.708064:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3244
00000100:00100000:0.0:1651532122.708066:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468352000:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532122.708067:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3245
00000100:00100000:1.0:1651532122.708069:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468351936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.708069:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.708072:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.708073:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40efff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499b6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.708081:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40efff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499b6 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.708084:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f006 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499af expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.708089:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40efff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499b6 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.708091:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f006 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499af expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.708092:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532122.708103:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f006 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499af expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532122.708108:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468352000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.708110:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3244
00010000:00010000:1.0:1651532122.708113:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532122.708116:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3246
00000100:00100000:0.0:1651532122.708117:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468352064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.708120:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532122.708122:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468351936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (96us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532122.708123:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f00d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499bd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.708125:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3245
00010000:00010000:0.0:1651532122.708129:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f00d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499bd expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.708133:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f00d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499bd expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.708136:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532122.708142:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468352064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.708144:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3246
00000001:00080000:1.0:1651532122.807069:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793727 is committed
00010000:00010000:0.0:1651532122.807099:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807104:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.807127:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008744f71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468347776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 374030us (374086us total) trans 158913793727 rc 0/0
00000100:00100000:0.0:1651532122.807130:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4128
00010000:00010000:0.0:1651532122.807138:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807141:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.807142:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807145:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807150:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.807151:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.807152:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807155:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807158:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.807158:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.807159:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807166:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807182:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807186:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40ef34 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4825088->10113023] (req 4825088->10113023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807188:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807192:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807197:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807200:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.807532:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.807543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.807547:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468352320
00000100:00100000:1.0:1651532122.807551:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.807560:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.807568:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468352384
00000100:00100000:1.0:1651532122.807578:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.807586:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4137
00000100:00100000:1.0:1651532122.807588:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4138
00000100:00100000:0.0:1651532122.807588:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468352320:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532122.807590:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468352384:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532122.807595:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807599:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807600:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532122.807601:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807604:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532122.807605:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807608:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532122.807610:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807613:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532122.807613:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807617:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807618:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807621:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807621:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.807630:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468352448
00010000:00010000:1.0:1651532122.807633:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807636:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.807639:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468352576
00000100:00100000:0.0:1651532122.807641:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468352704
00000100:00100000:0.0:1651532122.807644:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3247
00000100:00100000:0.0:1651532122.807645:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468352448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.807648:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.807657:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f022 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499c4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.807661:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468349184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 266210us (266277us total) trans 0 rc 36864/36864
00010000:00010000:0.0:1651532122.807662:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532122.807664:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4130
00010000:00010000:0.0:1651532122.807665:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f022 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499c4 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.807669:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f022 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499c4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532122.807672:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3248
00010000:00010000:0.0:1651532122.807672:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532122.807674:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468352576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.807677:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.807680:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f029 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499cb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.807681:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468352448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (130us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532122.807685:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532122.807686:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3247
00010000:00010000:1.0:1651532122.807688:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f029 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499cb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532122.807691:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3249
00010000:00010000:1.0:1651532122.807692:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f029 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499cb expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532122.807693:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468352704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.807695:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532122.807695:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.807697:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f030 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499d2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.807702:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468352576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (141us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532122.807702:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.807703:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f030 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499d2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532122.807704:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3248
00010000:00010000:0.0:1651532122.807707:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f030 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499d2 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.807710:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532122.807715:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468352704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.807718:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3249
00010000:00010000:0.0:1651532122.807729:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807732:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.807759:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000038aec961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468347840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 374651us (374685us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532122.807764:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4129
00010000:00010000:0.0:1651532122.807772:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807777:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807778:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.807779:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807781:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532122.807782:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807784:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807785:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807791:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807793:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532122.807794:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532122.807794:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.807794:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ef7a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3747840->9355263] (req 3747840->9355263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807797:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807821:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807832:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40ef3b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7118847] (req 2281472->7118847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807839:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.807842:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.808125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.808150:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468352896
00000100:00100000:1.0:1651532122.808154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.808169:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.808178:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468352960
00000100:00100000:0.0:1651532122.808181:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468352832
00000100:00100000:0.0:1651532122.808185:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3250
00000100:00100000:1.0:1651532122.808186:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.808186:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468352896:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532122.808196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532122.808196:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.808204:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f037 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499e0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.808205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532122.808212:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f037 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499e0 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.808217:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f037 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499e0 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.808220:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532122.808234:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468352896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.808237:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3250
00000100:00100000:0.0:1651532122.808242:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468353280
00000100:00100000:0.0:1651532122.808246:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3251
00000100:00100000:0.0:1651532122.808247:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468352960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.808250:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.808252:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f03e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499e7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.808258:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f03e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499e7 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.808262:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f03e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499e7 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.808265:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532122.808270:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468352960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.808273:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3251
00000100:00100000:0.0:1651532122.808276:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3252
00000100:00100000:0.0:1651532122.808278:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468352832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.808280:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532122.808282:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3253
00010000:00010000:0.0:1651532122.808282:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f045 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499d9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.808284:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468353280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.808287:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f045 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499d9 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.808288:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.808290:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f045 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499d9 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.808292:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f04c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499ee expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.808293:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532122.808298:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468352832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 19us (128us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532122.808300:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f04c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499ee expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532122.808300:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3252
00010000:00010000:1.0:1651532122.808304:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f04c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499ee expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532122.808307:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468353152
00000100:00100000:0.0:1651532122.808318:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468353216
00010000:00010000:1.0:1651532122.808333:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532122.808333:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4139
00000100:00100000:0.0:1651532122.808334:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468353152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532122.808340:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.808343:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468353280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (137us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532122.808344:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532122.808345:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.808346:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3253
00010000:00010000:0.0:1651532122.808351:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532122.808352:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.808355:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4140
00010000:00010000:0.0:1651532122.808356:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.808357:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468353216:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532122.808359:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.808364:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.808368:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.808369:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.808372:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532122.808372:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.808377:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.808380:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.808679:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.808691:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468353472
00000100:00100000:0.0:1651532122.808700:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3254
00000100:00100000:0.0:1651532122.808701:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468353472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.808705:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.808708:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f061 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499f5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.808716:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f061 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499f5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.808720:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f061 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499f5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.808723:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532122.808756:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468353472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.808761:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3254
00000100:00100000:1.0:1651532122.808783:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.808795:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468353664
00000100:00100000:0.0:1651532122.808812:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3255
00000100:00100000:0.0:1651532122.808814:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468353664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.808818:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.808821:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f068 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4499fc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.808829:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f068 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499fc expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.808833:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f068 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4499fc expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.808836:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532122.808850:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468353664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.808853:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3255
00000100:00100000:1.0:1651532122.809109:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.809120:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468353984
00000100:00100000:0.0:1651532122.809128:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3256
00000100:00100000:0.0:1651532122.809130:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468353984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.809133:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.809136:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f06f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a03 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.809144:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f06f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a03 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.809148:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f06f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a03 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.809151:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532122.809167:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468353984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.809169:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3256
00000001:00080000:1.0:1651532122.873779:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793728 is committed
00010000:00010000:1.0:1651532122.873794:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.873798:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.873823:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.873828:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.873829:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.873831:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468349120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 332342us (332430us total) trans 158913793728 rc 0/0
00010000:00010000:0.0:1651532122.873833:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.873835:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4131
00010000:00010000:0.0:1651532122.873838:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.873839:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.873840:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.873843:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.873853:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.873858:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40ef81 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7950335] (req 1835008->7950335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.873872:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.873876:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.874147:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532122.874166:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.874175:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.874176:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468354176
00000100:00100000:0.0:1651532122.874192:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3257
00000100:00100000:1.0:1651532122.874193:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c52c0bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468350464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 224914us (224955us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532122.874194:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468354176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532122.874196:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4132
00010000:00010000:0.0:1651532122.874197:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.874201:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f076 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a0a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874206:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532122.874209:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532122.874209:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f076 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a0a expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.874213:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f076 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a0a expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.874216:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532122.874225:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468354176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.874228:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3257
00000100:00100000:0.0:1651532122.874234:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468354240
00000100:00100000:1.0:1651532122.874244:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532122.874244:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3258
00000100:00100000:0.0:1651532122.874246:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468354240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532122.874249:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.874264:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f07d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a11 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.874271:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468354304
00010000:00010000:0.0:1651532122.874272:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.874275:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f07d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a11 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532122.874278:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3259
00010000:00010000:0.0:1651532122.874279:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f07d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a11 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532122.874280:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468354304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.874283:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532122.874283:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532122.874287:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f084 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a18 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.874296:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468354240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (87us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532122.874299:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532122.874299:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3258
00010000:00010000:1.0:1651532122.874302:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f084 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a18 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.874306:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f084 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a18 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.874309:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532122.874309:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.874317:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468354304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.874330:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3259
00010000:00010000:0.0:1651532122.874341:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532122.874342:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874346:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874351:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.874351:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532122.874352:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874358:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874369:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874373:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40efb2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->9523199] (req 315392->9523199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.874376:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.874380:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.874617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.874667:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.874675:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.874682:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468354432
00000100:00100000:1.0:1651532122.874696:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468354368
00000100:00100000:1.0:1651532122.874704:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4141
00000100:00100000:1.0:1651532122.874706:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468354432:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532122.874710:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4142
00010000:00010000:1.0:1651532122.874713:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.874713:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468354368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532122.874717:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532122.874718:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532122.874719:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874721:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.874722:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874725:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532122.874726:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874729:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874732:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532122.874732:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874737:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874743:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532122.874749:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532122.874836:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468354688
00000100:00100000:1.0:1651532122.874844:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3260
00000100:00100000:1.0:1651532122.874846:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468354688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.874849:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.874852:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f099 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a1f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.874860:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f099 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a1f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.874864:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f099 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a1f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.874867:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532122.874876:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468354688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (201us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.874879:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3260
00000100:00100000:1.0:1651532122.874895:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.874944:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.874953:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468354816
00000100:00100000:1.0:1651532122.874959:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468354880
00000100:00100000:1.0:1651532122.874968:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3261
00000100:00100000:1.0:1651532122.874970:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0c2aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468354816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.874973:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.874976:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a26 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532122.874979:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3262
00000100:00100000:0.0:1651532122.874982:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468354880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.874984:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a26 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.874985:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.874988:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a26 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.874989:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f0a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a2d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.874991:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532122.874996:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f0a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a2d expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532122.875000:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f0a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a2d expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532122.875001:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0c2aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468354816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.875003:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3261
00010000:00010000:0.0:1651532122.875004:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532122.875013:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468354880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532122.875016:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3262
00000100:00100000:1.0:1651532122.875125:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.875131:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468355072
00000100:00100000:1.0:1651532122.875138:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3263
00000100:00100000:1.0:1651532122.875140:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468355072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.875143:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.875147:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0ae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a34 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.875154:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a34 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.875157:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a34 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.875161:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532122.875170:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468355072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.875173:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3263
00000100:00100000:1.0:1651532122.875388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532122.875395:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468355200
00000100:00100000:1.0:1651532122.875402:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3264
00000100:00100000:1.0:1651532122.875403:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468355200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532122.875406:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532122.875410:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f0b5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a3b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532122.875417:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f0b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a3b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.875421:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f0b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a3b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532122.875424:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532122.875433:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468355200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532122.875436:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3264
00000001:00080000:1.0:1651532123.048765:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793729 is committed
00010000:00010000:1.0:1651532123.048781:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.048785:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.048809:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.048818:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9301923 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468350400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 399462us (399564us total) trans 158913793729 rc 0/0
00000100:00100000:1.0:1651532123.048821:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4133
00010000:00010000:0.0:1651532123.048824:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532123.048825:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.048829:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.048834:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.048835:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.048836:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.048839:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.048849:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.048853:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40efc0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [860160->10391551] (req 860160->10391551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.048864:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.048868:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.049106:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.049114:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468355584
00000100:00100000:1.0:1651532123.049122:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3265
00000100:00100000:1.0:1651532123.049124:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e299bd9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468355584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.049127:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.049139:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f0bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a42 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.049147:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f0bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a42 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.049151:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f0bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a42 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.049155:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532123.049172:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e299bd9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468355584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.049174:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3265
00000100:00100000:1.0:1651532123.049189:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.049223:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.049231:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468355712
00000100:00100000:1.0:1651532123.049243:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468355648
00000100:00100000:1.0:1651532123.049247:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3266
00000100:00100000:1.0:1651532123.049248:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b961ae6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468355712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.049252:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532123.049254:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3267
00010000:00010000:1.0:1651532123.049255:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a50 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.049257:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a54139d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468355648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.049261:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.049262:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a50 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.049265:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f0ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a49 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.049266:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a50 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.049277:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532123.049284:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f0ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a49 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532123.049287:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b961ae6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468355712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (98us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532123.049289:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f0ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a49 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532123.049290:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3266
00010000:00010000:0.0:1651532123.049292:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532123.049301:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a54139d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468355648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.049304:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3267
00000100:00100000:1.0:1651532123.049456:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.049468:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468355904
00000100:00100000:0.0:1651532123.049477:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3268
00000100:00100000:0.0:1651532123.049479:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67f4078 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468355904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.049482:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.049486:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f0d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a57 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.049494:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f0d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a57 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.049498:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f0d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a57 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.049501:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532123.049518:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67f4078 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468355904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.049530:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3268
00000100:00100000:1.0:1651532123.049585:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.049596:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468356032
00000100:00100000:1.0:1651532123.049603:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.049604:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3269
00000100:00100000:0.0:1651532123.049607:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468356032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.049612:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.049617:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a5e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.049620:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468356160
00010000:00010000:0.0:1651532123.049625:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a5e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532123.049627:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3270
00000100:00100000:1.0:1651532123.049628:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468356160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.049629:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a5e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.049632:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.049632:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532123.049635:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a65 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.049642:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a65 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532123.049648:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468356032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.049651:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3269
00010000:00010000:1.0:1651532123.049654:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a65 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.049657:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532123.049665:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468356160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.049668:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3270
00000001:00080000:1.0:1651532123.157077:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793730 is committed
00002000:00010000:1.0:1651532123.157099:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532121 -> 1651532122
00010000:00010000:1.0:1651532123.157102:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157105:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.157127:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001c0ee2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468350720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507626us (507667us total) trans 158913793730 rc 0/0
00010000:00010000:0.0:1651532123.157129:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.157130:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4134
00010000:00010000:0.0:1651532123.157134:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532123.157135:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157139:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157145:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.157146:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.157147:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157150:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157160:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157164:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40efce lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6615040->6619135] (req 6615040->6619135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157183:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157188:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.157423:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.157431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.157442:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468356608
00000100:00100000:1.0:1651532123.157458:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468356544
00000100:00100000:1.0:1651532123.157464:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4143
00000100:00100000:1.0:1651532123.157466:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e06ef4b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468356608:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532123.157469:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4144
00000100:00100000:0.0:1651532123.157472:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005e31be0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468356544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532123.157473:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157477:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.157478:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157481:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157491:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532123.157492:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157496:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532123.157497:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157500:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532123.157501:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157504:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157505:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157508:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157509:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157519:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157522:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.157537:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085d82f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468351616:12345-10.240.43.64@tcp:3:fio.0 Request processed in 450000us (450040us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532123.157540:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4135
00010000:00010000:1.0:1651532123.157546:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157549:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532123.157551:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157553:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157559:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.157559:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.157560:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157563:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157575:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157578:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40efea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2748416->10121215] (req 2748416->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157584:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.157587:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.157945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.157953:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468356800
00000100:00100000:1.0:1651532123.157961:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3271
00000100:00100000:1.0:1651532123.157962:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468356800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.157966:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.157969:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0f4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a6c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.157977:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a6c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.157981:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a6c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.157987:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532123.157997:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468356800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.157999:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3271
00000001:00080000:1.0:1651532123.257107:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793731 is committed
00010000:00010000:0.0:1651532123.257137:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257142:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.257166:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b405b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468351552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549618us (549677us total) trans 158913793731 rc 0/0
00000100:00100000:0.0:1651532123.257169:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4136
00010000:00010000:0.0:1651532123.257177:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257181:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532123.257182:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257185:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257199:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.257200:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.257201:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257207:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257219:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257222:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40eff1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->8593407] (req 1986560->8593407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257228:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257231:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.257544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.257561:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.257570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.257577:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468357056
00000100:00100000:1.0:1651532123.257586:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468357120
00000100:00100000:1.0:1651532123.257595:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4145
00000100:00100000:1.0:1651532123.257596:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468357056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532123.257604:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.257607:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4146
00010000:00010000:1.0:1651532123.257608:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532123.257609:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.257609:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468357120:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532123.257612:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532123.257613:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.257617:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.257621:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257627:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.257629:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468357312
00010000:00010000:0.0:1651532123.257632:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.257633:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.257635:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3272
00000100:00100000:1.0:1651532123.257636:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468357312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.257639:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.257641:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f109 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a73 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257641:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532123.257641:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257646:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.257650:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.257660:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f109 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a73 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.257665:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f109 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a73 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.257668:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532123.257679:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468357312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.257682:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3272
00000001:00080000:1.0:1651532123.340476:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793732 is committed
00010000:00010000:0.0:1651532123.340508:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.340512:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.340535:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468352320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532947us (533004us total) trans 158913793732 rc 0/0
00000100:00100000:0.0:1651532123.340539:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4137
00010000:00010000:0.0:1651532123.340546:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.340550:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532123.340551:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.340554:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.340573:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.340574:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.340576:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.340581:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.340595:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.340598:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f014 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1667072->8097791] (req 1667072->8097791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.340601:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.340606:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.340877:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.340889:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.340911:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468352384:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533319us (533367us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532123.340914:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4138
00010000:00010000:1.0:1651532123.340921:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.340924:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532123.340926:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.340928:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.340934:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.340934:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.340935:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.340938:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.340948:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.340951:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f01b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->8126463] (req 364544->8126463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.340952:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.340956:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.340984:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.341025:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468357568
00000100:00100000:1.0:1651532123.341039:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3273
00000100:00100000:1.0:1651532123.341040:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468357568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.341044:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.341048:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f110 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a7a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.341055:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f110 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a7a expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.341059:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f110 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a7a expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.341062:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532123.341073:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468357568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.341075:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3273
00000100:00100000:1.0:1651532123.341309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.341316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.341347:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468357632
00000100:00100000:1.0:1651532123.341358:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.341365:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468357696
00000100:00100000:1.0:1651532123.341368:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.341380:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4147
00000100:00100000:0.0:1651532123.341382:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b4b17ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468357632:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532123.341383:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4148
00000100:00100000:1.0:1651532123.341385:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085b1d320 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468357696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532123.341390:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.341394:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.341394:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532123.341404:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.341407:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532123.341407:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.341411:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532123.341413:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.341416:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532123.341416:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.341420:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.341421:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.341424:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.341424:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.341432:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468357760
00000100:00100000:0.0:1651532123.341433:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468357888
00000100:00100000:1.0:1651532123.341444:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3274
00000100:00100000:1.0:1651532123.341446:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e251c56c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468357760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.341449:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532123.341450:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3275
00010000:00010000:1.0:1651532123.341451:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f125 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a81 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.341452:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5d14c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468357888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.341455:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.341458:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f125 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a81 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.341458:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f12c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a88 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.341462:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f125 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a81 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.341466:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f12c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a88 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.341469:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532123.341470:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f12c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a88 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.341474:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532123.341479:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e251c56c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468357760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (121us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.341481:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3274
00000100:00100000:0.0:1651532123.341483:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5d14c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468357888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (115us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.341486:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3275
00000001:00080000:1.0:1651532123.465479:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793733 is committed
00010000:00010000:0.0:1651532123.465509:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465514:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.465537:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468353152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 657202us (657351us total) trans 158913793733 rc 0/0
00000100:00100000:0.0:1651532123.465540:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4139
00010000:00010000:0.0:1651532123.465548:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465551:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532123.465553:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465556:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465561:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.465562:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.465562:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465566:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465572:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.465573:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.465574:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465578:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465595:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465599:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f053 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->9469951] (req 2060288->9469951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.465601:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.465606:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465609:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465612:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.465873:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.465896:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468358208
00010000:00010000:1.0:1651532123.465900:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.465904:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.465906:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3276
00000100:00100000:0.0:1651532123.465908:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468358208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.465916:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.465921:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f133 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a8f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.465922:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468354432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 591215us (591304us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532123.465925:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4141
00010000:00010000:0.0:1651532123.465927:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.465938:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f133 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a8f expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.465943:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f133 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a8f expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.465946:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532123.465965:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468358208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.465969:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3276
00010000:00010000:1.0:1651532123.465971:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.465975:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532123.465976:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.465980:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465983:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.465986:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.465997:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.466000:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f08b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->9494527] (req 1482752->9494527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.466002:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468353216:12345-10.240.43.64@tcp:3:fio.0 Request processed in 657644us (657805us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532123.466004:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.466005:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4140
00010000:00010000:1.0:1651532123.466007:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532123.466008:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.466010:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.466014:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.466014:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.466015:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.466018:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.466027:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.466031:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f05a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1441792->8978431] (req 1441792->8978431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.466031:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.466035:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.466279:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.466346:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.466346:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468358464
00000100:00100000:1.0:1651532123.466356:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.466363:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468358400
00000100:00100000:1.0:1651532123.466365:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.466375:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4149
00000100:00100000:1.0:1651532123.466377:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a5796b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468358464:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532123.466379:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4150
00010000:00010000:1.0:1651532123.466385:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.466388:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096331adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468358400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532123.466390:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532123.466391:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532123.466391:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.466395:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.466396:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.466401:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532123.466402:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.466405:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.466407:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532123.466408:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.466412:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.466415:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.466418:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.466477:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.466489:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.466496:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468358528
00000100:00100000:1.0:1651532123.466501:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468358720
00000100:00100000:1.0:1651532123.466503:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468358912
00000100:00100000:1.0:1651532123.466505:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468358848
00000100:00100000:1.0:1651532123.466508:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3277
00000100:00100000:1.0:1651532123.466510:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468358528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.466518:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.466521:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f148 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a96 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.466523:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3278
00000100:00100000:0.0:1651532123.466525:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468358720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.466529:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f148 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a96 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.466529:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.466533:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f148 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a96 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.466533:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f14f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449a9d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.466536:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532123.466541:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f14f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a9d expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.466545:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f14f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449a9d expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532123.466546:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468358528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (200us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.466549:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3277
00010000:00010000:0.0:1651532123.466549:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532123.466554:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3279
00000100:00100000:1.0:1651532123.466556:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468358912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.466558:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532123.466558:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468358720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (193us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532123.466560:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f156 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449aab expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.466561:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3278
00010000:00010000:1.0:1651532123.466566:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f156 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449aab expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532123.466567:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3280
00000100:00100000:0.0:1651532123.466569:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468358848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.466570:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f156 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449aab expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.466571:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.466573:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f15d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449aa4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.466575:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532123.466579:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f15d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449aa4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532123.466581:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468358912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (105us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532123.466583:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f15d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449aa4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532123.466584:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3279
00010000:00010000:0.0:1651532123.466586:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532123.466591:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468358848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.466594:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3280
00000100:00100000:1.0:1651532123.466867:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.466879:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468359040
00000100:00100000:0.0:1651532123.466888:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3281
00000100:00100000:0.0:1651532123.466890:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468359040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.466893:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.466897:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f164 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ab2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.466904:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f164 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ab2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.466908:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f164 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ab2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.466912:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532123.466926:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468359040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.466929:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3281
00000100:00100000:1.0:1651532123.467039:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.467050:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468359232
00000100:00100000:0.0:1651532123.467058:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3282
00000100:00100000:0.0:1651532123.467060:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468359232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.467063:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.467066:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f16b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ab9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.467074:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f16b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ab9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.467078:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f16b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ab9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.467081:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532123.467095:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468359232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.467097:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3282
00000100:00100000:1.0:1651532123.467305:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.467316:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468359488
00000100:00100000:0.0:1651532123.467332:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3283
00000100:00100000:0.0:1651532123.467334:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468359488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.467337:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.467341:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f172 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ac0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.467348:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f172 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ac0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.467352:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f172 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ac0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.467355:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532123.467368:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468359488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.467370:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3283
00000001:00080000:1.0:1651532123.580508:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793734 is committed
00010000:00010000:0.0:1651532123.580534:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.580539:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.580562:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468354368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 705849us (705895us total) trans 158913793734 rc 0/0
00000100:00100000:0.0:1651532123.580566:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4142
00010000:00010000:0.0:1651532123.580573:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.580576:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532123.580577:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.580580:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.580585:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.580586:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.580587:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.580590:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.580597:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.580606:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f092 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4042752->10330111] (req 4042752->10330111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.580610:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.580615:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.580954:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.580966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.580967:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468359616
00000100:00100000:1.0:1651532123.580978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.580982:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468359680
00000100:00100000:0.0:1651532123.580997:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4151
00000100:00100000:0.0:1651532123.580999:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468359616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532123.581002:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.581006:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581006:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581011:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532123.581012:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581020:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532123.581021:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.581025:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e06ef4b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468356608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 423558us (423602us total) trans 0 rc 57344/57344
00010000:00010000:0.0:1651532123.581026:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.581028:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4143
00010000:00010000:0.0:1651532123.581029:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.581034:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4152
00010000:00010000:0.0:1651532123.581035:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.581036:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468359680:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532123.581043:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.581047:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.581048:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.581051:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532123.581052:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581055:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532123.581057:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581057:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.581060:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581060:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581065:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.581066:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.581066:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581069:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581076:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581079:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f0e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->9957375] (req 651264->9957375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581085:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581088:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.581113:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468359808
00000100:00100000:1.0:1651532123.581129:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3284
00000100:00100000:1.0:1651532123.581131:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468359808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.581135:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.581138:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f187 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ac7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.581146:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f187 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ac7 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.581153:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f187 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ac7 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.581157:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532123.581164:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468359808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (187us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.581167:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3284
00000100:00100000:1.0:1651532123.581531:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.581546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.581556:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.581565:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468360000
00000100:00100000:1.0:1651532123.581572:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468360256
00000100:00100000:1.0:1651532123.581574:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468360192
00000100:00100000:1.0:1651532123.581577:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3285
00000100:00100000:1.0:1651532123.581579:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468360000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.581582:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.581586:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f18e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ace expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.581593:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f18e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ace expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.581597:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f18e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ace expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.581610:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532123.581620:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468360000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.581623:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3286
00000100:00100000:1.0:1651532123.581633:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3285
00000100:00100000:0.0:1651532123.581633:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468360256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.581637:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532123.581638:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3287
00000100:00100000:1.0:1651532123.581639:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468360192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.581641:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f195 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449adc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.581642:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.581645:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f19c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ad5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.581649:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f195 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449adc expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.581652:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f19c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ad5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.581654:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f195 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449adc expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.581656:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f19c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ad5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.581657:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532123.581659:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532123.581667:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468360192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.581667:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468360256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (121us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.581670:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3287
00000100:00100000:0.0:1651532123.581671:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3286
00000001:00080000:1.0:1651532123.640537:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793735 is committed
00002000:00010000:0.0:1651532123.640566:0:330054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532122 -> 1651532123
00010000:00010000:0.0:1651532123.640570:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.640574:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.640594:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005e31be0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468356544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 483121us (483162us total) trans 158913793735 rc 0/0
00010000:00010000:1.0:1651532123.640596:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.640597:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4144
00010000:00010000:1.0:1651532123.640600:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532123.640608:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.640611:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.640617:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.640618:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.640619:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.640622:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.640629:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.640632:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f0ed lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->9875455] (req 53248->9875455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.640634:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.640645:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.641050:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.641060:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.641068:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.641076:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.641085:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.641092:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468360768
00000100:00100000:1.0:1651532123.641102:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468360896
00000100:00100000:1.0:1651532123.641107:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4153
00000100:00100000:1.0:1651532123.641109:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468360768:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532123.641121:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4154
00000100:00100000:0.0:1651532123.641123:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468360896:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532123.641124:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.641128:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532123.641129:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.641131:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.641132:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532123.641133:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.641137:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532123.641138:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.641141:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532123.641142:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.641145:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.641146:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.641149:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.641150:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.641157:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468361024
00000100:00100000:1.0:1651532123.641158:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468361088
00000100:00100000:0.0:1651532123.641169:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468360960
00000100:00100000:0.0:1651532123.641173:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3288
00000100:00100000:0.0:1651532123.641174:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468361024:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532123.641175:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3289
00000100:00100000:1.0:1651532123.641177:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468361088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.641178:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.641180:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.641181:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f1b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449aea expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.641183:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449af1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.641189:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f1b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449aea expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.641190:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449af1 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.641193:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f1b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449aea expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.641194:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449af1 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.641196:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532123.641217:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532123.641221:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468361024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (153us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.641224:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3288
00000100:00100000:1.0:1651532123.641226:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468361088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (150us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.641229:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3289
00000100:00100000:0.0:1651532123.641231:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3290
00000100:00100000:0.0:1651532123.641233:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468360960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.641235:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.641238:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f1bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ae3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.641244:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f1bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ae3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.641248:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f1bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ae3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.641266:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532123.641283:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468360960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (198us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.641286:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3290
00000100:00100000:1.0:1651532123.641575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.641587:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468361344
00000100:00100000:0.0:1651532123.641600:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3291
00000100:00100000:0.0:1651532123.641602:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468361344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.641606:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.641609:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f1c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449af8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.641617:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f1c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449af8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.641621:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f1c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449af8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.641624:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532123.641638:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468361344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.641641:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3291
00000100:00100000:1.0:1651532123.641891:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.641902:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468361600
00000100:00100000:0.0:1651532123.641913:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3292
00000100:00100000:0.0:1651532123.641914:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468361600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.641926:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.641929:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449aff expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.641937:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449aff expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.641941:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449aff expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.641944:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532123.641957:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468361600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.641959:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3292
00000100:00100000:1.0:1651532123.642195:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.642206:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468361728
00000100:00100000:0.0:1651532123.642217:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3293
00000100:00100000:0.0:1651532123.642219:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468361728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.642222:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.642226:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f1d4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b06 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.642233:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f1d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b06 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.642237:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f1d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b06 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.642251:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532123.642264:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468361728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.642266:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3293
00000001:00080000:1.0:1651532123.754543:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793736 is committed
00010000:00010000:0.0:1651532123.754573:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754578:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.754601:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468357056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 497003us (497057us total) trans 158913793736 rc 0/0
00000100:00100000:0.0:1651532123.754604:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4145
00010000:00010000:0.0:1651532123.754611:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754615:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532123.754616:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754619:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754624:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.754625:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.754625:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754637:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754647:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754652:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f0fb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2109440->9846783] (req 2109440->9846783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754661:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754664:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754678:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754681:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.754706:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468357120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 497096us (497144us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532123.754727:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4146
00010000:00010000:0.0:1651532123.754735:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754742:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532123.754743:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754746:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754752:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.754753:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.754754:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754759:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754769:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754772:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f102 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8617984->8622079] (req 8617984->8622079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754779:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754784:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.754917:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.754936:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468361984
00000100:00100000:0.0:1651532123.754949:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3294
00000100:00100000:0.0:1651532123.754951:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468361984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.754954:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.754958:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f1db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b0d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.754968:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f1db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b0d expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.754975:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f1db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b0d expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.754981:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532123.755033:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468361984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 81us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.755038:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3294
00000100:00100000:1.0:1651532123.755100:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.755110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.755120:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.755174:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468362240
00000100:00100000:0.0:1651532123.755187:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468362112
00000100:00100000:0.0:1651532123.755193:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4155
00000100:00100000:0.0:1651532123.755195:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468362240:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532123.755196:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4156
00000100:00100000:1.0:1651532123.755199:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468362112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532123.755202:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.755206:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532123.755207:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532123.755208:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.755208:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.755224:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532123.755225:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.755228:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.755231:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532123.755232:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.755261:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.755262:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.755265:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.755269:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.755271:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468362048
00000100:00100000:0.0:1651532123.755282:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3295
00000100:00100000:0.0:1651532123.755284:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468362048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.755287:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.755289:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f1f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b14 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.755296:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f1f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b14 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.755300:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f1f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b14 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.755304:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532123.755317:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468362048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (218us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.755328:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3295
00000100:00100000:1.0:1651532123.755610:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.755622:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468362432
00000100:00100000:0.0:1651532123.755635:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3296
00000100:00100000:0.0:1651532123.755636:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468362432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.755640:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.755643:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f1f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b1b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.755658:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f1f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b1b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.755662:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f1f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b1b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.755665:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532123.755680:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468362432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.755683:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3296
00000001:00080000:1.0:1651532123.871233:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793737 is committed
00002000:00010000:0.0:1651532123.871262:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532122 -> 1651532123
00010000:00010000:0.0:1651532123.871266:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871269:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.871290:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b4b17ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468357632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 529907us (529982us total) trans 158913793737 rc 0/0
00010000:00010000:1.0:1651532123.871293:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.871293:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4147
00010000:00010000:1.0:1651532123.871297:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532123.871298:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871302:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871307:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.871308:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.871309:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871312:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871335:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.871346:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.871347:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871351:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871360:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871363:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f117 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10317823] (req 839680->10317823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871370:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871373:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871395:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871400:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871417:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871424:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871442:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.871443:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085b1d320 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468357696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 530057us (530126us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532123.871446:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4148
00010000:00010000:0.0:1651532123.871447:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532123.871448:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871451:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871458:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871460:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f11e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4083712->4087807] (req 4083712->4087807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871667:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871672:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871684:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871689:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532123.871690:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.871691:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a5796b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468358464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 405313us (405413us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532123.871693:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.871695:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4149
00010000:00010000:0.0:1651532123.871698:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.871699:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532123.871699:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871703:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871710:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871713:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f13a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4284416->9695231] (req 4284416->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871718:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.871721:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.871829:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.871849:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.871858:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468362880
00000100:00100000:1.0:1651532123.871885:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468362816
00000100:00100000:1.0:1651532123.871895:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4157
00000100:00100000:1.0:1651532123.871897:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468362880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532123.871904:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871909:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532123.871910:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871913:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532123.871914:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871918:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871921:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.871929:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4158
00000100:00100000:1.0:1651532123.871930:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468362816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532123.871944:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871948:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532123.871949:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871951:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532123.871952:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871955:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.871958:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.872059:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.872070:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.872071:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468363008
00000100:00100000:1.0:1651532123.872077:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468363136
00000100:00100000:0.0:1651532123.872085:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3297
00000100:00100000:0.0:1651532123.872086:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468363008:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532123.872090:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3298
00010000:00010000:0.0:1651532123.872090:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532123.872092:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468363136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.872094:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f20c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b22 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.872096:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.872100:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f213 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b29 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.872102:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f20c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b22 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.872107:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f20c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b22 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.872108:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f213 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b29 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.872111:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532123.872113:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f213 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b29 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.872116:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532123.872122:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468363008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.872125:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468363136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532123.872125:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3297
00000100:00100000:1.0:1651532123.872136:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3298
00000001:00080000:1.0:1651532123.962947:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793738 is committed
00010000:00010000:0.0:1651532123.962978:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.962983:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.963003:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096331adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468358400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 496614us (496647us total) trans 158913793738 rc 0/0
00010000:00010000:1.0:1651532123.963006:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.963006:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4150
00010000:00010000:1.0:1651532123.963011:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532123.963012:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.963015:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.963021:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.963022:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532123.963022:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.963026:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.963037:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.963042:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f141 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2658304->8527871] (req 2658304->8527871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.963044:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.963050:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.963457:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.963474:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.963488:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532123.963504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.963506:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468363456
00000100:00100000:0.0:1651532123.963515:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468363328
00000100:00100000:1.0:1651532123.963520:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468363520
00000100:00100000:1.0:1651532123.963529:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3299
00000100:00100000:1.0:1651532123.963531:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468363456:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532123.963532:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468363392
00010000:00010000:1.0:1651532123.963535:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.963538:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f21a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b30 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.963538:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4159
00000100:00100000:0.0:1651532123.963540:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468363328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532123.963547:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f21a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b30 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.963548:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.963552:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532123.963553:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.963567:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532123.963568:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.963572:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f21a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b30 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.963572:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.963575:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532123.963576:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532123.963584:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4160
00000100:00100000:0.0:1651532123.963585:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468363392:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532123.963589:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468363456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.963591:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3299
00010000:00010000:0.0:1651532123.963596:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532123.963597:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3300
00000100:00100000:1.0:1651532123.963598:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000207f99f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468363520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532123.963600:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532123.963601:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532123.963601:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.963603:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f22f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b37 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.963603:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532123.963604:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532123.963608:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.963609:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f22f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b37 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532123.963611:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.963613:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f22f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b37 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.963616:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532123.963621:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000207f99f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468363520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.963623:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3300
00000100:00100000:1.0:1651532123.963970:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532123.963979:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468363648
00000100:00100000:1.0:1651532123.963986:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3301
00000100:00100000:1.0:1651532123.963988:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468363648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532123.963991:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532123.963995:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f236 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b3e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532123.964002:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f236 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b3e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.964006:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f236 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b3e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532123.964010:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532123.964024:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468363648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532123.964027:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3301
00000001:00080000:1.0:1651532124.021358:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793739 is committed
00010000:00010000:0.0:1651532124.021388:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021392:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.021415:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468359616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 440415us (440462us total) trans 158913793739 rc 0/0
00000100:00100000:0.0:1651532124.021418:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4151
00010000:00010000:0.0:1651532124.021426:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021429:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.021430:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021433:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021438:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.021439:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.021440:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021443:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021464:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021469:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f179 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6328320->8679423] (req 6328320->8679423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.021477:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.021481:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.021771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.021779:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532124.021794:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.021799:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.021832:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468359680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 440794us (440866us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532124.021835:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4152
00010000:00010000:0.0:1651532124.021839:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021843:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532124.021844:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468363904
00010000:00010000:0.0:1651532124.021844:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021848:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.021851:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468364032
00010000:00010000:0.0:1651532124.021853:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.021854:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532124.021855:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3302
00010000:00010000:0.0:1651532124.021855:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.021856:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d377484d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468363904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.021858:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.021859:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.021863:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f23d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b45 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021867:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021870:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f180 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [770048->8769535] (req 770048->8769535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.021877:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f23d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b45 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.021882:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f23d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b45 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.021885:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532124.021889:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3303
00000100:00100000:0.0:1651532124.021891:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe864bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468364032:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532124.021892:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d377484d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468363904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.021895:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3302
00010000:00010000:0.0:1651532124.021895:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.021898:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f244 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b4c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.021902:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.021905:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.021906:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f244 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b4c expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.021911:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f244 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b4c expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.021914:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532124.021923:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe864bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468364032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (144us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.021926:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3303
00000100:00100000:0.0:1651532124.022354:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.022366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.022367:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468364288
00000100:00100000:0.0:1651532124.022373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.022379:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468364224
00000100:00100000:0.0:1651532124.022380:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.022393:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4161
00000100:00100000:1.0:1651532124.022394:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000191e2581 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468364288:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532124.022397:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4162
00000100:00100000:0.0:1651532124.022399:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057a3157c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468364224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532124.022402:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.022406:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532124.022407:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532124.022408:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.022408:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.022411:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.022418:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468364352
00000100:00100000:1.0:1651532124.022423:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468364608
00010000:00010000:0.0:1651532124.022423:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532124.022425:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.022427:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3304
00010000:00010000:0.0:1651532124.022427:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.022429:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d52bfd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468364352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.022430:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532124.022431:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.022431:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.022434:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f259 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b53 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.022435:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.022438:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.022441:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f259 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b53 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.022441:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.022445:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f259 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b53 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.022449:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532124.022450:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3305
00000100:00100000:0.0:1651532124.022452:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089209c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468364608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.022455:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.022457:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f260 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b5a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.022460:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d52bfd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468364352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.022463:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3304
00010000:00010000:0.0:1651532124.022465:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f260 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b5a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.022469:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f260 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b5a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.022472:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532124.022481:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089209c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468364608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.022484:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3305
00000100:00100000:0.0:1651532124.022737:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.022745:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468364736
00000100:00100000:0.0:1651532124.022760:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3306
00000100:00100000:0.0:1651532124.022762:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f651876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468364736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.022765:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.022769:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f267 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b61 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.022776:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f267 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b61 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.022781:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f267 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b61 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.022784:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532124.022797:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f651876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468364736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.022802:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3306
00000100:00100000:0.0:1651532124.023047:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.023054:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468364928
00000100:00100000:0.0:1651532124.023069:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3307
00000100:00100000:0.0:1651532124.023070:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c390546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468364928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.023074:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.023077:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f26e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b68 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.023085:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f26e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b68 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.023089:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f26e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b68 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.023092:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532124.023105:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c390546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468364928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.023108:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3307
00000001:00080000:1.0:1651532124.088056:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793740 is committed
00010000:00010000:1.0:1651532124.088071:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088075:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.088097:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468360768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 446987us (447048us total) trans 158913793740 rc 0/0
00010000:00010000:0.0:1651532124.088099:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.088100:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4153
00010000:00010000:0.0:1651532124.088104:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.088105:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088118:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088124:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.088125:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.088125:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088128:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088132:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.088132:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.088133:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088135:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088146:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088151:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f1a3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->8441855] (req 1077248->8441855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088160:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088163:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088223:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088227:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.088504:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.088517:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468365120
00000100:00100000:1.0:1651532124.088522:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.088531:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468365184
00000100:00100000:0.0:1651532124.088544:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3308
00000100:00100000:0.0:1651532124.088550:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aca61869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468365120:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532124.088553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532124.088554:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.088558:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f275 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b6f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.088560:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468365312
00010000:00010000:0.0:1651532124.088563:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.088566:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f275 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b6f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532124.088567:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3309
00000100:00100000:1.0:1651532124.088569:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018165273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468365184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.088570:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f275 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b6f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.088572:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.088574:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532124.088577:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f27c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b76 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088582:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532124.088588:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aca61869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468365120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.088591:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3308
00010000:00010000:1.0:1651532124.088592:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f27c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b76 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.088596:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f27c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b76 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.088600:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532124.088608:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018165273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468365184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.088611:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3309
00000100:00100000:1.0:1651532124.088616:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3310
00000100:00100000:1.0:1651532124.088618:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079cbb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468365312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.088620:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.088623:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f283 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b7d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088627:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.088628:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088640:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088644:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f283 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b7d expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.088648:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f283 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b7d expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.088651:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532124.088654:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ed66c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468362240:12345-10.240.43.64@tcp:3:fio.0 Request processed in 333459us (333544us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532124.088657:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079cbb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468365312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (104us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.088658:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4155
00000100:00100000:1.0:1651532124.088660:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3310
00010000:00010000:0.0:1651532124.088669:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088673:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.088674:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088677:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088682:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088684:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f1e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1568768->10354687] (req 1568768->10354687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088692:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.088695:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.088724:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468360896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 447600us (447664us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532124.088727:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4154
00010000:00010000:1.0:1651532124.088728:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088733:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532124.088734:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088738:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088743:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.088744:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.088745:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088747:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088755:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088758:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f1aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->9998335] (req 401408->9998335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088781:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.088798:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.089198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.089206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.089219:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.089228:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.089232:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468365696
00000100:00100000:1.0:1651532124.089235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.089246:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468365568
00000100:00100000:0.0:1651532124.089254:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4163
00000100:00100000:0.0:1651532124.089256:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045cfe023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468365696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532124.089264:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089268:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532124.089269:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089272:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532124.089272:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089277:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089280:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.089288:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4164
00000100:00100000:0.0:1651532124.089290:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4b0fa2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468365568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532124.089295:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089298:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532124.089299:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089302:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532124.089302:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089305:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089308:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.089329:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468365440
00000100:00100000:0.0:1651532124.089336:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468365760
00000100:00100000:0.0:1651532124.089339:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468365824
00000100:00100000:0.0:1651532124.089341:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3311
00000100:00100000:0.0:1651532124.089343:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2cc2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468365440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.089346:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.089348:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f298 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b84 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089355:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f298 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b84 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.089362:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f298 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b84 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532124.089363:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3312
00000100:00100000:1.0:1651532124.089365:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b720e370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468365760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.089366:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532124.089369:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.089373:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f29f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b8b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.089379:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2cc2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468365440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (182us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.089382:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3311
00000100:00100000:0.0:1651532124.089387:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3313
00010000:00010000:1.0:1651532124.089388:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f29f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b8b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532124.089388:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000724d966c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468365824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.089391:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.089392:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f29f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b8b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.089393:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f2a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b92 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.089396:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532124.089399:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f2a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b92 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.089403:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f2a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b92 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532124.089405:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b720e370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468365760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (177us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532124.089406:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532124.089408:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3312
00000100:00100000:0.0:1651532124.089411:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000724d966c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468365824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (176us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.089414:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3313
00000100:00100000:1.0:1651532124.089665:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.089677:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468366016
00000100:00100000:0.0:1651532124.089685:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3314
00000100:00100000:0.0:1651532124.089687:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d43c04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468366016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.089690:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.089694:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f2ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449b99 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089701:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f2ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b99 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.089705:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f2ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449b99 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.089708:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532124.089728:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d43c04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468366016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.089733:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3314
00000100:00100000:1.0:1651532124.089780:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.089791:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.089792:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468366208
00000100:00100000:0.0:1651532124.089817:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468366336
00000100:00100000:1.0:1651532124.089826:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3315
00000100:00100000:1.0:1651532124.089829:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018bbbca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468366208:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532124.089829:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3316
00000100:00100000:0.0:1651532124.089831:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468366336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.089833:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.089834:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.089837:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f2b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ba0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.089838:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ba7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.089846:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f2b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ba0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.089846:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ba7 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.089850:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f2b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ba0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.089853:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532124.089861:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ba7 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532124.089863:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018bbbca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468366208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (84us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532124.089865:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532124.089866:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3315
00000100:00100000:0.0:1651532124.089874:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468366336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.089876:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3316
00000100:00100000:1.0:1651532124.090121:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.090138:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468366528
00000100:00100000:0.0:1651532124.090146:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3317
00000100:00100000:0.0:1651532124.090148:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468366528:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532124.090149:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532124.090152:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.090156:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bae expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.090167:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bae expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532124.090170:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468366656
00010000:00010000:0.0:1651532124.090171:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bae expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.090175:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532124.090178:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3318
00000100:00100000:1.0:1651532124.090180:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468366656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.090184:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532124.090190:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468366528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (71us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532124.090193:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f2c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bb5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.090193:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3317
00010000:00010000:1.0:1651532124.090213:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f2c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bb5 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.090217:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f2c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bb5 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.090220:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532124.090229:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468366656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.090232:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3318
00000001:00080000:1.0:1651532124.154767:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793741 is committed
00010000:00010000:1.0:1651532124.154783:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.154787:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.154812:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.154817:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.154818:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.154819:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468362112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 399620us (399699us total) trans 158913793741 rc 0/0
00010000:00010000:0.0:1651532124.154821:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.154823:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4156
00010000:00010000:0.0:1651532124.154827:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.154827:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.154828:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.154831:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.154841:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.154844:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f1e9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [364544->10477567] (req 364544->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.154853:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.154856:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.155200:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.155210:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.155217:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.155223:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.155229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.155250:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468367040
00010000:00010000:0.0:1651532124.155257:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155262:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.155268:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468366912
00000100:00100000:1.0:1651532124.155270:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468367104
00000100:00100000:1.0:1651532124.155273:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3319
00000100:00100000:1.0:1651532124.155275:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468367040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.155280:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.155285:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f2d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bc3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.155293:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.155296:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f2d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bc3 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532124.155306:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468362880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 283407us (283476us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532124.155308:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f2d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bc3 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532124.155310:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4157
00010000:00010000:1.0:1651532124.155312:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532124.155316:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468366976
00000100:00100000:1.0:1651532124.155331:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468367040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (114us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.155337:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468366848
00000100:00100000:1.0:1651532124.155339:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3319
00000100:00100000:0.0:1651532124.155344:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4165
00000100:00100000:1.0:1651532124.155345:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3320
00000100:00100000:0.0:1651532124.155346:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d377484d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468366976:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532124.155347:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468366912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.155350:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.155353:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f2d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bbc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155353:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155357:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.155358:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155361:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532124.155362:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.155365:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.155367:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f2d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bbc expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.155367:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155373:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.155380:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f2d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bbc expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.155380:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.155383:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532124.155383:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.155384:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155387:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.155390:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468366912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (167us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532124.155391:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.155392:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.155392:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.155393:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3320
00010000:00010000:0.0:1651532124.155395:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.155397:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3321
00000100:00100000:1.0:1651532124.155399:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468367104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.155401:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.155404:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155407:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f1fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7012352->9793535] (req 7012352->9793535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.155412:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f2e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bca expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.155416:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4166
00010000:00010000:1.0:1651532124.155418:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f2e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bca expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.155422:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f2e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bca expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.155425:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532124.155426:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe864bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468366848:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532124.155431:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468367104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (202us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532124.155432:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.155433:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3321
00010000:00010000:0.0:1651532124.155436:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532124.155436:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155439:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532124.155440:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.155443:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155443:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155446:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.155454:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.155473:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.155480:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468367232
00000100:00100000:0.0:1651532124.155494:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3322
00000100:00100000:0.0:1651532124.155496:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000207f99f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468367232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.155499:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.155502:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f2f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bd1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155509:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f2f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bd1 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.155530:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f2f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bd1 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.155534:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532124.155551:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000207f99f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468367232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.155556:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3322
00000100:00100000:0.0:1651532124.155863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.155870:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468367424
00000100:00100000:0.0:1651532124.155877:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3323
00000100:00100000:0.0:1651532124.155879:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d52bfd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468367424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.155882:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.155886:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f2fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bd8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155897:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f2fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bd8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.155904:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f2fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bd8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.155943:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532124.155947:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.155955:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d52bfd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468367424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 75us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.155960:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3323
00000100:00100000:0.0:1651532124.155965:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468367488
00000100:00100000:0.0:1651532124.155971:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3324
00000100:00100000:1.0:1651532124.155972:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.155973:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468367488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.155976:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.155990:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f301 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bdf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.155998:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f301 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bdf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.156005:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f301 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bdf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.156010:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532124.156022:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468367552
00000100:00100000:1.0:1651532124.156031:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3325
00000100:00100000:1.0:1651532124.156032:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468367552:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532124.156042:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468367488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (96us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532124.156043:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532124.156046:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3324
00010000:00010000:1.0:1651532124.156047:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f308 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449be6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.156054:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f308 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449be6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156058:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f308 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449be6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156062:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532124.156064:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.156070:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468367552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.156073:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3325
00000100:00100000:1.0:1651532124.156078:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468367744
00000100:00100000:1.0:1651532124.156090:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3326
00000100:00100000:1.0:1651532124.156093:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089209c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468367744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.156109:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.156112:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f30f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bed expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.156119:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f30f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bed expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156123:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f30f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bed expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156126:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532124.156140:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089209c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468367744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.156143:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3326
00000100:00100000:1.0:1651532124.156268:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.156275:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468367872
00000100:00100000:1.0:1651532124.156287:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3327
00000100:00100000:1.0:1651532124.156288:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468367872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.156292:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.156295:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f316 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bf4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.156302:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f316 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bf4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156306:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f316 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bf4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156309:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532124.156329:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468367872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.156332:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3327
00000100:00100000:1.0:1651532124.156565:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.156572:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.156583:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.156583:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468368128
00000100:00100000:1.0:1651532124.156592:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468368064
00000100:00100000:0.0:1651532124.156596:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468368256
00000100:00100000:1.0:1651532124.156598:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3328
00000100:00100000:1.0:1651532124.156600:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468368128:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532124.156601:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3329
00010000:00010000:1.0:1651532124.156603:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532124.156603:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468368064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.156607:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f31d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c02 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.156607:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.156610:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f324 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449bfb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.156614:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f31d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c02 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156618:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f31d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c02 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.156620:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f324 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bfb expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156621:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532124.156624:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f324 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449bfb expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.156628:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532124.156634:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468368128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.156636:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3328
00000100:00100000:1.0:1651532124.156641:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3330
00000100:00100000:0.0:1651532124.156643:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468368064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.156651:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468368256:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532124.156651:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3329
00010000:00010000:1.0:1651532124.156654:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.156656:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f32b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c09 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.156662:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f32b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c09 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156666:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f32b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c09 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156669:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532124.156676:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468368256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.156680:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3330
00000100:00100000:1.0:1651532124.156918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.156926:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468368384
00000100:00100000:1.0:1651532124.156937:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3331
00000100:00100000:1.0:1651532124.156939:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e251c56c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468368384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.156942:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.156946:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f332 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c10 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.156953:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f332 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c10 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156967:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f332 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c10 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.156971:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532124.156985:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e251c56c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468368384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.156990:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3331
00000100:00100000:0.0:1651532124.157044:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.157053:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468368512
00000100:00100000:0.0:1651532124.157055:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.157065:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468368640
00000100:00100000:1.0:1651532124.157069:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3332
00000100:00100000:1.0:1651532124.157071:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f651876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468368512:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532124.157072:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3333
00010000:00010000:1.0:1651532124.157074:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532124.157074:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c390546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468368640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.157077:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f339 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c17 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.157078:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.157082:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f340 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c1e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.157085:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f339 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c17 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.157089:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f339 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c17 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.157090:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f340 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c1e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.157093:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532124.157094:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f340 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c1e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.157097:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532124.157103:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f651876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468368512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.157105:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3332
00000100:00100000:0.0:1651532124.157105:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c390546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468368640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.157108:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3333
00000100:00100000:0.0:1651532124.157391:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.157398:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468368896
00000100:00100000:0.0:1651532124.157406:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3334
00000100:00100000:0.0:1651532124.157407:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000460b2efd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468368896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.157411:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.157414:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f347 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c25 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.157421:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f347 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c25 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.157425:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f347 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c25 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.157428:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532124.157445:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000460b2efd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468368896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.157448:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3334
00000001:00080000:1.0:1651532124.246453:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793742 is committed
00010000:00010000:1.0:1651532124.246468:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.246473:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.246496:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468362816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 374564us (374648us total) trans 158913793742 rc 0/0
00000100:00100000:1.0:1651532124.246499:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4158
00010000:00010000:1.0:1651532124.246506:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.246510:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532124.246511:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.246514:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.246519:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.246520:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.246521:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.246526:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.246553:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.246557:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f205 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1572864->9932799] (req 1572864->9932799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.246561:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.246566:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.246886:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.246905:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468369152
00000100:00100000:0.0:1651532124.246914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.246924:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468369088
00000100:00100000:0.0:1651532124.246929:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.246931:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4167
00000100:00100000:1.0:1651532124.246933:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024c75e52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468369152:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532124.246935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532124.246940:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.246942:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532124.246944:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532124.246945:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.246948:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532124.246949:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.246949:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4168
00000100:00100000:0.0:1651532124.246951:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000477bf573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468369088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532124.246953:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.246956:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.246960:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.246965:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532124.246966:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.246969:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468369280
00010000:00010000:0.0:1651532124.246969:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532124.246970:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.246974:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.246975:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468369344
00000100:00100000:1.0:1651532124.246977:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468369408
00010000:00010000:0.0:1651532124.246978:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.246980:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3335
00000100:00100000:1.0:1651532124.246990:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a1362a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468369280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.246993:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.246996:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f35c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c2c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.247003:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f35c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c2c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.247008:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f35c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c2c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.247011:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532124.247022:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a1362a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468369280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.247024:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3335
00000100:00100000:1.0:1651532124.247029:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3336
00000100:00100000:1.0:1651532124.247031:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f8bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468369344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.247033:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.247035:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f363 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c33 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.247040:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3337
00010000:00010000:1.0:1651532124.247041:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f363 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c33 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532124.247042:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000825ef029 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468369408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.247045:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f363 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c33 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.247047:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.247050:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f36a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c3a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.247058:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532124.247059:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f36a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c3a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.247063:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f36a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c3a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532124.247064:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f8bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468369344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (129us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532124.247066:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532124.247067:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3336
00000100:00100000:0.0:1651532124.247075:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000825ef029 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468369408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (134us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.247078:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3337
00000001:00080000:1.0:1651532124.338174:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793743 is committed
00010000:00010000:0.0:1651532124.338200:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338205:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.338222:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468363328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 374681us (374765us total) trans 158913793743 rc 0/0
00000100:00100000:0.0:1651532124.338225:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4159
00010000:00010000:0.0:1651532124.338232:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338236:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.338237:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338240:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338245:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.338246:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.338247:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338250:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338253:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.338253:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.338254:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338257:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338272:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338275:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f221 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8904703] (req 3072000->8904703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338280:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338282:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338286:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338286:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338520:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338525:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.338541:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468363392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 374955us (375067us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532124.338545:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4160
00010000:00010000:0.0:1651532124.338553:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338559:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.338560:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338565:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338571:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338574:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f228 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->9015295] (req 1822720->9015295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338596:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338601:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.338619:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000191e2581 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468364288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316223us (316265us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532124.338622:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4161
00010000:00010000:1.0:1651532124.338629:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338633:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532124.338634:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338649:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338655:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.338655:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.338656:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338659:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338671:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338674:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f24b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->5586943] (req 782336->5586943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338682:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338688:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.338756:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.338764:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468369856
00000100:00100000:1.0:1651532124.338796:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4169
00000100:00100000:1.0:1651532124.338799:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5d14c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468369856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532124.338821:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338828:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532124.338829:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338844:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532124.338845:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338850:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338856:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.338878:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.338897:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468369792
00000100:00100000:1.0:1651532124.338918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.338918:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4170
00000100:00100000:0.0:1651532124.338925:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468369792:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532124.338927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532124.338933:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.338935:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468369920
00010000:00010000:0.0:1651532124.338940:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532124.338941:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468369984
00010000:00010000:0.0:1651532124.338941:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338946:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532124.338947:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.338949:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3338
00000100:00100000:1.0:1651532124.338951:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468369920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.338957:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.338961:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f37f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c41 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.338993:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338994:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f37f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c41 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.338998:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.338999:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f37f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c41 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.339005:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532124.339015:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468369920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.339017:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3338
00000100:00100000:1.0:1651532124.339023:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3339
00000100:00100000:1.0:1651532124.339024:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468369984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.339027:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.339029:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f386 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c48 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.339035:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f386 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c48 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.339039:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f386 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c48 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.339042:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532124.339047:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468369984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.339049:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3339
00000100:00100000:1.0:1651532124.339064:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.339099:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468370112
00000100:00100000:0.0:1651532124.339125:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3340
00000100:00100000:0.0:1651532124.339127:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468370112:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532124.339135:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532124.339141:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532124.339143:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468370048
00010000:00010000:0.0:1651532124.339145:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f38d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c56 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.339150:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3341
00000100:00100000:1.0:1651532124.339152:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468370048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.339154:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f38d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c56 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.339155:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.339158:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f38d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c56 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.339159:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f394 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c4f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.339161:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532124.339166:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f394 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c4f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.339170:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f394 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c4f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.339173:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532124.339173:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468370112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.339175:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3340
00000100:00100000:1.0:1651532124.339181:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468370048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.339184:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3341
00000100:00100000:1.0:1651532124.339467:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.339475:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468370368
00000100:00100000:1.0:1651532124.339482:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3342
00000100:00100000:1.0:1651532124.339483:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468370368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.339486:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.339490:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f39b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c5d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.339497:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f39b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c5d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.339501:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f39b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c5d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.339504:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532124.339518:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468370368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.339521:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3342
00000001:00080000:1.0:1651532124.563350:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793744 is committed
00010000:00010000:0.0:1651532124.563381:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563386:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.563409:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057a3157c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468364224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541009us (541043us total) trans 158913793744 rc 0/0
00000100:00100000:0.0:1651532124.563413:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4162
00010000:00010000:0.0:1651532124.563420:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563435:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.563436:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563439:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563445:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.563446:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.563446:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563451:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563463:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563467:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f252 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4952064->9359359] (req 4952064->9359359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563473:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563476:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.563780:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.563796:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468370624
00000100:00100000:0.0:1651532124.563823:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4171
00000100:00100000:0.0:1651532124.563825:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468370624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532124.563833:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563837:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.563838:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563841:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532124.563842:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563846:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563850:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563861:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563864:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.563885:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045cfe023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468365696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474628us (474679us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532124.563888:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4163
00010000:00010000:0.0:1651532124.563897:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563901:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.563902:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563905:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563910:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.563910:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.563911:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563914:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563922:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563927:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f28a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9715711] (req 1380352->9715711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563936:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.563939:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.563968:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.563985:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468370560
00000100:00100000:0.0:1651532124.563998:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4172
00000100:00100000:0.0:1651532124.564001:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014422ad1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468370560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532124.564009:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.564013:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532124.564014:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.564017:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532124.564017:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.564021:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.564025:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.564181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.564201:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468370944
00000100:00100000:0.0:1651532124.564216:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3343
00000100:00100000:0.0:1651532124.564217:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468370944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.564222:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.564227:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f3b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c6b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.564239:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f3b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c6b expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.564282:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f3b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c6b expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.564289:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532124.564304:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468370944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 85us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.564307:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3343
00000100:00100000:1.0:1651532124.564318:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.564369:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.564381:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.564388:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468371008
00000100:00100000:1.0:1651532124.564400:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468371136
00000100:00100000:1.0:1651532124.564402:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468370880
00000100:00100000:1.0:1651532124.564405:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3344
00000100:00100000:1.0:1651532124.564407:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468371008:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532124.564409:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3345
00010000:00010000:1.0:1651532124.564411:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532124.564411:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468371136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.564415:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f3b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c72 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.564415:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.564419:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f3be lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c79 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.564423:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f3b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c72 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.564427:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f3b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c72 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.564427:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f3be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c79 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.564431:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532124.564432:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f3be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c79 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.564435:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532124.564441:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468371008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (123us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.564444:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3344
00000100:00100000:0.0:1651532124.564444:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468371136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.564447:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3345
00000100:00100000:1.0:1651532124.564449:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3346
00000100:00100000:1.0:1651532124.564450:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468370880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.564453:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.564455:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f3c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c64 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.564461:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f3c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c64 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.564464:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f3c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c64 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.564467:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532124.564474:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468370880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.564478:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3346
00000100:00100000:0.0:1651532124.564837:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.564851:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.564862:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468371392
00000100:00100000:1.0:1651532124.564875:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468371328
00000100:00100000:1.0:1651532124.564879:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3347
00000100:00100000:1.0:1651532124.564881:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468371392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.564884:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532124.564886:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3348
00010000:00010000:1.0:1651532124.564887:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c87 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.564888:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468371328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.564892:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.564897:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c87 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.564897:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c80 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.564901:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c87 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.564904:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c80 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.564905:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532124.564908:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c80 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.564912:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532124.564915:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468371392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.564918:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3347
00000100:00100000:0.0:1651532124.564920:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468371328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.564923:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3348
00000001:00080000:1.0:1651532124.787954:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793745 is committed
00010000:00010000:0.0:1651532124.787997:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788002:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788026:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.788026:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4b0fa2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468365568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 698735us (698806us total) trans 158913793745 rc 0/0
00000100:00100000:0.0:1651532124.788029:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4164
00010000:00010000:1.0:1651532124.788030:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532124.788031:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788035:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788040:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.788041:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.788042:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788045:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788064:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788075:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788079:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f291 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [679936->8785919] (req 679936->8785919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788081:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.788420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.788430:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.788441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.788447:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.788454:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468371712
00000100:00100000:0.0:1651532124.788470:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468371648
00000100:00100000:0.0:1651532124.788479:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4173
00000100:00100000:0.0:1651532124.788481:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e299bd9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468371712:12345-10.240.43.64@tcp:3:fio.
00000100:00100000:1.0:1651532124.788486:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4174
00000100:00100000:1.0:1651532124.788488:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b961ae6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468371648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532124.788488:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788492:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.788493:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788496:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532124.788497:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788497:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788502:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532124.788503:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788506:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532124.788507:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788510:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788511:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788514:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788515:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.788528:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468371840
00010000:00010000:0.0:1651532124.788528:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788531:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.788536:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468371904
00000100:00100000:0.0:1651532124.788550:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d377484d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468366976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 633203us (633350us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532124.788553:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4165
00000100:00100000:1.0:1651532124.788555:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3349
00000100:00100000:1.0:1651532124.788557:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a54139d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468371840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.788559:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788560:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.788563:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f3e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c8e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788563:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.788564:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788567:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788568:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.788571:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f3e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c8e expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.788572:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.788573:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.788573:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788576:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788581:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f3e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c8e expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.788583:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788584:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532124.788586:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f2de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->6324223] (req 126976->6324223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.788591:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.788593:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a54139d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468371840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (152us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532124.788594:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.788596:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3349
00000100:00100000:1.0:1651532124.788601:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3350
00000100:00100000:1.0:1651532124.788603:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67f4078 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468371904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.788605:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.788607:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f3ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c95 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.788613:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f3ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c95 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.788616:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f3ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c95 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.788620:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532124.788625:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67f4078 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468371904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (178us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.788627:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3350
00000100:00100000:1.0:1651532124.788968:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.788976:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468372160
00000100:00100000:1.0:1651532124.788987:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3351
00000100:00100000:1.0:1651532124.788989:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468372160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.788994:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.788999:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f3f6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ca3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.789009:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f3f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ca3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.789013:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f3f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ca3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.789016:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532124.789021:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.789027:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468372160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.789030:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3351
00000100:00100000:1.0:1651532124.789035:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468372224
00000100:00100000:1.0:1651532124.789046:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3352
00000100:00100000:1.0:1651532124.789048:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468372224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.789053:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532124.789058:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532124.789067:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f3fd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449caa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.789070:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468372096
00010000:00010000:1.0:1651532124.789075:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f3fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449caa expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532124.789077:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3353
00010000:00010000:1.0:1651532124.789079:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f3fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449caa expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532124.789079:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468372096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.789082:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532124.789083:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532124.789096:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468372224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.789098:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3352
00010000:00010000:0.0:1651532124.789100:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f404 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449c9c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.789110:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f404 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c9c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.789114:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f404 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449c9c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.789117:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532124.789127:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468372096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.789141:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3353
00000100:00100000:0.0:1651532124.789490:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.789500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.789507:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468372544
00000100:00100000:0.0:1651532124.789513:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468372608
00000100:00100000:0.0:1651532124.789525:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3354
00000100:00100000:0.0:1651532124.789527:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468372544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.789530:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.789534:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f40b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449cb1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.789536:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3355
00000100:00100000:1.0:1651532124.789538:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000016860e13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468372608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.789542:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.789542:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f40b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cb1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.789545:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f412 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449cb8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.789546:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f40b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cb1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.789549:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532124.789552:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f412 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cb8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.789556:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f412 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cb8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532124.789562:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468372544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.789565:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3354
00010000:00010000:1.0:1651532124.789569:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532124.789577:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000016860e13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468372608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.789580:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3355
00000100:00100000:1.0:1651532124.860862:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070bc959b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4117a37c-db10-4766-b60a-8aa6e5558d6b:39028:1731745966863616:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651532124.861123:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070bc959b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4117a37c-db10-4766-b60a-8aa6e5558d6b:39028:1731745966863616:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:1.0:1651532124.896313:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793746 is committed
00010000:00010000:0.0:1651532124.896346:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.896350:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.896379:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe864bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468366848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 740952us (741168us total) trans 158913793746 rc 0/0
00000100:00100000:0.0:1651532124.896382:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4166
00010000:00010000:0.0:1651532124.896389:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.896392:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.896394:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.896396:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.896401:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.896402:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.896403:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.896406:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.896418:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.896421:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f2ec lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1544192->7716863] (req 1544192->7716863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896431:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896435:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.896739:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.896763:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468372992
00000100:00100000:0.0:1651532124.896763:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.896776:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3356
00000100:00100000:1.0:1651532124.896777:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468372992:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532124.896778:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532124.896781:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.896785:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f419 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449cbf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.896795:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468372864
00010000:00010000:1.0:1651532124.896802:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.896814:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f419 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cbf expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532124.896818:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468372928
00010000:00010000:1.0:1651532124.896822:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f419 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cbf expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532124.896827:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4175
00000100:00100000:0.0:1651532124.896829:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a54139d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468372864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532124.896830:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532124.896836:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.896840:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468372992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (103us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532124.896841:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532124.896842:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.896843:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3356
00010000:00010000:0.0:1651532124.896845:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532124.896845:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.896850:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.896851:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4176
00000100:00100000:1.0:1651532124.896853:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67f4078 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468372928:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532124.896853:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896859:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896862:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.896863:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896866:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532124.896867:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896871:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896874:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896889:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896892:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.896904:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024c75e52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468369152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 649971us (650019us total) trans 0 rc 65536/65536
00000100:00100000:1.0:1651532124.896907:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4167
00010000:00010000:1.0:1651532124.896912:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896916:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532124.896917:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896920:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896924:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.896925:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.896925:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896928:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896944:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.896947:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f34e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10452991] (req 958464->10452991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.896953:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.896959:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.897429:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.897437:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.897446:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.897450:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468373312
00000100:00100000:0.0:1651532124.897453:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.897457:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468373376
00000100:00100000:1.0:1651532124.897460:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468373568
00000100:00100000:0.0:1651532124.897460:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468373248
00000100:00100000:1.0:1651532124.897463:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3357
00000100:00100000:1.0:1651532124.897465:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468373312:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532124.897467:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3358
00010000:00010000:1.0:1651532124.897468:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532124.897469:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468373376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.897472:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f42e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ccd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.897473:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.897477:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f435 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449cd4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.897479:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f42e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ccd expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.897484:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f42e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ccd expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.897485:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f435 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cd4 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.897488:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532124.897490:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f435 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cd4 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.897493:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532124.897498:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468373312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.897501:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3357
00000100:00100000:0.0:1651532124.897502:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468373376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.897504:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3358
00000100:00100000:1.0:1651532124.897506:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3359
00000100:00100000:1.0:1651532124.897517:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468373568:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532124.897518:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3360
00010000:00010000:1.0:1651532124.897520:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.897523:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f43c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449cdb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.897528:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468373248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.897529:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f43c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cdb expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.897531:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.897533:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f43c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cdb expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.897534:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f443 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449cc6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.897536:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532124.897540:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f443 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cc6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532124.897543:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468373568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (89us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532124.897544:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f443 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cc6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532124.897545:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3359
00010000:00010000:0.0:1651532124.897547:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532124.897553:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468373248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.897556:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3360
00000100:00100000:0.0:1651532124.897918:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.897927:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.897933:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468373696
00000100:00100000:0.0:1651532124.897940:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468373888
00000100:00100000:0.0:1651532124.897949:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3361
00000100:00100000:0.0:1651532124.897951:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468373696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.897954:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532124.897955:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3362
00000100:00100000:1.0:1651532124.897957:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468373888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.897958:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f44a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ce2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.897961:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.897965:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f451 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ce9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.897965:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f44a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ce2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.897972:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f451 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ce9 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.897972:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f44a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ce2 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.897976:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f451 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ce9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.897976:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532124.897988:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468373696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.897990:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3361
00010000:00010000:1.0:1651532124.897994:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532124.898002:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468373888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.898005:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3362
00000100:00100000:0.0:1651532124.898303:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.898330:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468374080
00000100:00100000:1.0:1651532124.898343:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3363
00000100:00100000:1.0:1651532124.898345:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468374080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.898348:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.898352:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f458 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449cf0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.898359:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f458 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cf0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.898363:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f458 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cf0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.898366:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532124.898377:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468374080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.898379:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3363
00000001:00080000:1.0:1651532124.964350:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793747 is committed
00010000:00010000:0.0:1651532124.964381:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964386:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.964404:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000477bf573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468369088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 717452us (717489us total) trans 158913793747 rc 0/0
00000100:00100000:0.0:1651532124.964407:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4168
00010000:00010000:0.0:1651532124.964414:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964417:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.964419:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964422:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964427:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.964428:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.964429:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964432:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964444:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964447:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f355 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1048576->8196095] (req 1048576->8196095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.964457:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.964464:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.964887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.964896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.964908:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.964914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.964919:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468374400
00000100:00100000:0.0:1651532124.964920:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.964926:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.964933:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468374336
00000100:00100000:1.0:1651532124.964941:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4177
00000100:00100000:1.0:1651532124.964948:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468374400:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532124.964952:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4178
00010000:00010000:1.0:1651532124.964955:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.964955:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468374336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532124.964959:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532124.964960:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532124.964961:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964963:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.964964:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964968:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532124.964969:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964981:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964984:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532124.964985:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.964988:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.964991:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.964995:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.965003:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.965007:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.965010:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5d14c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468369856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 626210us (626254us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532124.965013:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4169
00010000:00010000:0.0:1651532124.965014:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.965017:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532124.965018:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.965020:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468374464
00010000:00010000:0.0:1651532124.965021:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.965024:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468374592
00010000:00010000:0.0:1651532124.965026:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532124.965027:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468374656
00010000:00010000:0.0:1651532124.965027:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532124.965027:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.965028:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468374720
00010000:00010000:0.0:1651532124.965030:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532124.965031:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3364
00000100:00100000:1.0:1651532124.965033:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000207f99f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468374464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.965036:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.965036:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.965038:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f46d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449cf7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.965039:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f371 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1675264->9240575] (req 1675264->9240575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.965044:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.965046:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f46d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cf7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.965047:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.965050:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f46d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cf7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965053:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532124.965059:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000207f99f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468374464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (151us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.965061:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3364
00000100:00100000:1.0:1651532124.965065:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3365
00000100:00100000:1.0:1651532124.965067:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d52bfd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468374592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.965069:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.965071:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f474 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449cfe expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.965071:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3366
00000100:00100000:0.0:1651532124.965072:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089209c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468374656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.965076:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f474 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cfe expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.965076:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.965079:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f47b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d05 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.965080:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f474 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449cfe expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965083:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532124.965086:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f47b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d05 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532124.965088:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d52bfd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468374592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (174us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.965090:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3365
00010000:00010000:0.0:1651532124.965090:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f47b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d05 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532124.965093:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3367
00010000:00010000:0.0:1651532124.965094:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532124.965095:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f651876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468374720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.965097:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.965099:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f482 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d0c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532124.965101:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089209c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468374656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (180us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532124.965103:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3366
00010000:00010000:1.0:1651532124.965104:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f482 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d0c expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965107:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f482 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d0c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965110:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532124.965115:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f651876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468374720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (190us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.965117:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3367
00000100:00100000:0.0:1651532124.965515:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532124.965528:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.965529:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468374912
00000100:00100000:0.0:1651532124.965535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.965546:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468375104
00000100:00100000:1.0:1651532124.965549:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468375168
00000100:00100000:0.0:1651532124.965551:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3368
00000100:00100000:0.0:1651532124.965554:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c390546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468374912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532124.965555:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3369
00000100:00100000:1.0:1651532124.965556:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000460b2efd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468375104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532124.965558:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.965560:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532124.965562:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f489 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d13 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.965563:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f490 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d1a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532124.965571:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f489 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d13 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965572:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f490 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d1a expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532124.965575:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f489 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d13 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965576:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f490 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d1a expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965579:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532124.965579:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532124.965593:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000460b2efd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468375104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.965595:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3369
00000100:00100000:0.0:1651532124.965599:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c390546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468374912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.965600:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3370
00000100:00100000:1.0:1651532124.965601:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a1362a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468375168:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532124.965602:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3368
00010000:00010000:1.0:1651532124.965604:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.965606:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f497 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d21 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.965612:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f497 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d21 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965618:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f497 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d21 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965621:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532124.965627:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a1362a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468375168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.965631:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3370
00000100:00100000:0.0:1651532124.965881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532124.965903:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468375360
00000100:00100000:1.0:1651532124.965915:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3371
00000100:00100000:1.0:1651532124.965916:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f8bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468375360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532124.965920:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532124.965923:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f49e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d28 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532124.965930:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f49e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d28 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965934:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f49e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d28 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532124.965937:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532124.965949:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f8bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468375360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532124.965952:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3371
00000001:00080000:1.0:1651532125.089351:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793748 is committed
00002000:00010000:0.0:1651532125.089379:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532123 -> 1651532124
00002000:00010000:0.0:1651532125.089381:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532123 -> 1651532124
00010000:00010000:0.0:1651532125.089384:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089388:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.089405:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000212e8d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468369792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 750484us (750528us total) trans 158913793748 rc 0/0
00000100:00100000:0.0:1651532125.089408:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4170
00010000:00010000:0.0:1651532125.089415:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089418:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532125.089420:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089422:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089427:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.089428:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.089429:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089432:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089474:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089480:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f378 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->4767743] (req 2379776->4767743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089490:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089493:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089677:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089681:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.089696:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468370624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 525870us (525917us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532125.089699:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4171
00010000:00010000:0.0:1651532125.089705:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089709:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532125.089710:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089725:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089731:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.089732:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.089733:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089736:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089743:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089746:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f3a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->6873087] (req 2117632->6873087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089751:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089754:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.089888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.089921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.089934:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.089945:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468375552
00000100:00100000:1.0:1651532125.089948:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468375744
00000100:00100000:0.0:1651532125.089956:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468375616
00000100:00100000:1.0:1651532125.089961:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3372
00000100:00100000:1.0:1651532125.089962:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468375744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.089966:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532125.089972:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4179
00000100:00100000:0.0:1651532125.089973:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000825ef029 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468375552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532125.089975:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f4a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d2f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089981:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.089984:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f4a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d2f expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.089986:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532125.089987:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.089990:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532125.089990:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.089994:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f4a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d2f expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.089995:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.089998:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532125.089998:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.090006:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4180
00000100:00100000:0.0:1651532125.090007:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e251c56c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468375616:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532125.090011:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468375744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.090013:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3372
00010000:00010000:0.0:1651532125.090018:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.090022:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532125.090023:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.090025:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532125.090026:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.090030:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.090033:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.090103:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.090115:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468375872
00000100:00100000:1.0:1651532125.090128:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3373
00000100:00100000:1.0:1651532125.090129:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468375872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.090133:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.090136:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4ba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d3d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.090143:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d3d expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.090151:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d3d expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.090156:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532125.090156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.090166:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468375808
00000100:00100000:0.0:1651532125.090178:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3374
00000100:00100000:1.0:1651532125.090183:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468375872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.090186:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3373
00000100:00100000:0.0:1651532125.090186:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468375808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532125.090190:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.090193:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f4c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d36 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.090201:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f4c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d36 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.090206:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f4c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d36 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.090209:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532125.090217:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468375808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532125.090220:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3374
00000100:00100000:0.0:1651532125.090315:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.090332:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468376064
00000100:00100000:0.0:1651532125.090343:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3375
00000100:00100000:0.0:1651532125.090345:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468376064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532125.090349:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.090352:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f4c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d44 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.090360:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f4c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d44 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.090364:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f4c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d44 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.090368:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532125.090378:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468376064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532125.090380:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3375
00000100:00100000:0.0:1651532125.090493:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.090501:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468376320
00000100:00100000:0.0:1651532125.090515:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3376
00000100:00100000:0.0:1651532125.090517:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468376320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532125.090520:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.090524:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d4b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.090531:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d4b expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.090543:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d4b expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.090547:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532125.090557:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468376320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532125.090560:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3376
00000001:00080000:1.0:1651532125.172726:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793749 is committed
00010000:00010000:0.0:1651532125.172757:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.172762:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.172784:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.172784:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014422ad1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468370560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 608782us (608815us total) trans 158913793749 rc 0/0
00000100:00100000:0.0:1651532125.172787:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4172
00010000:00010000:1.0:1651532125.172788:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532125.172790:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.172793:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.172798:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.172799:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.172800:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.172814:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.172828:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.172843:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f3a9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6049792->6053887] (req 6049792->6053887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.172848:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.172853:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.173081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.173102:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.173115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.173122:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468376512
00000100:00100000:0.0:1651532125.173143:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468376576
00000100:00100000:0.0:1651532125.173150:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4181
00000100:00100000:0.0:1651532125.173152:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468376512:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532125.173154:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4182
00000100:00100000:1.0:1651532125.173156:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468376576:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532125.173159:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.173164:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532125.173165:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.173165:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.173168:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532125.173168:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.173173:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.173175:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.173178:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532125.173178:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.173182:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.173183:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.173186:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.173186:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.173198:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468376640
00010000:00010000:0.0:1651532125.173198:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.173201:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.173206:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3377
00000100:00100000:1.0:1651532125.173208:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468376640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.173210:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.173213:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f4e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d52 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.173216:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e299bd9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468371712:12345-10.240.43.64@tcp:3:fio. Request processed in 384735us (384798us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532125.173218:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532125.173219:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4173
00010000:00010000:1.0:1651532125.173221:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f4e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d52 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.173225:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f4e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d52 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.173228:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532125.173233:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.173237:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468376640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (122us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532125.173237:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532125.173238:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.173240:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3377
00010000:00010000:0.0:1651532125.173241:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.173246:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.173246:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.173247:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.173250:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.173259:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.173262:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f3da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->10387455] (req 892928->10387455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.173263:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.173267:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.173640:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.173658:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468376768
00000100:00100000:0.0:1651532125.173662:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.173691:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468376832
00000100:00100000:1.0:1651532125.173697:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3378
00000100:00100000:1.0:1651532125.173699:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468376768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.173703:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.173706:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f4eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d59 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.173717:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f4eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d59 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.173721:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f4eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d59 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.173724:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532125.173739:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468376768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.173742:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3378
00000100:00100000:1.0:1651532125.173746:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3379
00000100:00100000:1.0:1651532125.173748:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468376832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.173751:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.173753:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f4f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d60 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.173762:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f4f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d60 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.173768:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f4f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d60 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.173783:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532125.173796:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468376832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.173800:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3379
00000001:00080000:1.0:1651532125.297744:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793750 is committed
00010000:00010000:1.0:1651532125.297759:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.297763:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.297785:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b961ae6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468371648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 509296us (509354us total) trans 158913793750 rc 0/0
00000100:00100000:1.0:1651532125.297788:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4174
00010000:00010000:0.0:1651532125.297788:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.297793:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532125.297794:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.297798:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.297813:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.297813:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.297814:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.297817:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.297825:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.297828:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f3e1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1937408->8269823] (req 1937408->8269823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.297834:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.297837:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.298154:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.298172:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.298173:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468377152
00000100:00100000:0.0:1651532125.298180:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.298189:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468377088
00000100:00100000:0.0:1651532125.298194:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4183
00000100:00100000:1.0:1651532125.298202:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4184
00000100:00100000:0.0:1651532125.298202:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468377152:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532125.298204:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468377088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532125.298211:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.298216:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532125.298216:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532125.298217:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.298218:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.298220:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.298223:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532125.298225:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.298228:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.298230:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532125.298231:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.298236:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.298239:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.298242:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.298250:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468377216
00000100:00100000:1.0:1651532125.298257:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3380
00000100:00100000:1.0:1651532125.298258:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468377216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.298261:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.298263:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f507 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d67 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.298270:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f507 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d67 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.298274:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f507 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d67 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.298278:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532125.298288:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468377216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (108us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.298292:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3380
00000001:00080000:1.0:1651532125.389415:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793751 is committed
00010000:00010000:0.0:1651532125.389446:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.389451:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389474:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.389475:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a54139d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468372864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 492644us (492711us total) trans 158913793751 rc 0/0
00000100:00100000:0.0:1651532125.389478:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4175
00010000:00010000:1.0:1651532125.389479:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532125.389480:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389483:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389489:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.389490:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.389491:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389494:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389497:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.389497:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.389498:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389502:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389515:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389529:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f420 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2101248->9695231] (req 2101248->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389537:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389539:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389564:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389568:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.389917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.389929:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468377536
00000100:00100000:0.0:1651532125.389929:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.389938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.389947:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468377664
00000100:00100000:1.0:1651532125.389950:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468377728
00000100:00100000:1.0:1651532125.389958:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3381
00000100:00100000:1.0:1651532125.389965:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468377536:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532125.389967:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3382
00010000:00010000:1.0:1651532125.389969:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532125.389969:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468377664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.389973:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f50e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d6e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.389974:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.389978:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.389981:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f50e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d6e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.389986:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f515 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d75 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.389989:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f50e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d6e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.389992:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532125.389993:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.389996:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f515 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d75 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.390001:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f515 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d75 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532125.390004:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468377536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (87us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532125.390004:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532125.390006:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3381
00000100:00100000:1.0:1651532125.390011:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3383
00000100:00100000:1.0:1651532125.390013:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468377728:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532125.390013:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468377664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (84us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532125.390015:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532125.390016:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3382
00010000:00010000:1.0:1651532125.390017:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f51c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d7c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.390022:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.390023:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f51c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d7c expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.390027:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f51c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d7c expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.390030:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532125.390035:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468377728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.390038:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3383
00010000:00010000:1.0:1651532125.390050:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.390054:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390067:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.390070:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468374400:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425122us (425184us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532125.390071:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532125.390072:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.390073:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4177
00010000:00010000:0.0:1651532125.390075:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390081:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.390082:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390084:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f45f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->9773055] (req 839680->9773055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.390086:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.390098:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67f4078 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468372928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 493245us (493326us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532125.390100:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.390101:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4176
00010000:00010000:0.0:1651532125.390103:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532125.390104:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390106:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390110:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.390110:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.390111:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390114:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390121:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390123:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f427 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->9129983] (req 147456->9129983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390129:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390132:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.390582:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.390600:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.390613:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468378048
00000100:00100000:0.0:1651532125.390613:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.390624:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.390640:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468377984
00000100:00100000:1.0:1651532125.390649:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4185
00000100:00100000:1.0:1651532125.390651:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468378048:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532125.390658:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.390662:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532125.390662:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532125.390663:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.390669:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532125.390669:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.390671:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4186
00000100:00100000:0.0:1651532125.390673:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468377984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532125.390674:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.390677:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390683:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.390686:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468377920
00010000:00010000:0.0:1651532125.390687:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532125.390688:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.390694:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468378112
00000100:00100000:1.0:1651532125.390697:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468378304
00010000:00010000:0.0:1651532125.390698:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:1.0:1651532125.390699:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3384
00010000:00010000:0.0:1651532125.390699:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.390701:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468377920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.390704:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.390704:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.390706:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f531 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d83 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.390708:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.390713:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f531 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d83 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532125.390716:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3385
00010000:00010000:1.0:1651532125.390717:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f531 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d83 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532125.390718:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468378112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.390721:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532125.390722:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.390725:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f538 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d8a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.390732:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468377920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (119us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532125.390732:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f538 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d8a expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532125.390735:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3384
00010000:00010000:0.0:1651532125.390736:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f538 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d8a expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532125.390739:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3386
00010000:00010000:0.0:1651532125.390740:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532125.390741:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468378304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.390743:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.390745:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f53f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d91 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.390748:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468378112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (124us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532125.390751:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f53f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d91 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532125.390751:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3385
00010000:00010000:1.0:1651532125.390755:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f53f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d91 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.390758:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532125.390763:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468378304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.390765:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3386
00000100:00100000:0.0:1651532125.391269:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.391284:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.391290:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468378496
00000100:00100000:0.0:1651532125.391291:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.391301:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468378624
00000100:00100000:1.0:1651532125.391304:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468378560
00000100:00100000:0.0:1651532125.391305:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3387
00000100:00100000:0.0:1651532125.391308:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468378496:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532125.391309:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3388
00000100:00100000:1.0:1651532125.391310:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468378624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532125.391312:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.391314:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.391315:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f546 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d98 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.391317:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f54d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449da6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.391333:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f546 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d98 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.391339:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f54d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449da6 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.391343:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f54d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449da6 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.391346:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532125.391348:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f546 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d98 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.391352:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532125.391358:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468378624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.391360:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3388
00000100:00100000:0.0:1651532125.391361:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468378496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532125.391364:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3387
00000100:00100000:1.0:1651532125.391366:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3389
00000100:00100000:1.0:1651532125.391368:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468378560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.391370:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.391373:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f554 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449d9f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.391378:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f554 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d9f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.391382:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f554 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449d9f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.391385:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532125.391390:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468378560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.391393:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3389
00000100:00100000:0.0:1651532125.391678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.391697:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468378816
00000100:00100000:1.0:1651532125.391709:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3390
00000100:00100000:1.0:1651532125.391711:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468378816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.391714:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.391718:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f55b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449dad expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.391725:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f55b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dad expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.391729:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f55b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dad expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.391732:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532125.391747:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468378816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.391749:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3390
00000100:00100000:0.0:1651532125.408110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532125.408119:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232128
00000100:00100000:0.0:1651532125.408129:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 61
00000100:00100000:0.0:1651532125.408131:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232128:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532125.408137:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 458752 granted 351203904 pending 315392 free 81138851840 avail 76968140800
00000100:00100000:0.0:1651532125.408148:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232128:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 17us (39us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532125.408151:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 61
00000001:00080000:1.0:1651532125.489466:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793752 is committed
00010000:00010000:0.0:1651532125.489498:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.489503:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.489524:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468374336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524569us (524628us total) trans 158913793752 rc 0/0
00010000:00010000:1.0:1651532125.489525:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.489528:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4178
00010000:00010000:1.0:1651532125.489529:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532125.489530:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.489536:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.489542:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.489543:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.489543:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.489547:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.489561:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.489574:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f466 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [241664->9687039] (req 241664->9687039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.489583:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.489587:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.490000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.490008:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.490014:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.490024:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.490026:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468379200
00000100:00100000:0.0:1651532125.490032:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468379072
00000100:00100000:1.0:1651532125.490038:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468379264
00000100:00100000:1.0:1651532125.490045:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3391
00000100:00100000:1.0:1651532125.490046:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468379200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.490050:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532125.490055:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468379008
00010000:00010000:1.0:1651532125.490059:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f562 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449db4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.490062:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4187
00000100:00100000:0.0:1651532125.490063:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468379072:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532125.490067:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f562 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449db4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.490071:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.490074:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f562 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449db4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.490076:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532125.490077:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532125.490077:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.490080:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532125.490080:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.490085:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.490091:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468379200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.490094:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3391
00010000:00010000:0.0:1651532125.490094:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.490099:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3392
00000100:00100000:1.0:1651532125.490100:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468379264:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532125.490102:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4188
00010000:00010000:1.0:1651532125.490103:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532125.490104:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468379008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532125.490105:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f570 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449dbb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.490109:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.490111:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f570 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dbb expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.490113:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532125.490113:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.490116:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532125.490117:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.490120:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f570 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dbb expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.490120:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.490123:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532125.490123:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.490129:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468379264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.490132:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3392
00000001:00080000:1.0:1651532125.581127:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793753 is committed
00010000:00010000:0.0:1651532125.581158:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581162:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.581180:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000825ef029 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468375552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491205us (491292us total) trans 158913793753 rc 0/0
00000100:00100000:0.0:1651532125.581201:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4179
00010000:00010000:0.0:1651532125.581208:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581212:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532125.581213:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581216:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581221:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.581221:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.581222:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581225:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581232:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581235:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f4ac lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4165632->9293823] (req 4165632->9293823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581240:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581243:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581447:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581451:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.581466:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e251c56c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468375616:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491458us (491546us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532125.581469:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4180
00010000:00010000:0.0:1651532125.581475:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581479:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532125.581480:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581482:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581487:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.581488:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.581489:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581492:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581498:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581512:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f4b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->9727999] (req 749568->9727999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581518:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.581521:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.581600:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.581621:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468379584
00000100:00100000:1.0:1651532125.581632:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3393
00000100:00100000:1.0:1651532125.581633:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468379584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.581637:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.581641:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f57e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449dc2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.581649:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f57e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dc2 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.581653:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f57e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dc2 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.581656:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532125.581677:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468379584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.581681:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3393
00000100:00100000:0.0:1651532125.581926:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.581945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.581957:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.581968:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468379904
00000100:00100000:0.0:1651532125.581968:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468379776
00000100:00100000:1.0:1651532125.581977:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3394
00000100:00100000:0.0:1651532125.581981:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468379712
00000100:00100000:1.0:1651532125.581984:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468379904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.581987:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532125.581995:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4189
00010000:00010000:1.0:1651532125.581996:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f585 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449dc9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.581998:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468379776:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532125.582007:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f585 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dc9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.582015:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f585 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dc9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.582018:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532125.582024:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.582030:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532125.582033:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468379904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.582036:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3394
00010000:00010000:0.0:1651532125.582037:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.582040:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532125.582040:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.582045:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4190
00000100:00100000:1.0:1651532125.582047:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468379712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532125.582053:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.582055:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.582058:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532125.582059:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.582062:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532125.582063:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.582067:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.582067:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.582070:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.582084:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.582094:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468380096
00000100:00100000:1.0:1651532125.582101:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3395
00000100:00100000:1.0:1651532125.582103:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468380096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.582107:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.582111:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f59a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449dd0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.582131:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f59a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dd0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.582136:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f59a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dd0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.582139:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532125.582154:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468380096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.582157:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3395
00000100:00100000:0.0:1651532125.582431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.582450:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468380288
00000100:00100000:1.0:1651532125.582458:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3396
00000100:00100000:1.0:1651532125.582459:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d23405d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468380288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.582463:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.582466:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449dd7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.582473:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dd7 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.582477:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dd7 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.582480:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532125.582494:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d23405d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468380288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.582497:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3396
00000100:00100000:0.0:1651532125.582711:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.582730:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468380416
00000100:00100000:1.0:1651532125.582738:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3397
00000100:00100000:1.0:1651532125.582739:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007513dfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468380416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.582742:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.582746:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5a8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449dde expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.582753:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dde expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.582757:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dde expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.582760:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532125.582773:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007513dfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468380416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.582776:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3397
00000001:00080000:1.0:1651532125.667503:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793754 is committed
00010000:00010000:0.0:1651532125.667534:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.667546:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667568:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.667569:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468376512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 494416us (494490us total) trans 158913793754 rc 0/0
00010000:00010000:1.0:1651532125.667573:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532125.667573:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4181
00010000:00010000:1.0:1651532125.667574:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667578:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667583:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.667584:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.667585:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667588:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667591:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.667591:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.667592:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667596:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.667617:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667619:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667623:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f4d6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [278528->9306111] (req 278528->9306111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.667624:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667630:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667633:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.667874:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.667891:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667895:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667899:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.667917:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468376576:12345-10.240.43.64@tcp:3:fio.0 Request processed in 494760us (494815us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532125.667918:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468377152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 369715us (369764us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532125.667922:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4182
00000100:00100000:0.0:1651532125.667924:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4183
00010000:00010000:1.0:1651532125.667937:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667941:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532125.667942:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667945:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667951:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667957:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f4f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3178496->10153983] (req 3178496->10153983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.667959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532125.667960:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667963:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532125.667971:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667974:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667977:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.667978:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.667979:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667982:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.667993:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.668003:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468380544
00010000:00010000:1.0:1651532125.668007:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f4dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->8454143] (req 770048->8454143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.668018:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3398
00000100:00100000:0.0:1651532125.668020:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468380544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.668021:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.668024:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.668028:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f5af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449de5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.668032:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.668036:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f5af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449de5 expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.668041:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f5af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449de5 expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.668044:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532125.668064:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468380544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532125.668067:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3398
00000100:00100000:0.0:1651532125.668346:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.668370:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.668396:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.668404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.668414:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.668424:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468380672
00000100:00100000:1.0:1651532125.668425:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468380736
00000100:00100000:0.0:1651532125.668436:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4191
00000100:00100000:1.0:1651532125.668438:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4192
00000100:00100000:0.0:1651532125.668438:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cefde237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468380672:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532125.668440:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c4207f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468380736:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532125.668445:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.668450:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532125.668451:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.668451:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.668454:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532125.668454:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.668461:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532125.668462:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.668465:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532125.668465:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.668469:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.668470:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.668473:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.668476:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.668499:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468380864
00000100:00100000:0.0:1651532125.668506:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468380928
00000100:00100000:1.0:1651532125.668511:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468380992
00000100:00100000:1.0:1651532125.668515:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3399
00000100:00100000:1.0:1651532125.668517:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468380864:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532125.668519:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3400
00000100:00100000:0.0:1651532125.668521:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7789e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468380992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532125.668524:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.668528:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.668528:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f5c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449dfa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.668531:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449dec expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.668536:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f5c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dfa expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.668539:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dec expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.668541:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f5c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dfa expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.668543:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449dec expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.668544:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532125.668547:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532125.668553:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7789e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468380992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532125.668555:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3400
00000100:00100000:1.0:1651532125.668556:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468380864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (161us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.668559:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3399
00000100:00100000:0.0:1651532125.668561:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3401
00000100:00100000:0.0:1651532125.668563:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fef8a7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468380928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532125.668565:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.668567:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f5d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449df3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.668573:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f5d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449df3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.668577:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f5d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449df3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.668580:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532125.668585:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fef8a7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468380928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (181us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532125.668588:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3401
00000100:00100000:0.0:1651532125.668620:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.668656:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468381184
00000100:00100000:0.0:1651532125.668671:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3402
00000100:00100000:0.0:1651532125.668673:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a53cedc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468381184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532125.668676:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.668680:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f5d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e01 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.668689:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f5d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e01 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.668695:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f5d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e01 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.668701:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532125.668729:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a53cedc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468381184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532125.668732:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3402
00000100:00100000:0.0:1651532125.669046:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.669054:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468381440
00000100:00100000:0.0:1651532125.669067:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3403
00000100:00100000:0.0:1651532125.669069:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468381440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532125.669073:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.669077:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e08 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.669091:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e08 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.669095:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e08 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.669098:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532125.669109:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468381440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532125.669112:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3403
00000001:00080000:1.0:1651532125.714610:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793755 is committed
00010000:00010000:1.0:1651532125.714624:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.714628:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.714651:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a325bad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468377088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 416446us (416479us total) trans 158913793755 rc 0/0
00000100:00100000:1.0:1651532125.714654:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4184
00010000:00010000:1.0:1651532125.714662:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.714668:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532125.714669:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.714672:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.714677:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.714678:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.714679:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.714685:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.714707:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.714711:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f500 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->8359935] (req 73728->8359935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.714717:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.714720:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.715030:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.715046:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.715047:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468381760
00000100:00100000:0.0:1651532125.715054:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.715058:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468381632
00000100:00100000:1.0:1651532125.715071:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4193
00000100:00100000:1.0:1651532125.715073:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468381760:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532125.715076:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4194
00000100:00100000:0.0:1651532125.715078:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d23405d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468381632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532125.715080:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.715084:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.715085:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532125.715086:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715087:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.715089:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715091:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532125.715092:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715095:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715098:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532125.715107:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715112:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715115:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.715119:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715119:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.715123:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715137:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.715142:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468378048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 324491us (324586us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532125.715144:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532125.715145:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4185
00010000:00010000:0.0:1651532125.715145:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715148:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715153:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.715154:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.715155:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.715156:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468381824
00010000:00010000:0.0:1651532125.715158:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.715162:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3404
00000100:00100000:1.0:1651532125.715164:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007513dfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468381824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.715167:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.715170:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f5f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e0f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715174:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.715177:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f523 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5865472->10133503] (req 5865472->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.715178:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f5f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e0f expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.715182:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f5f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e0f expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.715183:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.715185:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532125.715185:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.715192:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007513dfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468381824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (138us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.715194:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3404
00000100:00100000:0.0:1651532125.715543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.715573:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468382080
00000100:00100000:1.0:1651532125.715582:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3405
00000100:00100000:1.0:1651532125.715584:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468382080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.715587:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.715591:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f5fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e16 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.715598:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f5fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e16 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.715602:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f5fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e16 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.715605:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532125.715618:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468382080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.715621:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3405
00000001:00080000:1.0:1651532125.806343:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793756 is committed
00010000:00010000:0.0:1651532125.806376:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.806382:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.806401:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.806405:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468377984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 415731us (415805us total) trans 158913793756 rc 0/0
00010000:00010000:1.0:1651532125.806406:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532125.806407:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.806409:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4186
00010000:00010000:1.0:1651532125.806410:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.806415:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.806416:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.806417:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.806420:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.806430:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.806435:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f52a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->10477567] (req 815104->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.806441:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.806446:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.806864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.806874:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.806886:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.806895:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.806901:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468382208
00000100:00100000:1.0:1651532125.806916:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468382272
00010000:00010000:0.0:1651532125.806918:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.806922:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4195
00010000:00010000:0.0:1651532125.806923:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.806924:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7789e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468382208:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532125.806942:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468379072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316878us (316942us total) trans 0 rc 36864/36864
00010000:00010000:1.0:1651532125.806943:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.806946:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4187
00010000:00010000:1.0:1651532125.806948:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532125.806949:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.806951:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:0.0:1651532125.806951:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4196
00010000:00010000:1.0:1651532125.806952:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.806953:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468382272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532125.806956:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.806960:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.806960:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.806964:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.806965:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.806968:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00000100:00100000:1.0:1651532125.806969:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468382336
00010000:00010000:0.0:1651532125.806969:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.806973:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.806975:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468382400
00010000:00010000:0.0:1651532125.806977:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.806978:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3406
00000100:00100000:1.0:1651532125.806980:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fef8a7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468382336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.806983:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.806986:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f611 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e1d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.806991:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.806993:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f611 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e1d expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807002:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f40f611 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e1d expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807007:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532125.807011:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.807017:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532125.807018:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.807023:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.807035:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fef8a7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468382336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (148us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.807038:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3406
00010000:00010000:0.0:1651532125.807038:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.807039:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.807040:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.807043:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.807044:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3407
00000100:00100000:1.0:1651532125.807046:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468382400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.807049:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.807050:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.807052:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f618 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e24 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.807053:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f569 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [495616->9482239] (req 495616->9482239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.807059:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f618 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e24 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.807059:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.807063:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f40f618 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e24 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.807063:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.807066:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532125.807071:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468382400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (177us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.807074:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3407
00000100:00100000:0.0:1651532125.807309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.807341:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468382464
00000100:00100000:1.0:1651532125.807351:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3408
00000100:00100000:1.0:1651532125.807353:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d529e503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468382464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.807358:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532125.807366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532125.807379:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f61f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e2b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.807387:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f61f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e2b expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807391:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f40f61f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e2b expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807395:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532125.807409:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d529e503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468382464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.807412:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3408
00000100:00100000:1.0:1651532125.807417:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468382592
00000100:00100000:1.0:1651532125.807423:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3409
00000100:00100000:1.0:1651532125.807425:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468382592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.807427:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.807430:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f626 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e32 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.807436:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f626 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e32 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807440:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f40f626 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e32 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807444:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532125.807450:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468382592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.807452:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3409
00000100:00100000:0.0:1651532125.807652:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.807663:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468382784
00000100:00100000:0.0:1651532125.807664:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.807676:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468382976
00000100:00100000:1.0:1651532125.807680:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3410
00000100:00100000:1.0:1651532125.807682:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e415d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468382784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.807685:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.807688:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f62d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e39 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.807695:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f62d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e39 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807699:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f40f62d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e39 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807702:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532125.807717:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e415d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468382784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.807722:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3410
00000100:00100000:1.0:1651532125.807729:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3411
00000100:00100000:1.0:1651532125.807730:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468382976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.807735:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.807738:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f634 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e40 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.807746:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f634 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e40 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532125.807759:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532125.807763:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f40f634 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e40 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807767:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532125.807776:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468382976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.807781:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3411
00000100:00100000:1.0:1651532125.807825:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468383104
00000100:00100000:1.0:1651532125.807843:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3412
00000100:00100000:1.0:1651532125.807845:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468383104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.807848:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.807851:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f63b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e47 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.807858:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f63b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e47 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807862:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f40f63b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e47 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.807868:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532125.807881:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468383104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (124us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.807884:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3412
00000100:00100000:0.0:1651532125.808105:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.808120:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.808131:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468383424
00000100:00100000:1.0:1651532125.808138:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468383488
00000100:00100000:1.0:1651532125.808142:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3413
00000100:00100000:1.0:1651532125.808144:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468383424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.808147:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.808151:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f642 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e4e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.808157:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f642 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e4e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.808161:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f40f642 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e4e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.808164:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532125.808178:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468383424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.808180:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3413
00000100:00100000:1.0:1651532125.808185:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3414
00000100:00100000:1.0:1651532125.808186:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468383488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.808190:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.808193:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f649 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e55 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.808203:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f649 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e55 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.808219:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f40f649 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e55 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.808222:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532125.808236:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468383488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (116us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.808238:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3414
00000100:00100000:0.0:1651532125.808431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.808444:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468383680
00000100:00100000:1.0:1651532125.808452:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3415
00000100:00100000:1.0:1651532125.808453:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468383680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.808457:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.808460:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f650 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e5c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.808467:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f650 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e5c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.808470:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f40f650 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e5c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.808477:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532125.808490:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468383680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.808493:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3415
00000100:00100000:0.0:1651532125.808726:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.808746:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468383872
00000100:00100000:1.0:1651532125.808754:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3416
00000100:00100000:1.0:1651532125.808755:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468383872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.808759:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.808762:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f657 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e63 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.808769:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f657 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e63 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.808773:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f657 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e63 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.808776:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532125.808790:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468383872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.808792:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3416
00000001:00080000:1.0:1651532125.873059:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793757 is committed
00010000:00010000:0.0:1651532125.873091:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873097:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.873115:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468379008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 383010us (383106us total) trans 158913793757 rc 0/0
00000100:00100000:0.0:1651532125.873118:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4188
00010000:00010000:0.0:1651532125.873125:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873129:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532125.873130:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873133:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873138:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.873139:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532125.873140:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873143:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873150:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873153:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f577 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2052096->10227711] (req 2052096->10227711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873158:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873161:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873361:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873366:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.873392:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468379776:12345-10.240.43.64@tcp:3:fio.0 Request processed in 291394us (291468us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532125.873394:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.873396:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4189
00010000:00010000:1.0:1651532125.873401:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532125.873403:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873406:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873412:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.873412:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532125.873413:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873418:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873441:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873444:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f58c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->8912895] (req 1400832->8912895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873451:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873454:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.873593:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.873609:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.873658:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532125.873673:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468384192
00000100:00100000:1.0:1651532125.873682:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3417
00000100:00100000:1.0:1651532125.873684:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000207f99f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468384192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.873693:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532125.873694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532125.873701:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f65e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e6a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532125.873703:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532125.873711:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532125.873714:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f65e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e6a expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.873718:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f65e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e6a expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532125.873719:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468384128
00010000:00010000:1.0:1651532125.873722:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:0.0:1651532125.873730:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468384064
00000100:00100000:1.0:1651532125.873736:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000207f99f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468384192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.873739:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3417
00000100:00100000:0.0:1651532125.873742:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4197
00000100:00100000:1.0:1651532125.873744:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468384256
00000100:00100000:0.0:1651532125.873744:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468384128:12345-10.240.43.64@tcp:3:fio.
00000100:00100000:1.0:1651532125.873748:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468384320
00000100:00100000:1.0:1651532125.873750:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468384448
00000100:00100000:1.0:1651532125.873752:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3418
00010000:00010000:0.0:1651532125.873752:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.873754:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d52bfd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468384256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.873756:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.873757:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532125.873758:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532125.873758:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873759:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f66c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e71 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873762:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873765:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f66c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e71 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532125.873768:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4198
00000100:00100000:0.0:1651532125.873770:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468384064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532125.873771:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f66c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e71 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.873775:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532125.873776:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873779:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532125.873780:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d52bfd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468384256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (87us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532125.873780:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.873783:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3418
00010000:00010000:0.0:1651532125.873783:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873785:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:1.0:1651532125.873786:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3419
00010000:00010000:0.0:1651532125.873786:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532125.873788:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089209c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468384320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.873790:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532125.873790:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873792:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f67a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e78 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532125.873793:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873797:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f67a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e78 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532125.873797:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873800:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f67a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e78 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.873818:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532125.873825:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089209c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468384320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.873828:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3419
00000100:00100000:1.0:1651532125.873832:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3420
00000100:00100000:1.0:1651532125.873845:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f651876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468384448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532125.873850:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532125.873864:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f681 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e7f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532125.873871:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f681 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e7f expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.873875:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f681 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e7f expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532125.873879:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532125.873892:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f651876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468384448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (180us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532125.873894:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3420
00000001:00080000:1.0:1651532126.039679:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793758 is committed
00002000:00010000:1.0:1651532126.039694:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532124 -> 1651532125
00002000:00010000:1.0:1651532126.039695:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532124 -> 1651532125
00010000:00010000:1.0:1651532126.039698:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.039702:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.039724:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468379712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457677us (457779us total) trans 158913793758 rc 0/0
00010000:00010000:0.0:1651532126.039727:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.039728:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4190
00010000:00010000:0.0:1651532126.039732:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532126.039733:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.039739:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.039745:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.039746:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.039747:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.039750:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.039758:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.039761:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40f593 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10428415] (req 512000->10428415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.039767:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.039771:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.040154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.040163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.040175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.040182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.040191:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468384832
00000100:00100000:1.0:1651532126.040204:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468384768
00000100:00100000:1.0:1651532126.040210:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4199
00000100:00100000:1.0:1651532126.040211:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468384832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532126.040219:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.040224:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532126.040225:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.040228:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532126.040229:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.040232:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4200
00010000:00010000:1.0:1651532126.040233:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.040235:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018165273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468384768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532126.040237:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.040244:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468385024
00010000:00010000:0.0:1651532126.040244:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.040252:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468384960
00000100:00100000:1.0:1651532126.040259:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3421
00000100:00100000:1.0:1651532126.040260:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079cbb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468385024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.040261:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532126.040262:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.040263:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.040265:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532126.040266:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f696 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e8d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.040266:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.040271:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.040273:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f696 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e8d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.040275:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.040278:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f696 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e8d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.040281:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:0.0:1651532126.040283:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3422
00000100:00100000:0.0:1651532126.040284:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2cc2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468384960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.040287:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.040290:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f69d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e86 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.040294:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079cbb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468385024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.040297:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3421
00010000:00010000:0.0:1651532126.040304:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f69d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e86 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.040308:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f69d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e86 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.040312:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532126.040353:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2cc2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468384960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (171us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.040357:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3422
00000100:00100000:1.0:1651532126.040616:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.040629:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468385216
00000100:00100000:0.0:1651532126.040641:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3423
00000100:00100000:0.0:1651532126.040643:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b720e370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468385216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.040647:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.040651:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f6a4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e94 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.040658:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f6a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e94 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.040662:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f6a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e94 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.040666:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532126.040677:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b720e370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468385216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.040680:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3423
00000100:00100000:1.0:1651532126.040924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.040935:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468385408
00000100:00100000:0.0:1651532126.040947:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3424
00000100:00100000:0.0:1651532126.040949:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000724d966c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468385408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.040953:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.040956:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f6ab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449e9b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.040974:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f6ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e9b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.040978:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f6ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449e9b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.040981:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532126.040993:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000724d966c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468385408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.040996:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3424
00000001:00080000:1.0:1651532126.123031:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793759 is committed
00010000:00010000:0.0:1651532126.123057:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.123063:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.123085:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cefde237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468380672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 454647us (454739us total) trans 158913793759 rc 0/0
00010000:00010000:1.0:1651532126.123087:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.123089:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4191
00010000:00010000:1.0:1651532126.123092:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532126.123093:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123096:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123104:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.123105:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.123106:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123109:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123112:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.123113:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.123113:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123118:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123140:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123143:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f5b6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2318336->9396223] (req 2318336->9396223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123153:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123158:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123187:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123191:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123416:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123420:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.123437:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.123445:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532126.123446:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.123462:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c4207f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468380736:12345-10.240.43.64@tcp:3:fio.0 Request processed in 455021us (455093us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532126.123466:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4192
00010000:00010000:0.0:1651532126.123467:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.123474:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.123477:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40f5bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->6696959] (req 307200->6696959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123478:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123481:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.123495:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468381760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408422us (408467us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532126.123498:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4193
00010000:00010000:1.0:1651532126.123510:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123540:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532126.123543:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123556:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.123560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532126.123561:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.123562:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.123563:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123566:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.123570:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468385600
00010000:00010000:1.0:1651532126.123577:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123580:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40f5e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->9175039] (req 200704->9175039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.123588:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3425
00000100:00100000:0.0:1651532126.123590:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000460b2efd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468385600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.123594:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.123595:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.123598:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f6b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ea2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.123599:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.123606:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f6b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ea2 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.123611:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f6b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ea2 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.123615:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532126.123630:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000460b2efd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468385600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.123643:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3425
00000100:00100000:0.0:1651532126.123905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.123915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.123924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.123939:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.123949:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468385984
00000100:00100000:0.0:1651532126.123959:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468386048
00000100:00100000:0.0:1651532126.123963:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3426
00000100:00100000:0.0:1651532126.123965:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f8bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468385984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.123968:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.123973:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f6b9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ea9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.123982:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468385920
00010000:00010000:0.0:1651532126.123984:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f6b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ea9 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.123991:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f6b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ea9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.124000:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468385856
00000100:00100000:1.0:1651532126.124011:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4201
00000100:00100000:1.0:1651532126.124013:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c390546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468385920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532126.124020:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.124024:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532126.124025:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532126.124026:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.124029:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532126.124030:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.124034:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.124035:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f8bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468385984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 69us (111us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532126.124038:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.124038:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3426
00000100:00100000:0.0:1651532126.124043:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3427
00000100:00100000:1.0:1651532126.124045:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4202
00000100:00100000:0.0:1651532126.124045:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468386048:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532126.124047:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a1362a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468385856:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532126.124049:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.124051:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.124052:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f6ce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449eb0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.124055:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532126.124056:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.124073:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532126.124073:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.124078:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.124079:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f6ce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449eb0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.124082:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.124083:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f6ce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449eb0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.124087:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532126.124092:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468386048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (153us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.124095:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3427
00000100:00100000:0.0:1651532126.124109:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.124123:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.124132:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468386176
00000100:00100000:1.0:1651532126.124140:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468386304
00000100:00100000:1.0:1651532126.124148:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3428
00000100:00100000:0.0:1651532126.124150:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3429
00000100:00100000:1.0:1651532126.124151:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468386176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532126.124153:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468386304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.124158:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.124162:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f6d5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ebe expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.124166:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.124170:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f6dc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449eb7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.124173:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f6d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ebe expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.124178:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f6dc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449eb7 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.124178:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f6d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ebe expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.124181:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532126.124182:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f6dc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449eb7 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.124186:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:0.0:1651532126.124192:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468386304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.124194:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3429
00000100:00100000:1.0:1651532126.124196:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468386176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.124199:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3428
00000100:00100000:0.0:1651532126.124409:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.124424:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.124435:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468386432
00000100:00100000:1.0:1651532126.124443:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468386496
00000100:00100000:1.0:1651532126.124451:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3430
00000100:00100000:1.0:1651532126.124453:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468386432:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532126.124455:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3431
00000100:00100000:0.0:1651532126.124457:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468386496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.124458:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.124461:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f6e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ec5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.124461:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.124465:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f6ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ecc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.124469:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f6e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ec5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.124473:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f6e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ec5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.124473:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f6ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ecc expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.124476:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00010000:00010000:0.0:1651532126.124477:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f6ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ecc expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.124480:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532126.124489:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468386432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.124491:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3430
00000100:00100000:0.0:1651532126.124500:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468386496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.124504:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3431
00000100:00100000:0.0:1651532126.124553:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.124580:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468386688
00000100:00100000:0.0:1651532126.124595:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3432
00000100:00100000:0.0:1651532126.124597:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468386688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.124600:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.124604:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f6f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ed3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.124611:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f6f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ed3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.124615:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f6f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ed3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.124618:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532126.124628:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468386688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.124631:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3432
00000100:00100000:0.0:1651532126.124773:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.124780:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468386944
00000100:00100000:0.0:1651532126.124792:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3433
00000100:00100000:0.0:1651532126.124793:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468386944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.124797:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.124800:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f6f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449eda expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.124820:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f6f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449eda expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.124827:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f6f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449eda expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.124830:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532126.124840:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468386944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.124843:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3433
00000001:00080000:1.0:1651532126.256397:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793760 is committed
00010000:00010000:1.0:1651532126.256412:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256416:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.256438:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d23405d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468381632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541360us (541392us total) trans 158913793760 rc 0/0
00000100:00100000:1.0:1651532126.256442:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4194
00010000:00010000:1.0:1651532126.256449:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256455:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532126.256456:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256459:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256465:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.256466:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.256467:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256471:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256493:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256496:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f5ee lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->10469375] (req 1990656->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256502:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256505:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.256867:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.256887:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.256897:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.256905:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.256917:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468387392
00000100:00100000:0.0:1651532126.256927:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468387456
00000100:00100000:0.0:1651532126.256931:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3434
00000100:00100000:0.0:1651532126.256933:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468387392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.256936:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.256940:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f6ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ee1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.256944:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468387136
00010000:00010000:0.0:1651532126.256949:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f6ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ee1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.256953:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f6ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ee1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.256955:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468387200
00010000:00010000:0.0:1651532126.256959:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532126.256961:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4203
00000100:00100000:1.0:1651532126.256963:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468387136:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532126.256969:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468387392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.256972:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3434
00000100:00100000:0.0:1651532126.256977:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3435
00000100:00100000:0.0:1651532126.256978:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468387456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.256979:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.256981:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.256983:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f70d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ee8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256984:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532126.256985:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256988:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532126.256989:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.256995:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.256996:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f70d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ee8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.256999:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.256999:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f70d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ee8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.257003:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532126.257006:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4204
00000100:00100000:1.0:1651532126.257008:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468387200:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532126.257008:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468387456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.257010:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3435
00010000:00010000:1.0:1651532126.257027:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.257030:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532126.257032:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.257040:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532126.257041:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.257059:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.257063:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532126.356382:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793761 is committed
00010000:00010000:1.0:1651532126.356397:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.356400:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.356422:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7789e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468382208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549497us (549560us total) trans 158913793761 rc 0/0
00000100:00100000:1.0:1651532126.356425:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4195
00010000:00010000:0.0:1651532126.356425:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356430:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532126.356439:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356442:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356449:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.356449:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.356450:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356453:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356457:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.356457:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.356458:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356460:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356471:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356476:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40f603 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5861376->9965567] (req 5861376->9965567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356485:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356498:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356535:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356558:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.356773:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.356787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.356819:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468387648
00000100:00100000:0.0:1651532126.356828:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468387712
00000100:00100000:1.0:1651532126.356830:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3436
00000100:00100000:1.0:1651532126.356833:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d43c04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468387648:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532126.356835:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3437
00010000:00010000:1.0:1651532126.356837:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532126.356837:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018bbbca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468387712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.356840:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.356841:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f71b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449eef expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356844:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f722 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ef6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356850:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.356853:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f722 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ef6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.356855:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.356858:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f71b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449eef expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.356858:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f722 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ef6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.356862:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532126.356863:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f71b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449eef expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.356866:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:0.0:1651532126.356872:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018bbbca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468387712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.356875:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d43c04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468387648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.356878:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3436
00000100:00100000:0.0:1651532126.356884:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3437
00010000:00010000:0.0:1651532126.356896:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356900:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.356913:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.356916:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468384128:12345-10.240.43.64@tcp:3:fio. Request processed in 483172us (483324us total) trans 0 rc 45056/45056
00010000:00010000:1.0:1651532126.356917:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532126.356918:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.356919:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4197
00010000:00010000:1.0:1651532126.356921:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.356926:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356928:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.356929:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f665 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1531904->9650175] (req 1531904->9650175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356932:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.356945:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468382272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 549991us (550071us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532126.356947:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.356948:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4196
00010000:00010000:1.0:1651532126.356950:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532126.356951:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.356953:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.356957:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.356958:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.356958:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.356961:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.356971:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.356975:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f60a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->9588735] (req 376832->9588735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356985:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.356991:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.357312:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.357332:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.357354:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.357364:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468387968
00000100:00100000:0.0:1651532126.357369:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468387840
00000100:00100000:1.0:1651532126.357376:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3438
00000100:00100000:1.0:1651532126.357379:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468387968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.357384:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.357389:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f729 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449efd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.357397:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f729 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449efd expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.357402:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f729 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449efd expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532126.357409:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468387904
00010000:00010000:1.0:1651532126.357412:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532126.357423:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468387968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.357425:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4205
00000100:00100000:1.0:1651532126.357426:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3438
00000100:00100000:0.0:1651532126.357427:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468387840:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532126.357434:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4206
00010000:00010000:0.0:1651532126.357435:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.357436:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468387904:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532126.357440:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532126.357441:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.357442:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.357444:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532126.357444:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.357451:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532126.357452:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.357455:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532126.357456:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.357461:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.357461:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.357465:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.357467:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.357487:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.357494:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468388224
00000100:00100000:0.0:1651532126.357506:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3439
00000100:00100000:0.0:1651532126.357508:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468388224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.357511:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.357514:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f73e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f04 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.357525:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f73e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f04 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.357543:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532126.357543:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f73e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f04 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.357546:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532126.357555:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.357557:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468388224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.357560:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3439
00000100:00100000:0.0:1651532126.357565:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468388160
00000100:00100000:0.0:1651532126.357569:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468388352
00000100:00100000:0.0:1651532126.357572:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3440
00000100:00100000:0.0:1651532126.357574:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468388160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.357576:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.357579:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f745 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f0b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.357589:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f745 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f0b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.357594:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3441
00010000:00010000:0.0:1651532126.357596:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f745 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f0b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.357597:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef0e4aff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468388352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.357599:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532126.357601:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.357604:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f74c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f12 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.357612:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468388160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.357615:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3440
00010000:00010000:1.0:1651532126.357618:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f74c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f12 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.357623:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f74c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f12 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.357626:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532126.357636:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef0e4aff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468388352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.357641:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3441
00000100:00100000:1.0:1651532126.357776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.357784:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468388480
00000100:00100000:1.0:1651532126.357791:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3442
00000100:00100000:1.0:1651532126.357793:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4432ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468388480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.357796:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.357800:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f753 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f19 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.357821:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f753 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f19 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.357825:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f753 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f19 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.357828:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532126.357840:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4432ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468388480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.357843:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3442
00000100:00100000:1.0:1651532126.357908:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.357916:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468388800
00000100:00100000:1.0:1651532126.357922:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3443
00000100:00100000:1.0:1651532126.357924:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060027dfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468388800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.357927:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.357931:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f75a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f20 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.357938:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f75a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f20 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.357942:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f75a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f20 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.357945:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532126.357958:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060027dfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468388800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.357961:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3443
00000001:00080000:1.0:1651532126.448113:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793762 is committed
00010000:00010000:0.0:1651532126.448144:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448149:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.448172:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468384064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574401us (574563us total) trans 158913793762 rc 0/0
00000100:00100000:0.0:1651532126.448175:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4198
00010000:00010000:0.0:1651532126.448183:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448186:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532126.448187:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448190:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448195:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.448196:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.448197:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448199:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448210:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.448228:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448228:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f673 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->7995391] (req 827392->7995391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.448233:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.448537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.448552:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.448569:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468389184
00000100:00100000:0.0:1651532126.448579:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468389248
00000100:00100000:1.0:1651532126.448595:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4207
00000100:00100000:1.0:1651532126.448597:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d2f345e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468389184:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532126.448602:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4208
00000100:00100000:0.0:1651532126.448604:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6a8a35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468389248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532126.448605:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.448610:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532126.448611:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448612:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.448616:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532126.448617:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448623:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.448624:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448627:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532126.448628:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.448632:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448633:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.448636:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448636:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.448655:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.448666:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.448680:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468389312
00000100:00100000:0.0:1651532126.448686:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468389440
00000100:00100000:1.0:1651532126.448688:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3444
00000100:00100000:1.0:1651532126.448690:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468389312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.448693:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532126.448694:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3445
00010000:00010000:1.0:1651532126.448695:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f76f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f27 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.448700:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.448703:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f76f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f27 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532126.448703:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468389440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.448707:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f76f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f27 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.448707:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.448710:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00010000:00010000:0.0:1651532126.448710:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f776 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f2e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448716:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.448719:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f776 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f2e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.448721:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468389312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (66us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532126.448723:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f776 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f2e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.448724:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3444
00010000:00010000:0.0:1651532126.448726:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532126.448735:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468389440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (69us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532126.448736:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.448738:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3445
00010000:00010000:1.0:1651532126.448739:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448750:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.448751:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468384832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408539us (408598us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532126.448753:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4199
00010000:00010000:0.0:1651532126.448754:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532126.448755:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448758:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448763:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.448770:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.448772:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448775:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448782:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448785:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f688 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4018176->9961471] (req 4018176->9961471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448790:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.448794:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.449041:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.449064:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468389632
00000100:00100000:1.0:1651532126.449077:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3446
00000100:00100000:1.0:1651532126.449078:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6757c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468389632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.449082:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.449086:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f77d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f35 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.449093:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f77d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f35 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.449097:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f77d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f35 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.449101:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532126.449111:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6757c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468389632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.449114:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3446
00000100:00100000:0.0:1651532126.449179:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.449186:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.449198:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468389696
00000100:00100000:0.0:1651532126.449201:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.449206:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468389760
00000100:00100000:0.0:1651532126.449208:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468389888
00000100:00100000:1.0:1651532126.449210:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3447
00000100:00100000:1.0:1651532126.449211:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468389696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.449214:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532126.449215:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3448
00000100:00100000:0.0:1651532126.449217:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468389760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.449218:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f784 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f3c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.449221:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.449225:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f784 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f3c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.449225:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f78b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f43 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.449229:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f784 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f3c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.449232:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532126.449242:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468389696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.449244:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3447
00010000:00010000:0.0:1651532126.449245:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f78b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f43 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.449249:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f78b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f43 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.449253:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532126.449262:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3449
00000100:00100000:1.0:1651532126.449264:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a617cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468389888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.449267:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.449269:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f792 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f4a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.449275:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f792 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f4a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532126.449277:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468389760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (90us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532126.449279:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f792 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f4a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532126.449280:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3448
00010000:00010000:1.0:1651532126.449282:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532126.449289:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a617cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468389888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.449291:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3449
00000001:00080000:1.0:1651532126.589698:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793763 is committed
00010000:00010000:0.0:1651532126.589730:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.589734:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.589756:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.589757:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018165273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468384768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549521us (549593us total) trans 158913793763 rc 0/0
00000100:00100000:0.0:1651532126.589760:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4200
00010000:00010000:1.0:1651532126.589761:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532126.589762:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.589765:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.589771:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.589772:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.589773:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.589776:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.589785:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.589790:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f68f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2539520->9023487] (req 2539520->9023487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.589793:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.589798:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.590174:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.590187:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.590199:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.590208:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.590211:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468390336
00000100:00100000:0.0:1651532126.590214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.590222:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468390208
00000100:00100000:1.0:1651532126.590233:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4209
00000100:00100000:1.0:1651532126.590234:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468390336:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532126.590236:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.590240:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590241:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590246:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.590247:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532126.590247:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590251:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.590259:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c390546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468385920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466245us (466354us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532126.590262:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4201
00000100:00100000:1.0:1651532126.590264:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4210
00000100:00100000:1.0:1651532126.590266:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468390208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532126.590270:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590271:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590274:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532126.590274:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532126.590275:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590281:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590283:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532126.590284:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.590287:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590288:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.590290:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590291:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590295:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.590296:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.590296:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.590297:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.590300:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.590310:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.590313:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468390272
00010000:00010000:0.0:1651532126.590313:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40f6c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3985408->9740287] (req 3985408->9740287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.590330:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468390464
00000100:00100000:1.0:1651532126.590334:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468390592
00000100:00100000:1.0:1651532126.590337:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3450
00000100:00100000:1.0:1651532126.590338:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468390272:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532126.590339:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3451
00010000:00010000:1.0:1651532126.590341:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532126.590341:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468390464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.590344:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f7a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f51 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.590345:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.590349:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7ae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f58 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590351:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f7a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f51 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.590356:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f58 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.590359:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f7a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f51 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.590361:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f58 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.590362:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00010000:00010000:0.0:1651532126.590364:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532126.590371:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468390272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (172us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.590372:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468390464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (164us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.590374:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3450
00000100:00100000:0.0:1651532126.590375:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3451
00000100:00100000:1.0:1651532126.590378:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3452
00000100:00100000:1.0:1651532126.590380:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468390592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.590382:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.590384:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f7b5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f5f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590389:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f7b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f5f expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.590393:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f7b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f5f expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.590396:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532126.590401:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468390592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (187us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.590403:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3452
00010000:00010000:1.0:1651532126.590411:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590417:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.590741:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.590822:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468390720
00000100:00100000:1.0:1651532126.590833:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3453
00000100:00100000:1.0:1651532126.590835:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468390720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.590839:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.590842:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f7bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f66 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.590850:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f7bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f66 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.590854:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f7bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f66 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.590857:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532126.590870:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468390720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (131us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.590873:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3453
00000100:00100000:0.0:1651532126.591107:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.591126:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468390912
00000100:00100000:1.0:1651532126.591138:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3454
00000100:00100000:1.0:1651532126.591140:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468390912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.591143:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.591147:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f7c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f6d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.591154:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f7c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f6d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.591158:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f7c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f6d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.591161:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532126.591174:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468390912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.591176:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3454
00000100:00100000:0.0:1651532126.591416:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.591444:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468391040
00000100:00100000:1.0:1651532126.591455:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3455
00000100:00100000:1.0:1651532126.591457:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468391040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.591460:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.591463:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f74 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.591470:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f74 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.591474:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f74 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.591477:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532126.591489:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468391040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.591492:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3455
00000100:00100000:0.0:1651532126.591692:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.591710:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468391168
00000100:00100000:1.0:1651532126.591721:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3456
00000100:00100000:1.0:1651532126.591723:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468391168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.591726:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.591729:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f7b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.591736:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f7b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.591740:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f7b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.591743:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532126.591755:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468391168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.591757:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3456
00000001:00080000:1.0:1651532126.656457:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793764 is committed
00002000:00010000:1.0:1651532126.656470:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532125 -> 1651532126
00002000:00010000:1.0:1651532126.656472:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532125 -> 1651532126
00010000:00010000:1.0:1651532126.656474:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.656478:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.656502:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a1362a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468385856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532454us (532587us total) trans 158913793764 rc 0/0
00010000:00010000:0.0:1651532126.656505:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.656506:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4202
00010000:00010000:0.0:1651532126.656510:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532126.656511:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.656515:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.656521:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.656521:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.656522:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.656525:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.656535:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.656538:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f6c7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->10203135] (req 1736704->10203135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.656549:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.656554:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.656972:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.656989:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468391360
00000100:00100000:0.0:1651532126.656991:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.657003:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468391296
00000100:00100000:0.0:1651532126.657004:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.657015:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4211
00000100:00100000:1.0:1651532126.657017:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468391360:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532126.657020:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4212
00000100:00100000:0.0:1651532126.657022:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468391296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532126.657024:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.657029:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532126.657030:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.657031:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.657033:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532126.657033:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.657038:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532126.657039:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.657042:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532126.657042:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.657046:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.657047:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.657050:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.657051:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.657057:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468391552
00000100:00100000:1.0:1651532126.657066:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3457
00000100:00100000:1.0:1651532126.657068:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468391552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.657071:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.657073:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f82 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.657080:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f82 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.657084:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f82 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.657087:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532126.657097:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ec6876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468391552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.657100:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3457
00000001:00080000:1.0:1651532126.756441:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793765 is committed
00010000:00010000:0.0:1651532126.756474:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.756479:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.756505:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.756506:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a77dc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468387136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499542us (499639us total) trans 158913793765 rc 0/0
00010000:00010000:1.0:1651532126.756509:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532126.756510:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.756510:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4203
00010000:00010000:1.0:1651532126.756513:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.756519:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.756519:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.756527:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.756531:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.756543:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.756558:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f706 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2719744->7733247] (req 2719744->7733247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.756566:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.756569:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.756899:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.756917:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468391744
00000100:00100000:0.0:1651532126.756929:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3458
00000100:00100000:0.0:1651532126.756931:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468391744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.756934:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.756935:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.756939:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.756939:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f7ed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f89 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.756945:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.756955:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f7ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f89 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.756959:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468387200:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499949us (500071us total) trans 0 rc 36864/36864
00010000:00010000:0.0:1651532126.756959:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f7ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f89 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.756962:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4204
00010000:00010000:0.0:1651532126.756963:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532126.756972:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c97d2e74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468391744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.756975:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3458
00010000:00010000:0.0:1651532126.756982:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.756988:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532126.756989:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.756992:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.756997:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.756997:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.756999:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.757003:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.757015:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.757018:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f714 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->8138751] (req 1806336->8138751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.757025:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.757028:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.757431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.757444:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.757457:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468392064
00000100:00100000:0.0:1651532126.757459:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.757465:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.757469:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468391936
00000100:00100000:0.0:1651532126.757481:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.757490:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4213
00000100:00100000:1.0:1651532126.757492:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468392064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532126.757501:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.757505:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532126.757506:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.757509:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532126.757510:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.757514:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.757517:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.757525:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468392192
00000100:00100000:1.0:1651532126.757533:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468392128
00000100:00100000:1.0:1651532126.757535:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468392384
00000100:00100000:1.0:1651532126.757538:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3459
00000100:00100000:1.0:1651532126.757540:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468392192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.757542:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.757545:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f7fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f97 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.757552:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f7fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f97 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532126.757553:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4214
00010000:00010000:1.0:1651532126.757556:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f7fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f97 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532126.757556:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468391936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532126.757560:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532126.757570:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468392192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.757572:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3459
00010000:00010000:0.0:1651532126.757573:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.757577:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3460
00000100:00100000:1.0:1651532126.757578:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468392128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.757578:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532126.757579:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.757581:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.757582:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532126.757583:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f809 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f90 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.757583:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.757588:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f809 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f90 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.757588:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.757592:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f809 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f90 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.757592:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.757595:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532126.757599:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468392128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (134us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.757601:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3461
00000100:00100000:0.0:1651532126.757603:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468392384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.757606:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.757609:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f810 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449f9e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.757615:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3460
00010000:00010000:0.0:1651532126.757630:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f810 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f9e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.757635:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f810 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449f9e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.757638:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532126.757653:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd35278d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468392384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (171us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.757657:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3461
00000100:00100000:1.0:1651532126.757925:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.757933:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468392576
00000100:00100000:1.0:1651532126.757945:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3462
00000100:00100000:1.0:1651532126.757947:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468392576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.757950:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.757954:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f817 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449fa5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.757961:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f817 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fa5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.757965:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f817 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fa5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.757968:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532126.757980:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468392576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.757983:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3462
00000001:00080000:1.0:1651532126.848201:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793766 is committed
00010000:00010000:0.0:1651532126.848242:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.848247:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.848271:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468387840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490843us (490948us total) trans 158913793766 rc 0/0
00000100:00100000:0.0:1651532126.848274:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4205
00010000:00010000:0.0:1651532126.848282:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.848286:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532126.848287:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.848293:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.848298:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.848298:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.848299:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.848302:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.848309:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.848314:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f730 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5050368->6459391] (req 5050368->6459391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.848336:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.848341:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.848577:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532126.848595:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.848602:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.848622:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468387904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491185us (491268us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532126.848625:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4206
00010000:00010000:1.0:1651532126.848632:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.848635:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532126.848637:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.848640:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.848646:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.848648:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.848649:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.848653:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.848656:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468392768
00000100:00100000:0.0:1651532126.848670:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3463
00000100:00100000:0.0:1651532126.848672:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468392768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.848674:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.848676:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.848678:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f737 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6037503] (req 684032->6037503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.848680:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f81e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449fac expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.848684:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.848687:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.848689:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f81e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fac expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.848696:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f81e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fac expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.848699:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532126.848714:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468392768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.848717:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3463
00000100:00100000:0.0:1651532126.849003:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.849019:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.849026:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468392896
00000100:00100000:0.0:1651532126.849027:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.849034:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.849041:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468392960
00000100:00100000:1.0:1651532126.849050:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4215
00000100:00100000:1.0:1651532126.849051:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468392896:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532126.849056:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4216
00010000:00010000:1.0:1651532126.849058:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.849059:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468392960:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532126.849063:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532126.849064:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.849069:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532126.849070:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.849071:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.849078:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.849081:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.849094:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532126.849095:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.849098:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532126.849099:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.849104:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.849110:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.849120:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468393024
00000100:00100000:0.0:1651532126.849130:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468393088
00000100:00100000:0.0:1651532126.849137:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3464
00000100:00100000:0.0:1651532126.849139:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079cbb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468393024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.849142:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.849145:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f833 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449fb3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.849152:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f833 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fb3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.849156:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f833 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fb3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.849160:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532126.849170:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079cbb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468393024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.849173:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3464
00000100:00100000:0.0:1651532126.849177:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3465
00000100:00100000:0.0:1651532126.849179:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2cc2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468393088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.849182:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.849184:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f83a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449fba expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.849189:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f83a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fba expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.849193:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f83a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fba expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.849194:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532126.849196:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532126.849201:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2cc2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468393088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (168us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.849203:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3465
00000100:00100000:0.0:1651532126.849207:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468393216
00000100:00100000:0.0:1651532126.849215:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3466
00000100:00100000:0.0:1651532126.849217:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef0e4aff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468393216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.849219:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.849222:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f841 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449fc1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.849228:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f841 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fc1 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.849234:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f841 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fc1 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.849239:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532126.849253:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef0e4aff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468393216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.849256:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3466
00000001:00080000:1.0:1651532126.914870:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793767 is committed
00010000:00010000:1.0:1651532126.914885:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.914889:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.914912:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d2f345e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468389184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466314us (466376us total) trans 158913793767 rc 0/0
00010000:00010000:0.0:1651532126.914914:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.914915:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4207
00010000:00010000:0.0:1651532126.914919:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532126.914920:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.914924:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.914929:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.914930:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.914931:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.914934:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.914937:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.914938:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.914938:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.914941:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.914952:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.914957:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f761 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->9637887] (req 548864->9637887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.914974:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.914978:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.915001:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.915005:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.915358:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.915370:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.915378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.915378:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468393600
00000100:00100000:0.0:1651532126.915391:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468393856
00000100:00100000:0.0:1651532126.915394:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468393792
00000100:00100000:0.0:1651532126.915397:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3467
00000100:00100000:0.0:1651532126.915399:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4432ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468393600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.915402:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.915403:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.915406:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f848 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449fc8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.915408:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.915411:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.915414:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f848 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fc8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.915425:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f848 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fc8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.915427:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6a8a35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468389248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466822us (466874us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532126.915428:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532126.915430:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4208
00000100:00100000:0.0:1651532126.915437:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4432ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468393600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (81us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532126.915440:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.915440:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3467
00010000:00010000:1.0:1651532126.915444:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.915445:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3468
00000100:00100000:0.0:1651532126.915446:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060027dfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468393856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.915450:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.915452:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f84f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449fd6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.915454:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468390336:12345-10.240.43.64@tcp:3:fio.0 Request processed in 325219us (325282us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532126.915456:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4209
00010000:00010000:0.0:1651532126.915457:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532126.915459:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f84f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fd6 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.915461:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.915462:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f84f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fd6 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.915465:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532126.915465:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532126.915466:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.915469:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.915470:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060027dfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468393856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.915473:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3468
00010000:00010000:1.0:1651532126.915474:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.915476:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3469
00010000:00010000:1.0:1651532126.915477:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40f768 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1703936->9629695] (req 1703936->9629695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.915478:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6757c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468393792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.915480:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.915481:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.915482:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f856 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449fcf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.915483:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532126.915484:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.915485:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.915487:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.915487:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f856 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fcf expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.915490:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.915491:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532126.915491:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.915494:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.915498:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f856 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fcf expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.915501:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.915503:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f799 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->9498623] (req 1097728->9498623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.915505:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532126.915508:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.915510:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6757c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468393792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (132us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532126.915511:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.915512:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3469
00000100:00100000:1.0:1651532126.915958:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.915991:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.916006:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.916018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.916019:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468394176
00000100:00100000:1.0:1651532126.916027:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.916035:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532126.916038:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468394240
00000100:00100000:0.0:1651532126.916041:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468394368
00000100:00100000:1.0:1651532126.916043:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468394048
00000100:00100000:0.0:1651532126.916043:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468394496
00000100:00100000:0.0:1651532126.916046:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3470
00000100:00100000:0.0:1651532126.916048:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b5a93ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468394176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.916051:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532126.916053:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468394112
00010000:00010000:0.0:1651532126.916055:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f85d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449fdd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532126.916062:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4217
00000100:00100000:1.0:1651532126.916064:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ec70ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468394048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532126.916068:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f85d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fdd expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.916071:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.916072:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f85d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fdd expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.916076:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532126.916076:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532126.916077:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.916080:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532126.916080:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.916085:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.916090:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b5a93ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468394176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.916093:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3470
00000100:00100000:0.0:1651532126.916098:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3471
00000100:00100000:0.0:1651532126.916099:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c75e9d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468394240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.916102:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.916105:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f86b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449fe4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.916106:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.916111:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f86b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fe4 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.916114:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4218
00010000:00010000:0.0:1651532126.916114:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f86b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449fe4 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532126.916116:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468394112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532126.916118:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532126.916121:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.916123:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c75e9d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468394240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (105us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532126.916125:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532126.916125:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3471
00010000:00010000:1.0:1651532126.916126:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.916128:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532126.916129:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532126.916129:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3472
00000100:00100000:0.0:1651532126.916130:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468394368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.916132:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.916132:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.916134:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f879 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449feb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.916135:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.916140:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f879 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449feb expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.916143:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f879 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449feb expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.916158:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532126.916164:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468394368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.916167:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3472
00000100:00100000:0.0:1651532126.916171:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3473
00000100:00100000:0.0:1651532126.916173:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e688b703 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468394496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532126.916177:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532126.916181:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f880 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ff2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532126.916190:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f880 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ff2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.916194:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f880 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ff2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532126.916198:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532126.916211:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e688b703 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468394496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (175us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532126.916215:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3473
00000100:00100000:1.0:1651532126.916433:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532126.916441:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468394624
00000100:00100000:1.0:1651532126.916453:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3474
00000100:00100000:1.0:1651532126.916455:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468394624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532126.916466:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532126.916470:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f887 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db449ff9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532126.916478:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f887 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ff9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.916483:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f887 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db449ff9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532126.916486:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532126.916497:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468394624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532126.916500:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3474
00000001:00080000:1.0:1651532127.023293:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793768 is committed
00010000:00010000:1.0:1651532127.023308:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.023312:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023340:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.023342:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468390208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 433075us (433155us total) trans 158913793768 rc 0/0
00000100:00100000:1.0:1651532127.023345:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4210
00010000:00010000:0.0:1651532127.023345:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.023346:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023357:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023363:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.023364:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.023365:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023368:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023377:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023382:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40f7a0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10391551] (req 20480->10391551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.023399:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.023407:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.023718:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.023728:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.023739:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.023742:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468395136
00000100:00100000:1.0:1651532127.023745:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.023762:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468395008
00000100:00100000:1.0:1651532127.023768:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4219
00000100:00100000:1.0:1651532127.023770:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007513dfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468395136:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532127.023771:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4220
00000100:00100000:0.0:1651532127.023773:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468395008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532127.023779:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023780:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.023783:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.023784:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532127.023785:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023789:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532127.023790:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023796:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023799:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532127.023800:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.023818:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023819:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023822:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023825:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.023829:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.023833:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.023833:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468395200
00000100:00100000:0.0:1651532127.023842:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468395264
00000100:00100000:0.0:1651532127.023848:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3475
00000100:00100000:0.0:1651532127.023850:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fef8a7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468395200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.023852:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.023855:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f89c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a007 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.023856:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468391360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366838us (366884us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532127.023860:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4211
00010000:00010000:0.0:1651532127.023860:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.023863:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f89c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a007 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.023869:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023870:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f89c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a007 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.023873:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.023873:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532127.023874:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.023877:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.023882:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.023882:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532127.023882:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fef8a7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468395200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (143us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532127.023883:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.023885:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3475
00010000:00010000:1.0:1651532127.023886:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.023889:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3476
00000100:00100000:0.0:1651532127.023890:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468395264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.023893:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.023897:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.023900:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f7d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2994176->10465279] (req 2994176->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023902:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a000 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023908:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a000 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.023912:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a000 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.023915:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532127.023921:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468395264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (176us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.023924:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3476
00010000:00010000:0.0:1651532127.023930:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.023933:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.024290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.024300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.024301:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468395392
00000100:00100000:1.0:1651532127.024308:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468395520
00000100:00100000:0.0:1651532127.024314:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3477
00000100:00100000:0.0:1651532127.024315:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d529e503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468395392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.024319:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532127.024330:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3478
00010000:00010000:0.0:1651532127.024331:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8aa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a00e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.024333:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468395520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.024337:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.024339:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a00e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.024341:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f8b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a015 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.024343:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a00e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.024346:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532127.024349:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f8b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a015 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.024353:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f8b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a015 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532127.024360:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d529e503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468395392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.024363:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3477
00010000:00010000:1.0:1651532127.024364:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532127.024373:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468395520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.024376:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3478
00000100:00100000:1.0:1651532127.024643:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.024651:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468395648
00000100:00100000:1.0:1651532127.024658:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3479
00000100:00100000:1.0:1651532127.024659:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e415d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468395648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.024663:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.024666:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f8b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a01c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.024673:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f8b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a01c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.024681:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f8b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a01c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.024684:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532127.024694:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e415d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468395648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.024696:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3479
00000100:00100000:1.0:1651532127.024962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.024969:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468395840
00000100:00100000:1.0:1651532127.024976:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3480
00000100:00100000:1.0:1651532127.024978:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468395840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.024981:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.024985:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a023 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.024992:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a023 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.024996:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a023 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.024999:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532127.025008:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468395840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.025012:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3480
00000100:00100000:1.0:1651532127.025241:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.025249:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468395968
00000100:00100000:1.0:1651532127.025256:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3481
00000100:00100000:1.0:1651532127.025258:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468395968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.025261:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.025264:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a02a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.025271:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a02a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.025275:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a02a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.025279:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532127.025287:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc759190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468395968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.025290:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3481
00000001:00080000:1.0:1651532127.139883:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793769 is committed
00010000:00010000:0.0:1651532127.139914:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.139919:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.139945:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468391296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482922us (482953us total) trans 158913793769 rc 0/0
00000100:00100000:0.0:1651532127.139948:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4212
00010000:00010000:0.0:1651532127.139956:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.139959:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.139960:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.139963:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.139968:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.139969:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.139970:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.139973:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.139983:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.139988:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f7df lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->10080255] (req 434176->10080255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140004:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140009:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140037:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140040:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.140059:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000313d1779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468392064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 382566us (382629us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532127.140065:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4213
00010000:00010000:1.0:1651532127.140074:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140077:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532127.140078:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140081:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140086:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.140087:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.140088:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140091:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140103:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.140112:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140113:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f7f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5898240->5902335] (req 5898240->5902335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.140116:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.140410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.140419:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.140434:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.140442:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468396416
00000100:00100000:1.0:1651532127.140457:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3482
00000100:00100000:1.0:1651532127.140458:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468396416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.140462:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.140466:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a031 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140474:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a031 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.140478:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a031 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.140482:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532127.140490:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d28e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468396416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.140492:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3482
00000100:00100000:1.0:1651532127.140499:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468396160
00000100:00100000:1.0:1651532127.140507:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468396224
00000100:00100000:0.0:1651532127.140510:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4221
00000100:00100000:0.0:1651532127.140512:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468396160:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532127.140518:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4222
00000100:00100000:1.0:1651532127.140520:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468396224:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532127.140521:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.140525:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532127.140526:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.140526:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.140529:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532127.140530:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140534:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532127.140535:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140538:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532127.140538:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.140542:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140543:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.140546:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.140546:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.140565:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.140576:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468396544
00000100:00100000:0.0:1651532127.140588:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3483
00000100:00100000:0.0:1651532127.140590:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468396544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.140593:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.140597:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a038 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.140608:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a038 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.140615:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a038 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.140618:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532127.140633:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468396544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.140637:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3483
00000001:00080000:1.0:1651532127.206657:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793770 is committed
00010000:00010000:0.0:1651532127.206712:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.206717:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.206740:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d187b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468391936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449184us (449295us total) trans 158913793770 rc 0/0
00000100:00100000:0.0:1651532127.206743:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4214
00010000:00010000:0.0:1651532127.206751:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.206757:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.206758:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.206761:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.206766:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.206767:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.206767:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.206770:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.206781:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.206786:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f802 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->8093695] (req 2445312->8093695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.206813:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.206818:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.207166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.207181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.207187:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.207187:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468396736
00000100:00100000:1.0:1651532127.207196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.207202:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.207206:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468396800
00000100:00100000:0.0:1651532127.207214:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4223
00000100:00100000:0.0:1651532127.207215:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000207f99f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468396736:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532127.207216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.207227:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4224
00010000:00010000:0.0:1651532127.207227:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.207229:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d52bfd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468396800:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532127.207234:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532127.207236:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.207238:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.207238:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532127.207239:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.207243:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532127.207244:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.207247:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532127.207248:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.207252:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.207252:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.207255:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.207256:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.207263:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468396992
00000100:00100000:0.0:1651532127.207264:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468397056
00000100:00100000:0.0:1651532127.207268:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468396928
00000100:00100000:1.0:1651532127.207269:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468397120
00000100:00100000:0.0:1651532127.207271:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3484
00000100:00100000:0.0:1651532127.207273:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f651876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468397056:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532127.207274:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3485
00000100:00100000:1.0:1651532127.207276:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089209c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468396992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.207276:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.207278:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.207278:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f8f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a04d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.207281:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f8fe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a046 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.207286:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f8f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a04d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.207290:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f8f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a04d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.207296:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532127.207297:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f8fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a046 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.207302:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f8fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a046 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.207305:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:0.0:1651532127.207310:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f651876 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468397056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (114us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.207313:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3484
00000100:00100000:0.0:1651532127.207318:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3486
00000100:00100000:1.0:1651532127.207320:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089209c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468396992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (132us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.207320:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000460b2efd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468396928:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532127.207333:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3485
00010000:00010000:0.0:1651532127.207333:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532127.207338:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3487
00000100:00100000:1.0:1651532127.207340:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f8bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468397120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.207343:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.207344:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f905 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a03f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.207346:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f90c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a054 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.207351:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f905 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a03f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.207353:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f90c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a054 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.207355:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f905 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a03f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.207357:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f90c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a054 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.207359:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532127.207360:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:0.0:1651532127.207366:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000460b2efd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468396928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (164us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.207367:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f8bd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468397120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (151us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.207369:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3486
00000100:00100000:1.0:1651532127.207377:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3487
00000100:00100000:1.0:1651532127.207701:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.207713:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.207714:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468397312
00000100:00100000:1.0:1651532127.207721:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468397248
00000100:00100000:0.0:1651532127.207727:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3488
00000100:00100000:0.0:1651532127.207730:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e22cbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468397312:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532127.207737:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3489
00000100:00100000:1.0:1651532127.207740:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468397248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.207745:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.207749:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f913 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a05b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.207762:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.207763:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f913 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a05b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.207766:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f91a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a062 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.207767:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f913 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a05b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.207771:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00010000:00010000:0.0:1651532127.207775:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f91a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a062 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.207779:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f91a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a062 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532127.207781:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468397248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (67us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532127.207782:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532127.207784:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3489
00000100:00100000:0.0:1651532127.207791:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e22cbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468397312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.207794:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3488
00000100:00100000:1.0:1651532127.207833:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.207846:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468397568
00000100:00100000:0.0:1651532127.207854:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3490
00000100:00100000:0.0:1651532127.207855:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468397568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.207859:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.207862:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f921 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a069 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.207870:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f921 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a069 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.207877:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f921 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a069 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.207882:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532127.207896:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468397568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.207899:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3490
00000001:00080000:1.0:1651532127.331649:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793771 is committed
00010000:00010000:0.0:1651532127.331680:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.331685:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.331708:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468392896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482655us (482705us total) trans 158913793771 rc 0/0
00000100:00100000:0.0:1651532127.331711:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4215
00010000:00010000:0.0:1651532127.331718:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.331722:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.331723:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.331726:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.331731:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.331732:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.331732:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.331735:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.331746:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.331751:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40f825 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10158079] (req 643072->10158079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.331759:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.331764:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.332125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.332135:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.332136:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468397888
00000100:00100000:1.0:1651532127.332143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.332162:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468397824
00000100:00100000:0.0:1651532127.332165:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468398080
00000100:00100000:0.0:1651532127.332169:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3491
00000100:00100000:0.0:1651532127.332171:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3144eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468397888:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532127.332172:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3492
00000100:00100000:1.0:1651532127.332174:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083b26f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468397824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.332174:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.332178:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f928 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a077 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332179:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.332183:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f92f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a070 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.332184:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.332187:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f928 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a077 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.332189:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.332192:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f92f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a070 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.332192:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f928 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a077 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.332196:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f92f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a070 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.332198:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532127.332200:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:0.0:1651532127.332212:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3144eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468397888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.332215:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3491
00000100:00100000:1.0:1651532127.332217:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083b26f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468397824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.332220:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3492
00000100:00100000:0.0:1651532127.332222:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3493
00000100:00100000:0.0:1651532127.332223:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468398080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.332226:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.332228:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f936 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a07e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.332233:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.332235:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f936 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a07e expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.332239:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f936 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a07e expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.332242:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532127.332247:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468398080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (104us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.332250:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3493
00010000:00010000:0.0:1651532127.332261:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.332266:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.332290:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468392960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483231us (483271us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532127.332293:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4216
00010000:00010000:1.0:1651532127.332308:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332312:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532127.332313:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332317:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332332:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.332333:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.332334:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332339:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332351:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332354:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f82c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3010560->8278015] (req 3010560->8278015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332360:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332363:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.332868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.332891:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468398464
00000100:00100000:1.0:1651532127.332901:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.332903:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4225
00000100:00100000:0.0:1651532127.332905:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb1a7802 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468398464:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532127.332912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532127.332912:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.332917:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532127.332918:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532127.332918:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.332920:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468398400
00010000:00010000:0.0:1651532127.332922:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.332934:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4226
00000100:00100000:1.0:1651532127.332936:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f4fc3f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468398400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532127.332944:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.332944:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468398720
00010000:00010000:1.0:1651532127.332949:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532127.332950:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.332951:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3494
00000100:00100000:0.0:1651532127.332952:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000186dea31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468398720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.332953:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332955:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532127.332955:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.332956:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.332957:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f94b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a085 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332960:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.332965:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.332965:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f94b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a085 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.332968:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.332973:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f94b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a085 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.332976:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532127.332990:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000186dea31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468398720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.332993:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3494
00000001:00080000:1.0:1651532127.453278:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793772 is committed
00010000:00010000:1.0:1651532127.453293:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453297:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.453321:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ec70ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468394048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 537256us (537364us total) trans 158913793772 rc 0/0
00010000:00010000:0.0:1651532127.453322:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.453334:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4217
00010000:00010000:0.0:1651532127.453335:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.453336:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453339:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453345:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.453346:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.453347:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453350:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453353:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.453354:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.453355:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453358:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453367:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453371:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40f864 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10407935] (req 172032->10407935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453389:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453393:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453415:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453419:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.453700:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.453714:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468399104
00010000:00010000:1.0:1651532127.453716:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453720:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.453727:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3495
00000100:00100000:0.0:1651532127.453729:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba128a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468399104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.453738:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.453742:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f952 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a08c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.453743:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468394112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 537626us (537763us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532127.453747:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4218
00010000:00010000:0.0:1651532127.453747:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.453750:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f952 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a08c expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.453754:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40f952 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a08c expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.453757:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453757:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532127.453760:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.453766:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba128a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468399104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.453770:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007513dfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468395136:12345-10.240.43.64@tcp:3:fio.0 Request processed in 430000us (430054us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532127.453771:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3495
00000100:00100000:1.0:1651532127.453773:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4219
00010000:00010000:0.0:1651532127.453778:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453779:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453781:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532127.453782:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.453782:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453783:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453785:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453786:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453791:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453793:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.453793:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40f872 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->9437183] (req 1163264->9437183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453794:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.453794:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453797:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453820:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.453823:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f88e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->10031103] (req 0->10031103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453828:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.453832:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.454224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.454234:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.454241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.454253:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.454262:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.454262:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468399488
00000100:00100000:0.0:1651532127.454274:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468399360
00000100:00100000:0.0:1651532127.454277:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468399552
00000100:00100000:0.0:1651532127.454281:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3496
00000100:00100000:0.0:1651532127.454282:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a83fbab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468399488:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532127.454290:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.454299:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468399296
00010000:00010000:0.0:1651532127.454301:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.454305:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f959 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0a1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.454310:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468399232
00010000:00010000:0.0:1651532127.454313:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f959 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0a1 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532127.454320:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4227
00000100:00100000:1.0:1651532127.454322:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5946202 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468399296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532127.454333:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40f959 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0a1 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.454337:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532127.454347:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.454351:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a83fbab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468399488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.454354:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3496
00010000:00010000:1.0:1651532127.454359:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.454361:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.454364:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532127.454364:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.454369:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.454373:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.454381:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4228
00000100:00100000:0.0:1651532127.454381:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468399424
00000100:00100000:1.0:1651532127.454383:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac9b1854 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468399232:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532127.454385:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3497
00000100:00100000:0.0:1651532127.454387:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468399360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.454389:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.454390:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.454392:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532127.454393:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532127.454393:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f96e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a093 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.454394:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.454397:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.454399:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f96e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a093 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.454403:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40f96e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a093 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532127.454404:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3498
00000100:00100000:1.0:1651532127.454405:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a079a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468399552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.454408:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.454409:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532127.454410:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f975 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0a8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.454416:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468399360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (163us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532127.454418:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f975 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0a8 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532127.454418:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3497
00010000:00010000:1.0:1651532127.454422:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f975 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0a8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532127.454422:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3499
00000100:00100000:0.0:1651532127.454424:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b94b4005 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468399424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.454426:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00010000:00010000:0.0:1651532127.454426:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.454428:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f97c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a09a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.454433:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f97c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a09a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532127.454436:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a079a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468399552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (174us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532127.454437:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40f97c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a09a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532127.454439:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3498
00010000:00010000:0.0:1651532127.454440:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532127.454445:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b94b4005 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468399424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (155us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.454447:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3499
00000100:00100000:1.0:1651532127.454738:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.454751:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468399744
00000100:00100000:0.0:1651532127.454760:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3500
00000100:00100000:0.0:1651532127.454761:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1fc9b52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468399744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.454765:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.454768:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f983 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0af expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.454776:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f983 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0af expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.454780:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f983 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0af expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.454783:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532127.454799:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1fc9b52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468399744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.454816:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3500
00000100:00100000:1.0:1651532127.454852:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.454864:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468399872
00000100:00100000:0.0:1651532127.454872:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3501
00000100:00100000:0.0:1651532127.454874:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000005eb034c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468399872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.454877:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.454880:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f98a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0b6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.454887:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f98a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0b6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.454891:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f98a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0b6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.454894:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532127.454911:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000005eb034c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468399872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.454914:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3501
00000100:00100000:1.0:1651532127.455065:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.455077:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468400128
00000100:00100000:0.0:1651532127.455085:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3502
00000100:00100000:0.0:1651532127.455086:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005e86aa73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468400128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.455090:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.455093:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f991 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0bd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.455100:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f991 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0bd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.455104:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f991 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0bd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.455108:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532127.455124:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005e86aa73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468400128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.455126:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3502
00000100:00100000:1.0:1651532127.455173:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.455184:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468400256
00000100:00100000:0.0:1651532127.455192:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3503
00000100:00100000:0.0:1651532127.455194:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005259aa0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468400256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.455197:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.455200:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f998 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0c4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.455209:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f998 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0c4 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.455213:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f998 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0c4 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.455216:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532127.455230:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005259aa0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468400256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.455232:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3503
00000100:00100000:1.0:1651532127.455472:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.455483:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468400448
00000100:00100000:0.0:1651532127.455491:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3504
00000100:00100000:0.0:1651532127.455493:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f32eacfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468400448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.455496:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.455499:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f99f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0cb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.455506:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f99f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0cb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.455510:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f99f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0cb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.455514:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532127.455529:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f32eacfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468400448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.455532:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3504
00000001:00080000:1.0:1651532127.520061:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793773 is committed
00010000:00010000:0.0:1651532127.520095:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520099:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.520122:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468395008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 496348us (496393us total) trans 158913793773 rc 0/0
00000100:00100000:0.0:1651532127.520125:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4220
00010000:00010000:0.0:1651532127.520133:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520136:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.520137:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520140:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520145:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.520146:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.520147:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520150:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520161:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520166:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f895 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->6909951] (req 495616->6909951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520175:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520178:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.520525:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.520541:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468400704
00000100:00100000:1.0:1651532127.520553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.520561:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468400576
00000100:00100000:1.0:1651532127.520562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.520572:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.520579:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4229
00000100:00100000:0.0:1651532127.520581:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074dced3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468400704:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532127.520582:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4230
00000100:00100000:1.0:1651532127.520584:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a61ff77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468400576:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532127.520588:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.520593:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520593:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532127.520594:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520597:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532127.520597:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.520602:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532127.520603:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.520606:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532127.520607:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520610:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.520611:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520614:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.520615:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.520627:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468400832
00000100:00100000:1.0:1651532127.520634:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468400640
00000100:00100000:1.0:1651532127.520639:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3505
00000100:00100000:1.0:1651532127.520640:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7ce9547 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468400832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.520645:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.520647:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f9b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0d9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.520655:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f9b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0d9 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.520659:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f9b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0d9 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.520662:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532127.520673:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7ce9547 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468400832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.520676:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3505
00000100:00100000:0.0:1651532127.520679:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3506
00000100:00100000:0.0:1651532127.520681:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007f4a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468400640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.520685:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.520688:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f9bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0d2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.520696:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f9bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0d2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.520700:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f9bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0d2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.520703:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532127.520723:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007f4a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468400640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (149us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.520726:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3506
00000001:00080000:1.0:1651532127.620086:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793774 is committed
00002000:00010000:0.0:1651532127.620127:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532126 -> 1651532127
00010000:00010000:0.0:1651532127.620131:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620135:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.620162:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001186752c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468396160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 479649us (479753us total) trans 158913793774 rc 0/0
00000100:00100000:0.0:1651532127.620166:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4221
00010000:00010000:0.0:1651532127.620173:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620177:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.620178:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620181:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620186:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.620186:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.620187:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620190:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620197:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620202:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40f8d4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1507328->9711615] (req 1507328->9711615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.620213:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.620217:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.620470:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.620488:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.620488:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468401152
00000100:00100000:0.0:1651532127.620500:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468401280
00000100:00100000:0.0:1651532127.620507:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3507
00000100:00100000:0.0:1651532127.620509:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e51916f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468401152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.620510:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620513:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.620514:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620516:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f9c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0e0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620522:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.620525:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f9c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0e0 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.620529:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40f9c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0e0 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532127.620530:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2675e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468396224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 480008us (480111us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532127.620532:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532127.620533:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4222
00000100:00100000:0.0:1651532127.620540:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e51916f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468401152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.620541:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3508
00000100:00100000:1.0:1651532127.620543:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000406f95d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468401280:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532127.620543:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3507
00010000:00010000:1.0:1651532127.620546:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.620550:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f9c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0e7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.620555:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.620557:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.620558:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f9c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0e7 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.620560:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532127.620562:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40f9c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0e7 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.620562:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620565:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.620566:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532127.620572:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000406f95d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468401280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (84us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532127.620572:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.620572:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.620573:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.620575:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3508
00010000:00010000:0.0:1651532127.620576:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620583:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620586:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40f8db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->9109503] (req 221184->9109503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620591:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620594:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.620862:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.620870:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.620880:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468401408
00000100:00100000:1.0:1651532127.620893:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4231
00000100:00100000:0.0:1651532127.620894:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468401472
00000100:00100000:1.0:1651532127.620895:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a80344f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468401408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532127.620902:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.620906:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532127.620907:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.620908:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4232
00010000:00010000:1.0:1651532127.620910:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.620911:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca8573fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468401472:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532127.620913:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532127.620913:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.620918:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.620921:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.620924:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.620971:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.620972:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532127.620977:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532127.620979:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.620981:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532127.620981:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532127.620982:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.620991:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468401600
00010000:00010000:0.0:1651532127.620994:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.620999:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468401536
00010000:00010000:0.0:1651532127.621002:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.621006:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3509
00000100:00100000:1.0:1651532127.621007:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000711d02d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468401600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.621010:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.621014:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f9de lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0f5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.621016:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3510
00000100:00100000:0.0:1651532127.621019:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468401536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.621021:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f9de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0f5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.621022:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.621025:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40f9de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0f5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.621025:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f9e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0ee expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.621029:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532127.621033:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f9e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0ee expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.621037:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40f9e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0ee expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532127.621038:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000711d02d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468401600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (66us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532127.621040:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532127.621041:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3509
00000100:00100000:0.0:1651532127.621050:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468401536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.621054:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3510
00000100:00100000:1.0:1651532127.621331:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.621349:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468401920
00000100:00100000:0.0:1651532127.621358:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3511
00000100:00100000:0.0:1651532127.621360:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468401920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.621363:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.621367:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f9ec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a0fc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.621374:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f9ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0fc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.621378:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40f9ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a0fc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.621381:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532127.621397:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468401920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.621400:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3511
00000100:00100000:1.0:1651532127.621635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.621646:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468402048
00000100:00100000:0.0:1651532127.621655:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3512
00000100:00100000:0.0:1651532127.621656:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef0e4aff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468402048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.621659:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.621663:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f9f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a103 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.621670:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f9f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a103 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.621674:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f9f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a103 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.621678:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532127.621694:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef0e4aff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468402048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.621696:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3512
00000001:00080000:1.0:1651532127.711752:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793775 is committed
00010000:00010000:0.0:1651532127.711782:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711787:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.711821:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000207f99f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468396736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 504605us (504655us total) trans 158913793775 rc 0/0
00000100:00100000:0.0:1651532127.711825:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4223
00010000:00010000:0.0:1651532127.711832:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711835:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.711837:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711839:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711849:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.711849:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.711851:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711856:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711862:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.711862:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.711863:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711866:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711880:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711883:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40f8e9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->9330687] (req 425984->9330687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711889:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.711892:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.711893:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.711897:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.712096:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.712136:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468402176
00000100:00100000:0.0:1651532127.712147:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3513
00000100:00100000:0.0:1651532127.712148:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4432ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468402176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.712152:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.712156:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f9fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a10a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712162:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.712164:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f9fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a10a expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.712168:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40f9fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a10a expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.712171:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532127.712186:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4432ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468402176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.712189:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3513
00010000:00010000:0.0:1651532127.712201:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712205:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.712225:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb1a7802 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468398464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 379318us (379358us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532127.712229:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4225
00010000:00010000:1.0:1651532127.712232:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712236:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.712239:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712244:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.712245:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712254:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712260:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.712262:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d52bfd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468396800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 505033us (505081us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532127.712263:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40f93d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->9015295] (req 626688->9015295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.712266:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4224
00010000:00010000:0.0:1651532127.712266:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712269:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.712270:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712273:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712276:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.712277:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.712277:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712283:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712292:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712297:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40f8f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3715072->7032831] (req 3715072->7032831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.712309:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.712313:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.712814:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.712823:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.712836:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468402432
00000100:00100000:1.0:1651532127.712837:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.712846:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.712855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.712857:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468402496
00000100:00100000:0.0:1651532127.712870:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4233
00000100:00100000:0.0:1651532127.712872:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060027dfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468402432:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532127.712873:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4234
00000100:00100000:1.0:1651532127.712875:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6757c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468402496:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532127.712888:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712888:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712893:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532127.712894:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712896:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532127.712897:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.712901:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532127.712902:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.712908:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532127.712908:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712912:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.712913:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.712916:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712916:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.712925:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468402560
00000100:00100000:0.0:1651532127.712926:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468402688
00000100:00100000:0.0:1651532127.712935:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468402880
00000100:00100000:0.0:1651532127.712938:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3514
00000100:00100000:0.0:1651532127.712940:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c75e9d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468402688:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532127.712943:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3515
00010000:00010000:0.0:1651532127.712943:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532127.712944:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b5a93ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468402560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.712945:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fa0f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a118 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.712947:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.712950:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa16 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a111 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712952:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fa0f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a118 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.712957:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fa0f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a118 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.712958:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa16 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a111 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.712961:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532127.712963:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa16 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a111 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.712966:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:0.0:1651532127.712971:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c75e9d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468402688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (125us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.712974:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3514
00000100:00100000:1.0:1651532127.712975:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b5a93ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468402560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.712979:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3516
00000100:00100000:1.0:1651532127.712980:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3515
00000100:00100000:0.0:1651532127.712980:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468402880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.712983:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.712985:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fa1d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a11f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.712990:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fa1d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a11f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.712994:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fa1d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a11f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.712997:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532127.713003:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468402880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (148us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.713005:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3516
00000100:00100000:1.0:1651532127.713251:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.713263:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468403008
00000100:00100000:0.0:1651532127.713275:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3517
00000100:00100000:0.0:1651532127.713276:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e688b703 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468403008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.713280:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.713284:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa24 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a126 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.713291:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa24 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a126 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.713295:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa24 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a126 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.713298:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532127.713309:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e688b703 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468403008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.713311:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3517
00000001:00080000:1.0:1651532127.770190:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793776 is committed
00002000:00010000:1.0:1651532127.770204:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532126 -> 1651532127
00010000:00010000:1.0:1651532127.770207:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770211:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.770234:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f4fc3f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468398400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 437297us (437333us total) trans 158913793776 rc 0/0
00010000:00010000:0.0:1651532127.770236:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.770237:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4226
00010000:00010000:0.0:1651532127.770241:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.770242:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770245:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770251:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.770252:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.770252:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770256:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770259:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.770259:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.770260:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770263:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770271:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770275:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40f944 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1277952->10338303] (req 1277952->10338303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770280:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770285:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770289:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770293:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.770649:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.770668:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.770672:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468403328
00000100:00100000:0.0:1651532127.770676:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.770681:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.770682:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468403392
00000100:00100000:1.0:1651532127.770700:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4235
00000100:00100000:1.0:1651532127.770702:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079cbb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468403328:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532127.770703:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532127.770714:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.770714:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4236
00000100:00100000:0.0:1651532127.770716:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2cc2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468403392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532127.770719:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532127.770720:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770723:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532127.770724:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770724:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770728:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770729:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532127.770730:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770733:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532127.770734:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770737:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770738:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770745:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770748:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770752:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.770770:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5946202 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468399296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316448us (316547us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532127.770773:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4227
00000100:00100000:1.0:1651532127.770781:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468403520
00000100:00100000:1.0:1651532127.770786:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468403456
00000100:00100000:1.0:1651532127.770788:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468403648
00000100:00100000:1.0:1651532127.770791:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3518
00000100:00100000:1.0:1651532127.770793:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b720e370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468403520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.770796:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.770799:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fa39 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a134 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770819:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fa39 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a134 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.770829:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fa39 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a134 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.770833:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00010000:00010000:0.0:1651532127.770835:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.770839:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532127.770840:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b720e370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468403520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (164us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532127.770840:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.770842:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3518
00010000:00010000:0.0:1651532127.770843:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.770847:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3519
00000100:00100000:1.0:1651532127.770849:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000724d966c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468403456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.770849:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770851:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.770852:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40f960 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7049216->7528447] (req 7049216->7528447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770854:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa40 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a12d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.770859:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa40 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a12d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532127.770860:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3520
00000100:00100000:0.0:1651532127.770862:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d43c04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468403648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.770863:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa40 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a12d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.770865:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.770866:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532127.770868:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fa47 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a13b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.770871:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000724d966c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468403456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (189us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532127.770875:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fa47 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a13b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.770879:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fa47 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a13b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532127.770883:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3519
00010000:00010000:0.0:1651532127.770883:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532127.770892:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d43c04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468403648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (189us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.770894:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3520
00000100:00100000:0.0:1651532127.771267:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.771275:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.771289:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468403776
00000100:00100000:1.0:1651532127.771294:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468403840
00000100:00100000:0.0:1651532127.771300:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3521
00000100:00100000:0.0:1651532127.771302:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018bbbca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468403776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.771305:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532127.771307:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3522
00000100:00100000:1.0:1651532127.771309:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468403840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.771309:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fa4e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a142 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.771312:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.771315:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa55 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a149 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.771316:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fa4e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a142 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.771320:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fa4e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a142 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.771331:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa55 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a149 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.771333:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532127.771336:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa55 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a149 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.771339:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:0.0:1651532127.771346:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018bbbca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468403776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.771351:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3521
00000100:00100000:1.0:1651532127.771353:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468403840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.771356:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3522
00000100:00100000:0.0:1651532127.771654:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.771673:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468404032
00000100:00100000:1.0:1651532127.771681:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3523
00000100:00100000:1.0:1651532127.771683:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468404032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.771686:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.771689:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fa5c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a150 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.771696:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fa5c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a150 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.771709:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fa5c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a150 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.771712:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532127.771723:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468404032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.771725:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3523
00000001:00080000:1.0:1651532127.903502:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793777 is committed
00010000:00010000:0.0:1651532127.903535:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903540:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.903559:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac9b1854 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468399232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449175us (449325us total) trans 158913793777 rc 0/0
00000100:00100000:0.0:1651532127.903562:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4228
00010000:00010000:0.0:1651532127.903569:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903572:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532127.903573:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903576:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903581:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.903582:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532127.903583:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903586:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903595:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903598:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40f967 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2469888->6709247] (req 2469888->6709247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903603:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903606:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903843:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.903848:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.903866:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074dced3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468400704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 383284us (383342us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532127.903869:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4229
00010000:00010000:1.0:1651532127.903900:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.903905:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532127.903906:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.903910:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.903916:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.903916:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532127.903917:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.903920:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.903928:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.903939:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40f9a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8912895] (req 77824->8912895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.903945:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.903948:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.904030:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.904065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.904073:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.904080:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468404544
00000100:00100000:1.0:1651532127.904088:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3524
00000100:00100000:1.0:1651532127.904090:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ec70ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468404544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.904094:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.904097:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fa63 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a15e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904105:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fa63 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a15e expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.904109:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fa63 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a15e expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.904112:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532127.904132:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ec70ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468404544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.904134:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3524
00000100:00100000:1.0:1651532127.904142:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468404352
00000100:00100000:1.0:1651532127.904149:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468404288
00000100:00100000:1.0:1651532127.904158:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4237
00000100:00100000:1.0:1651532127.904160:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d2f345e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468404352:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532127.904166:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904170:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532127.904171:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532127.904172:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904175:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.904190:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4238
00000100:00100000:1.0:1651532127.904192:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6a8a35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468404288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532127.904197:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904200:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532127.904201:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904203:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904207:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532127.904207:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904211:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904214:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904218:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532127.904269:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.904277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.904350:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468404608
00000100:00100000:1.0:1651532127.904358:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468404480
00000100:00100000:1.0:1651532127.904368:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3525
00000100:00100000:1.0:1651532127.904370:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468404608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.904373:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.904377:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fa78 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a165 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532127.904380:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3526
00000100:00100000:0.0:1651532127.904382:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468404480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.904384:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fa78 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a165 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.904386:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.904388:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fa78 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a165 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.904391:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fa7f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a157 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904392:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00010000:00010000:0.0:1651532127.904401:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fa7f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a157 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532127.904402:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468404608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.904405:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3525
00010000:00010000:0.0:1651532127.904406:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fa7f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a157 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.904409:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532127.904418:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468404480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (141us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.904421:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3526
00000100:00100000:0.0:1651532127.904541:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.904549:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468404864
00000100:00100000:0.0:1651532127.904564:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3527
00000100:00100000:0.0:1651532127.904566:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468404864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532127.904570:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.904573:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fa86 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a16c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.904581:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fa86 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a16c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.904585:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fa86 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a16c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.904588:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532127.904601:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468404864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.904604:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3527
00000100:00100000:0.0:1651532127.904850:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532127.904858:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532127.904868:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468405056
00000100:00100000:0.0:1651532127.904869:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468405184
00000100:00100000:1.0:1651532127.904882:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3528
00000100:00100000:1.0:1651532127.904884:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468405056:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532127.904884:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3529
00000100:00100000:0.0:1651532127.904886:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468405184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532127.904887:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532127.904890:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fa8d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a173 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532127.904890:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532127.904893:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa94 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a17a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532127.904898:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fa8d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a173 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.904901:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa94 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a17a expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.904902:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fa8d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a173 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532127.904905:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00010000:00010000:0.0:1651532127.904905:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa94 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a17a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532127.904909:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532127.904916:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468405056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532127.904917:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468405184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532127.904918:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3528
00000100:00100000:0.0:1651532127.904920:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3529
00000001:00080000:1.0:1651532128.011862:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793778 is committed
00010000:00010000:1.0:1651532128.011878:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.011893:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.011915:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a61ff77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468400576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491330us (491361us total) trans 158913793778 rc 0/0
00000100:00100000:1.0:1651532128.011918:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4230
00010000:00010000:0.0:1651532128.011918:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.011923:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.011924:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.011928:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.011934:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.011934:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.011935:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.011938:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.011948:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.011951:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40f9ad lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->5902335] (req 868352->5902335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.011963:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.011967:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.012290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.012297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.012309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.012311:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468405376
00000100:00100000:0.0:1651532128.012333:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468405440
00000100:00100000:0.0:1651532128.012341:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4239
00000100:00100000:0.0:1651532128.012343:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468405376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532128.012350:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.012355:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.012356:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.012362:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532128.012362:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.012367:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.012370:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.012377:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4240
00000100:00100000:0.0:1651532128.012379:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468405440:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532128.012385:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.012389:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468405696
00010000:00010000:0.0:1651532128.012389:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.012390:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.012392:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532128.012393:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.012396:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.012398:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3530
00010000:00010000:0.0:1651532128.012399:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.012400:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468405696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.012404:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.012408:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40faa9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a181 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.012415:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40faa9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a181 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.012420:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40faa9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a181 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.012432:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532128.012443:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468405696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.012446:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3530
00000001:00080000:1.0:1651532128.128490:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793779 is committed
00010000:00010000:1.0:1651532128.128505:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.128509:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.128525:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a80344f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468401408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507630us (507664us total) trans 158913793779 rc 0/0
00000100:00100000:1.0:1651532128.128529:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4231
00010000:00010000:1.0:1651532128.128535:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.128538:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532128.128539:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.128542:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.128547:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532128.128548:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532128.128549:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.128552:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.128564:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.128567:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40f9d0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9158655] (req 405504->9158655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128576:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128581:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128759:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128764:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.128786:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca8573fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468401472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 507874us (507915us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532128.128789:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4232
00010000:00010000:0.0:1651532128.128796:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128799:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.128801:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128818:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128826:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.128827:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.128828:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128831:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128839:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128842:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40f9d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->6799359] (req 684032->6799359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128848:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.128851:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.128921:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.128928:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468405888
00000100:00100000:1.0:1651532128.128943:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3531
00000100:00100000:1.0:1651532128.128944:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468405888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.128948:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.128952:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fab0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a188 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.128960:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fab0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a188 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.128964:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fab0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a188 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.128967:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532128.128977:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468405888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.128980:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3531
00000100:00100000:1.0:1651532128.129057:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.129067:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.129074:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.129081:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468406016
00000100:00100000:1.0:1651532128.129089:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468406080
00000100:00100000:1.0:1651532128.129097:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4241
00000100:00100000:1.0:1651532128.129099:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468406016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532128.129106:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.129110:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532128.129111:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.129114:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532128.129115:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.129119:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.129122:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.129129:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4242
00000100:00100000:0.0:1651532128.129131:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468406080:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532128.129133:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468405952
00000100:00100000:1.0:1651532128.129141:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3532
00000100:00100000:1.0:1651532128.129143:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468405952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.129146:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532128.129146:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.129148:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fac5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a18f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.129150:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.129151:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532128.129152:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.129157:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.129158:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fac5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a18f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.129162:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fac5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a18f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.129165:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532128.129175:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468405952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.129178:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3532
00000100:00100000:1.0:1651532128.129261:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.129268:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468406272
00000100:00100000:1.0:1651532128.129278:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3533
00000100:00100000:1.0:1651532128.129280:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468406272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.129284:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.129287:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40facc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a196 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.129294:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40facc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a196 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.129298:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40facc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a196 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.129301:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532128.129310:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468406272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.129313:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3533
00000100:00100000:1.0:1651532128.129445:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.129452:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468406464
00000100:00100000:1.0:1651532128.129463:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3534
00000100:00100000:1.0:1651532128.129464:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468406464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.129467:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.129471:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fad3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a19d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.129478:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fad3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a19d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.129482:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fad3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a19d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.129485:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532128.129494:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468406464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.129496:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3534
00000001:00080000:1.0:1651532128.236860:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793780 is committed
00010000:00010000:0.0:1651532128.236891:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.236895:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.236919:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060027dfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468402432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524045us (524105us total) trans 158913793780 rc 0/0
00000100:00100000:0.0:1651532128.236922:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4233
00010000:00010000:0.0:1651532128.236929:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.236933:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.236934:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.236937:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.236942:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.236942:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.236943:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.236946:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.236961:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.236967:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fa01 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [839680->10272767] (req 839680->10272767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.236972:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.236979:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.237215:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.237239:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.237254:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468406848
00010000:00010000:1.0:1651532128.237260:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.237264:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.237264:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468406784
00000100:00100000:0.0:1651532128.237273:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3535
00000100:00100000:0.0:1651532128.237275:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468406848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532128.237279:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532128.237283:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fada lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1ab expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.237284:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6757c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468402496:12345-10.240.43.64@tcp:3:fio.0 Request processed in 524408us (524460us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532128.237287:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4234
00010000:00010000:0.0:1651532128.237288:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.237291:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fada lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1ab expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.237294:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237296:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fada lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1ab expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.237298:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532128.237299:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237299:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532128.237302:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.237307:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532128.237307:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532128.237308:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.237308:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468406848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.237311:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3535
00010000:00010000:1.0:1651532128.237312:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.237315:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3536
00000100:00100000:0.0:1651532128.237317:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468406784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.237319:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237319:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.237321:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fa08 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [659456->8740863] (req 659456->8740863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237321:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fae1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1a4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237337:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fae1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1a4 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.237338:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.237341:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237341:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fae1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1a4 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.237345:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532128.237350:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468406784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.237353:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3536
00000100:00100000:1.0:1651532128.237825:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.237843:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.237856:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.237865:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.237866:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468407104
00000100:00100000:1.0:1651532128.237875:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468407168
00000100:00100000:0.0:1651532128.237878:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4243
00000100:00100000:0.0:1651532128.237880:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468407104:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532128.237886:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4244
00010000:00010000:0.0:1651532128.237887:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.237888:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468407168:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532128.237892:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.237893:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.237895:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237896:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237901:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532128.237902:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.237906:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532128.237907:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.237918:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532128.237919:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237923:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.237924:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237926:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.237928:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.237930:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.237936:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468407232
00000100:00100000:0.0:1651532128.237937:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468407360
00000100:00100000:1.0:1651532128.237946:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3537
00000100:00100000:1.0:1651532128.237948:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468407232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.237950:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532128.237952:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3538
00010000:00010000:1.0:1651532128.237953:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40faf6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1b2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.237954:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468407360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532128.237957:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532128.237959:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fafd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1b9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.237960:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40faf6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1b2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.237964:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40faf6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1b2 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.237966:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fafd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1b9 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.237968:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00010000:00010000:0.0:1651532128.237971:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fafd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1b9 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.237977:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532128.237978:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468407232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.237985:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468407360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (120us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.237988:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3538
00000100:00100000:1.0:1651532128.237990:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3537
00000001:00080000:1.0:1651532128.336903:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793781 is committed
00010000:00010000:1.0:1651532128.336918:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.336922:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.336945:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079cbb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468403328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566242us (566296us total) trans 158913793781 rc 0/0
00000100:00100000:1.0:1651532128.336948:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4235
00010000:00010000:0.0:1651532128.336951:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.336955:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.336957:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.336960:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.336966:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.336966:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.336967:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.336970:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.336973:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.336974:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.336975:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.336978:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.336995:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.336999:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fa2b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10047487] (req 1318912->10047487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337003:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337005:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337008:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337008:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.337370:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.337382:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468407744
00010000:00010000:1.0:1651532128.337395:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.337400:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3539
00000100:00100000:0.0:1651532128.337402:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468407744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.337405:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337406:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532128.337420:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb04 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1c0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.337422:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d2f345e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468404352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433261us (433392us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532128.337425:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4237
00010000:00010000:0.0:1651532128.337427:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.337430:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb04 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1c0 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.337434:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb04 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1c0 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.337440:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532128.337449:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468407744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.337453:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3539
00010000:00010000:0.0:1651532128.337468:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337474:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337490:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337495:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532128.337499:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.337499:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2cc2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468403392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566782us (566830us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532128.337502:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4236
00010000:00010000:1.0:1651532128.337503:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337509:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337512:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fa6a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [700416->9453567] (req 700416->9453567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337514:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337519:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.337521:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337525:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337554:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.337555:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.337556:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337559:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337573:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337576:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fa32 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3739648->10166271] (req 3739648->10166271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337581:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337586:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.337874:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.337884:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.337888:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468407936
00000100:00100000:1.0:1651532128.337891:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.337900:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.337907:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468408064
00000100:00100000:0.0:1651532128.337913:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4245
00000100:00100000:0.0:1651532128.337915:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468407936:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532128.337916:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4246
00000100:00100000:1.0:1651532128.337918:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468408064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532128.337923:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337927:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337927:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.337928:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337931:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532128.337932:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337935:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532128.337936:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337939:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532128.337940:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337944:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337945:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337948:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.337948:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.337956:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468408192
00000100:00100000:0.0:1651532128.337956:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468408320
00000100:00100000:0.0:1651532128.337962:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3540
00000100:00100000:1.0:1651532128.337968:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3541
00000100:00100000:0.0:1651532128.337969:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468408320:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532128.337970:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468408192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532128.337972:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.337973:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532128.337975:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fb19 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1ce expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337976:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fb20 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1c7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.337984:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fb20 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1c7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.337984:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fb19 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1ce expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.337988:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fb19 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1ce expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.337989:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fb20 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1c7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.337991:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532128.338000:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:0.0:1651532128.338006:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468408320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.338008:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3540
00000100:00100000:1.0:1651532128.338016:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468408192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (124us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.338019:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3541
00000100:00100000:1.0:1651532128.338364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.338386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.338406:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468408512
00000100:00100000:0.0:1651532128.338409:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468408576
00000100:00100000:1.0:1651532128.338417:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3542
00000100:00100000:1.0:1651532128.338419:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468408512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.338423:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532128.338423:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3543
00000100:00100000:0.0:1651532128.338425:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008675f510 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468408576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.338427:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb27 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1d5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.338428:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532128.338433:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb2e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1dc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.338434:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1d5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.338438:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1d5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.338441:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb2e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1dc expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.338442:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532128.338445:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb2e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1dc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.338448:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532128.338452:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468408512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.338454:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3542
00000100:00100000:0.0:1651532128.338456:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008675f510 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468408576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.338459:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3543
00000001:00080000:1.0:1651532128.526947:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793782 is committed
00010000:00010000:1.0:1651532128.526961:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.526973:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.526995:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6a8a35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468404288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 622802us (622930us total) trans 158913793782 rc 0/0
00000100:00100000:1.0:1651532128.526998:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4238
00010000:00010000:0.0:1651532128.527007:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527013:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.527014:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527017:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527026:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.527027:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.527028:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527034:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527046:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527053:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fa71 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->10276863] (req 184320->10276863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527059:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527062:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.527444:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.527453:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.527471:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.527481:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.527491:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468408832
00000100:00100000:1.0:1651532128.527504:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468408896
00000100:00100000:1.0:1651532128.527511:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4247
00000100:00100000:1.0:1651532128.527513:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468408832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532128.527522:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.527528:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532128.527529:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.527532:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532128.527533:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.527538:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.527540:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4248
00000100:00100000:0.0:1651532128.527542:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468408896:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532128.527544:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527550:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527555:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.527556:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.527558:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468408960
00010000:00010000:0.0:1651532128.527559:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532128.527560:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.527564:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.527567:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468409024
00000100:00100000:1.0:1651532128.527572:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3544
00000100:00100000:1.0:1651532128.527574:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468408960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532128.527575:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.527577:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.527580:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fb43 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1e3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.527585:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3545
00000100:00100000:0.0:1651532128.527587:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468409024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.527589:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fb43 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1e3 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.527589:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532128.527592:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fb4a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1ea expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.527593:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fb43 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1e3 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.527597:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532128.527599:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fb4a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1ea expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.527603:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fb4a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1ea expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.527607:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532128.527608:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468408960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.527611:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3544
00000100:00100000:0.0:1651532128.527616:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468409024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.527619:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3545
00000001:00080000:1.0:1651532128.621459:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793783 is committed
00010000:00010000:0.0:1651532128.621490:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621494:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.621514:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468405376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 609170us (609224us total) trans 158913793783 rc 0/0
00010000:00010000:1.0:1651532128.621517:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.621517:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4239
00010000:00010000:1.0:1651532128.621522:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532128.621523:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.621527:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.621532:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532128.621533:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532128.621534:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.621537:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.621546:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.621550:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fa9b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->9723903] (req 1339392->9723903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621557:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621561:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.621849:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532128.621865:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621868:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.621888:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468405440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 609508us (609591us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532128.621891:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4240
00010000:00010000:0.0:1651532128.621909:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621919:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.621920:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621923:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621929:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.621929:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.621930:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.621931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532128.621933:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621937:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.621937:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.621938:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.621940:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532128.621940:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.621947:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468409472
00010000:00010000:0.0:1651532128.621951:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621954:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40faa2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->9162751] (req 1052672->9162751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.621961:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468409344
00000100:00100000:0.0:1651532128.621962:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468409536
00000100:00100000:1.0:1651532128.621964:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3546
00000100:00100000:1.0:1651532128.621966:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468409472:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532128.621968:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3547
00010000:00010000:1.0:1651532128.621970:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532128.621970:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468409344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532128.621973:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.621974:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fb51 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1f8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621976:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fb58 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1f1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.621983:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fb58 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1f1 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.621985:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fb51 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1f8 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.621989:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fb51 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1f8 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.621990:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fb58 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1f1 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.621993:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532128.621994:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532128.622003:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468409472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (155us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.622003:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468409344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.622006:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3547
00000100:00100000:1.0:1651532128.622007:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3546
00000100:00100000:0.0:1651532128.622010:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3548
00000100:00100000:0.0:1651532128.622012:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468409536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.622014:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.622014:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532128.622016:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fb5f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a1ff expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622018:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.622021:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fb5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1ff expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.622025:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fb5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a1ff expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.622028:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532128.622032:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468409536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.622034:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3548
00010000:00010000:0.0:1651532128.622040:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.622044:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.622069:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.622073:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.622086:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468406080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 492954us (493019us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532128.622089:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4242
00010000:00010000:0.0:1651532128.622094:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.622098:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532128.622098:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.622099:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.622102:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.622114:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.622116:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fabe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8810496->8814591] (req 8810496->8814591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.622130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.622145:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468409728
00000100:00100000:0.0:1651532128.622154:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468409664
00000100:00100000:0.0:1651532128.622161:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4249
00000100:00100000:0.0:1651532128.622163:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468409728:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532128.622169:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4250
00010000:00010000:0.0:1651532128.622169:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.622171:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468409664:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532128.622173:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.622174:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.622177:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622179:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622184:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532128.622185:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622190:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622199:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532128.622200:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622205:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622208:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622218:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.622395:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.622417:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468409856
00000100:00100000:1.0:1651532128.622425:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3549
00000100:00100000:1.0:1651532128.622427:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468409856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.622431:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.622434:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fb74 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a206 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622442:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fb74 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a206 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.622449:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fb74 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a206 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.622453:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532128.622463:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468409856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.622466:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3549
00000100:00100000:0.0:1651532128.622470:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.622486:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468409920
00000100:00100000:1.0:1651532128.622500:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3550
00000100:00100000:1.0:1651532128.622502:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468409920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.622505:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.622508:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fb7b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a20d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622514:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fb7b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a20d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.622518:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fb7b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a20d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.622522:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532128.622533:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468409920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.622536:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3550
00000100:00100000:1.0:1651532128.622704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.622711:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468410176
00000100:00100000:1.0:1651532128.622717:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3551
00000100:00100000:1.0:1651532128.622719:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468410176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.622722:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.622725:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fb82 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a214 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622732:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fb82 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a214 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.622735:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fb82 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a214 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.622739:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532128.622751:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468410176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.622754:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3551
00000100:00100000:1.0:1651532128.622937:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.622944:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468410432
00000100:00100000:1.0:1651532128.622949:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3552
00000100:00100000:1.0:1651532128.622951:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468410432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.622954:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.622957:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb89 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a21b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.622964:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a21b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.622968:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a21b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.622971:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532128.622983:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468410432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.622986:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3552
00000001:00080000:1.0:1651532128.754798:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793784 is committed
00002000:00010000:1.0:1651532128.754827:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532127 -> 1651532128
00002000:00010000:1.0:1651532128.754828:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532127 -> 1651532128
00010000:00010000:1.0:1651532128.754831:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.754835:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.754852:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468406016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 625752us (625795us total) trans 158913793784 rc 0/0
00000100:00100000:1.0:1651532128.754855:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4241
00010000:00010000:1.0:1651532128.754862:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.754865:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532128.754866:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.754872:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.754877:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532128.754877:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532128.754878:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.754881:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.754894:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.754897:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fab7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->6230015] (req 638976->6230015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.754907:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.754912:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.755291:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.755304:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468410624
00000100:00100000:0.0:1651532128.755304:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.755313:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468410752
00000100:00100000:1.0:1651532128.755319:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4251
00000100:00100000:1.0:1651532128.755321:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468410624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532128.755339:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.755345:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4252
00000100:00100000:0.0:1651532128.755347:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468410752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532128.755350:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532128.755351:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.755354:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532128.755355:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.755362:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.755368:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.755369:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.755372:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532128.755373:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.755376:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.755377:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.755380:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.755381:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532128.879811:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793785 is committed
00010000:00010000:0.0:1651532128.879844:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.879849:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.879872:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468407104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 641991us (642072us total) trans 158913793785 rc 0/0
00000100:00100000:0.0:1651532128.879876:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4243
00010000:00010000:0.0:1651532128.879883:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.879889:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.879891:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.879893:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.879899:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.879899:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.879900:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.879903:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.879915:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.879920:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fae8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->10297343] (req 1073152->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.879925:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.879930:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.880197:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.880205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.880235:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468411072
00000100:00100000:1.0:1651532128.880248:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468411136
00000100:00100000:1.0:1651532128.880253:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3553
00000100:00100000:1.0:1651532128.880255:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468411072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.880259:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532128.880260:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3554
00000100:00100000:0.0:1651532128.880262:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468411136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.880263:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fb9e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a222 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880267:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.880269:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.880271:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fba5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a229 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.880272:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fb9e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a222 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.880279:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.880282:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fba5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a229 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.880287:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fb9e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a222 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.880287:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fba5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a229 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.880290:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532128.880291:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:0.0:1651532128.880301:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468411136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.880302:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468411072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.880304:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3554
00000100:00100000:1.0:1651532128.880306:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3553
00010000:00010000:1.0:1651532128.880321:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.880336:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880353:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880360:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.880361:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.880362:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468407168:12345-10.240.43.64@tcp:3:fio.0 Request processed in 642474us (642519us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532128.880365:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.880366:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4244
00010000:00010000:0.0:1651532128.880370:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.880371:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.880372:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880375:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880383:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880386:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40faef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1912832->8794111] (req 1912832->8794111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880392:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880397:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.880592:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.880599:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468411264
00000100:00100000:1.0:1651532128.880606:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3555
00000100:00100000:1.0:1651532128.880607:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468411264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.880611:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.880614:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fbac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a230 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.880622:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fbac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a230 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.880626:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fbac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a230 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.880630:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532128.880639:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468411264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.880642:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3555
00000100:00100000:1.0:1651532128.880875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.880885:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.880899:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468411456
00000100:00100000:1.0:1651532128.880905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.880911:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468411520
00000100:00100000:1.0:1651532128.880915:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4253
00000100:00100000:1.0:1651532128.880917:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468411456:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532128.880925:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4254
00000100:00100000:0.0:1651532128.880927:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468411520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532128.880933:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880934:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880939:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.880940:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.880944:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532128.880945:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.880949:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.880951:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532128.880952:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.880958:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.880959:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.880963:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.880966:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.880974:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468411584
00000100:00100000:1.0:1651532128.880982:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3556
00000100:00100000:1.0:1651532128.880984:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468411584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.881003:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.881006:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fbc1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a237 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.881015:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fbc1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a237 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.881019:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fbc1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a237 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.881023:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532128.881036:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468411584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (131us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.881041:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3556
00000001:00080000:1.0:1651532128.996520:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793786 is committed
00010000:00010000:0.0:1651532128.996552:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.996557:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.996578:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468407936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 658661us (658704us total) trans 158913793786 rc 0/0
00010000:00010000:1.0:1651532128.996580:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.996581:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4245
00010000:00010000:1.0:1651532128.996585:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532128.996586:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.996590:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.996595:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532128.996596:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532128.996597:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.996600:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.996608:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.996611:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fb0b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->9629695] (req 86016->9629695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.996617:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.996623:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.996954:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.996967:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.996975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.996983:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468411968
00000100:00100000:1.0:1651532128.996995:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468412096
00000100:00100000:1.0:1651532128.996998:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468412160
00010000:00010000:0.0:1651532128.996999:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.997002:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3557
00010000:00010000:0.0:1651532128.997003:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.997004:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468411968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.997008:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.997011:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fbc8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a23e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.997017:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532128.997018:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468408064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 659099us (659133us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532128.997020:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fbc8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a23e expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532128.997021:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4246
00010000:00010000:1.0:1651532128.997024:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fbc8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a23e expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.997028:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00010000:00010000:0.0:1651532128.997028:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.997034:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532128.997035:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.997037:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468411968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (84us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532128.997038:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.997040:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3557
00010000:00010000:0.0:1651532128.997043:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532128.997044:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3558
00010000:00010000:0.0:1651532128.997044:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532128.997044:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.997046:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468412096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532128.997047:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.997048:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.997050:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fbcf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a245 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.997058:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.997062:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fb12 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5730304->8335359] (req 5730304->8335359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.997064:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fbcf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a245 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.997068:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fbcf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a245 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532128.997069:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3559
00010000:00010000:1.0:1651532128.997071:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:0.0:1651532128.997071:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468412160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532128.997075:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532128.997077:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468412096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (111us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532128.997078:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fbd6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a24c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532128.997080:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3558
00010000:00010000:1.0:1651532128.997088:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.997088:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fbd6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a24c expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.997091:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.997093:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fbd6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a24c expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.997096:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532128.997103:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468412160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532128.997106:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3559
00000100:00100000:0.0:1651532128.997576:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.997593:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.997602:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.997612:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468412544
00000100:00100000:0.0:1651532128.997612:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532128.997620:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468412352
00000100:00100000:1.0:1651532128.997621:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468412480
00000100:00100000:1.0:1651532128.997625:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3560
00000100:00100000:1.0:1651532128.997627:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468412544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.997630:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532128.997630:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468412416
00010000:00010000:1.0:1651532128.997634:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fbdd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a25a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.997635:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4255
00000100:00100000:0.0:1651532128.997637:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468412352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532128.997641:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fbdd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a25a expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.997644:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.997646:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fbdd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a25a expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.997649:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00010000:00010000:0.0:1651532128.997649:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.997650:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.997653:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532128.997654:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.997658:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.997662:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532128.997669:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4256
00000100:00100000:1.0:1651532128.997673:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468412544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.997676:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3560
00000100:00100000:0.0:1651532128.997678:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468412416:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532128.997681:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3561
00000100:00100000:1.0:1651532128.997682:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468412480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532128.997682:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.997685:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532128.997686:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532128.997687:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.997688:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fbf2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a253 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.997689:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532128.997690:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.997695:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fbf2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a253 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532128.997695:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532128.997698:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.997699:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fbf2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a253 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.997702:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532128.997709:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468412480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.997711:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3561
00000100:00100000:0.0:1651532128.997974:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.997993:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468412800
00000100:00100000:1.0:1651532128.998001:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3562
00000100:00100000:1.0:1651532128.998002:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468412800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.998006:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.998008:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fbf9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a261 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.998018:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fbf9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a261 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.998022:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fbf9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a261 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.998025:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532128.998039:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468412800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.998041:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3562
00000100:00100000:0.0:1651532128.998263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.998281:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468412992
00000100:00100000:1.0:1651532128.998287:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3563
00000100:00100000:1.0:1651532128.998289:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468412992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.998292:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.998303:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fc00 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a268 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.998310:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fc00 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a268 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.998314:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fc00 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a268 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.998317:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532128.998338:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468412992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.998341:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3563
00000100:00100000:0.0:1651532128.998541:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532128.998558:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468413120
00000100:00100000:1.0:1651532128.998565:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3564
00000100:00100000:1.0:1651532128.998566:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b94b4005 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468413120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532128.998569:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532128.998572:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fc07 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a26f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532128.998579:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fc07 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a26f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.998583:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fc07 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a26f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532128.998586:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532128.998599:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b94b4005 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468413120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532128.998602:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3564
00000001:00080000:1.0:1651532129.129774:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793787 is committed
00010000:00010000:1.0:1651532129.129789:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.129793:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.129817:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.129823:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.129824:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.129828:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468408832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 602314us (602385us total) trans 158913793787 rc 0/0
00000100:00100000:1.0:1651532129.129832:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4247
00010000:00010000:0.0:1651532129.129833:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.129840:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.129840:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.129841:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.129844:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.129847:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.129848:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.129849:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.129851:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.129859:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.129865:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fb35 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->8642559] (req 438272->8642559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.129873:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.129876:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.129878:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.129880:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130196:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.130208:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532129.130227:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130232:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.130235:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.130240:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130249:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468409728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508085us (508151us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532129.130252:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4249
00010000:00010000:1.0:1651532129.130259:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130262:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532129.130263:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.130264:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468408896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 602721us (602810us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532129.130266:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.130268:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4248
00010000:00010000:0.0:1651532129.130276:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.130280:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.130283:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130284:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.130285:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130287:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fb66 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4722688->7028735] (req 4722688->7028735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.130293:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532129.130294:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468413376
00010000:00010000:0.0:1651532129.130294:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.130295:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.130298:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130301:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468413440
00000100:00100000:1.0:1651532129.130313:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3565
00010000:00010000:0.0:1651532129.130313:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130315:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468413376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.130316:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fb3c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [126976->8224767] (req 126976->8224767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130318:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.130321:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fc0e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a276 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.130336:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3566
00000100:00100000:0.0:1651532129.130339:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468413440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.130342:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fc0e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a276 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.130343:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.130346:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fc0e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a276 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.130346:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc15 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a27d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130349:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00010000:00010000:0.0:1651532129.130355:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc15 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a27d expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532129.130357:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468413376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (162us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532129.130359:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc15 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a27d expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532129.130360:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3565
00010000:00010000:0.0:1651532129.130362:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532129.130367:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.130371:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468413440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (163us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.130374:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3566
00010000:00010000:1.0:1651532129.130381:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.130780:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.130797:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.130824:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.130831:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468413760
00000100:00100000:1.0:1651532129.130840:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3567
00000100:00100000:0.0:1651532129.130840:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.130842:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000005eb034c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468413760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.130845:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.130849:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fc1c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a284 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.130849:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.130858:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468413632
00010000:00010000:1.0:1651532129.130863:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fc1c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a284 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.130867:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fc1c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a284 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532129.130871:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468413696
00010000:00010000:1.0:1651532129.130875:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:0.0:1651532129.130878:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4257
00000100:00100000:0.0:1651532129.130880:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1fc9b52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468413632:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532129.130885:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000005eb034c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468413760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (89us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532129.130887:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130888:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3567
00010000:00010000:0.0:1651532129.130892:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532129.130893:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468413888
00010000:00010000:0.0:1651532129.130893:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130896:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468413952
00010000:00010000:0.0:1651532129.130896:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532129.130896:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130899:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3568
00000100:00100000:1.0:1651532129.130900:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005259aa0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468413888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.130901:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130903:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.130904:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130906:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fc2a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a28b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130912:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fc2a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a28b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532129.130914:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4258
00010000:00010000:1.0:1651532129.130916:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fc2a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a28b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532129.130916:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005e86aa73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468413696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532129.130919:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00010000:00010000:0.0:1651532129.130921:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130924:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005259aa0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468413888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (84us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532129.130924:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532129.130925:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130926:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3568
00010000:00010000:0.0:1651532129.130927:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532129.130928:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130930:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3569
00010000:00010000:0.0:1651532129.130931:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.130932:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f32eacfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468413952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.130934:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.130934:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130935:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fc38 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a292 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.130940:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fc38 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a292 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.130944:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fc38 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a292 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.130947:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532129.130951:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f32eacfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468413952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 19us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.130954:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3569
00000100:00100000:0.0:1651532129.131270:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.131289:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468414208
00000100:00100000:1.0:1651532129.131296:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3570
00000100:00100000:1.0:1651532129.131298:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7ce9547 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468414208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.131301:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.131304:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc3f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a299 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.131311:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc3f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a299 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.131315:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc3f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a299 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.131318:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532129.131337:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7ce9547 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468414208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.131340:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3570
00000100:00100000:0.0:1651532129.131561:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.131579:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468414336
00000100:00100000:1.0:1651532129.131587:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3571
00000100:00100000:1.0:1651532129.131588:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007f4a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468414336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.131591:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.131594:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc46 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2a0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.131601:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc46 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2a0 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.131605:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc46 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2a0 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.131609:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532129.131618:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007f4a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468414336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.131620:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3571
00000001:00080000:1.0:1651532129.229835:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793788 is committed
00010000:00010000:1.0:1651532129.229849:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.229853:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.229875:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468409664:12345-10.240.43.64@tcp:4:fio.0 Request processed in 607703us (607745us total) trans 158913793788 rc 0/0
00000100:00100000:1.0:1651532129.229879:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4250
00010000:00010000:1.0:1651532129.229886:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.229890:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532129.229891:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.229894:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.229899:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532129.229900:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532129.229900:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.229904:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.229911:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.229913:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fb6d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->6922239] (req 1376256->6922239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.229918:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.229930:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.230260:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.230273:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.230280:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.230290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.230299:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468414528
00000100:00100000:0.0:1651532129.230310:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468414592
00000100:00100000:0.0:1651532129.230315:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4259
00000100:00100000:0.0:1651532129.230317:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e51916f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468414528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532129.230335:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.230340:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532129.230341:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.230344:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532129.230344:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.230349:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.230352:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.230358:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4260
00000100:00100000:1.0:1651532129.230360:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000406f95d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468414592:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532129.230366:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468414656
00010000:00010000:1.0:1651532129.230368:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.230372:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468414720
00010000:00010000:1.0:1651532129.230373:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532129.230374:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.230376:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3572
00000100:00100000:0.0:1651532129.230378:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000711d02d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468414656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.230380:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532129.230380:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.230381:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.230384:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fc5b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2a7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.230385:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.230389:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.230392:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fc5b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2a7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532129.230396:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3573
00000100:00100000:1.0:1651532129.230398:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468414720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.230400:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.230400:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fc5b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2a7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.230403:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc62 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2ae expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.230403:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532129.230409:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc62 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2ae expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.230413:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc62 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2ae expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532129.230417:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000711d02d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468414656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.230420:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3572
00010000:00010000:1.0:1651532129.230424:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532129.230433:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468414720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (143us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.230436:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3573
00000100:00100000:0.0:1651532129.230672:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.230691:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468414848
00000100:00100000:1.0:1651532129.230705:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3574
00000100:00100000:1.0:1651532129.230706:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468414848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.230710:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.230713:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fc69 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2b5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.230720:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fc69 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2b5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.230724:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fc69 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2b5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.230727:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532129.230737:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468414848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.230740:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3574
00000100:00100000:0.0:1651532129.230940:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.230958:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468415040
00000100:00100000:1.0:1651532129.230968:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3575
00000100:00100000:1.0:1651532129.230970:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef0e4aff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468415040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.230973:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.230977:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fc70 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2bc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.230984:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fc70 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2bc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.230990:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fc70 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2bc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.230994:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532129.231004:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef0e4aff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468415040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.231006:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3575
00000001:00080000:1.0:1651532129.388103:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793789 is committed
00010000:00010000:1.0:1651532129.388119:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.388123:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.388144:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468410624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 632823us (632854us total) trans 158913793789 rc 0/0
00000100:00100000:1.0:1651532129.388148:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4251
00010000:00010000:0.0:1651532129.388149:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388154:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.388155:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388158:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388165:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.388165:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.388166:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388169:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388175:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.388176:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.388176:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388179:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388191:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388196:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fb90 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->8761343] (req 8192->8761343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388204:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388207:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388238:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388243:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.388524:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.388546:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468415168
00010000:00010000:0.0:1651532129.388549:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.388556:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3576
00000100:00100000:1.0:1651532129.388558:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468415168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.388561:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.388561:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.388565:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fc77 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2c3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.388573:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532129.388576:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fc77 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2c3 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.388580:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fc77 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2c3 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.388590:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532129.388598:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468415168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.388601:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3576
00000100:00100000:0.0:1651532129.388614:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468411520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 507658us (507700us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532129.388620:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4254
00010000:00010000:0.0:1651532129.388631:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388635:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532129.388636:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532129.388636:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388639:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388645:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388647:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fbba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5136384->5836799] (req 5136384->5836799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.388655:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468415424
00000100:00100000:1.0:1651532129.388667:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.388667:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3577
00000100:00100000:0.0:1651532129.388670:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468415424:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532129.388679:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468415488
00010000:00010000:0.0:1651532129.388681:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.388684:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fc7e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2ca expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.388685:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3578
00000100:00100000:1.0:1651532129.388686:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468415488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.388689:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.388690:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532129.388692:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fc85 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2d1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388693:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fc7e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2ca expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.388697:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fc7e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2ca expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.388698:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532129.388700:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fc85 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2d1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.388701:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532129.388704:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fc85 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2d1 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.388710:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:0.0:1651532129.388715:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468415424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.388718:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3577
00000100:00100000:1.0:1651532129.388725:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468415488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.388728:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3578
00010000:00010000:0.0:1651532129.388731:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388734:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.388748:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468410752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 633401us (633444us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532129.388751:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4252
00010000:00010000:0.0:1651532129.388763:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388769:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.388770:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388776:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388781:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.388782:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.388784:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388789:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388800:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.388815:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.388815:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fb97 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1794048->6533119] (req 1794048->6533119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.388819:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.388989:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.389003:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468415552
00000100:00100000:1.0:1651532129.389016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.389016:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4261
00000100:00100000:0.0:1651532129.389018:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468415552:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532129.389024:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532129.389025:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.389035:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468415616
00010000:00010000:0.0:1651532129.389036:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532129.389037:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.389040:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532129.389041:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.389047:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4262
00000100:00100000:1.0:1651532129.389049:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468415616:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532129.389050:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.389054:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.389056:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.389060:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532129.389062:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.389063:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468415744
00010000:00010000:1.0:1651532129.389064:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532129.389065:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.389072:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3579
00000100:00100000:0.0:1651532129.389074:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468415744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.389077:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.389081:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fc9a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2d8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.389084:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.389088:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.389092:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fc9a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2d8 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.389134:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fc9a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2d8 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.389138:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532129.389148:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468415744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 73us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.389151:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3579
00000100:00100000:1.0:1651532129.389171:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.389215:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.389226:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468416000
00000100:00100000:0.0:1651532129.389227:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468415936
00000100:00100000:1.0:1651532129.389236:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3580
00000100:00100000:1.0:1651532129.389237:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468416000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.389241:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532129.389243:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3581
00010000:00010000:1.0:1651532129.389244:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fca1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2e6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.389245:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468415936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.389249:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.389252:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fca1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2e6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.389253:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fca8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2df expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.389256:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fca1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2e6 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.389260:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00010000:00010000:0.0:1651532129.389260:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fca8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2df expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.389264:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fca8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2df expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.389268:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532129.389281:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468415936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.389283:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3581
00000100:00100000:1.0:1651532129.389286:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468416000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.389289:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3580
00000100:00100000:1.0:1651532129.389599:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.389606:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468416384
00000100:00100000:1.0:1651532129.389617:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3582
00000100:00100000:1.0:1651532129.389619:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468416384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.389622:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.389625:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcaf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2ed expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.389632:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcaf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2ed expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.389636:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcaf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2ed expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.389639:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532129.389648:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468416384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.389651:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3582
00000100:00100000:1.0:1651532129.389894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.389901:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468416512
00000100:00100000:1.0:1651532129.389912:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3583
00000100:00100000:1.0:1651532129.389914:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468416512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.389917:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.389920:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcb6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2f4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.389927:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcb6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2f4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.389931:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcb6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2f4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.389935:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532129.389944:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468416512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.389946:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3583
00000001:00080000:1.0:1651532129.546414:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793790 is committed
00010000:00010000:1.0:1651532129.546429:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.546433:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.546454:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468411456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 665537us (665581us total) trans 158913793790 rc 0/0
00000100:00100000:1.0:1651532129.546458:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4253
00010000:00010000:0.0:1651532129.546458:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546463:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.546464:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546467:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546473:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.546474:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.546475:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546478:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546486:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546491:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fbb3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9269247] (req 1839104->9269247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.546500:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.546504:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.546882:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.546895:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.546909:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468416768
00000100:00100000:1.0:1651532129.546912:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.546919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.546929:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468416704
00000100:00100000:1.0:1651532129.546930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.546940:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4263
00000100:00100000:1.0:1651532129.546942:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468416768:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532129.546943:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4264
00000100:00100000:0.0:1651532129.546944:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468416704:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532129.546950:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546952:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.546955:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532129.546956:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532129.546956:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546962:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532129.546963:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546966:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546968:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532129.546969:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.546975:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546976:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.546979:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.546982:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468416896
00010000:00010000:0.0:1651532129.546983:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.546991:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468416960
00000100:00100000:1.0:1651532129.546994:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468417024
00000100:00100000:1.0:1651532129.546997:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3584
00000100:00100000:1.0:1651532129.546999:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468416896:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532129.546999:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3585
00010000:00010000:1.0:1651532129.547001:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532129.547001:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468416960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.547004:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fccb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a2fb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.547004:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.547006:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fcd2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a302 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.547011:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fccb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2fb expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.547014:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fcd2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a302 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.547015:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fccb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a2fb expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.547018:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fcd2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a302 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.547019:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00010000:00010000:0.0:1651532129.547021:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532129.547029:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468416896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.547031:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3584
00000100:00100000:0.0:1651532129.547031:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468416960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.547034:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3585
00000100:00100000:1.0:1651532129.547036:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3586
00000100:00100000:1.0:1651532129.547037:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468417024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.547040:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.547042:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcd9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a309 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.547047:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcd9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a309 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.547051:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcd9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a309 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.547054:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532129.547059:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468417024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.547061:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3586
00000100:00100000:1.0:1651532129.547323:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.547342:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468417152
00000100:00100000:1.0:1651532129.547352:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3587
00000100:00100000:1.0:1651532129.547354:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468417152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.547359:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.547362:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fce0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a310 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.547369:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fce0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a310 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.547373:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fce0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a310 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.547376:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532129.547386:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468417152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.547388:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3587
00000001:00080000:1.0:1651532129.613102:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793791 is committed
00010000:00010000:1.0:1651532129.613117:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.613121:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.613143:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468412352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 615505us (615567us total) trans 158913793791 rc 0/0
00010000:00010000:0.0:1651532129.613144:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.613146:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4255
00010000:00010000:0.0:1651532129.613150:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.613151:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.613154:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.613160:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.613160:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.613161:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.613164:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.613172:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.613177:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fbe4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->6987775] (req 270336->6987775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.613186:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.613193:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.613474:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532129.613490:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.613494:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.613513:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.613514:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468412416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 615836us (615921us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532129.613517:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4256
00010000:00010000:0.0:1651532129.613517:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.613518:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.613524:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.613525:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468417472
00010000:00010000:0.0:1651532129.613529:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.613530:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.613531:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.613534:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3588
00000100:00100000:1.0:1651532129.613536:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468417472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.613539:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.613540:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.613543:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fce7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a317 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.613547:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.613549:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fbeb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->8540159] (req 606208->8540159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.613550:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fce7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a317 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.613554:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fce7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a317 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.613555:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.613558:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.613560:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532129.613567:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468417472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.613569:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3588
00000100:00100000:1.0:1651532129.613976:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.614018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.614028:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.614039:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468417856
00000100:00100000:1.0:1651532129.614040:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.614048:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468417664
00000100:00100000:0.0:1651532129.614049:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468417920
00000100:00100000:0.0:1651532129.614055:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3589
00000100:00100000:0.0:1651532129.614056:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468417856:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532129.614063:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468417600
00010000:00010000:0.0:1651532129.614066:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532129.614071:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4265
00000100:00100000:1.0:1651532129.614073:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468417664:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532129.614075:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fcee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a31e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.614081:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.614083:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fcee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a31e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.614088:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532129.614089:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.614092:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532129.614093:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.614097:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fcee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a31e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.614098:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.614101:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532129.614102:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.614110:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4266
00000100:00100000:1.0:1651532129.614112:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468417600:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532129.614115:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468417856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.614118:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3589
00010000:00010000:1.0:1651532129.614124:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.614124:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3590
00000100:00100000:0.0:1651532129.614125:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf7a70b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468417920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.614128:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532129.614128:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.614129:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.614131:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532129.614132:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.614136:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.614138:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd03 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a325 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.614139:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.614145:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd03 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a325 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.614149:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd03 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a325 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.614152:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532129.614159:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf7a70b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468417920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.614162:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3590
00000001:00080000:1.0:1651532129.713161:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793792 is committed
00010000:00010000:0.0:1651532129.713193:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713198:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.713220:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1fc9b52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468413632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582340us (582441us total) trans 158913793792 rc 0/0
00000100:00100000:0.0:1651532129.713224:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4257
00010000:00010000:0.0:1651532129.713231:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713235:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.713236:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713239:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713244:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.713244:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.713245:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713248:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713261:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713266:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fc23 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10100735] (req 192512->10100735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713275:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713278:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.713670:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.713678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.713694:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468418304
00000100:00100000:1.0:1651532129.713706:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468418176
00010000:00010000:0.0:1651532129.713709:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.713711:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3591
00000100:00100000:1.0:1651532129.713713:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468418304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.713713:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.713719:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.713724:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd0a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a333 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.713733:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005e86aa73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468413696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 582815us (582909us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532129.713736:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4258
00010000:00010000:1.0:1651532129.713737:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532129.713740:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd0a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a333 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.713743:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.713745:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd0a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a333 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.713747:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.713748:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.713749:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532129.713754:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.713758:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468418304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (90us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532129.713759:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.713759:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.713760:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.713762:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3591
00010000:00010000:0.0:1651532129.713763:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.713767:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3592
00000100:00100000:1.0:1651532129.713768:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468418176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.713770:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.713771:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.713773:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fd11 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a32c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713773:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fc31 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->9052159] (req 368640->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.713778:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.713780:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fd11 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a32c expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.713781:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.713784:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fd11 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a32c expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.713790:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532129.713795:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468418176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.713798:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3592
00000100:00100000:1.0:1651532129.714207:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.714217:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.714230:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468418624
00000100:00100000:1.0:1651532129.714255:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468418560
00000100:00100000:0.0:1651532129.714259:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4267
00000100:00100000:0.0:1651532129.714261:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468418624:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532129.714267:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4268
00000100:00100000:1.0:1651532129.714269:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468418560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532129.714276:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.714277:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.714280:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532129.714281:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.714285:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532129.714285:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.714290:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532129.714291:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.714294:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532129.714295:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.714298:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.714299:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.714302:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.714303:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.714316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.714335:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468418688
00000100:00100000:1.0:1651532129.714337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.714346:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468418816
00000100:00100000:1.0:1651532129.714350:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.714351:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3593
00000100:00100000:0.0:1651532129.714353:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468418688:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532129.714356:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468418944
00010000:00010000:0.0:1651532129.714356:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.714359:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd26 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a33a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.714362:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3594
00000100:00100000:1.0:1651532129.714364:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468418816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.714367:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.714367:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd26 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a33a expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.714370:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd2d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a341 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.714372:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd26 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a33a expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.714378:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a341 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.714378:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532129.714382:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a341 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.714385:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:0.0:1651532129.714392:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468418688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.714395:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3593
00000100:00100000:0.0:1651532129.714400:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3595
00000100:00100000:1.0:1651532129.714401:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468418816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.714402:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468418944:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532129.714404:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3594
00010000:00010000:0.0:1651532129.714404:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.714406:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd34 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a348 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.714412:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd34 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a348 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.714416:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd34 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a348 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.714419:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532129.714425:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468418944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.714427:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3595
00000100:00100000:1.0:1651532129.714679:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.714691:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468419072
00000100:00100000:0.0:1651532129.714700:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3596
00000100:00100000:0.0:1651532129.714702:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468419072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.714705:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.714709:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fd3b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a34f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.714716:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fd3b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a34f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.714720:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fd3b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a34f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.714723:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532129.714737:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468419072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.714740:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3596
00000001:00080000:1.0:1651532129.854782:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793793 is committed
00002000:00010000:0.0:1651532129.854822:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532128 -> 1651532129
00010000:00010000:0.0:1651532129.854825:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.854829:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.854854:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e51916f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468414528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 624535us (624594us total) trans 158913793793 rc 0/0
00000100:00100000:0.0:1651532129.854857:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4259
00010000:00010000:0.0:1651532129.854864:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.854868:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.854869:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.854873:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.854878:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.854878:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.854879:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.854882:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.854895:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.854900:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fc4d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [507904->5808127] (req 507904->5808127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.854908:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.854913:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.855203:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.855215:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468419456
00010000:00010000:1.0:1651532129.855223:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.855225:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3597
00000100:00100000:0.0:1651532129.855227:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468419456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.855228:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855230:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.855234:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fd42 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a356 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.855246:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000406f95d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468414592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 624885us (624973us total) trans 0 rc 24576/24576
00010000:00010000:0.0:1651532129.855246:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532129.855249:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4260
00010000:00010000:0.0:1651532129.855249:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fd42 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a356 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.855256:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fd42 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a356 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.855259:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532129.855268:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468419456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.855271:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3597
00010000:00010000:0.0:1651532129.855278:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855284:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.855285:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855291:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855297:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.855298:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.855300:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855304:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855313:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855320:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fc54 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->10088447] (req 1011712->10088447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.855336:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.855341:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.855724:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.855731:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.855744:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.855751:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468419648
00000100:00100000:1.0:1651532129.855753:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.855763:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468419584
00000100:00100000:0.0:1651532129.855768:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4269
00000100:00100000:0.0:1651532129.855770:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468419648:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532129.855776:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4270
00000100:00100000:1.0:1651532129.855778:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468419584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532129.855782:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.855785:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855787:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532129.855788:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532129.855788:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855792:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.855800:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468419776
00010000:00010000:1.0:1651532129.855801:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532129.855802:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.855818:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.855821:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468419968
00000100:00100000:0.0:1651532129.855828:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3598
00000100:00100000:0.0:1651532129.855829:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468419776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.855830:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532129.855831:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855832:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.855835:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd57 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a35d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.855836:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.855839:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.855842:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.855842:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd57 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a35d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.855849:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd57 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a35d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532129.855850:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3599
00000100:00100000:1.0:1651532129.855852:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468419968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.855853:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532129.855855:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.855858:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fd5e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a364 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.855866:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468419776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (121us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.855869:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3598
00010000:00010000:1.0:1651532129.855871:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fd5e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a364 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.855883:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fd5e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a364 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.855886:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532129.855896:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468419968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (143us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.855898:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3599
00000001:00080000:1.0:1651532129.963165:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793794 is committed
00010000:00010000:1.0:1651532129.963180:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.963184:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.963206:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468415552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574188us (574218us total) trans 158913793794 rc 0/0
00010000:00010000:0.0:1651532129.963208:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.963210:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4261
00010000:00010000:0.0:1651532129.963213:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.963214:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963217:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963223:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.963223:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.963224:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963227:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963230:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.963231:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.963232:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963235:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963244:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963249:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fc8c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7741439] (req 143360->7741439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.963259:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.963263:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963264:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963267:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.963642:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.963661:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468420224
00010000:00010000:0.0:1651532129.963667:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.963673:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3600
00000100:00100000:1.0:1651532129.963675:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468420224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.963677:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.963679:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.963683:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fd65 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a36b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.963688:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532129.963691:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fd65 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a36b expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532129.963697:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468416768:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416754us (416815us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532129.963700:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4263
00010000:00010000:1.0:1651532129.963702:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fd65 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a36b expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.963706:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00010000:00010000:0.0:1651532129.963708:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.963714:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468420224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (73us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532129.963714:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.963715:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.963717:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3600
00010000:00010000:0.0:1651532129.963718:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963723:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963726:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40fcbd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->10280959] (req 753664->10280959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.963728:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.963732:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963744:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.963747:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468415616:12345-10.240.43.64@tcp:3:fio.0 Request processed in 574697us (574731us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532129.963747:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532129.963748:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.963750:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4262
00010000:00010000:0.0:1651532129.963751:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963755:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.963755:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532129.963756:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963762:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963768:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963771:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40fc93 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2174976->6590463] (req 2174976->6590463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963776:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.963779:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.964181:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.964188:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.964221:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.964230:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.964236:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468420480
00000100:00100000:1.0:1651532129.964237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.964246:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.964255:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468420544
00000100:00100000:0.0:1651532129.964261:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4271
00000100:00100000:0.0:1651532129.964263:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468420480:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532129.964274:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4272
00010000:00010000:0.0:1651532129.964275:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532129.964276:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468420544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532129.964280:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532129.964281:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.964283:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.964284:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532129.964284:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.964289:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532129.964290:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.964293:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532129.964294:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.964297:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.964298:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.964302:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.964302:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532129.964309:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468420608
00000100:00100000:1.0:1651532129.964310:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468420736
00000100:00100000:1.0:1651532129.964314:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468420800
00000100:00100000:0.0:1651532129.964314:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468420864
00000100:00100000:1.0:1651532129.964317:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3601
00000100:00100000:1.0:1651532129.964319:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468420736:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532129.964319:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3602
00000100:00100000:0.0:1651532129.964321:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468420608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.964322:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.964333:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.964334:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fd7a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a379 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.964336:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fd81 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a372 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.964342:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fd7a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a379 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.964344:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fd81 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a372 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.964347:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fd7a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a379 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.964349:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fd81 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a372 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.964350:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532129.964352:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532129.964361:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468420736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (131us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.964362:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468420608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (141us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.964364:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3601
00000100:00100000:0.0:1651532129.964366:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3602
00000100:00100000:1.0:1651532129.964369:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3603
00000100:00100000:1.0:1651532129.964371:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468420800:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532129.964371:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3604
00000100:00100000:0.0:1651532129.964373:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468420864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.964374:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.964376:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fd88 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a380 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.964376:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.964378:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fd8f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a387 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.964382:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fd88 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a380 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.964384:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fd8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a387 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.964386:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fd88 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a380 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.964387:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fd8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a387 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.964389:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00010000:00010000:0.0:1651532129.964390:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532129.964394:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468420800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (157us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.964396:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468420864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (150us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.964397:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3603
00000100:00100000:0.0:1651532129.964399:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3604
00000100:00100000:1.0:1651532129.964664:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.964676:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468420992
00000100:00100000:0.0:1651532129.964684:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3605
00000100:00100000:0.0:1651532129.964686:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468420992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.964689:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.964693:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fd96 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a38e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.964700:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fd96 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a38e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.964704:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fd96 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a38e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.964710:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532129.964725:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468420992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.964729:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3605
00000100:00100000:1.0:1651532129.964773:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.964783:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468421120
00000100:00100000:1.0:1651532129.964784:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532129.964795:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468421248
00000100:00100000:0.0:1651532129.964812:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3606
00000100:00100000:0.0:1651532129.964814:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468421120:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532129.964815:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3607
00000100:00100000:1.0:1651532129.964817:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468421248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532129.964817:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.964821:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532129.964821:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fd9d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a395 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.964824:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fda4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a39c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532129.964828:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fd9d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a395 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.964831:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fda4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a39c expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.964832:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fd9d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a395 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.964835:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fda4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a39c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532129.964835:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532129.964839:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:0.0:1651532129.964848:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468421120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532129.964850:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3606
00000100:00100000:1.0:1651532129.964853:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468421248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.964856:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3607
00000100:00100000:1.0:1651532129.964937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.964944:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468421376
00000100:00100000:1.0:1651532129.964955:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3608
00000100:00100000:1.0:1651532129.964957:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468421376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.964960:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.964963:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3a3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.964970:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3a3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.964974:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3a3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.964977:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532129.964986:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468421376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.964988:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3608
00000100:00100000:1.0:1651532129.965115:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.965122:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468421504
00000100:00100000:1.0:1651532129.965132:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3609
00000100:00100000:1.0:1651532129.965134:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468421504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.965137:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.965140:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fdb2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3aa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.965147:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fdb2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3aa expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.965151:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fdb2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3aa expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.965157:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532129.965166:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468421504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.965168:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3609
00000100:00100000:1.0:1651532129.965412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532129.965419:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468421760
00000100:00100000:1.0:1651532129.965431:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3610
00000100:00100000:1.0:1651532129.965433:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468421760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532129.965436:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532129.965440:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdb9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3b1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532129.965447:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdb9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3b1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.965451:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdb9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3b1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532129.965454:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532129.965463:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468421760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532129.965466:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3610
00000001:00080000:1.0:1651532130.096507:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793795 is committed
00010000:00010000:0.0:1651532130.096541:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.096549:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.096573:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468416704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549628us (549678us total) trans 158913793795 rc 0/0
00000100:00100000:0.0:1651532130.096577:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4264
00010000:00010000:0.0:1651532130.096584:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.096588:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.096589:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.096592:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.096597:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.096598:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.096599:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.096602:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.096613:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.096618:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fcc4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1024000->8728575] (req 1024000->8728575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.096636:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.096644:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.097001:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.097013:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.097014:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468421888
00000100:00100000:1.0:1651532130.097023:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.097030:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.097038:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468421952
00000100:00100000:0.0:1651532130.097045:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4273
00000100:00100000:0.0:1651532130.097047:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468421888:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532130.097049:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4274
00000100:00100000:1.0:1651532130.097052:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468421952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532130.097054:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097058:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532130.097059:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.097060:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097062:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532130.097063:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.097066:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.097068:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.097071:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532130.097072:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097075:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.097076:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097079:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.097080:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.097088:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468422016
00010000:00010000:1.0:1651532130.097091:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.097094:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468422144
00010000:00010000:1.0:1651532130.097095:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.097098:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3611
00000100:00100000:0.0:1651532130.097100:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468422016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.097108:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.097111:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fdce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3b8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.097115:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468417664:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483041us (483140us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532130.097116:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532130.097118:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4265
00010000:00010000:0.0:1651532130.097119:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fdce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3b8 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.097123:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fdce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3b8 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532130.097126:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3612
00010000:00010000:0.0:1651532130.097126:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532130.097128:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468422144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.097131:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.097134:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fdd5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3bf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.097135:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468422016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.097138:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3611
00010000:00010000:1.0:1651532130.097139:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.097142:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fdd5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3bf expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.097146:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fdd5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3bf expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.097146:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.097149:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00010000:00010000:0.0:1651532130.097149:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.097150:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097153:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.097155:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468422144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (126us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.097158:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3612
00010000:00010000:0.0:1651532130.097158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.097158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.097159:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097162:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097173:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097176:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40fcf5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->6811647] (req 421888->6811647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097187:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097190:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.097510:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.097523:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468422464
00000100:00100000:1.0:1651532130.097534:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.097544:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468422400
00000100:00100000:1.0:1651532130.097545:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3613
00000100:00100000:1.0:1651532130.097548:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468422464:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532130.097550:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3614
00000100:00100000:0.0:1651532130.097552:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468422400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.097553:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.097555:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.097557:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fddc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3cd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.097559:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fde3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3c6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.097568:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fddc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3cd expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.097568:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fde3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3c6 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.097573:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fddc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3cd expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.097573:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fde3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3c6 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.097577:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532130.097579:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532130.097588:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468422464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.097588:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468422400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.097591:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3614
00000100:00100000:1.0:1651532130.097593:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3613
00000001:00080000:1.0:1651532130.196517:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793796 is committed
00010000:00010000:0.0:1651532130.196549:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.196553:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.196576:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468417600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582463us (582558us total) trans 158913793796 rc 0/0
00000100:00100000:0.0:1651532130.196579:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4266
00010000:00010000:0.0:1651532130.196587:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.196590:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.196591:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.196594:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.196599:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.196600:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.196601:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.196604:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.196615:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.196620:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40fcfc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9920511] (req 1294336->9920511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.196629:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.196634:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.196989:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.197001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.197005:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468422848
00000100:00100000:1.0:1651532130.197008:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.197015:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.197016:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468422784
00000100:00100000:1.0:1651532130.197026:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4275
00000100:00100000:1.0:1651532130.197028:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468422848:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532130.197029:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4276
00000100:00100000:0.0:1651532130.197031:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468422784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532130.197037:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197038:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.197042:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532130.197043:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197048:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532130.197049:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197052:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197055:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532130.197055:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.197058:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197060:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197063:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197067:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.197075:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468422912
00000100:00100000:0.0:1651532130.197080:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468422976
00000100:00100000:0.0:1651532130.197084:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3615
00000100:00100000:0.0:1651532130.197086:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468422912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.197089:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.197091:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fdf8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3d4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197098:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fdf8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3d4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.197102:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fdf8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3d4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.197106:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532130.197119:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468422912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.197122:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3615
00000100:00100000:0.0:1651532130.197127:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3616
00000100:00100000:0.0:1651532130.197129:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468422976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.197131:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.197134:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fdff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3db expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197139:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fdff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3db expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.197143:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fdff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3db expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.197146:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532130.197151:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468422976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.197153:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3616
00000100:00100000:1.0:1651532130.197451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.197462:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468423168
00000100:00100000:0.0:1651532130.197471:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3617
00000100:00100000:0.0:1651532130.197473:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468423168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.197476:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.197488:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe06 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3e2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197496:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe06 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3e2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.197500:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe06 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3e2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.197504:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532130.197519:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468423168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.197522:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3617
00000100:00100000:1.0:1651532130.197762:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.197773:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468423360
00000100:00100000:0.0:1651532130.197781:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3618
00000100:00100000:0.0:1651532130.197783:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468423360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.197787:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.197790:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fe0d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3e9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.197797:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fe0d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3e9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.197801:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fe0d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3e9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.197819:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532130.197831:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468423360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.197834:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3618
00000001:00080000:1.0:1651532130.346457:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793797 is committed
00010000:00010000:1.0:1651532130.346475:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.346479:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.346499:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.346503:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468418560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 632233us (632286us total) trans 158913793797 rc 0/0
00010000:00010000:0.0:1651532130.346505:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.346506:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.346507:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4268
00010000:00010000:0.0:1651532130.346510:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.346516:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.346517:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.346517:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.346521:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.346524:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.346524:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.346525:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.346528:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.346536:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.346540:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fd18 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9674751] (req 872448->9674751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.346549:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.346549:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.346553:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.346557:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.346927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.346937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.346945:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468423552
00000100:00100000:0.0:1651532130.346959:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468423488
00010000:00010000:1.0:1651532130.346960:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.346967:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3619
00010000:00010000:1.0:1651532130.346969:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.346969:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468423552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.346973:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.346982:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fe14 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3f7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.346987:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468419648:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491217us (491263us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532130.346988:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532130.346991:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4269
00010000:00010000:0.0:1651532130.346991:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fe14 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3f7 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.346995:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40fe14 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3f7 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532130.346999:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3620
00010000:00010000:0.0:1651532130.346999:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532130.347001:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468423488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.347005:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.347008:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fe1b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3f0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.347008:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468423552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.347010:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3619
00010000:00010000:1.0:1651532130.347014:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.347017:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fe1b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3f0 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.347022:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fe1b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3f0 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.347022:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.347025:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00010000:00010000:0.0:1651532130.347026:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.347032:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468423488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.347035:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3620
00000100:00100000:0.0:1651532130.347038:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468418624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 632777us (632832us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532130.347041:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4267
00010000:00010000:0.0:1651532130.347048:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347051:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.347052:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347055:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347060:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347063:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40fd49 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1355776->8531967] (req 1355776->8531967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347066:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347069:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.347070:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347074:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347080:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.347081:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.347083:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347088:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347103:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347107:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fd1f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4947968->7000063] (req 4947968->7000063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.347110:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.347115:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.347536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.347549:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.347556:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.347557:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468423872
00000100:00100000:1.0:1651532130.347562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.347571:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.347576:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468423808
00000100:00100000:0.0:1651532130.347583:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4277
00000100:00100000:0.0:1651532130.347584:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468423872:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532130.347585:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4278
00000100:00100000:1.0:1651532130.347587:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468423808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532130.347592:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.347596:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347596:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532130.347597:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347600:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532130.347601:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.347607:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532130.347609:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.347612:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532130.347612:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347616:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.347617:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347620:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.347621:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.347628:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468423936
00000100:00100000:0.0:1651532130.347633:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468424128
00000100:00100000:0.0:1651532130.347636:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468424192
00000100:00100000:0.0:1651532130.347638:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3621
00000100:00100000:0.0:1651532130.347640:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468423936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.347642:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.347645:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fe30 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a3fe expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347652:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fe30 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3fe expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.347656:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40fe30 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a3fe expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.347659:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532130.347673:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468423936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.347676:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3621
00000100:00100000:0.0:1651532130.347681:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3622
00000100:00100000:0.0:1651532130.347682:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468424128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.347685:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.347687:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fe37 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a405 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.347692:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fe37 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a405 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.347696:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fe37 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a405 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.347699:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532130.347703:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3623
00000100:00100000:0.0:1651532130.347704:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468424128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (142us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.347706:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468424192:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532130.347707:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3622
00010000:00010000:1.0:1651532130.347709:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.347713:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fe3e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a40c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.347721:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fe3e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a40c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.347725:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fe3e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a40c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.347729:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532130.347738:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468424192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (167us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.347741:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3623
00000100:00100000:0.0:1651532130.348000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.348015:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.348023:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468424384
00000100:00100000:0.0:1651532130.348023:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468424448
00000100:00100000:0.0:1651532130.348031:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3624
00000100:00100000:1.0:1651532130.348041:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3625
00000100:00100000:0.0:1651532130.348041:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468424448:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532130.348043:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468424384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.348047:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.348050:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fe45 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a413 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.348058:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fe45 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a413 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.348062:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fe45 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a413 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.348066:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.348071:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fe4c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a41a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.348072:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532130.348079:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fe4c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a41a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532130.348085:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468424384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.348088:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3625
00010000:00010000:0.0:1651532130.348099:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fe4c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a41a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.348102:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532130.348112:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468424448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 70us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.348115:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3624
00000100:00100000:1.0:1651532130.348116:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.348133:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468424640
00000100:00100000:0.0:1651532130.348139:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3626
00000100:00100000:0.0:1651532130.348141:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468424640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.348144:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.348147:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fe53 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a421 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.348157:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fe53 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a421 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.348162:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40fe53 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a421 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.348165:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532130.348178:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468424640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.348181:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3626
00000100:00100000:1.0:1651532130.348386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.348398:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.348398:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468424768
00000100:00100000:0.0:1651532130.348410:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468424832
00000100:00100000:0.0:1651532130.348418:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3627
00000100:00100000:0.0:1651532130.348419:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468424768:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532130.348421:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3628
00000100:00100000:1.0:1651532130.348423:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468424832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.348423:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.348426:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fe5a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a428 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.348427:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.348431:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe61 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a42f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.348434:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fe5a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a428 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.348438:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fe5a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a428 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.348439:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe61 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a42f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.348442:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532130.348443:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe61 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a42f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.348449:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:0.0:1651532130.348454:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468424768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.348457:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468424832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.348459:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3627
00000100:00100000:1.0:1651532130.348461:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3628
00000100:00100000:1.0:1651532130.348532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.348545:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468425024
00000100:00100000:0.0:1651532130.348553:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3629
00000100:00100000:0.0:1651532130.348555:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468425024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.348558:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.348562:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe68 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a436 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.348569:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe68 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a436 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.348576:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe68 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a436 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.348579:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532130.348589:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468425024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.348592:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3629
00000001:00080000:1.0:1651532130.413179:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793798 is committed
00002000:00010000:1.0:1651532130.413193:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532128 -> 1651532129
00010000:00010000:1.0:1651532130.413196:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.413200:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.413222:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468419584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557444us (557491us total) trans 158913793798 rc 0/0
00010000:00010000:0.0:1651532130.413224:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.413226:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4270
00010000:00010000:0.0:1651532130.413228:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.413229:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.413233:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.413239:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.413239:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.413240:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.413243:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.413251:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.413258:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40fd50 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->9383935] (req 1179648->9383935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.413265:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.413270:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.413670:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.413682:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.413690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.413697:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.413703:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468425408
00000100:00100000:0.0:1651532130.413713:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468425472
00000100:00100000:0.0:1651532130.413719:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4279
00000100:00100000:0.0:1651532130.413720:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef0e4aff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468425408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532130.413728:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.413732:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532130.413733:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.413735:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4280
00010000:00010000:0.0:1651532130.413736:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532130.413736:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.413737:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4432ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468425472:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532130.413741:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.413744:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.413745:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.413750:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532130.413751:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.413754:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532130.413755:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.413760:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.413763:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.413764:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468425536
00000100:00100000:0.0:1651532130.413772:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468425728
00000100:00100000:0.0:1651532130.413777:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3630
00000100:00100000:0.0:1651532130.413779:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c75e9d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468425536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.413781:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532130.413782:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3631
00000100:00100000:1.0:1651532130.413784:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b5a93ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468425728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.413784:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fe7d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a43d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.413787:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.413790:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fe84 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a444 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.413791:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fe7d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a43d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.413795:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fe7d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a43d expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.413798:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fe84 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a444 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.413799:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532130.413825:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c75e9d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468425536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (134us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.413828:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3630
00010000:00010000:1.0:1651532130.413830:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40fe84 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a444 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.413834:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532130.413844:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b5a93ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468425728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (148us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.413847:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3631
00000100:00100000:0.0:1651532130.414101:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.414121:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468425920
00000100:00100000:1.0:1651532130.414135:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3632
00000100:00100000:1.0:1651532130.414137:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468425920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.414141:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.414144:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fe8b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a44b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.414151:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fe8b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a44b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.414155:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fe8b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a44b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.414159:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532130.414169:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468425920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.414172:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3632
00000100:00100000:0.0:1651532130.414412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.414431:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468426176
00000100:00100000:1.0:1651532130.414444:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3633
00000100:00100000:1.0:1651532130.414446:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e688b703 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468426176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.414449:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.414452:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fe92 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a452 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.414462:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fe92 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a452 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.414466:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40fe92 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a452 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.414469:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532130.414479:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e688b703 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468426176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.414481:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3633
00000100:00100000:0.0:1651532130.414693:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.414712:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468426304
00000100:00100000:1.0:1651532130.414725:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3634
00000100:00100000:1.0:1651532130.414727:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ec70ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468426304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.414730:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.414733:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fe99 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a459 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.414740:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fe99 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a459 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.414744:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fe99 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a459 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.414747:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532130.414757:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ec70ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468426304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.414769:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3634
00000001:00080000:1.0:1651532130.521564:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793799 is committed
00010000:00010000:1.0:1651532130.521578:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.521582:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.521604:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468420480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557340us (557423us total) trans 158913793799 rc 0/0
00000100:00100000:1.0:1651532130.521607:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4271
00010000:00010000:1.0:1651532130.521614:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.521618:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532130.521619:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.521622:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.521627:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.521628:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.521628:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.521631:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.521656:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.521659:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40fd6c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->7225343] (req 131072->7225343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.521665:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.521668:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.521915:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.521940:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468426432
00000100:00100000:0.0:1651532130.521956:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.521958:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3635
00000100:00100000:1.0:1651532130.521960:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468426432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.521963:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.521967:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fea0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a460 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.521967:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468426560
00010000:00010000:1.0:1651532130.521973:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.521975:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fea0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a460 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532130.521976:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3636
00000100:00100000:0.0:1651532130.521978:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468426560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.521980:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fea0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a460 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.521982:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.521986:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fea7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a467 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.521992:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.521994:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00010000:00010000:0.0:1651532130.521995:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fea7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a467 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.521999:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fea7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a467 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.522003:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532130.522006:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468426432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.522009:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3635
00000100:00100000:0.0:1651532130.522011:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468426560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.522014:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3636
00010000:00010000:1.0:1651532130.522020:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.522024:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522036:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.522039:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468420544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 557762us (557850us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532130.522040:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.522041:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.522042:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4272
00010000:00010000:0.0:1651532130.522044:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522049:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.522050:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.522051:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522054:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522061:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522064:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40fd73 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4554752->7397375] (req 4554752->7397375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522069:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522073:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.522439:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.522451:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468426752
00000100:00100000:0.0:1651532130.522451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.522463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.522469:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468426688
00000100:00100000:1.0:1651532130.522478:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4281
00000100:00100000:1.0:1651532130.522479:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468426752:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532130.522484:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532130.522486:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.522491:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532130.522492:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532130.522492:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.522492:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4282
00000100:00100000:0.0:1651532130.522494:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468426688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532130.522496:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522504:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522508:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532130.522509:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522515:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522517:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532130.522518:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522522:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522525:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522528:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.522535:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468426816
00000100:00100000:0.0:1651532130.522542:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468427008
00000100:00100000:0.0:1651532130.522551:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3637
00000100:00100000:0.0:1651532130.522553:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000706143c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468426816:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532130.522554:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3638
00000100:00100000:1.0:1651532130.522556:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468427008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.522556:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.522559:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40febc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a46e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.522560:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.522562:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fec3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a475 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522566:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40febc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a46e expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.522570:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fec3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a475 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.522573:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40febc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a46e expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.522574:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fec3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a475 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.522576:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532130.522577:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:0.0:1651532130.522590:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000706143c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468426816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.522592:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3637
00000100:00100000:1.0:1651532130.522596:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468427008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.522598:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3638
00000100:00100000:0.0:1651532130.522858:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.522866:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468427264
00000100:00100000:0.0:1651532130.522873:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3639
00000100:00100000:0.0:1651532130.522875:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468427264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.522878:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.522882:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40feca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a47c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.522889:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40feca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a47c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.522893:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40feca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a47c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.522896:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532130.522911:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468427264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.522915:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3639
00000100:00100000:0.0:1651532130.528089:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532130.528099:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232192
00000100:00100000:0.0:1651532130.528107:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 62
00000100:00100000:0.0:1651532130.528109:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232192:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532130.528115:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 831488 granted 352842304 pending 57344 free 81138851840 avail 76966305792
00000100:00100000:0.0:1651532130.528133:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232192:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (44us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532130.528135:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 62
00000001:00080000:1.0:1651532130.611655:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793800 is committed
00010000:00010000:0.0:1651532130.611686:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611691:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.611708:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468421888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 514660us (514708us total) trans 158913793800 rc 0/0
00000100:00100000:0.0:1651532130.611711:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4273
00010000:00010000:0.0:1651532130.611718:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611721:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.611722:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611725:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611731:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.611732:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.611733:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611736:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611739:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.611739:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.611740:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611742:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611755:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611758:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f40fdc0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5435392->9125887] (req 5435392->9125887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.611767:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.611772:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611790:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.611795:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.612053:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.612061:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.612083:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468427456
00000100:00100000:0.0:1651532130.612091:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468427520
00010000:00010000:1.0:1651532130.612092:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.612098:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3640
00000100:00100000:0.0:1651532130.612100:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468427456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.612103:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.612104:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612107:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fed1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a483 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612113:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.612116:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fed1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a483 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532130.612120:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468421952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 515068us (515107us total) trans 0 rc 40960/40960
00010000:00010000:0.0:1651532130.612120:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f40fed1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a483 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532130.612123:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4274
00010000:00010000:0.0:1651532130.612123:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532130.612130:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.612132:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468427456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (80us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532130.612134:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532130.612135:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.612135:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3640
00010000:00010000:1.0:1651532130.612138:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.612139:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3641
00000100:00100000:0.0:1651532130.612141:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468427520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.612143:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612143:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.612145:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fed8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a48a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612146:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40fdc7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [315392->10084351] (req 315392->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612149:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.612151:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fed8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a48a expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.612155:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f40fed8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a48a expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.612158:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532130.612163:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468427520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.612165:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3641
00010000:00010000:0.0:1651532130.612177:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612182:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.612204:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468422848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 415176us (415216us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532130.612208:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4275
00010000:00010000:1.0:1651532130.612209:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612213:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532130.612214:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612217:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612221:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.612222:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.612223:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612226:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612241:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612245:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40fdea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->5480447] (req 450560->5480447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612253:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612256:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.612633:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.612656:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.612665:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.612673:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.612679:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.612686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.612695:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468427712
00000100:00100000:0.0:1651532130.612705:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468427648
00000100:00100000:0.0:1651532130.612713:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4283
00000100:00100000:0.0:1651532130.612715:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468427712:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532130.612722:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612726:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532130.612727:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612730:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532130.612731:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612735:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.612739:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4284
00010000:00010000:0.0:1651532130.612739:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.612742:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468427648:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532130.612745:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468427776
00000100:00100000:0.0:1651532130.612749:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468427840
00010000:00010000:1.0:1651532130.612750:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.612751:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468427968
00000100:00100000:0.0:1651532130.612754:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468428032
00010000:00010000:1.0:1651532130.612757:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532130.612757:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3642
00010000:00010000:1.0:1651532130.612758:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.612758:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468427776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.612761:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532130.612761:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.612762:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612763:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40feed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a491 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612766:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612770:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612770:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40feed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a491 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.612774:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f40feed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a491 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.612777:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532130.612778:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3643
00000100:00100000:1.0:1651532130.612780:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468427840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.612782:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.612785:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fef4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a498 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.612790:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468427776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (159us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.612793:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3642
00000100:00100000:0.0:1651532130.612798:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3644
00010000:00010000:1.0:1651532130.612799:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fef4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a498 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532130.612800:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468427968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.612815:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40fef4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a498 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.612815:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.612817:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fefb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a49f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.612819:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00010000:00010000:0.0:1651532130.612824:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fefb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a49f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.612828:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f40fefb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a49f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.612831:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532130.612838:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468427968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (158us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.612840:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3644
00000100:00100000:1.0:1651532130.612843:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468427840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (169us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.612844:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3645
00000100:00100000:1.0:1651532130.612846:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3643
00000100:00100000:0.0:1651532130.612846:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468428032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.612848:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.612858:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ff02 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4a6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.612864:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ff02 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4a6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.612868:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f40ff02 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4a6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.612872:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532130.612878:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468428032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (192us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.612880:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3645
00000100:00100000:0.0:1651532130.613146:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.613154:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468428224
00000100:00100000:0.0:1651532130.613161:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3646
00000100:00100000:0.0:1651532130.613163:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468428224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.613166:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.613169:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ff09 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4ad expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.613177:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ff09 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4ad expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.613194:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ff09 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4ad expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.613198:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532130.613230:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468428224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.613239:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3646
00000100:00100000:1.0:1651532130.613261:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.613273:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468428480
00000100:00100000:0.0:1651532130.613281:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3647
00000100:00100000:0.0:1651532130.613282:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468428480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.613286:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.613289:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff10 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4b4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.613296:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff10 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4b4 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.613300:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff10 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4b4 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.613303:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532130.613313:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468428480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.613315:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3647
00000100:00100000:1.0:1651532130.613446:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.613458:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468428608
00000100:00100000:0.0:1651532130.613466:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3648
00000100:00100000:0.0:1651532130.613468:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468428608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.613471:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.613475:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff17 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4bb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.613482:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff17 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4bb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.613486:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff17 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4bb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.613489:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532130.613499:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468428608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.613502:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3648
00000001:00080000:1.0:1651532130.711629:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793801 is committed
00002000:00010000:1.0:1651532130.711643:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532129 -> 1651532130
00010000:00010000:1.0:1651532130.711646:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.711649:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.711671:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468422784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 514640us (514670us total) trans 158913793801 rc 0/0
00000100:00100000:1.0:1651532130.711675:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4276
00010000:00010000:0.0:1651532130.711682:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.711687:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.711688:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.711691:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.711697:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.711698:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.711699:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.711702:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.711713:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.711718:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40fdf1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->9003007] (req 3379200->9003007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.711727:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.711730:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.712032:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.712041:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.712048:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.712060:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.712075:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.712079:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468428992
00000100:00100000:1.0:1651532130.712082:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468428864
00000100:00100000:0.0:1651532130.712091:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468429056
00000100:00100000:0.0:1651532130.712094:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468429120
00000100:00100000:0.0:1651532130.712097:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3649
00000100:00100000:1.0:1651532130.712098:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468428928
00000100:00100000:0.0:1651532130.712099:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468428992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.712103:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532130.712105:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4285
00000100:00100000:1.0:1651532130.712106:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468428864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532130.712106:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff1e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4c2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.712112:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.712114:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.712114:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff1e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4c2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.712119:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff1e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4c2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.712121:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532130.712122:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.712122:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532130.712125:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532130.712125:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712130:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712133:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.712133:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468428992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.712136:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3649
00000100:00100000:0.0:1651532130.712140:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3650
00000100:00100000:1.0:1651532130.712141:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4286
00000100:00100000:1.0:1651532130.712142:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468428928:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532130.712142:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468429056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.712144:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.712146:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.712146:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff2c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4c9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712150:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.712151:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712153:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532130.712154:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.712157:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.712159:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.712159:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff2c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4c9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.712162:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.712163:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff2c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4c9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.712166:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532130.712170:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3651
00000100:00100000:1.0:1651532130.712172:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468429120:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532130.712172:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468429056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (112us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532130.712174:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532130.712174:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3650
00010000:00010000:1.0:1651532130.712177:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff3a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4d0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712181:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.712184:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff3a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4d0 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.712185:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.712189:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712192:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff3a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4d0 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.712203:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:0.0:1651532130.712203:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468423872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 364618us (364668us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532130.712206:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4277
00000100:00100000:1.0:1651532130.712212:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468429120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (136us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.712214:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3651
00010000:00010000:1.0:1651532130.712222:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712225:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532130.712226:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712229:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712234:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.712235:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.712235:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712260:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712273:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712276:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f40fe22 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->9822207] (req 843776->9822207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712282:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.712285:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532130.868138:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793802 is committed
00010000:00010000:1.0:1651532130.868152:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868156:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.868173:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468423808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 520585us (520623us total) trans 158913793802 rc 0/0
00000100:00100000:1.0:1651532130.868176:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4278
00010000:00010000:1.0:1651532130.868183:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868186:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532130.868187:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868190:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868195:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.868196:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.868196:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868199:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868211:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868215:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40fe29 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->10063871] (req 2072576->10063871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.868224:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.868230:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.868642:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.868655:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468429440
00000100:00100000:0.0:1651532130.868664:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.868677:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468429504
00000100:00100000:1.0:1651532130.868684:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4287
00000100:00100000:0.0:1651532130.868684:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.868686:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468429440:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532130.868692:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532130.868693:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.868704:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4288
00000100:00100000:0.0:1651532130.868706:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468429504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532130.868708:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532130.868709:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868712:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532130.868712:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.868716:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868717:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.868721:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532130.868722:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.868725:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532130.868726:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868729:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.868730:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.868734:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.868738:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468429568
00000100:00100000:0.0:1651532130.868741:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468429632
00000100:00100000:1.0:1651532130.868747:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3652
00000100:00100000:1.0:1651532130.868749:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468429568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.868752:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.868755:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff4f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4d7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.868756:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3653
00000100:00100000:0.0:1651532130.868757:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468429632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.868760:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.868763:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff56 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4de expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.868765:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff4f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4d7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.868770:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff4f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4d7 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.868771:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff56 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4de expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.868773:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532130.868775:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff56 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4de expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.868779:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532130.868784:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468429568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.868787:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3652
00000100:00100000:0.0:1651532130.868787:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468429632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.868790:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3653
00000001:00080000:1.0:1651532130.969956:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793803 is committed
00002000:00010000:0.0:1651532130.969987:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532129 -> 1651532130
00010000:00010000:0.0:1651532130.969991:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.969995:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.970013:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef0e4aff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468425408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 556292us (556344us total) trans 158913793803 rc 0/0
00000100:00100000:0.0:1651532130.970017:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4279
00010000:00010000:0.0:1651532130.970024:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970027:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532130.970029:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970032:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970036:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.970037:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.970038:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970041:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970044:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.970045:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532130.970045:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970051:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970064:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970067:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fe6f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->8646655] (req 139264->8646655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.970076:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.970081:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970099:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970105:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.970434:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.970442:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532130.970465:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468429952
00010000:00010000:1.0:1651532130.970472:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.970472:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468430016
00010000:00010000:1.0:1651532130.970476:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.970480:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3654
00000100:00100000:0.0:1651532130.970482:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468429952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.970486:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.970490:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff5d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4e5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970495:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532130.970497:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4432ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468425472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 556760us (556815us total) trans 0 rc 40960/40960
00010000:00010000:0.0:1651532130.970498:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff5d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4e5 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532130.970501:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4280
00010000:00010000:0.0:1651532130.970503:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ff5d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4e5 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.970506:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532130.970515:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468429952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.970517:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3654
00010000:00010000:1.0:1651532130.970518:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.970521:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532130.970522:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.970522:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3655
00000100:00100000:0.0:1651532130.970524:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468430016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.970525:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970526:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.970528:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ff64 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4ec expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.970530:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970532:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.970533:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f40fe76 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1245184->9568255] (req 1245184->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970534:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ff64 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4ec expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.970538:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ff64 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4ec expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.970541:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532130.970546:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468430016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (104us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.970548:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3655
00010000:00010000:0.0:1651532130.970559:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970563:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.970584:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.970588:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532130.970588:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468426752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 448108us (448149us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532130.970589:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.970591:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.970591:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4281
00010000:00010000:1.0:1651532130.970596:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.970596:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532130.970597:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.970611:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.970627:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.970630:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f40feae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [270336->9625599] (req 270336->9625599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970656:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532130.970661:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.970997:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.971009:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.971016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.971022:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.971031:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.971039:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468430208
00000100:00100000:1.0:1651532130.971052:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468430272
00000100:00100000:1.0:1651532130.971058:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4289
00000100:00100000:1.0:1651532130.971060:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468430208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532130.971066:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971071:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532130.971072:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971074:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532130.971075:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971088:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971091:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532130.971099:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4290
00000100:00100000:1.0:1651532130.971101:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468430272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532130.971105:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971109:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532130.971110:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971112:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532130.971113:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.971113:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468430336
00010000:00010000:1.0:1651532130.971116:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971119:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532130.971125:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468430528
00000100:00100000:0.0:1651532130.971127:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468430592
00000100:00100000:0.0:1651532130.971131:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3656
00000100:00100000:0.0:1651532130.971132:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468430336:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532130.971133:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3657
00000100:00100000:1.0:1651532130.971135:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468430528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532130.971136:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.971138:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532130.971140:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ff79 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4f3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971141:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ff80 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a4fa expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971149:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ff80 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4fa expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.971149:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ff79 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4f3 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532130.971153:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ff79 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4f3 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971154:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f40ff80 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a4fa expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971157:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00010000:00010000:0.0:1651532130.971157:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532130.971168:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468430528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (146us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532130.971168:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468430336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (152us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.971171:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3657
00000100:00100000:0.0:1651532130.971172:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3656
00000100:00100000:1.0:1651532130.971176:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3658
00000100:00100000:1.0:1651532130.971178:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468430592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.971193:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.971195:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ff87 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a501 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971202:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ff87 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a501 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971206:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f40ff87 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a501 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532130.971207:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532130.971212:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532130.971219:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468430592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (188us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.971222:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3658
00000100:00100000:1.0:1651532130.971226:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468430720
00000100:00100000:1.0:1651532130.971235:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3659
00000100:00100000:1.0:1651532130.971237:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468430720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.971247:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.971250:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ff8e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a508 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971256:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ff8e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a508 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971260:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f40ff8e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a508 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971263:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532130.971274:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468430720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.971277:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3659
00000100:00100000:1.0:1651532130.971499:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.971507:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468430912
00000100:00100000:1.0:1651532130.971518:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3660
00000100:00100000:1.0:1651532130.971520:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468430912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.971524:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.971527:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ff95 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a50f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971534:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ff95 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a50f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971538:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f40ff95 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a50f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971541:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:0.0:1651532130.971548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.971561:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468430912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.971564:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3660
00000100:00100000:1.0:1651532130.971568:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468430976
00000100:00100000:1.0:1651532130.971577:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3661
00000100:00100000:1.0:1651532130.971584:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468430976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.971587:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.971590:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ff9c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a516 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971596:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ff9c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a516 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971599:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f40ff9c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a516 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971605:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532130.971616:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468430976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.971619:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3661
00000100:00100000:1.0:1651532130.971816:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.971823:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468431296
00000100:00100000:1.0:1651532130.971833:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3662
00000100:00100000:1.0:1651532130.971835:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468431296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.971838:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.971841:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ffa3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a51d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.971848:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ffa3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a51d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971852:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f40ffa3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a51d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.971855:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532130.971866:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468431296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.971869:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3662
00000100:00100000:1.0:1651532130.972107:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.972114:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468431488
00000100:00100000:1.0:1651532130.972124:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3663
00000100:00100000:1.0:1651532130.972133:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468431488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.972137:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.972140:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ffaa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a524 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.972148:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ffaa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a524 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.972152:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ffaa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a524 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.972155:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532130.972167:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468431488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.972169:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3663
00000100:00100000:1.0:1651532130.972427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532130.972434:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468431680
00000100:00100000:1.0:1651532130.972445:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3664
00000100:00100000:1.0:1651532130.972447:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468431680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532130.972450:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532130.972453:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffb1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a52b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532130.972460:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffb1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a52b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.972467:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffb1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a52b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532130.972470:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532130.972481:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468431680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532130.972484:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3664
00000001:00080000:1.0:1651532131.061687:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793804 is committed
00010000:00010000:0.0:1651532131.061719:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.061725:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.061749:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468426688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 539253us (539296us total) trans 158913793804 rc 0/0
00000100:00100000:0.0:1651532131.061752:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4282
00010000:00010000:0.0:1651532131.061760:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.061764:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532131.061765:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.061768:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.061774:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532131.061774:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532131.061775:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.061778:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.061787:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.061791:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f40feb5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->8556543] (req 3072000->8556543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.061800:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.061819:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.062115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.062127:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.062136:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.062136:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468431936
00000100:00100000:1.0:1651532131.062143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.062154:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468431872
00000100:00100000:1.0:1651532131.062156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.062168:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4291
00000100:00100000:0.0:1651532131.062170:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468431936:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532131.062171:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4292
00000100:00100000:1.0:1651532131.062173:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468431872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532131.062178:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062181:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.062183:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532131.062184:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532131.062184:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062191:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.062192:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062195:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062198:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532131.062199:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.062203:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062204:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062207:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062210:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.062216:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.062217:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468432000
00010000:00010000:0.0:1651532131.062219:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.062234:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468432064
00000100:00100000:1.0:1651532131.062237:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468432192
00000100:00100000:1.0:1651532131.062240:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3665
00000100:00100000:1.0:1651532131.062241:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468432000:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532131.062242:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468427712:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449526us (449585us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532131.062244:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532131.062245:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4283
00010000:00010000:1.0:1651532131.062246:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ffc6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a532 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062251:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532131.062253:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3666
00010000:00010000:1.0:1651532131.062254:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ffc6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a532 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532131.062255:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468432064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.062258:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f40ffc6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a532 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.062258:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.062261:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532131.062261:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ffcd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a539 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.062266:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532131.062269:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ffcd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a539 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532131.062270:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468432000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.062273:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3665
00010000:00010000:0.0:1651532131.062273:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f40ffcd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a539 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532131.062277:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3667
00010000:00010000:0.0:1651532131.062277:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532131.062278:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468432192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.062281:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.062283:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ffd4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a540 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.062283:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468432064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (140us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.062286:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3666
00010000:00010000:1.0:1651532131.062287:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.062289:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ffd4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a540 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.062292:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40ffd4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a540 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.062295:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532131.062300:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468432192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (144us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.062303:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3667
00010000:00010000:1.0:1651532131.062309:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062312:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.062313:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062319:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062361:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.062362:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.062363:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062366:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062374:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062377:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f40fedf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2379776->9601023] (req 2379776->9601023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062383:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062386:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.062713:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.062728:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.062740:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.062753:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468432320
00000100:00100000:0.0:1651532131.062761:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468432384
00000100:00100000:0.0:1651532131.062764:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3668
00000100:00100000:0.0:1651532131.062766:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468432320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.062770:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.062773:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ffdb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a547 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.062781:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ffdb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a547 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.062785:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f40ffdb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a547 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.062788:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532131.062799:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468432320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.062801:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3668
00000100:00100000:1.0:1651532131.062817:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468432512
00000100:00100000:0.0:1651532131.062819:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3669
00000100:00100000:0.0:1651532131.062821:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468432384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.062824:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532131.062825:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3670
00000100:00100000:1.0:1651532131.062827:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468432512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.062827:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ffe2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a54e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.062830:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.062834:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ffe9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a555 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.062836:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ffe2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a54e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.062841:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40ffe2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a54e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.062842:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ffe9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a555 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.062844:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532131.062846:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40ffe9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a555 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.062849:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532131.062850:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468432384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.062852:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3669
00000100:00100000:1.0:1651532131.062858:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468432512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.062875:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3670
00000001:00080000:1.0:1651532131.194957:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793805 is committed
00010000:00010000:1.0:1651532131.194972:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.194976:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.194992:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468427648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582250us (582327us total) trans 158913793805 rc 0/0
00000100:00100000:1.0:1651532131.194995:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4284
00010000:00010000:1.0:1651532131.195002:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195008:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.195009:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195012:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195017:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.195017:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.195018:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195021:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195027:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195030:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f40fee6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3399680->10371071] (req 3399680->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195035:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195038:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.195408:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.195416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.195437:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468432960
00000100:00100000:0.0:1651532131.195452:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468433024
00000100:00100000:0.0:1651532131.195462:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4293
00000100:00100000:1.0:1651532131.195463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.195464:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468432960:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532131.195472:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532131.195472:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.195484:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4294
00010000:00010000:0.0:1651532131.195484:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532131.195486:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468433024:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532131.195486:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.195489:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532131.195489:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.195494:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195495:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.195498:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195499:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.195500:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195503:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532131.195504:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195509:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195512:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.195514:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468433152
00000100:00100000:1.0:1651532131.195520:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3671
00000100:00100000:0.0:1651532131.195520:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468433216
00000100:00100000:1.0:1651532131.195522:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468433152:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532131.195524:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3672
00010000:00010000:1.0:1651532131.195525:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532131.195526:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468433216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.195527:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40fffe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a55c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.195529:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.195536:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40fffe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a55c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.195540:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f40fffe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a55c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.195540:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410005 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a563 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.195543:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532131.195548:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410005 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a563 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.195552:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410005 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a563 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532131.195557:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468433152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.195559:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3671
00010000:00010000:0.0:1651532131.195562:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532131.195572:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468433216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.195575:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3672
00000001:00080000:1.0:1651532131.328358:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793806 is committed
00010000:00010000:1.0:1651532131.328374:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328378:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.328394:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468428864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616287us (616369us total) trans 158913793806 rc 0/0
00000100:00100000:1.0:1651532131.328398:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4285
00010000:00010000:1.0:1651532131.328404:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328407:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.328409:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328412:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328417:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.328418:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.328418:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328422:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328428:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328431:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f40ff25 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1896448->6565887] (req 1896448->6565887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328436:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328439:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328653:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328657:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.328681:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468428928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 616537us (616639us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532131.328684:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4286
00010000:00010000:1.0:1651532131.328691:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328694:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.328695:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328698:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328702:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.328703:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.328704:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328714:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328722:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328725:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f40ff33 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9560063] (req 69632->9560063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328730:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.328733:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.328907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.328950:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468433664
00000100:00100000:0.0:1651532131.328964:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3673
00000100:00100000:0.0:1651532131.328966:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468433664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.328972:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.328976:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41000c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a56a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.328985:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41000c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a56a expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.328989:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41000c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a56a expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.328992:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532131.329003:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468433664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.329006:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3673
00000100:00100000:1.0:1651532131.329108:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.329117:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.329123:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.329144:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468433728
00000100:00100000:1.0:1651532131.329158:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468433792
00000100:00100000:1.0:1651532131.329166:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4295
00000100:00100000:1.0:1651532131.329168:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468433728:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532131.329172:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4296
00000100:00100000:0.0:1651532131.329174:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468433792:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532131.329175:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.329180:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.329181:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.329183:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.329184:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532131.329184:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.329188:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532131.329190:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.329193:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532131.329193:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.329200:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.329201:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.329203:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.329204:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.329214:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468433856
00000100:00100000:1.0:1651532131.329222:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3674
00000100:00100000:1.0:1651532131.329224:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468433856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.329226:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.329229:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410021 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a571 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.329236:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410021 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a571 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.329240:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410021 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a571 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.329244:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532131.329256:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468433856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.329258:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3674
00000100:00100000:0.0:1651532131.329319:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.329340:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468434112
00000100:00100000:1.0:1651532131.329350:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3675
00000100:00100000:1.0:1651532131.329352:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468434112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.329355:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.329358:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410028 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a578 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.329366:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410028 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a578 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.329370:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410028 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a578 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.329373:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532131.329382:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468434112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.329385:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3675
00000100:00100000:0.0:1651532131.329498:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.329517:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468434304
00000100:00100000:1.0:1651532131.329528:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3676
00000100:00100000:1.0:1651532131.329530:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468434304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.329533:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.329536:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41002f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a57f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.329543:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41002f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a57f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.329547:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41002f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a57f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.329550:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532131.329560:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468434304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.329563:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3676
00000100:00100000:0.0:1651532131.329611:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.329621:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468434432
00000100:00100000:1.0:1651532131.329631:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3677
00000100:00100000:1.0:1651532131.329633:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468434432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.329636:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.329639:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410036 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a586 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.329645:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410036 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a586 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.329649:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410036 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a586 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.329652:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532131.329661:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468434432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.329664:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3677
00000100:00100000:0.0:1651532131.329889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.329900:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468434688
00000100:00100000:1.0:1651532131.329910:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3678
00000100:00100000:1.0:1651532131.329912:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468434688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.329915:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.329918:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41003d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a58d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.329925:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41003d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a58d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.329932:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41003d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a58d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.329935:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532131.329945:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468434688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.329947:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3678
00000001:00080000:1.0:1651532131.420025:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793807 is committed
00010000:00010000:1.0:1651532131.420041:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420045:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.420065:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.420069:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468429440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 551382us (551427us total) trans 158913793807 rc 0/0
00000100:00100000:1.0:1651532131.420072:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4287
00010000:00010000:0.0:1651532131.420075:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532131.420076:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.420080:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.420086:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532131.420086:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532131.420087:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.420090:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.420101:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.420104:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f40ff41 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->10481663] (req 413696->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420107:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420119:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.420454:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.420462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.420473:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468434880
00000100:00100000:1.0:1651532131.420476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.420485:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468435008
00000100:00100000:0.0:1651532131.420488:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468435072
00000100:00100000:1.0:1651532131.420491:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3679
00000100:00100000:1.0:1651532131.420494:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468434880:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532131.420496:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3680
00010000:00010000:1.0:1651532131.420498:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532131.420498:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468435008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.420502:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410044 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a594 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.420502:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.420506:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41004b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a59b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420507:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.420510:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410044 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a594 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.420511:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.420515:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410044 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a594 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.420515:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41004b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a59b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.420518:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532131.420519:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41004b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a59b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.420523:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532131.420527:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468434880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.420530:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3679
00000100:00100000:0.0:1651532131.420532:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468435008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.420535:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3680
00000100:00100000:1.0:1651532131.420537:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3681
00000100:00100000:1.0:1651532131.420539:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468435072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.420542:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.420544:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410052 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5a2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420548:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.420550:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410052 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5a2 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.420557:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410052 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5a2 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.420560:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532131.420565:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468435072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.420568:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3681
00010000:00010000:1.0:1651532131.420578:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420581:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.420592:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468429504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 551886us (551928us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532131.420594:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4288
00010000:00010000:1.0:1651532131.420600:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420603:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.420604:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420607:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420614:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.420615:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.420616:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420619:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420625:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420628:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f40ff48 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7442432->8380415] (req 7442432->8380415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420633:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.420636:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.421045:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.421066:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.421075:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.421081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.421092:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468435328
00000100:00100000:0.0:1651532131.421095:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468435264
00000100:00100000:1.0:1651532131.421105:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468435200
00000100:00100000:0.0:1651532131.421108:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468435520
00000100:00100000:1.0:1651532131.421113:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4297
00000100:00100000:1.0:1651532131.421115:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b720e370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468435328:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532131.421118:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3682
00000100:00100000:0.0:1651532131.421120:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d43c04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468435264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.421122:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.421124:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.421127:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532131.421127:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410060 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5a9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.421128:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532131.421128:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.421132:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.421135:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410060 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5a9 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532131.421139:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4298
00010000:00010000:0.0:1651532131.421139:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410060 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5a9 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532131.421140:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000724d966c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468435200:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532131.421143:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532131.421145:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.421148:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.421149:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.421151:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.421154:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00000100:00100000:0.0:1651532131.421158:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d43c04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468435264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (83us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532131.421160:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.421161:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3682
00010000:00010000:1.0:1651532131.421165:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.421166:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3683
00000100:00100000:0.0:1651532131.421167:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018bbbca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468435520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.421170:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.421171:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.421172:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41006e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5b0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.421174:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.421178:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41006e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5b0 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.421185:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41006e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5b0 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.421188:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532131.421194:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018bbbca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468435520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.421196:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3683
00000001:00080000:1.0:1651532131.528403:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793808 is committed
00010000:00010000:1.0:1651532131.528419:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528422:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.528438:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468430208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557378us (557442us total) trans 158913793808 rc 0/0
00000100:00100000:1.0:1651532131.528442:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4289
00010000:00010000:1.0:1651532131.528448:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528451:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.528452:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528455:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528460:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.528461:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.528462:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528465:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528468:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.528468:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.528469:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528471:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528485:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528488:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f40ff6b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->10113023] (req 49152->10113023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528494:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.528496:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528497:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.528501:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528753:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528757:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.528791:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.528792:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468430272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 557690us (557783us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532131.528795:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4290
00010000:00010000:0.0:1651532131.528796:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532131.528797:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.528800:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.528822:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.528828:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f40ff72 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1011712->7155711] (req 1011712->7155711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.528840:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.528845:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528860:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528865:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.528866:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528869:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528874:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.528875:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.528875:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528879:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528886:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.528892:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468431936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466721us (466783us total) trans 0 rc 40960/40960
00010000:00010000:1.0:1651532131.528894:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f40ffb8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->9879551] (req 1437696->9879551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.528896:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4291
00010000:00010000:1.0:1651532131.528899:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528910:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.528916:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.528965:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468436032
00000100:00100000:1.0:1651532131.528981:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3684
00000100:00100000:1.0:1651532131.528983:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045d23ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468436032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.528986:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.528990:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410075 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5b7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.528998:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410075 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5b7 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.529002:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410075 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5b7 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.529005:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532131.529019:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045d23ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468436032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.529022:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3684
00000100:00100000:1.0:1651532131.529111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.529127:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468436096
00000100:00100000:1.0:1651532131.529133:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.529153:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468436160
00000100:00100000:0.0:1651532131.529170:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4299
00000100:00100000:0.0:1651532131.529173:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d43c04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468436096:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532131.529174:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4300
00000100:00100000:1.0:1651532131.529176:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018bbbca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468436160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532131.529181:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.529183:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.529186:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532131.529187:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.529190:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532131.529191:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.529197:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.529198:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.529201:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532131.529202:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.529205:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.529206:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.529209:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.529209:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.529477:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.529486:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.529497:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468436480
00000100:00100000:0.0:1651532131.529498:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468436416
00000100:00100000:1.0:1651532131.529508:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3685
00000100:00100000:1.0:1651532131.529514:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468436480:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532131.529517:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3686
00010000:00010000:1.0:1651532131.529518:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532131.529519:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045cfe023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468436416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.529522:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41008a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5c5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.529522:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.529526:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410091 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5be expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.529530:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41008a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5c5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.529534:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410091 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5be expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.529537:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41008a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5c5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.529539:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410091 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5be expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.529540:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532131.529542:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532131.529554:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468436480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.529556:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3685
00000100:00100000:0.0:1651532131.529559:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045cfe023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468436416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.529562:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3686
00000100:00100000:1.0:1651532131.529906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.529913:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468436992
00000100:00100000:1.0:1651532131.529926:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3687
00000100:00100000:1.0:1651532131.529928:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4b0fa2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468436992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.529931:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.529935:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410098 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5cc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.529942:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410098 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5cc expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.529946:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410098 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5cc expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.529950:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532131.529963:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4b0fa2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468436992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.529974:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3687
00000001:00080000:1.0:1651532131.595107:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793809 is committed
00010000:00010000:1.0:1651532131.595121:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595125:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.595141:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468431872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532968us (533014us total) trans 158913793809 rc 0/0
00000100:00100000:1.0:1651532131.595144:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4292
00010000:00010000:1.0:1651532131.595151:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595154:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.595155:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595158:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595163:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.595164:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.595164:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595167:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595182:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595185:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f40ffbf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2105344->9445375] (req 2105344->9445375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.595195:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.595203:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.595587:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.595599:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468437184
00000100:00100000:0.0:1651532131.595609:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.595610:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4301
00000100:00100000:1.0:1651532131.595612:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468437184:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532131.595619:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595623:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.595624:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532131.595625:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595628:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.595634:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468437120
00000100:00100000:0.0:1651532131.595639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.595645:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4302
00000100:00100000:1.0:1651532131.595651:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468437120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532131.595657:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.595659:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532131.595660:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.595661:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595664:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532131.595665:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.595666:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532131.595674:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595678:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.595679:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468437248
00000100:00100000:1.0:1651532131.595685:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468437376
00000100:00100000:0.0:1651532131.595689:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468437440
00000100:00100000:0.0:1651532131.595692:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3688
00000100:00100000:0.0:1651532131.595694:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468437248:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532131.595696:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3689
00000100:00100000:1.0:1651532131.595698:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468437440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.595698:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.595701:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.595702:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4100ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5d3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595703:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4100b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5e1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595712:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4100b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5e1 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.595712:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4100ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5d3 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.595716:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4100ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5d3 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.595717:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4100b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5e1 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.595720:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532131.595720:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532131.595732:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468437440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.595732:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468437248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.595734:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3689
00000100:00100000:0.0:1651532131.595736:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3688
00000100:00100000:1.0:1651532131.595739:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3690
00000100:00100000:1.0:1651532131.595741:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468437376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.595743:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.595745:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4100bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5da expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.595751:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4100bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5da expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.595754:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4100bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5da expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.595757:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532131.595763:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468437376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.595765:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3690
00000100:00100000:0.0:1651532131.596033:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.596052:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468437632
00000100:00100000:1.0:1651532131.596063:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3691
00000100:00100000:1.0:1651532131.596065:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468437632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.596069:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.596072:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5e8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.596079:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5e8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.596083:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5e8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.596087:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532131.596097:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468437632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.596099:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3691
00000001:00080000:1.0:1651532131.695107:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793810 is committed
00002000:00010000:0.0:1651532131.695136:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532130 -> 1651532131
00010000:00010000:0.0:1651532131.695140:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695144:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.695161:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468432960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499696us (499754us total) trans 158913793810 rc 0/0
00000100:00100000:0.0:1651532131.695165:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4293
00010000:00010000:0.0:1651532131.695172:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695175:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532131.695176:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695179:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695184:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532131.695185:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532131.695186:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695189:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695204:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695207:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f40fff0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4694016->8417279] (req 4694016->8417279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.695216:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.695221:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.695507:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.695540:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532131.695541:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.695552:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.695553:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468437888
00000100:00100000:0.0:1651532131.695563:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468437824
00000100:00100000:0.0:1651532131.695567:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3692
00000100:00100000:1.0:1651532131.695569:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468433024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 500082us (500152us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532131.695569:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468437888:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532131.695572:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4294
00010000:00010000:0.0:1651532131.695573:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.695577:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4100c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5f6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.695579:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695583:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532131.695586:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4100c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5f6 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.695590:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4100c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5f6 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.695593:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532131.695594:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.695596:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.695599:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.695602:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468437888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (110us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532131.695604:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.695605:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.695605:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.695607:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3692
00010000:00010000:1.0:1651532131.695609:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.695611:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3693
00000100:00100000:0.0:1651532131.695613:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468437824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.695615:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.695616:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695617:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4100d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5ef expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.695619:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f40fff7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [184320->7761919] (req 184320->7761919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695623:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4100d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5ef expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.695625:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.695627:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.695627:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4100d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5ef expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.695630:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532131.695634:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468437824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.695637:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3693
00000100:00100000:1.0:1651532131.696081:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.696115:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.696126:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.696128:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468438144
00000100:00100000:1.0:1651532131.696135:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.696143:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.696153:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468438080
00000100:00100000:0.0:1651532131.696154:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4303
00000100:00100000:0.0:1651532131.696156:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d377484d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468438144:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532131.696166:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4304
00000100:00100000:1.0:1651532131.696168:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe864bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468438080:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532131.696168:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.696173:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532131.696174:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.696176:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.696180:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532131.696180:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.696184:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.696185:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.696188:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.696191:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532131.696192:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.696196:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.696196:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.696199:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.696200:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.696203:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.696208:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468438336
00000100:00100000:0.0:1651532131.696214:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468438272
00000100:00100000:0.0:1651532131.696216:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468438208
00000100:00100000:0.0:1651532131.696219:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3694
00000100:00100000:0.0:1651532131.696220:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018165273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468438336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.696223:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.696226:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4100e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a60b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.696227:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3695
00000100:00100000:1.0:1651532131.696228:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468438272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.696231:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.696233:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4100e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a60b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.696234:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4100ec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a604 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.696237:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4100e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a60b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.696240:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532131.696242:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4100ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a604 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.696246:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4100ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a604 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.696250:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532131.696251:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018165273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468438336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.696254:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3694
00000100:00100000:1.0:1651532131.696258:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468438272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.696259:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3696
00000100:00100000:1.0:1651532131.696261:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3695
00000100:00100000:0.0:1651532131.696261:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468438208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.696263:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.696265:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4100f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a5fd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.696271:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4100f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5fd expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.696275:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4100f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a5fd expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.696278:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532131.696283:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468438208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (140us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.696285:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3696
00000100:00100000:1.0:1651532131.696567:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.696580:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468438784
00000100:00100000:0.0:1651532131.696593:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3697
00000100:00100000:0.0:1651532131.696595:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468438784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.696598:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.696602:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4100fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a612 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.696612:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4100fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a612 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.696616:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4100fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a612 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.696619:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532131.696629:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468438784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.696632:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3697
00000001:00080000:1.0:1651532131.828461:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793811 is committed
00002000:00010000:1.0:1651532131.828475:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532130 -> 1651532131
00010000:00010000:1.0:1651532131.828477:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828481:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.828509:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468433728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499340us (499401us total) trans 158913793811 rc 0/0
00000100:00100000:1.0:1651532131.828512:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4295
00010000:00010000:1.0:1651532131.828519:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828522:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.828523:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828526:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828531:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.828532:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.828532:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828535:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828538:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.828539:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.828540:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828542:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828559:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828562:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410013 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->10383359] (req 2285568->10383359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828567:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828570:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.828572:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.828578:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.828859:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.828864:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828868:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828873:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.828883:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468433792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499708us (499759us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532131.828887:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b720e370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468435328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 407772us (407842us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532131.828887:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4296
00000100:00100000:1.0:1651532131.828890:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4297
00010000:00010000:0.0:1651532131.828894:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828897:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.828898:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532131.828899:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828901:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.828902:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.828902:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828907:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.828908:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.828911:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41001a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->9920511] (req 1552384->9920511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828912:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.828913:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.828914:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828917:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828923:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828926:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410059 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3006464->10358783] (req 3006464->10358783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828931:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.828934:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.829001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.829011:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468438912
00000100:00100000:0.0:1651532131.829024:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3698
00000100:00100000:0.0:1651532131.829026:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468438912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.829030:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.829042:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410101 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a619 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.829054:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410101 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a619 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.829092:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410101 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a619 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532131.829101:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532131.829102:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532131.829109:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468439040
00000100:00100000:1.0:1651532131.829116:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3699
00000100:00100000:1.0:1651532131.829118:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468439040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.829123:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.829127:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410108 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a620 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.829135:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468438912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 108us (134us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.829138:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3698
00010000:00010000:1.0:1651532131.829142:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410108 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a620 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.829146:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410108 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a620 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.829149:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532131.829158:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468439040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.829160:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3699
00000100:00100000:0.0:1651532131.829350:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.829362:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468439232
00000100:00100000:0.0:1651532131.829365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.829373:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468439168
00000100:00100000:0.0:1651532131.829374:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.829385:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4305
00000100:00100000:0.0:1651532131.829388:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4306
00000100:00100000:0.0:1651532131.829391:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468439168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532131.829400:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.829401:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468439232:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532131.829404:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532131.829405:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.829408:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.829408:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532131.829409:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.829413:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.829414:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.829417:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532131.829418:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.829422:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.829422:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.829425:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.829426:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.829435:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468439296
00000100:00100000:1.0:1651532131.829442:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3700
00000100:00100000:1.0:1651532131.829443:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468439296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.829446:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.829448:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41011d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a627 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.829455:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41011d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a627 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.829459:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41011d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a627 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.829463:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532131.829473:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468439296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.829476:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3700
00000100:00100000:0.0:1651532131.829532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.829543:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468439488
00000100:00100000:0.0:1651532131.829545:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.829559:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468439424
00000100:00100000:0.0:1651532131.829560:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3701
00000100:00100000:0.0:1651532131.829563:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468439488:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532131.829565:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3702
00010000:00010000:0.0:1651532131.829566:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.829570:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410124 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a635 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.829575:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468439424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.829578:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410124 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a635 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.829579:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.829582:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41012b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a62e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.829582:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410124 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a635 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.829586:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532131.829589:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41012b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a62e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.829593:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41012b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a62e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532131.829600:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468439488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (68us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532131.829602:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532131.829603:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3701
00000100:00100000:1.0:1651532131.829610:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468439424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.829613:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3702
00000100:00100000:0.0:1651532131.829955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.829964:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468439808
00000100:00100000:0.0:1651532131.829967:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.829981:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468439872
00000100:00100000:0.0:1651532131.829983:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3703
00000100:00100000:0.0:1651532131.829986:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468439808:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532131.829990:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3704
00000100:00100000:1.0:1651532131.829992:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468439872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.829994:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.829995:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.829999:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410139 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a643 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.829999:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410132 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a63c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.830007:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410139 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a643 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.830008:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410132 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a63c expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.830011:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410139 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a643 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.830012:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410132 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a63c expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.830015:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532131.830022:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532131.830029:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468439808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.830031:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3703
00000100:00100000:1.0:1651532131.830037:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468439872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.830039:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3704
00000100:00100000:0.0:1651532131.830321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.830345:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468440064
00000100:00100000:1.0:1651532131.830352:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3705
00000100:00100000:1.0:1651532131.830354:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468440064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.830357:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.830360:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410140 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a64a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.830368:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410140 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a64a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.830372:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410140 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a64a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532131.830375:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532131.830384:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468440064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532131.830386:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3705
00000001:00080000:1.0:1651532131.945143:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793812 is committed
00010000:00010000:1.0:1651532131.945159:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945166:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.945188:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000724d966c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468435200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524046us (524128us total) trans 158913793812 rc 0/0
00000100:00100000:1.0:1651532131.945191:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4298
00010000:00010000:1.0:1651532131.945198:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945202:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532131.945203:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945206:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945211:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.945212:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532131.945212:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945216:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945232:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.945233:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945235:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410067 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2326528->8716287] (req 2326528->8716287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.945240:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.945657:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.945665:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.945672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532131.945679:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468440384
00000100:00100000:1.0:1651532131.945688:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468440320
00000100:00100000:1.0:1651532131.945694:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4307
00000100:00100000:1.0:1651532131.945695:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468440384:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532131.945702:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945706:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.945707:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532131.945708:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945711:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532131.945717:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4308
00000100:00100000:1.0:1651532131.945719:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468440320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532131.945723:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945726:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532131.945727:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.945731:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468440448
00010000:00010000:1.0:1651532131.945732:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945735:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532131.945736:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532131.945744:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3706
00000100:00100000:0.0:1651532131.945746:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468440448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532131.945747:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532131.945750:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.945750:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532131.945754:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.945754:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410155 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a651 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.945762:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410155 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a651 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.945766:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410155 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a651 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.945770:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532131.945781:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468440448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.945784:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3706
00000100:00100000:1.0:1651532131.946050:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532131.946069:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468440832
00000100:00100000:0.0:1651532131.946080:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3707
00000100:00100000:0.0:1651532131.946082:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468440832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532131.946086:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532131.946090:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41015c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a658 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532131.946097:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41015c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a658 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.946101:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41015c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a658 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532131.946105:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532131.946116:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468440832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532131.946118:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3707
00000001:00080000:1.0:1651532132.011857:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793813 is committed
00010000:00010000:0.0:1651532132.011889:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011894:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.011917:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d43c04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468436096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482743us (482806us total) trans 158913793813 rc 0/0
00000100:00100000:0.0:1651532132.011920:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4299
00010000:00010000:0.0:1651532132.011927:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011931:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532132.011932:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011935:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011940:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.011941:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.011942:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011945:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011948:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.011948:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.011949:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011954:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011971:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011975:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41007c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->10399743] (req 692224->10399743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.011980:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.011985:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011985:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.011988:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.012237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.012251:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468441024
00000100:00100000:1.0:1651532132.012259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.012265:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.012265:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468440960
00000100:00100000:0.0:1651532132.012270:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3708
00000100:00100000:0.0:1651532132.012272:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468441024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.012275:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.012279:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410163 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a666 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.012284:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.012288:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.012292:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.012295:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410163 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a666 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.012302:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410163 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a666 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532132.012306:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468437184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416693us (416720us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532132.012309:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4301
00010000:00010000:0.0:1651532132.012311:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532132.012317:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.012320:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532132.012320:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468441024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (84us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532132.012321:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.012323:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3708
00010000:00010000:1.0:1651532132.012324:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.012338:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468441152
00010000:00010000:1.0:1651532132.012339:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.012340:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.012340:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.012342:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3709
00010000:00010000:1.0:1651532132.012343:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.012343:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468440960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.012346:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.012349:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41016a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a65f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.012351:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.012356:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41016a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a65f expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.012359:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41016a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a65f expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.012362:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532132.012363:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41009f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1409024->8200191] (req 1409024->8200191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.012369:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.012369:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468440960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.012371:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3709
00010000:00010000:1.0:1651532132.012372:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.012375:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3710
00000100:00100000:0.0:1651532132.012376:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468441152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.012379:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.012380:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410171 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a66d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.012385:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410171 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a66d expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.012389:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410171 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a66d expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.012392:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532132.012397:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468441152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (132us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.012399:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3710
00010000:00010000:0.0:1651532132.012409:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.012413:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.012425:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.012428:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018bbbca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468436160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483252us (483295us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532132.012430:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.012431:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.012431:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4300
00010000:00010000:1.0:1651532132.012434:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.012439:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.012442:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410083 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6598656->9412607] (req 6598656->9412607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.012921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.012972:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.012983:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468441344
00000100:00100000:0.0:1651532132.012985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.012993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.012997:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468441280
00000100:00100000:1.0:1651532132.013009:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4309
00000100:00100000:0.0:1651532132.013010:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.013011:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468441344:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532132.013021:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4310
00000100:00100000:0.0:1651532132.013023:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468441280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532132.013024:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.013028:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.013029:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532132.013030:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.013032:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.013033:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.013036:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532132.013037:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.013040:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.013043:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532132.013044:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.013048:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.013051:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468441408
00010000:00010000:0.0:1651532132.013051:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.013054:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.013057:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468441600
00000100:00100000:1.0:1651532132.013060:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468441856
00000100:00100000:0.0:1651532132.013063:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3711
00000100:00100000:1.0:1651532132.013065:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3712
00000100:00100000:0.0:1651532132.013065:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468441408:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532132.013066:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468441600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.013067:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.013069:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.013069:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410186 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a674 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.013072:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41018d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a67b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.013076:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410186 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a674 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.013079:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41018d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a67b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.013080:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410186 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a674 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.013083:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532132.013084:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41018d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a67b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.013090:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532132.013097:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468441408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.013100:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3711
00000100:00100000:0.0:1651532132.013105:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3713
00000100:00100000:1.0:1651532132.013106:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468441600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (112us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.013107:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468441856:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532132.013109:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3712
00010000:00010000:0.0:1651532132.013110:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.013112:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410194 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a682 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.013118:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410194 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a682 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.013122:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410194 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a682 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.013127:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532132.013133:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468441856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.013136:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3713
00000100:00100000:0.0:1651532132.013430:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.013438:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468442176
00000100:00100000:0.0:1651532132.013452:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3714
00000100:00100000:0.0:1651532132.013454:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468442176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.013457:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.013461:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41019b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a689 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.013468:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41019b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a689 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.013472:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41019b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a689 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.013476:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532132.013490:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468442176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.013492:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3714
00000100:00100000:0.0:1651532132.013701:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.013708:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468442304
00000100:00100000:0.0:1651532132.013722:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3715
00000100:00100000:0.0:1651532132.013725:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468442304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.013728:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.013731:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4101a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a690 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.013738:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4101a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a690 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.013742:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4101a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a690 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.013746:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532132.013759:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468442304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.013762:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3715
00000001:00080000:1.0:1651532132.078577:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793814 is committed
00010000:00010000:1.0:1651532132.078593:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.078597:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.078618:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468437120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482970us (483009us total) trans 158913793814 rc 0/0
00000100:00100000:1.0:1651532132.078621:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4302
00010000:00010000:0.0:1651532132.078623:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.078628:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532132.078629:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.078633:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.078638:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.078639:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.078640:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.078643:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.078651:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.078654:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4100a6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->5926911] (req 12288->5926911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.078663:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.078667:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.078982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.078999:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.079005:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.079016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.079019:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468442624
00000100:00100000:1.0:1651532132.079027:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468442496
00000100:00100000:0.0:1651532132.079031:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468442688
00000100:00100000:0.0:1651532132.079038:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3716
00000100:00100000:0.0:1651532132.079040:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468442624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.079044:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532132.079049:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468442560
00010000:00010000:0.0:1651532132.079053:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4101a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a697 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.079059:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.079062:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4101a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a697 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532132.079064:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4311
00000100:00100000:1.0:1651532132.079066:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468442496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532132.079066:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4101a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a697 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.079069:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532132.079073:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079077:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.079078:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.079083:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468442624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.079086:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3716
00010000:00010000:1.0:1651532132.079087:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532132.079088:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.079091:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3717
00010000:00010000:1.0:1651532132.079093:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.079093:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468442688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.079096:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.079096:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.079098:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4101b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a69e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.079103:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4312
00010000:00010000:0.0:1651532132.079103:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532132.079105:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468442560:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532132.079105:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4101b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a69e expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.079108:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4101b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a69e expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.079110:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.079112:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532132.079113:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.079114:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079117:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00000100:00100000:0.0:1651532132.079117:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468442688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.079120:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3717
00010000:00010000:1.0:1651532132.079124:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079129:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079132:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079142:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079145:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.079160:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d377484d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468438144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 383004us (383079us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532132.079163:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4303
00010000:00010000:1.0:1651532132.079169:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079173:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.079174:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079177:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079181:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.079182:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.079183:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079186:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079192:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079195:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4100d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9854975] (req 786432->9854975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079200:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079203:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.079644:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.079658:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.079668:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.079670:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468443008
00000100:00100000:0.0:1651532132.079682:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468443072
00000100:00100000:0.0:1651532132.079685:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468443136
00000100:00100000:0.0:1651532132.079688:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3718
00000100:00100000:0.0:1651532132.079689:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468443008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.079693:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.079696:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4101c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6a5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.079707:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4101c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6a5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.079711:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4101c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6a5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.079714:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532132.079729:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468443008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.079732:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3718
00000100:00100000:0.0:1651532132.079736:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3719
00000100:00100000:0.0:1651532132.079738:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468443072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.079740:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.079743:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4101cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6ac expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.079748:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4101cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6ac expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.079755:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4101cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6ac expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.079760:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532132.079765:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3720
00000100:00100000:1.0:1651532132.079768:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468443136:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.079774:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468443072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (116us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532132.079777:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532132.079778:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3719
00010000:00010000:1.0:1651532132.079781:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4101d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6b3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.079789:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4101d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6b3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.079794:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4101d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6b3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.079797:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532132.079820:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468443136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (152us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.079823:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3720
00000100:00100000:1.0:1651532132.079988:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.079996:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468443264
00000100:00100000:1.0:1651532132.080009:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3721
00000100:00100000:1.0:1651532132.080011:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468443264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.080015:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.080018:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4101da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6ba expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.080025:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4101da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6ba expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.080029:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4101da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6ba expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.080033:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532132.080042:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468443264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.080054:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3721
00000100:00100000:1.0:1651532132.080278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.080285:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468443584
00000100:00100000:1.0:1651532132.080298:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3722
00000100:00100000:1.0:1651532132.080300:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468443584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.080303:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.080307:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4101e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6c1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.080314:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4101e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6c1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.080318:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4101e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6c1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.080321:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532132.080340:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468443584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.080342:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3722
00000100:00100000:1.0:1651532132.080551:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.080558:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468443712
00000100:00100000:1.0:1651532132.080570:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3723
00000100:00100000:1.0:1651532132.080572:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468443712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.080575:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.080579:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4101e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6c8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.080593:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4101e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6c8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.080597:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4101e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6c8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.080600:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532132.080610:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468443712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.080613:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3723
00000100:00100000:1.0:1651532132.080866:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.080873:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468443840
00000100:00100000:1.0:1651532132.080886:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3724
00000100:00100000:1.0:1651532132.080887:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468443840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.080891:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.080894:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4101ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6cf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.080901:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4101ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6cf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.080905:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4101ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6cf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.080908:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532132.080917:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468443840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.080920:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3724
00000100:00100000:1.0:1651532132.081126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.081133:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468444032
00000100:00100000:1.0:1651532132.081145:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3725
00000100:00100000:1.0:1651532132.081147:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468444032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.081150:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.081153:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101f6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6d6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.081160:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6d6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.081164:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6d6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.081167:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532132.081176:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468444032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.081178:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3725
00000001:00080000:1.0:1651532132.178588:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793815 is committed
00010000:00010000:1.0:1651532132.178603:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.178607:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.178626:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe864bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468438080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482457us (482519us total) trans 158913793815 rc 0/0
00000100:00100000:1.0:1651532132.178629:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4304
00010000:00010000:1.0:1651532132.178636:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.178639:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.178640:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.178643:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.178648:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.178649:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.178650:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.178653:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.178665:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.178668:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4100de lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->9879551] (req 1155072->9879551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.178679:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.178685:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.179051:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.179060:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.179067:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.179073:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.179083:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468444224
00000100:00100000:0.0:1651532132.179090:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468444288
00000100:00100000:1.0:1651532132.179095:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468444160
00000100:00100000:1.0:1651532132.179103:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4313
00000100:00100000:1.0:1651532132.179105:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468444224:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532132.179108:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468444416
00010000:00010000:1.0:1651532132.179112:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.179113:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3726
00000100:00100000:0.0:1651532132.179115:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468444288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.179117:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.179118:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532132.179118:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.179119:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.179122:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.179129:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4314
00000100:00100000:1.0:1651532132.179130:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468444160:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532132.179131:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410204 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6dd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.179134:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.179137:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.179138:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.179141:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.179146:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532132.179147:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.179152:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.179153:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410204 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6dd expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.179155:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.179157:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410204 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6dd expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.179158:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.179161:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532132.179165:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3727
00000100:00100000:1.0:1651532132.179167:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468444416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.179169:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.179172:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410212 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6e4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.179175:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468444288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.179178:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3726
00010000:00010000:1.0:1651532132.179186:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410212 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6e4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.179190:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410212 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6e4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.179194:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532132.179202:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468444416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.179205:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3727
00000001:00080000:1.0:1651532132.295248:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793816 is committed
00010000:00010000:0.0:1651532132.295280:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295285:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.295306:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468439168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 465914us (465940us total) trans 158913793816 rc 0/0
00010000:00010000:1.0:1651532132.295309:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.295309:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4306
00010000:00010000:1.0:1651532132.295313:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.295314:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295318:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295323:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.295324:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.295325:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295337:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295341:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.295341:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.295342:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295345:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295356:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295367:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41010f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9142271] (req 167936->9142271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295373:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295376:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295400:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295404:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.295639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.295656:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532132.295662:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.295671:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468444800
00010000:00010000:1.0:1651532132.295672:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.295678:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468444736
00000100:00100000:0.0:1651532132.295682:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3728
00000100:00100000:0.0:1651532132.295684:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468444800:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532132.295688:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468440384:12345-10.240.43.64@tcp:3:fio.0 Request processed in 349991us (350031us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532132.295688:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532132.295691:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4307
00010000:00010000:0.0:1651532132.295692:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410219 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6f2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295697:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.295701:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295701:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410219 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6f2 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.295705:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295709:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410219 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6f2 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532132.295719:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468439232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466332us (466370us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532132.295719:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532132.295722:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4305
00010000:00010000:1.0:1651532132.295728:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.295728:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468444800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (90us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532132.295731:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.295732:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.295733:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3728
00010000:00010000:1.0:1651532132.295735:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.295738:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3729
00000100:00100000:0.0:1651532132.295739:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468444736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.295740:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295742:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.295743:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410147 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8953855] (req 352256->8953855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295744:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410220 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6eb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295746:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295749:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.295750:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.295751:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295751:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410220 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6eb expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.295754:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295755:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410220 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6eb expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.295757:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.295758:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.295758:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295758:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532132.295761:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.295763:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468444736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (107us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532132.295764:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.295765:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.295765:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.295765:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3729
00010000:00010000:1.0:1651532132.295768:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295774:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295777:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410116 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [503808->7528447] (req 503808->7528447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295779:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295782:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.295782:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.295788:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.296020:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.296030:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296041:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296045:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.296046:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.296051:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468441344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 283039us (283132us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532132.296054:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.296055:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4309
00010000:00010000:1.0:1651532132.296060:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296063:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410178 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2473984->3837951] (req 2473984->3837951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.296268:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.296296:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.296308:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468445184
00000100:00100000:0.0:1651532132.296309:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.296317:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.296319:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468445056
00000100:00100000:1.0:1651532132.296336:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4315
00000100:00100000:1.0:1651532132.296338:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468445184:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532132.296341:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532132.296345:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296349:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.296350:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296353:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532132.296354:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.296355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532132.296358:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296361:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.296369:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468445632
00000100:00100000:1.0:1651532132.296376:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468445568
00000100:00100000:1.0:1651532132.296380:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4316
00000100:00100000:1.0:1651532132.296381:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468445056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532132.296394:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.296396:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532132.296398:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.296399:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296402:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532132.296402:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296406:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.296408:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4317
00000100:00100000:0.0:1651532132.296410:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468445632:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532132.296412:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.296419:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4318
00010000:00010000:0.0:1651532132.296420:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.296421:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468445568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532132.296424:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.296425:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.296425:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532132.296426:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296430:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.296431:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296433:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296436:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532132.296436:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296440:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.296440:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296442:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296445:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.296448:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468445248
00000100:00100000:0.0:1651532132.296455:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468445376
00000100:00100000:0.0:1651532132.296457:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468445696
00000100:00100000:0.0:1651532132.296460:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3730
00000100:00100000:0.0:1651532132.296462:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468445248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.296465:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.296467:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410243 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a6f9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.296471:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3731
00000100:00100000:1.0:1651532132.296472:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b60e634 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468445376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.296474:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410243 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6f9 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.296475:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.296478:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41024a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a700 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.296478:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410243 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a6f9 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.296481:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532132.296486:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41024a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a700 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.296490:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41024a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a700 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532132.296495:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468445248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (186us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.296498:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3730
00010000:00010000:1.0:1651532132.296500:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532132.296502:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3732
00000100:00100000:0.0:1651532132.296504:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468445696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.296507:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.296509:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410251 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a707 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.296510:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b60e634 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468445376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (193us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.296513:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3731
00010000:00010000:0.0:1651532132.296515:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410251 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a707 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.296521:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410251 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a707 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.296524:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532132.296530:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468445696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.296532:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3732
00000100:00100000:0.0:1651532132.296869:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.296885:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.296891:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468445952
00000100:00100000:0.0:1651532132.296892:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468445888
00000100:00100000:1.0:1651532132.296901:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3733
00000100:00100000:1.0:1651532132.296902:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468445952:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.296903:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3734
00000100:00100000:0.0:1651532132.296904:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468445888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.296906:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.296908:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.296909:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410258 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a715 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.296912:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41025f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a70e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.296917:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410258 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a715 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.296920:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41025f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a70e expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.296924:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41025f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a70e expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.296927:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532132.296931:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410258 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a715 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.296935:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532132.296940:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468445888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.296945:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3734
00000100:00100000:1.0:1651532132.296949:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468445952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.296952:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3733
00000100:00100000:0.0:1651532132.297269:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.297283:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.297294:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468446272
00000100:00100000:1.0:1651532132.297306:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468446208
00000100:00100000:1.0:1651532132.297310:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3735
00000100:00100000:1.0:1651532132.297312:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468446272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.297315:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532132.297317:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3736
00010000:00010000:1.0:1651532132.297319:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410266 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a723 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.297319:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468446208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.297323:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.297333:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410266 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a723 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.297335:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41026d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a71c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.297337:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410266 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a723 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.297341:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532132.297343:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41026d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a71c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.297347:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41026d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a71c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.297350:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532132.297351:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468446272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.297354:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3735
00000100:00100000:0.0:1651532132.297358:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468446208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.297363:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3736
00000100:00100000:0.0:1651532132.297671:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.297678:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468446464
00000100:00100000:0.0:1651532132.297685:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3737
00000100:00100000:0.0:1651532132.297687:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468446464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.297690:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.297693:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410274 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a72a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.297701:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410274 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a72a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.297705:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410274 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a72a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.297708:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532132.297725:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468446464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.297727:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3737
00000001:00080000:1.0:1651532132.353656:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793817 is committed
00010000:00010000:1.0:1651532132.353671:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.353675:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.353695:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468440320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 407975us (408029us total) trans 158913793817 rc 0/0
00000100:00100000:1.0:1651532132.353698:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4308
00010000:00010000:0.0:1651532132.353707:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.353712:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532132.353713:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.353716:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.353722:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.353723:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.353724:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.353727:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.353750:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.353755:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41014e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6569984->10457087] (req 6569984->10457087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.353762:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.353765:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.354042:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.354053:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.354066:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468446656
00000100:00100000:1.0:1651532132.354073:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468446720
00000100:00100000:1.0:1651532132.354077:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3738
00000100:00100000:1.0:1651532132.354079:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468446656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.354083:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.354086:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41027b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a731 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.354094:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41027b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a731 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.354098:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41027b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a731 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.354101:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532132.354110:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468446656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.354120:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3739
00000100:00100000:1.0:1651532132.354123:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3738
00000100:00100000:0.0:1651532132.354123:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468446720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.354126:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.354130:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410282 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a738 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.354138:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410282 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a738 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.354142:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410282 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a738 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.354145:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532132.354164:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468446720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.354176:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3739
00000001:00080000:1.0:1651532132.495352:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793818 is committed
00010000:00010000:0.0:1651532132.495383:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.495388:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.495410:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468441280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482386us (482438us total) trans 158913793818 rc 0/0
00010000:00010000:1.0:1651532132.495412:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.495413:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4310
00010000:00010000:1.0:1651532132.495417:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.495418:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495421:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495427:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.495427:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.495428:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495431:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495439:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495442:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41017f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->9453567] (req 434176->9453567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495447:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495461:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.495856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.495863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.495870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.495872:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468446976
00000100:00100000:1.0:1651532132.495881:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.495887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.495889:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468447040
00000100:00100000:0.0:1651532132.495895:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4319
00000100:00100000:1.0:1651532132.495897:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4320
00000100:00100000:0.0:1651532132.495897:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468446976:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532132.495900:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468447040:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532132.495904:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495908:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.495909:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532132.495910:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.495913:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532132.495914:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495919:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.495920:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495923:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532132.495924:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495928:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.495928:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495932:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.495935:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.495941:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468447104
00000100:00100000:0.0:1651532132.495944:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468447232
00000100:00100000:0.0:1651532132.495949:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468447296
00000100:00100000:1.0:1651532132.495950:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3740
00000100:00100000:1.0:1651532132.495952:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468447104:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.495952:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3741
00010000:00010000:1.0:1651532132.495954:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532132.495954:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468447232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.495957:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410297 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a73f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.495957:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.495960:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41029e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a746 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.495964:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410297 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a73f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.495967:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41029e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a746 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.495968:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410297 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a73f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.495971:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41029e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a746 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.495972:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532132.495975:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532132.495984:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468447104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.495987:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3740
00000100:00100000:0.0:1651532132.495991:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468447232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.495992:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3742
00000100:00100000:1.0:1651532132.495994:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468447296:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.495994:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3741
00010000:00010000:1.0:1651532132.495996:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.495999:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a74d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.496004:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a74d expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.496020:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a74d expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.496023:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532132.496041:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468447296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (153us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.496044:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3742
00000100:00100000:0.0:1651532132.496254:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.496272:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468447424
00000100:00100000:1.0:1651532132.496281:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3743
00000100:00100000:1.0:1651532132.496282:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468447424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.496286:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.496289:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4102ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a754 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.496296:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4102ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a754 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.496300:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4102ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a754 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.496303:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532132.496313:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468447424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.496316:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3743
00000100:00100000:0.0:1651532132.496377:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.496389:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468447616
00000100:00100000:1.0:1651532132.496396:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3744
00000100:00100000:1.0:1651532132.496398:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468447616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.496401:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.496404:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4102b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a75b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.496412:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4102b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a75b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.496416:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4102b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a75b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.496419:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532132.496428:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468447616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.496430:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3744
00000001:00080000:1.0:1651532132.587015:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793819 is committed
00002000:00010000:0.0:1651532132.587044:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532131 -> 1651532132
00002000:00010000:0.0:1651532132.587046:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532131 -> 1651532132
00010000:00010000:0.0:1651532132.587049:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587052:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587074:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.587075:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468442496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 508008us (508093us total) trans 158913793819 rc 0/0
00010000:00010000:1.0:1651532132.587079:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532132.587079:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4311
00010000:00010000:1.0:1651532132.587080:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587083:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587098:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.587099:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.587100:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587103:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587106:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.587106:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.587115:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587118:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587126:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587129:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4101b0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10317823] (req 2035712->10317823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587135:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587138:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587162:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587166:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.587518:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.587530:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468447872
00000100:00100000:0.0:1651532132.587532:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.587540:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.587551:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468447936
00000100:00100000:1.0:1651532132.587554:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468448000
00000100:00100000:0.0:1651532132.587556:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.587558:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3745
00000100:00100000:1.0:1651532132.587559:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468447872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.587568:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.587576:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4102ba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a762 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.587576:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468448064
00010000:00010000:1.0:1651532132.587582:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.587584:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4102ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a762 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532132.587584:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3746
00000100:00100000:0.0:1651532132.587585:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468447936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.587588:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4102ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a762 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.587589:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.587592:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532132.587594:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4102c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a769 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587599:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532132.587602:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468447872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (86us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532132.587603:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4102c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a769 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532132.587605:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3745
00010000:00010000:0.0:1651532132.587607:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4102c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a769 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532132.587610:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3747
00010000:00010000:0.0:1651532132.587610:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532132.587612:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468448000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.587615:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.587617:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4102c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a770 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.587619:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468447936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (87us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532132.587622:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532132.587622:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3746
00010000:00010000:1.0:1651532132.587624:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4102c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a770 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.587627:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4102c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a770 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532132.587627:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3748
00000100:00100000:0.0:1651532132.587628:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468448064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.587631:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532132.587631:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.587633:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4102cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a777 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.587636:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468448000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (96us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532132.587637:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532132.587638:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3747
00010000:00010000:0.0:1651532132.587639:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4102cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a777 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.587643:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4102cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a777 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.587646:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532132.587650:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.587651:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468448064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.587653:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3748
00010000:00010000:1.0:1651532132.587654:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.587670:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468444224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408565us (408627us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532132.587673:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4313
00010000:00010000:0.0:1651532132.587674:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587678:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532132.587679:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587682:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.587688:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587692:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587697:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.587698:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468442560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508592us (508699us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532132.587700:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4101fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1798144->9793535] (req 1798144->9793535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.587701:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4312
00010000:00010000:0.0:1651532132.587704:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587706:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532132.587707:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587710:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587713:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.587714:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.587715:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587718:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587727:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587731:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4101be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5423104->9158655] (req 5423104->9158655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587744:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.587749:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.588214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.588228:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468448192
00000100:00100000:0.0:1651532132.588233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.588249:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468448320
00000100:00100000:0.0:1651532132.588250:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.588258:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4321
00000100:00100000:1.0:1651532132.588260:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468448192:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532132.588263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532132.588267:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.588269:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532132.588271:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.588272:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.588275:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532132.588276:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.588277:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4322
00000100:00100000:0.0:1651532132.588279:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468448320:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532132.588280:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.588283:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.588288:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.588293:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532132.588294:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.588297:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532132.588298:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.588300:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468448448
00000100:00100000:1.0:1651532132.588305:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468448384
00010000:00010000:0.0:1651532132.588305:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.588308:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468448640
00010000:00010000:0.0:1651532132.588309:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.588310:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3749
00000100:00100000:1.0:1651532132.588312:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468448448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.588314:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532132.588316:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3750
00010000:00010000:1.0:1651532132.588317:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4102e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a785 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.588317:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468448384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.588320:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.588322:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4102eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a77e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.588324:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4102e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a785 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.588337:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4102e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a785 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.588339:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4102eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a77e expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.588341:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532132.588344:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4102eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a77e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.588348:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532132.588352:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468448448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.588354:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3749
00000100:00100000:0.0:1651532132.588357:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468448384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.588359:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3751
00000100:00100000:1.0:1651532132.588361:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468448640:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.588361:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3750
00010000:00010000:1.0:1651532132.588364:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.588366:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4102f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a78c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.588375:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4102f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a78c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.588379:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4102f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a78c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.588382:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532132.588387:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468448640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.588389:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3751
00000100:00100000:0.0:1651532132.588725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.588739:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.588745:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468448768
00000100:00100000:0.0:1651532132.588747:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468448960
00000100:00100000:1.0:1651532132.588759:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3752
00000100:00100000:1.0:1651532132.588761:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468448768:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.588762:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3753
00000100:00100000:0.0:1651532132.588763:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468448960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.588764:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.588767:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.588768:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4102f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a793 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.588775:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4102f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a793 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.588779:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4102f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a793 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.588779:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410300 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a79a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.588782:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532132.588788:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410300 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a79a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532132.588792:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468448768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (68us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532132.588792:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410300 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a79a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532132.588795:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3752
00010000:00010000:0.0:1651532132.588795:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532132.588816:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468448960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.588819:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3753
00000100:00100000:0.0:1651532132.589066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.589073:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468449088
00000100:00100000:0.0:1651532132.589080:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3754
00000100:00100000:0.0:1651532132.589081:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468449088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.589085:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.589088:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410307 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7a1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.589095:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410307 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7a1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.589102:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410307 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7a1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.589105:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532132.589122:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468449088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.589125:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3754
00000100:00100000:0.0:1651532132.589343:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.589351:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468449280
00000100:00100000:0.0:1651532132.589358:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3755
00000100:00100000:0.0:1651532132.589360:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468449280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.589363:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.589367:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41030e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7a8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.589374:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41030e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7a8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.589378:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41030e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7a8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.589381:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532132.589396:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468449280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.589400:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3755
00000100:00100000:0.0:1651532132.589599:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.589606:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468449408
00000100:00100000:0.0:1651532132.589613:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3756
00000100:00100000:0.0:1651532132.589614:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468449408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.589618:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.589621:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410315 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7af expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.589628:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410315 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7af expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.589632:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410315 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7af expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.589635:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532132.589652:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468449408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.589654:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3756
00000100:00100000:0.0:1651532132.589910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.589918:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468449536
00000100:00100000:0.0:1651532132.589925:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3757
00000100:00100000:0.0:1651532132.589926:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468449536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.589930:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.589933:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41031c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7b6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.589940:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41031c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7b6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.589944:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41031c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7b6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.589948:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532132.589964:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468449536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.589967:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3757
00000001:00080000:1.0:1651532132.645408:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793820 is committed
00010000:00010000:0.0:1651532132.645438:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.645443:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.645466:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468444160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466334us (466405us total) trans 158913793820 rc 0/0
00010000:00010000:1.0:1651532132.645467:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.645469:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4314
00010000:00010000:1.0:1651532132.645471:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.645472:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.645476:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.645481:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.645482:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.645482:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.645485:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.645493:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.645496:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41020b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7512063] (req 1601536->7512063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.645504:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.645511:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.645868:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.645888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.645901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.645905:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468449792
00000100:00100000:0.0:1651532132.645908:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.645913:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.645916:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468449728
00000100:00100000:1.0:1651532132.645922:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4323
00000100:00100000:1.0:1651532132.645924:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468449792:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532132.645925:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468449856
00010000:00010000:1.0:1651532132.645930:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.645936:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468449984
00000100:00100000:0.0:1651532132.645938:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468450048
00010000:00010000:1.0:1651532132.645941:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532132.645941:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3758
00010000:00010000:1.0:1651532132.645942:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532132.645943:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.645943:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468449856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.645946:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.645947:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.645951:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41032a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7bd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.645953:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4324
00000100:00100000:1.0:1651532132.645954:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468449728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532132.645957:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.645959:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.645960:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41032a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7bd expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.645963:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.645963:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.645966:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.645969:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532132.645969:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.645973:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.645973:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41032a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7bd expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.645976:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.645976:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532132.645980:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.645988:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468449856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.645991:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3758
00000100:00100000:1.0:1651532132.645994:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3759
00000100:00100000:1.0:1651532132.645995:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468449984:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.645996:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3760
00010000:00010000:1.0:1651532132.645998:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532132.645998:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468450048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.646000:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410338 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7c4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646001:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.646003:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41033f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7cb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.646005:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.646007:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410338 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7c4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.646008:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.646009:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41033f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7cb expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.646011:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410338 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7c4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.646013:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41033f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7cb expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.646015:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532132.646016:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532132.646023:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468449984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (115us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.646024:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468450048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.646026:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3759
00000100:00100000:0.0:1651532132.646028:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3760
00010000:00010000:0.0:1651532132.646039:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646043:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.646059:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468445184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 349720us (349791us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532132.646063:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4315
00010000:00010000:0.0:1651532132.646079:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646085:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532132.646087:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646091:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646097:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.646097:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.646098:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646101:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646105:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.646106:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.646107:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646112:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646147:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646151:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410227 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9924607] (req 999424->9924607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.646155:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646157:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646160:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.646162:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646174:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646177:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.646194:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.646198:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532132.646202:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468445632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 349791us (349860us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651532132.646203:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.646205:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4317
00010000:00010000:1.0:1651532132.646207:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.646212:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.646215:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410235 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1265664->1269759] (req 1265664->1269759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.646560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.646572:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.646574:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468450304
00000100:00100000:1.0:1651532132.646581:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.646590:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.646597:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468450496
00000100:00100000:0.0:1651532132.646606:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3761
00000100:00100000:0.0:1651532132.646607:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468450304:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532132.646610:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3762
00010000:00010000:0.0:1651532132.646611:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532132.646613:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468450496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.646615:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410346 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7d2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.646617:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.646621:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41034d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7d9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646623:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410346 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7d2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.646628:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410346 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7d2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.646629:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41034d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7d9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.646631:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532132.646633:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41034d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7d9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.646636:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532132.646642:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468450304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.646644:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468450496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.646645:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3761
00000100:00100000:1.0:1651532132.646647:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3762
00000100:00100000:0.0:1651532132.646653:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468450432
00000100:00100000:0.0:1651532132.646660:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4325
00000100:00100000:0.0:1651532132.646662:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468450432:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532132.646668:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646671:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532132.646673:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646675:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532132.646676:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646680:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646684:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.646690:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468450368
00000100:00100000:0.0:1651532132.646701:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4326
00000100:00100000:0.0:1651532132.646702:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468450368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532132.646707:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646713:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532132.646714:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646716:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532132.646717:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646721:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.646724:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532132.745435:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793821 is committed
00010000:00010000:1.0:1651532132.745450:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745454:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.745470:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468445056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449087us (449173us total) trans 158913793821 rc 0/0
00000100:00100000:1.0:1651532132.745473:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4316
00010000:00010000:1.0:1651532132.745479:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745482:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.745484:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745496:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745501:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.745502:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.745502:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745506:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745513:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745515:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41022e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1916928->9183231] (req 1916928->9183231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745521:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745524:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.745896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.745907:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.745916:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.745920:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468450688
00000100:00100000:1.0:1651532132.745924:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468450816
00000100:00100000:0.0:1651532132.745929:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468450880
00000100:00100000:1.0:1651532132.745931:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3763
00000100:00100000:1.0:1651532132.745941:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468450688:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.745942:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3764
00000100:00100000:0.0:1651532132.745944:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468450816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.745945:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.745948:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.745949:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410362 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7e0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.745952:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410369 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7e7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745956:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410362 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7e0 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.745961:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410362 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7e0 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.745961:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410369 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7e7 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.745964:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532132.745965:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410369 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7e7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.745972:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532132.745977:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468450688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.745980:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3763
00000100:00100000:1.0:1651532132.745985:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3765
00000100:00100000:1.0:1651532132.745987:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468450880:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.745987:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468450816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (80us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532132.745990:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532132.745990:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3764
00010000:00010000:1.0:1651532132.745992:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410370 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7ee expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.745998:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410370 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7ee expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.746001:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410370 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7ee expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.746007:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532132.746013:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468450880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.746016:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3765
00000100:00100000:1.0:1651532132.746255:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.746262:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468451008
00000100:00100000:1.0:1651532132.746274:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3766
00000100:00100000:1.0:1651532132.746275:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468451008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.746279:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.746282:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410377 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7f5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.746289:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410377 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7f5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.746293:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410377 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7f5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.746296:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532132.746307:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468451008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.746309:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3766
00000001:00080000:1.0:1651532132.812152:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793822 is committed
00010000:00010000:1.0:1651532132.812166:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.812173:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.812194:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468445568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 515772us (515840us total) trans 158913793822 rc 0/0
00010000:00010000:0.0:1651532132.812196:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.812197:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4318
00010000:00010000:0.0:1651532132.812202:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532132.812203:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812206:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812212:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.812213:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.812214:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812217:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812225:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812230:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41023c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1093632->9965567] (req 1093632->9965567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.812239:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.812243:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.812581:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.812595:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.812604:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.812613:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.812621:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.812628:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468451456
00000100:00100000:0.0:1651532132.812635:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468451520
00000100:00100000:0.0:1651532132.812638:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468451584
00000100:00100000:0.0:1651532132.812640:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3767
00000100:00100000:0.0:1651532132.812642:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468451456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.812646:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.812650:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41037e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a7fc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812658:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41037e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7fc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.812662:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41037e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a7fc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.812666:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532132.812669:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468451392
00000100:00100000:0.0:1651532132.812680:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468451456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.812682:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3767
00000100:00100000:1.0:1651532132.812689:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468451328
00000100:00100000:0.0:1651532132.812694:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3768
00000100:00100000:1.0:1651532132.812696:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4327
00000100:00100000:0.0:1651532132.812696:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468451520:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532132.812698:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468451392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532132.812699:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.812702:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410385 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a803 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.812705:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812708:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410385 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a803 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.812710:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.812711:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.812714:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532132.812714:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.812721:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812721:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410385 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a803 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.812724:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532132.812725:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.812731:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468451520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.812732:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4328
00000100:00100000:0.0:1651532132.812733:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3768
00000100:00100000:1.0:1651532132.812734:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468451328:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532132.812737:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3769
00010000:00010000:1.0:1651532132.812738:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.812739:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468451584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.812741:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532132.812741:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.812742:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812743:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41039a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a80a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.812744:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532132.812745:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.812748:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812749:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41039a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a80a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.812751:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.812752:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41039a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a80a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.812758:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532132.812763:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468451584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (142us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.812765:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3769
00000001:00080000:1.0:1651532132.870550:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793823 is committed
00010000:00010000:1.0:1651532132.870565:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.870576:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.870598:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468446976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 374701us (374743us total) trans 158913793823 rc 0/0
00000100:00100000:1.0:1651532132.870602:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4319
00010000:00010000:1.0:1651532132.870609:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.870613:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.870614:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.870617:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.870622:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.870622:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.870623:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.870626:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.870633:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.870636:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410289 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->7540735] (req 851968->7540735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.870641:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.870648:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.870962:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.870970:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.870976:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.870986:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468451840
00000100:00100000:0.0:1651532132.870999:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468451968
00000100:00100000:0.0:1651532132.871002:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468452032
00000100:00100000:0.0:1651532132.871005:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3770
00000100:00100000:0.0:1651532132.871007:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468451840:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532132.871009:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3771
00010000:00010000:0.0:1651532132.871010:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532132.871012:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468451968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.871014:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4103a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a811 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871016:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.871019:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4103a8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a818 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.871020:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.871023:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4103a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a811 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.871025:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.871027:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4103a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a818 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.871030:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4103a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a811 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.871032:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4103a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a818 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.871033:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532132.871035:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532132.871047:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468451840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.871049:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3770
00000100:00100000:1.0:1651532132.871052:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468451968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.871055:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3772
00000100:00100000:1.0:1651532132.871056:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3771
00000100:00100000:0.0:1651532132.871056:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468452032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.871059:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.871061:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4103af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a81f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.871066:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.871068:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4103af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a81f expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.871072:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4103af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a81f expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.871075:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532132.871081:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468452032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.871083:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3772
00010000:00010000:0.0:1651532132.871100:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.871105:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871122:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871126:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.871127:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.871129:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468447040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375229us (375265us total) trans 0 rc 40960/40960
00010000:00010000:1.0:1651532132.871131:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.871132:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4320
00010000:00010000:1.0:1651532132.871136:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.871137:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.871138:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871141:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871147:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871150:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410290 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->10485759] (req 430080->10485759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871155:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871158:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.871360:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.871416:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468452224
00000100:00100000:1.0:1651532132.871430:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3773
00000100:00100000:1.0:1651532132.871432:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468452224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.871436:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.871439:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4103b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a826 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871458:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4103b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a826 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.871463:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4103b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a826 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.871467:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532132.871478:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468452224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.871480:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3773
00000100:00100000:0.0:1651532132.871537:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.871548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.871551:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468452288
00000100:00100000:0.0:1651532132.871559:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468452416
00000100:00100000:1.0:1651532132.871567:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3774
00000100:00100000:1.0:1651532132.871569:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468452288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.871572:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532132.871578:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4329
00000100:00100000:0.0:1651532132.871579:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468452416:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532132.871580:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4103bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a82d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.871587:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871589:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4103bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a82d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.871592:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532132.871593:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.871596:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532132.871596:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871600:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4103bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a82d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.871601:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871604:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532132.871607:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.871615:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468452288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.871618:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3774
00000100:00100000:1.0:1651532132.871634:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.871650:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468452352
00000100:00100000:1.0:1651532132.871662:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4330
00000100:00100000:1.0:1651532132.871664:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045cfe023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468452352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532132.871670:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871674:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.871675:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871678:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532132.871679:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871683:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871686:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.871731:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.871742:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468452608
00000100:00100000:1.0:1651532132.871752:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3775
00000100:00100000:1.0:1651532132.871753:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468452608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.871756:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.871759:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4103d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a834 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871766:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4103d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a834 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.871770:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4103d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a834 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.871773:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532132.871783:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468452608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.871786:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3775
00000100:00100000:0.0:1651532132.871909:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.871931:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468452736
00000100:00100000:1.0:1651532132.871942:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3776
00000100:00100000:1.0:1651532132.871944:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468452736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.871947:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.871950:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4103d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a83b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.871958:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4103d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a83b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.871962:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4103d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a83b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.871965:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532132.871974:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468452736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.871977:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3776
00000100:00100000:0.0:1651532132.872039:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.872050:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468452928
00000100:00100000:1.0:1651532132.872060:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3777
00000100:00100000:1.0:1651532132.872062:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468452928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.872065:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.872068:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4103e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a842 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.872075:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4103e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a842 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.872079:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4103e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a842 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.872083:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532132.872092:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468452928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.872094:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3777
00000100:00100000:0.0:1651532132.872201:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.872211:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468453120
00000100:00100000:1.0:1651532132.872221:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3778
00000100:00100000:1.0:1651532132.872223:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000414d1fc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468453120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.872226:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.872229:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4103e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a849 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.872236:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4103e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a849 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.872243:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4103e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a849 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.872246:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532132.872255:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000414d1fc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468453120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.872258:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3778
00000100:00100000:0.0:1651532132.872340:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.872350:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468453248
00000100:00100000:1.0:1651532132.872361:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3779
00000100:00100000:1.0:1651532132.872363:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468453248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.872366:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.872370:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4103ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a850 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.872377:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4103ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a850 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.872381:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4103ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a850 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.872384:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532132.872393:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468453248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.872396:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3779
00000100:00100000:0.0:1651532132.872596:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.872615:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468453440
00000100:00100000:1.0:1651532132.872626:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3780
00000100:00100000:1.0:1651532132.872628:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468453440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.872631:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.872634:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4103f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a857 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.872641:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4103f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a857 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.872645:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4103f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a857 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.872648:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532132.872658:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468453440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.872661:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3780
00000100:00100000:0.0:1651532132.872866:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.872877:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468453568
00000100:00100000:1.0:1651532132.872887:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3781
00000100:00100000:1.0:1651532132.872889:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468453568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.872892:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.872895:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4103fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a85e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.872902:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4103fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a85e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.872916:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4103fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a85e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.872920:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532132.872930:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468453568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.872933:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3781
00000001:00080000:1.0:1651532132.962281:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793824 is committed
00010000:00010000:1.0:1651532132.962296:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962300:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962319:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.962323:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468448192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 374063us (374136us total) trans 158913793824 rc 0/0
00000100:00100000:1.0:1651532132.962336:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4321
00010000:00010000:0.0:1651532132.962339:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532132.962340:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962344:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962350:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.962350:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.962351:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962354:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962368:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.962369:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532132.962370:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962375:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962396:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962399:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4102d6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [798720->3997695] (req 798720->3997695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962405:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962406:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962408:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962410:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.962691:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532132.962716:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962731:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962734:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962739:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.962751:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468449792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316821us (316880us total) trans 0 rc 45056/45056
00000100:00100000:1.0:1651532132.962755:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4323
00000100:00100000:0.0:1651532132.962757:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468448320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 374477us (374524us total) trans 0 rc 28672/28672
00010000:00010000:1.0:1651532132.962762:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962765:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.962766:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962769:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.962770:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4322
00010000:00010000:1.0:1651532132.962775:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962778:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410323 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->10043391] (req 1982464->10043391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962782:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962784:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532132.962785:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.962786:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468453824
00010000:00010000:1.0:1651532132.962788:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962792:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.962792:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532132.962793:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.962794:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3782
00010000:00010000:1.0:1651532132.962796:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.962796:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468453824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.962799:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.962815:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962818:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4102dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->9592831] (req 335872->9592831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962821:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410403 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a865 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962823:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.962826:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.962831:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410403 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a865 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.962835:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410403 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a865 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.962839:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532132.962848:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468453824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (158us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.962851:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3782
00000100:00100000:1.0:1651532132.963414:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.963435:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.963435:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468453952
00000100:00100000:1.0:1651532132.963444:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.963456:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468453888
00000100:00100000:1.0:1651532132.963458:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.963467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.963468:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4331
00000100:00100000:0.0:1651532132.963470:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4b0fa2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468453952:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532132.963477:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532132.963482:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.963485:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4332
00010000:00010000:0.0:1651532132.963487:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532132.963488:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018165273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468453888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532132.963488:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.963491:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532132.963492:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.963496:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.963496:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.963499:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.963501:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532132.963502:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.963505:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532132.963506:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.963510:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.963514:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.963515:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468454016
00000100:00100000:0.0:1651532132.963519:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468454080
00000100:00100000:1.0:1651532132.963522:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468454208
00000100:00100000:0.0:1651532132.963522:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468454400
00000100:00100000:0.0:1651532132.963525:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3783
00000100:00100000:0.0:1651532132.963527:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468454016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532132.963528:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3784
00000100:00100000:1.0:1651532132.963530:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468454080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.963530:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.963532:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410418 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a86c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.963533:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.963535:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f41041f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a873 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.963540:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410418 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a86c expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.963543:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f41041f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a873 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.963544:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410418 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a86c expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.963547:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f41041f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a873 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.963547:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532132.963551:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:0.0:1651532132.963562:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468454016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.963565:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3783
00000100:00100000:1.0:1651532132.963568:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468454080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.963570:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3785
00000100:00100000:1.0:1651532132.963572:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3784
00000100:00100000:0.0:1651532132.963572:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468454400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532132.963575:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532132.963577:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3786
00010000:00010000:0.0:1651532132.963577:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410426 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a881 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532132.963579:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468454208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.963582:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.963583:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410426 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a881 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.963584:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f41042d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a87a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.963587:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410426 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a881 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.963590:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f41042d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a87a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.963590:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532132.963594:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f41042d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a87a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532132.963596:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468454400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (118us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532132.963597:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:0.0:1651532132.963598:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3785
00000100:00100000:1.0:1651532132.963603:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468454208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (135us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.963605:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3786
00000100:00100000:1.0:1651532132.963981:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.963988:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.963999:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532132.963999:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468454592
00000100:00100000:1.0:1651532132.964007:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468454784
00000100:00100000:0.0:1651532132.964012:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468454848
00000100:00100000:1.0:1651532132.964013:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3787
00000100:00100000:1.0:1651532132.964015:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468454592:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.964016:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3788
00010000:00010000:1.0:1651532132.964018:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532132.964018:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468454784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.964021:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410434 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a888 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.964021:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.964025:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41043b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a88f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.964028:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410434 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a888 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.964032:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410434 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a888 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.964035:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532132.964035:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41043b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a88f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.964039:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41043b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a88f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.964043:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532132.964047:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468454592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.964050:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3787
00000100:00100000:1.0:1651532132.964055:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3789
00000100:00100000:1.0:1651532132.964056:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468454848:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532132.964058:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468454784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (69us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532132.964059:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532132.964061:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410442 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a896 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532132.964061:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3788
00010000:00010000:1.0:1651532132.964067:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410442 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a896 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.964081:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410442 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a896 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.964084:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532132.964091:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468454848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.964121:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3789
00000100:00100000:1.0:1651532132.964371:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.964388:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532132.964398:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468455040
00000100:00100000:0.0:1651532132.964399:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468455104
00000100:00100000:1.0:1651532132.964407:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3790
00000100:00100000:1.0:1651532132.964409:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468455040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.964412:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532132.964413:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3791
00000100:00100000:0.0:1651532132.964415:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468455104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532132.964416:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410449 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a89d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532132.964418:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532132.964422:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410450 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8a4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532132.964423:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410449 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a89d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.964427:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410449 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a89d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532132.964430:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00010000:00010000:0.0:1651532132.964430:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410450 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8a4 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.964434:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410450 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8a4 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532132.964437:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532132.964441:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468455040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532132.964452:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3790
00000100:00100000:0.0:1651532132.964452:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468455104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532132.964455:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3791
00000001:00080000:1.0:1651532133.212375:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793825 is committed
00010000:00010000:1.0:1651532133.212391:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.212395:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.212417:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468449728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566461us (566528us total) trans 158913793825 rc 0/0
00000100:00100000:1.0:1651532133.212420:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4324
00010000:00010000:0.0:1651532133.212423:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212430:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.212431:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212435:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212441:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.212442:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.212443:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212446:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212454:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212457:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410331 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->9568255] (req 872448->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212463:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212466:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.212764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.212781:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.212798:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.212832:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.212842:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468455488
00010000:00010000:0.0:1651532133.212843:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212848:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.212854:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468455424
00000100:00100000:1.0:1651532133.212860:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4333
00000100:00100000:1.0:1651532133.212862:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468455488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532133.212869:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.212871:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468450432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566207us (566298us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532133.212873:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.212874:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.212875:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4325
00010000:00010000:1.0:1651532133.212877:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00000100:00100000:0.0:1651532133.212882:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4334
00000100:00100000:0.0:1651532133.212884:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468455424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532133.212886:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.212891:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212891:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.212895:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212896:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532133.212897:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212900:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532133.212901:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212906:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212909:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.212915:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468455680
00010000:00010000:0.0:1651532133.212917:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212920:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.212921:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.212925:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468455744
00000100:00100000:1.0:1651532133.212929:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3792
00000100:00100000:1.0:1651532133.212931:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468455680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.212931:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.212934:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.212936:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.212937:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410465 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8ab expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212937:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.212937:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212941:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.212946:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410465 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8ab expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.212947:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212950:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410354 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2088960->10260479] (req 2088960->10260479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.212951:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410465 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8ab expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.212954:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00010000:00010000:0.0:1651532133.212955:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.212958:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.212962:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468455680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (165us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.212965:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3792
00000100:00100000:1.0:1651532133.212969:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3793
00000100:00100000:1.0:1651532133.212978:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468455744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.212981:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.212983:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f41046c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8b2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.212989:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f41046c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8b2 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.212993:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f41046c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8b2 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.212996:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532133.213002:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468455744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (170us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.213005:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3793
00000100:00100000:0.0:1651532133.213349:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.213363:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.213369:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468455808
00000100:00100000:1.0:1651532133.213379:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468455936
00000100:00100000:0.0:1651532133.213388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.213391:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468456000
00000100:00100000:1.0:1651532133.213395:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3794
00000100:00100000:1.0:1651532133.213397:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468455808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.213400:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532133.213400:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3795
00000100:00100000:0.0:1651532133.213402:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468455936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.213403:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410473 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8b9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.213406:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.213411:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410473 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8b9 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.213411:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41047a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8c0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.213420:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41047a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8c0 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.213424:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41047a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8c0 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.213427:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410473 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8b9 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.213427:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532133.213430:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:0.0:1651532133.213441:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468455936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.213444:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3795
00000100:00100000:1.0:1651532133.213446:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468455808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.213449:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3794
00000100:00100000:0.0:1651532133.213451:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3796
00000100:00100000:0.0:1651532133.213453:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468456000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.213455:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.213458:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410481 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8c7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.213466:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410481 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8c7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.213470:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410481 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8c7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.213473:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532133.213482:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468456000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.213484:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3796
00000100:00100000:0.0:1651532133.213687:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.213694:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468456192
00000100:00100000:0.0:1651532133.213702:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3797
00000100:00100000:0.0:1651532133.213704:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468456192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.213707:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.213710:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410488 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8ce expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.213717:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410488 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8ce expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.213721:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410488 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8ce expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.213724:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532133.213741:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468456192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.213744:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3797
00000001:00080000:1.0:1651532133.412039:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793826 is committed
00010000:00010000:0.0:1651532133.412069:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412074:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.412092:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468450368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 765389us (765510us total) trans 158913793826 rc 0/0
00000100:00100000:0.0:1651532133.412095:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4326
00010000:00010000:0.0:1651532133.412102:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412105:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.412106:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412109:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412115:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.412115:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.412116:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412119:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412134:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412137:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41035b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [544768->6995967] (req 544768->6995967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.412146:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.412151:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.412495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.412506:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.412513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.412518:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.412535:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468456512
00000100:00100000:0.0:1651532133.412548:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468456448
00010000:00010000:1.0:1651532133.412552:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.412556:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4335
00000100:00100000:0.0:1651532133.412558:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468456512:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532133.412561:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412565:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412575:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.412576:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412579:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532133.412580:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.412581:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468451392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 599882us (600002us total) trans 0 rc 24576/24576
00010000:00010000:0.0:1651532133.412584:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.412585:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4327
00000100:00100000:1.0:1651532133.412591:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4336
00010000:00010000:0.0:1651532133.412591:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.412593:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468456448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532133.412597:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412599:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.412600:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412603:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412608:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.412608:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.412609:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412609:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412612:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.412617:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532133.412618:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.412621:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532133.412622:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.412626:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412629:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412632:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41038c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2031616->10481663] (req 2031616->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.412636:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.412639:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468456576
00010000:00010000:1.0:1651532133.412644:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.412645:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468456640
00010000:00010000:1.0:1651532133.412647:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.412652:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3798
00000100:00100000:0.0:1651532133.412653:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468456576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.412656:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.412659:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41049d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8d5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.412667:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41049d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8d5 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.412671:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41049d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8d5 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.412674:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532133.412675:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3799
00000100:00100000:1.0:1651532133.412677:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468456640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.412680:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.412683:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104a4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8dc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.412683:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468456576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (170us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.412685:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3798
00010000:00010000:1.0:1651532133.412702:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8dc expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.412706:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8dc expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.412710:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532133.412717:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468456640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (198us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.412720:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3799
00000100:00100000:1.0:1651532133.413103:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.413125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.413139:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468456896
00000100:00100000:1.0:1651532133.413144:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468456960
00000100:00100000:0.0:1651532133.413147:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3800
00000100:00100000:0.0:1651532133.413149:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468456896:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532133.413156:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3801
00000100:00100000:1.0:1651532133.413158:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468456960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.413158:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.413162:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.413162:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104ab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8e3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.413165:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8ea expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.413169:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8e3 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.413173:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8ea expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.413177:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8ea expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.413177:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8e3 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.413180:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532133.413190:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468456896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (88us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532133.413191:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:0.0:1651532133.413193:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3800
00000100:00100000:1.0:1651532133.413200:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468456960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.413202:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3801
00000001:00080000:1.0:1651532133.520467:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793827 is committed
00010000:00010000:1.0:1651532133.520482:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.520486:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.520504:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468451328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 707769us (707908us total) trans 158913793827 rc 0/0
00000100:00100000:1.0:1651532133.520507:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4328
00010000:00010000:1.0:1651532133.520513:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.520517:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532133.520518:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.520521:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.520526:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.520527:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.520536:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.520539:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.520552:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.520555:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410393 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [954368->8232959] (req 954368->8232959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520564:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520569:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520752:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520756:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.520772:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468452416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 649192us (649223us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532133.520775:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4329
00010000:00010000:0.0:1651532133.520781:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520785:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.520786:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520789:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520794:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.520795:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.520796:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520798:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520838:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520842:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4103c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1626112->9498623] (req 1626112->9498623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.520848:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532133.520859:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.520867:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.520881:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468457280
00000100:00100000:0.0:1651532133.520906:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4337
00000100:00100000:0.0:1651532133.520907:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468457280:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532133.520914:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520918:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532133.520919:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520925:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532133.520926:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520930:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.520933:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.520949:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.520958:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.520964:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468457216
00000100:00100000:1.0:1651532133.520990:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4338
00000100:00100000:1.0:1651532133.520992:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468457216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532133.520999:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.521000:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468457408
00010000:00010000:1.0:1651532133.521004:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532133.521005:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.521007:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3802
00000100:00100000:0.0:1651532133.521009:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468457408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.521012:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.521015:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4104c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8f1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.521016:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532133.521017:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.521023:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.521023:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4104c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8f1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.521026:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.521028:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4104c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8f1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.521031:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532133.521041:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468457408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.521046:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3802
00000100:00100000:1.0:1651532133.521101:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.521111:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468457600
00000100:00100000:1.0:1651532133.521112:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.521118:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468457472
00000100:00100000:1.0:1651532133.521120:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3803
00000100:00100000:1.0:1651532133.521122:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468457600:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532133.521124:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3804
00010000:00010000:1.0:1651532133.521126:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532133.521126:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468457472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.521129:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104ce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8ff expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.521129:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.521132:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104d5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a8f8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.521136:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104ce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8ff expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.521139:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8f8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.521141:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104ce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8ff expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.521143:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a8f8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.521144:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532133.521146:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532133.521157:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468457600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.521161:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3803
00000100:00100000:0.0:1651532133.521163:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468457472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.521165:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3804
00000001:00080000:1.0:1651532133.562382:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793828 is committed
00010000:00010000:1.0:1651532133.562396:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562399:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.562420:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045cfe023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468452352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 690755us (690786us total) trans 158913793828 rc 0/0
00010000:00010000:0.0:1651532133.562422:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.562423:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4330
00010000:00010000:0.0:1651532133.562427:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.562428:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562434:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562439:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.562440:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.562440:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562444:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562451:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562454:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4103cb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6819840->6823935] (req 6819840->6823935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562459:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562462:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.562764:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.562773:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.562785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.562791:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468457984
00000100:00100000:1.0:1651532133.562801:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468458048
00000100:00100000:0.0:1651532133.562820:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4339
00000100:00100000:0.0:1651532133.562822:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468457984:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532133.562827:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4340
00000100:00100000:1.0:1651532133.562829:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468458048:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532133.562829:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562834:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532133.562835:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562836:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562838:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532133.562839:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562842:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.562843:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532133.562844:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562848:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562848:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.562851:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.562858:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468458112
00010000:00010000:0.0:1651532133.562862:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.562864:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3805
00010000:00010000:0.0:1651532133.562865:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.562866:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468458112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.562868:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.562871:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4104ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a906 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562882:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532133.562883:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4b0fa2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468453952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 599413us (599470us total) trans 0 rc 36864/36864
00010000:00010000:1.0:1651532133.562885:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4104ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a906 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532133.562886:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4331
00010000:00010000:1.0:1651532133.562889:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4104ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a906 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.562893:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532133.562901:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468458112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.562904:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3805
00010000:00010000:1.0:1651532133.562912:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562941:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532133.562942:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562946:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562951:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.562951:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.562952:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562955:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562963:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562966:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41040a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10424319] (req 110592->10424319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562971:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.562974:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.563291:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.563299:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.563375:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468458176
00000100:00100000:1.0:1651532133.563388:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468458304
00000100:00100000:1.0:1651532133.563394:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3806
00000100:00100000:1.0:1651532133.563395:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468458176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.563399:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532133.563400:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3807
00000100:00100000:0.0:1651532133.563402:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468458304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.563406:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.563411:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4104f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a90d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.563411:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4104f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a914 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.563419:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4104f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a914 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.563420:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4104f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a90d expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.563423:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4104f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a914 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.563424:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4104f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a90d expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.563427:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532133.563428:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532133.563437:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468458176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.563437:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468458304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.563440:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3807
00000100:00100000:1.0:1651532133.563441:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3806
00000100:00100000:1.0:1651532133.563691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.563698:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468458560
00000100:00100000:1.0:1651532133.563705:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3808
00000100:00100000:1.0:1651532133.563707:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468458560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.563710:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.563713:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4104ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a91b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.563721:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4104ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a91b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.563725:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4104ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a91b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.563740:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:0.0:1651532133.563740:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.563764:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468458560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.563767:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3808
00000100:00100000:1.0:1651532133.563772:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468458688
00000100:00100000:1.0:1651532133.563781:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3809
00000100:00100000:1.0:1651532133.563782:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468458688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.563785:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.563794:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410506 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a922 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.563802:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410506 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a922 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.563819:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410506 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a922 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.563822:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532133.563830:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468458688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.563832:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3809
00000100:00100000:0.0:1651532133.564048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.564066:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468458816
00000100:00100000:1.0:1651532133.564075:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3810
00000100:00100000:1.0:1651532133.564076:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468458816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.564081:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.564084:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41050d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a929 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.564091:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41050d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a929 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.564095:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41050d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a929 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.564098:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532133.564108:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468458816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.564110:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3810
00000001:00080000:1.0:1651532133.653858:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793829 is committed
00010000:00010000:1.0:1651532133.653873:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.653877:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.653898:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018165273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468453888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 690409us (690462us total) trans 158913793829 rc 0/0
00010000:00010000:0.0:1651532133.653900:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.653901:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4332
00010000:00010000:0.0:1651532133.653905:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.653906:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.653909:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.653915:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.653916:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.653916:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.653923:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.653932:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.653935:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410411 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3260416->8982527] (req 3260416->8982527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.653946:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.653953:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.654291:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.654299:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.654310:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.654311:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468459136
00000100:00100000:1.0:1651532133.654316:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.654325:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468459072
00000100:00100000:1.0:1651532133.654335:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.654341:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4341
00000100:00100000:0.0:1651532133.654343:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468459136:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532133.654350:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.654353:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4342
00010000:00010000:0.0:1651532133.654354:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532133.654355:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468459072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532133.654355:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654358:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532133.654359:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.654363:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654363:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654366:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.654368:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532133.654369:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.654372:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532133.654372:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.654377:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.654380:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.654386:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468459200
00000100:00100000:0.0:1651532133.654392:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468459392
00010000:00010000:1.0:1651532133.654394:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.654395:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468459456
00010000:00010000:1.0:1651532133.654397:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.654398:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3811
00000100:00100000:0.0:1651532133.654399:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468459200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.654402:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.654411:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410522 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a930 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654417:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532133.654418:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468455488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441555us (441654us total) trans 0 rc 40960/40960
00010000:00010000:0.0:1651532133.654419:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410522 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a930 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532133.654421:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4333
00010000:00010000:0.0:1651532133.654423:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410522 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a930 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.654427:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532133.654428:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3812
00000100:00100000:1.0:1651532133.654430:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468459392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.654433:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.654436:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410529 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a937 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.654436:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468459200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (125us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.654438:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3811
00010000:00010000:1.0:1651532133.654441:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.654443:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410529 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a937 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532133.654443:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3813
00000100:00100000:0.0:1651532133.654445:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468459456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.654447:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410529 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a937 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.654448:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.654450:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410530 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a93e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.654451:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532133.654457:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468459392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (140us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532133.654457:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.654459:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410530 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a93e expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532133.654461:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3812
00010000:00010000:0.0:1651532133.654463:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410530 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a93e expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.654465:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532133.654470:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468459456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (149us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.654473:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3813
00010000:00010000:0.0:1651532133.654480:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654483:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.654484:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654488:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654492:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.654492:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.654493:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654496:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654503:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654506:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410457 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1908736->9777151] (req 1908736->9777151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654511:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654513:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.654765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.654801:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468459648
00000100:00100000:0.0:1651532133.654822:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3814
00000100:00100000:0.0:1651532133.654824:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468459648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.654827:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.654831:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410537 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a94c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.654840:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532133.654848:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410537 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a94c expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.654853:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410537 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a94c expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.654856:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532133.654865:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468459648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.654868:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.654868:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3814
00000100:00100000:0.0:1651532133.654882:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468459584
00000100:00100000:0.0:1651532133.654886:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468459712
00000100:00100000:0.0:1651532133.654888:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3815
00000100:00100000:0.0:1651532133.654890:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468459584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.654892:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.654895:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41053e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a945 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.654901:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41053e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a945 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.654904:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41053e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a945 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.654907:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532133.654908:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3816
00000100:00100000:1.0:1651532133.654910:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468459712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.654914:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.654924:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410545 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a953 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.654930:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468459584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (77us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532133.654932:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410545 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a953 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532133.654933:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3815
00010000:00010000:1.0:1651532133.654936:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410545 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a953 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.654939:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532133.654947:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468459712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.654950:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3816
00000100:00100000:1.0:1651532133.654965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.654999:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468459904
00000100:00100000:1.0:1651532133.655010:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3817
00000100:00100000:1.0:1651532133.655012:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468459904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.655015:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.655018:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41054c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a95a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.655025:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41054c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a95a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.655029:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41054c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a95a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.655032:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532133.655042:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468459904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.655044:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3817
00000100:00100000:1.0:1651532133.655146:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.655153:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468460096
00000100:00100000:1.0:1651532133.655164:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3818
00000100:00100000:1.0:1651532133.655166:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468460096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.655169:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.655172:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410553 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a961 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.655179:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410553 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a961 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.655183:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410553 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a961 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.655189:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532133.655198:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468460096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.655200:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3818
00000100:00100000:1.0:1651532133.655386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.655393:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468460288
00000100:00100000:1.0:1651532133.655404:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3819
00000100:00100000:1.0:1651532133.655406:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468460288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.655409:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.655412:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f41055a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a968 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.655419:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f41055a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a968 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.655423:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f41055a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a968 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.655426:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532133.655436:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468460288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.655444:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3819
00000100:00100000:1.0:1651532133.655469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.655505:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468460480
00000100:00100000:1.0:1651532133.655515:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3820
00000100:00100000:1.0:1651532133.655523:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468460480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.655527:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.655530:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410561 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a96f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.655537:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410561 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a96f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.655541:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410561 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a96f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.655544:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532133.655554:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468460480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.655557:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3820
00000001:00080000:1.0:1651532133.762177:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793830 is committed
00010000:00010000:0.0:1651532133.762209:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762213:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.762237:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468455424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549352us (549456us total) trans 158913793830 rc 0/0
00010000:00010000:1.0:1651532133.762239:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.762240:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4334
00010000:00010000:1.0:1651532133.762243:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532133.762245:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762248:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762253:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.762260:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.762261:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762265:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762274:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762278:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41045e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->9670655] (req 2297856->9670655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762282:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762287:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.762602:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.762613:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.762623:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.762625:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468460800
00000100:00100000:0.0:1651532133.762632:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.762640:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468460736
00000100:00100000:0.0:1651532133.762642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.762650:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4343
00000100:00100000:1.0:1651532133.762652:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468460800:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532133.762655:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468460864
00010000:00010000:1.0:1651532133.762658:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762662:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.762663:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.762663:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468460928
00000100:00100000:0.0:1651532133.762665:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468461056
00010000:00010000:1.0:1651532133.762666:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532133.762667:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.762668:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3821
00000100:00100000:0.0:1651532133.762669:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468460864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.762671:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762673:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.762677:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41056f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a976 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762678:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762682:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532133.762685:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4344
00010000:00010000:0.0:1651532133.762685:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41056f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a976 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532133.762687:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468460736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532133.762691:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762693:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41056f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a976 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.762694:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532133.762695:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762696:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532133.762698:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762700:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532133.762701:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762704:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.762710:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468460864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.762712:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3821
00010000:00010000:1.0:1651532133.762713:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762716:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.762717:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3822
00000100:00100000:0.0:1651532133.762719:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468460928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.762721:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.762724:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41057d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a97d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.762726:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3823
00000100:00100000:1.0:1651532133.762727:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468461056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.762728:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.762730:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.762730:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41057d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a97d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.762732:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410584 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a984 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762734:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41057d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a97d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.762737:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.762737:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532133.762740:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410584 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a984 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532133.762742:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468460928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (110us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532133.762744:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410584 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a984 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532133.762745:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3822
00010000:00010000:1.0:1651532133.762747:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532133.762756:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468461056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (114us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532133.762756:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.762759:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3823
00010000:00010000:0.0:1651532133.762760:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.762771:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468456512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350213us (350296us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532133.762774:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4335
00010000:00010000:0.0:1651532133.762779:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762782:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.762783:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762786:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762790:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.762791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.762792:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762795:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762819:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.762826:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41048f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->8179711] (req 1830912->8179711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762833:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.762837:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.763118:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.763125:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468461184
00000100:00100000:0.0:1651532133.763132:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3824
00000100:00100000:0.0:1651532133.763134:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468461184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.763137:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.763141:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41058b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a98b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.763148:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41058b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a98b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763152:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41058b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a98b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763155:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532133.763169:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468461184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.763171:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3824
00000100:00100000:0.0:1651532133.763207:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.763213:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468461376
00000100:00100000:0.0:1651532133.763219:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3825
00000100:00100000:0.0:1651532133.763221:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee5ce04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468461376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.763225:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.763228:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410592 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a992 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.763235:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410592 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a992 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763239:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410592 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a992 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763242:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532133.763255:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee5ce04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468461376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.763258:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3825
00000100:00100000:0.0:1651532133.763385:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.763393:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468461568
00000100:00100000:0.0:1651532133.763399:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3826
00000100:00100000:0.0:1651532133.763401:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468461568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.763404:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.763407:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410599 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a999 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.763414:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410599 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a999 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763418:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410599 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a999 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763422:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532133.763437:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468461568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.763440:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3826
00000100:00100000:0.0:1651532133.763478:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.763485:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468461696
00000100:00100000:0.0:1651532133.763491:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3827
00000100:00100000:0.0:1651532133.763492:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468461696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.763495:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.763498:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4105a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9a0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.763505:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4105a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9a0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763509:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4105a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9a0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763513:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532133.763526:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468461696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.763528:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3827
00000100:00100000:0.0:1651532133.763634:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.763641:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468461824
00000100:00100000:0.0:1651532133.763646:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3828
00000100:00100000:0.0:1651532133.763648:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468461824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.763651:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.763654:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4105a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9a7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.763660:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4105a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9a7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763664:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4105a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9a7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763668:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532133.763681:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468461824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (47us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.763683:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3828
00000100:00100000:0.0:1651532133.763883:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.763889:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468462016
00000100:00100000:0.0:1651532133.763896:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3829
00000100:00100000:0.0:1651532133.763897:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468462016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.763900:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.763904:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4105ae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9ae expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.763911:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4105ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9ae expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763918:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4105ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9ae expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.763921:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532133.763934:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468462016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.763937:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3829
00000100:00100000:0.0:1651532133.764142:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.764149:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468462144
00000100:00100000:0.0:1651532133.764155:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3830
00000100:00100000:0.0:1651532133.764156:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468462144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.764160:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.764163:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4105b5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9b5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.764169:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4105b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9b5 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.764173:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4105b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9b5 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.764176:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532133.764192:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468462144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.764196:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3830
00000100:00100000:0.0:1651532133.764380:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.764386:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468462272
00000100:00100000:0.0:1651532133.764393:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3831
00000100:00100000:0.0:1651532133.764394:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468462272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.764397:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.764401:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9bc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.764408:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9bc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.764412:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9bc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.764415:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532133.764430:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468462272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.764433:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3831
00000001:00080000:1.0:1651532133.878880:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793831 is committed
00010000:00010000:1.0:1651532133.878894:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.878906:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.878928:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468456448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466334us (466421us total) trans 158913793831 rc 0/0
00000100:00100000:1.0:1651532133.878931:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4336
00010000:00010000:0.0:1651532133.878931:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.878935:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.878937:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.878942:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.878948:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.878949:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.878949:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.878953:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.878960:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.878963:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410496 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1150976->9830399] (req 1150976->9830399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.878966:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.878979:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.879220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.879236:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.879253:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468462400
00010000:00010000:1.0:1651532133.879256:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879260:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.879264:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468462464
00000100:00100000:0.0:1651532133.879270:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4345
00000100:00100000:0.0:1651532133.879271:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468462400:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532133.879274:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468457280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358366us (358426us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532133.879277:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4337
00000100:00100000:1.0:1651532133.879283:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4346
00000100:00100000:1.0:1651532133.879284:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468462464:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532133.879295:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879299:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.879300:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532133.879301:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.879306:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532133.879307:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879311:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.879312:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879315:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532133.879316:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.879319:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879320:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.879323:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879324:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879342:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879345:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532133.879346:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879349:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879354:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.879355:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532133.879355:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879367:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879374:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879377:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4104b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5095424->10207231] (req 5095424->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879382:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879385:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.879415:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.879425:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468462592
00000100:00100000:1.0:1651532133.879432:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.879433:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3832
00000100:00100000:0.0:1651532133.879434:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468462592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.879437:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.879440:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4105d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9ca expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.879447:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4105d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9ca expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.879451:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4105d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9ca expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.879454:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532133.879463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532133.879463:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468462592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.879476:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3832
00000100:00100000:0.0:1651532133.879481:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468462528
00000100:00100000:0.0:1651532133.879484:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468462656
00000100:00100000:0.0:1651532133.879487:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3833
00000100:00100000:0.0:1651532133.879488:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468462528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.879491:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.879494:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9c3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.879497:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3834
00000100:00100000:1.0:1651532133.879499:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468462656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532133.879499:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9c3 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.879503:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.879503:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9c3 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.879506:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4105df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9d1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.879506:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:1.0:1651532133.879515:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4105df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9d1 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532133.879518:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468462528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.879521:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3833
00010000:00010000:1.0:1651532133.879536:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4105df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9d1 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.879540:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532133.879548:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468462656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.879551:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3834
00000100:00100000:1.0:1651532133.879744:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.879752:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468462784
00000100:00100000:1.0:1651532133.879779:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3835
00000100:00100000:1.0:1651532133.879780:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468462784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.879784:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532133.879788:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9d8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.879796:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9d8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.879800:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9d8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.879817:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532133.879828:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468462784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532133.879832:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3835
00000001:00080000:1.0:1651532133.987204:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793832 is committed
00010000:00010000:1.0:1651532133.987219:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.987223:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.987246:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468457216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466253us (466297us total) trans 158913793832 rc 0/0
00010000:00010000:0.0:1651532133.987246:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.987249:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4338
00010000:00010000:0.0:1651532133.987251:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.987252:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987258:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987264:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.987264:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.987265:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987268:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987272:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.987272:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.987273:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987275:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987283:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987286:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4104c0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->9727999] (req 98304->9727999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987291:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.987294:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987294:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.987298:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.987705:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.987713:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.987719:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.987725:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532133.987739:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468463104
00000100:00100000:1.0:1651532133.987751:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468463168
00000100:00100000:1.0:1651532133.987759:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4347
00000100:00100000:1.0:1651532133.987761:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468463104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532133.987768:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.987782:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4348
00010000:00010000:1.0:1651532133.987783:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532133.987784:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.987784:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468463168:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532133.987787:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532133.987788:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.987792:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987792:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987796:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532133.987797:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987800:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532133.987801:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.987819:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987820:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987824:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.987830:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.987833:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468463360
00010000:00010000:1.0:1651532133.987834:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.987846:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468463296
00000100:00100000:0.0:1651532133.987851:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3836
00000100:00100000:0.0:1651532133.987852:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468463360:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532133.987863:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468458048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425033us (425090us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532133.987867:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4340
00010000:00010000:0.0:1651532133.987867:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.987870:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4105fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9e6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.987875:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3837
00000100:00100000:1.0:1651532133.987877:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468463296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532133.987880:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532133.987880:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4105fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9e6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.987884:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4105fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9e6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.987887:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:1.0:1651532133.987894:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410602 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9df expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532133.987896:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468463360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (177us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532133.987899:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3836
00010000:00010000:1.0:1651532133.987902:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410602 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9df expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532133.987907:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410602 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9df expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532133.987907:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532133.987910:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00010000:00010000:0.0:1651532133.987910:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532133.987911:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532133.987914:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.987917:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468463296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (192us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532133.987919:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532133.987920:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3837
00010000:00010000:0.0:1651532133.987922:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4104e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->3760127] (req 1257472->3760127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532134.103931:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793833 is committed
00010000:00010000:0.0:1651532134.103965:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.103970:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.103992:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468457984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541168us (541227us total) trans 158913793833 rc 0/0
00010000:00010000:1.0:1651532134.103995:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.103995:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4339
00010000:00010000:1.0:1651532134.104000:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532134.104001:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104005:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104010:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.104011:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.104012:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104025:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104032:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.104040:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104043:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4104dc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6684672->10043391] (req 6684672->10043391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.104044:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.104482:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.104491:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.104508:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468463808
00000100:00100000:0.0:1651532134.104511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.104519:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468463744
00000100:00100000:1.0:1651532134.104530:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4349
00000100:00100000:1.0:1651532134.104531:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468463808:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532134.104532:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.104537:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104539:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104543:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.104544:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532134.104545:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104548:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.104556:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468459136:12345-10.240.43.64@tcp:3:fio.0 Request processed in 450212us (450265us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532134.104559:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4341
00000100:00100000:1.0:1651532134.104562:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4350
00000100:00100000:1.0:1651532134.104564:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468463744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532134.104568:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104569:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.104571:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.104572:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.104575:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104580:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.104581:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104584:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104587:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532134.104587:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.104590:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.104591:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.104592:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.104595:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104599:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.104604:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104607:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.104607:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410514 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->9883647] (req 139264->9883647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104611:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.104615:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468464128
00010000:00010000:1.0:1651532134.104617:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.104620:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.104624:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3838
00000100:00100000:0.0:1651532134.104626:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468464128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.104630:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.104633:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410617 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9ed expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.104640:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410617 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9ed expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.104644:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410617 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9ed expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.104647:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532134.104655:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468464128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (144us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.104657:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3838
00000100:00100000:1.0:1651532134.105063:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.105077:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.105082:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468464256
00000100:00100000:1.0:1651532134.105085:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.105096:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468464320
00000100:00100000:0.0:1651532134.105097:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468464512
00000100:00100000:0.0:1651532134.105103:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3839
00000100:00100000:1.0:1651532134.105105:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3840
00000100:00100000:0.0:1651532134.105105:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468464256:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532134.105107:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468464320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.105108:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.105110:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.105112:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41061e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9f4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.105114:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410625 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44a9fb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.105120:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41061e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9f4 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.105123:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410625 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9fb expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.105124:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41061e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9f4 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.105127:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410625 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44a9fb expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.105127:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:1.0:1651532134.105131:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:0.0:1651532134.105138:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468464256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.105139:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468464320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.105141:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3839
00000100:00100000:1.0:1651532134.105142:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3840
00000100:00100000:0.0:1651532134.105145:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3841
00000100:00100000:0.0:1651532134.105147:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468464512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.105149:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.105152:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41062c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa02 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.105158:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41062c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa02 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.105161:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41062c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa02 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.105164:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532134.105169:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468464512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.105172:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3841
00000100:00100000:1.0:1651532134.105464:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.105475:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468464704
00000100:00100000:0.0:1651532134.105487:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3842
00000100:00100000:0.0:1651532134.105489:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468464704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.105492:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.105495:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410633 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa09 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.105505:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410633 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa09 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.105509:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410633 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa09 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.105512:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532134.105522:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468464704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.105524:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3842
00000001:00080000:1.0:1651532134.212245:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793834 is committed
00002000:00010000:1.0:1651532134.212258:0:330054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532132 -> 1651532133
00010000:00010000:1.0:1651532134.212261:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212265:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.212290:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468459072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557934us (557990us total) trans 158913793834 rc 0/0
00000100:00100000:1.0:1651532134.212293:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4342
00010000:00010000:0.0:1651532134.212294:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212299:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.212300:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212303:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212309:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.212310:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.212310:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212313:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212324:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212336:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f41051b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7372800->10158079] (req 7372800->10158079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212350:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212354:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.212654:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.212663:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.212673:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.212674:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468464896
00000100:00100000:1.0:1651532134.212689:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468464960
00000100:00100000:0.0:1651532134.212691:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4351
00000100:00100000:0.0:1651532134.212693:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468464896:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532134.212702:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4352
00000100:00100000:1.0:1651532134.212704:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468464960:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532134.212706:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212710:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532134.212711:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212711:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212714:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532134.212715:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212719:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.212720:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212723:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532134.212724:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212727:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212728:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212731:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212732:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.212740:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468465088
00010000:00010000:1.0:1651532134.212743:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.212749:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3843
00000100:00100000:0.0:1651532134.212751:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468465088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532134.212752:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212754:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.212756:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410648 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa10 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.212761:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.212763:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410648 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa10 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.212767:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410648 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa10 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532134.212771:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468460800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 450118us (450189us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532134.212774:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4343
00010000:00010000:0.0:1651532134.212777:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532134.212781:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212784:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532134.212785:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.212786:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468465088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (113us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532134.212788:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.212789:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3843
00010000:00010000:1.0:1651532134.212793:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.212793:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.212794:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212800:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212819:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212822:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410568 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->9564159] (req 1462272->9564159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212827:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.212830:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.213224:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.213234:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.213235:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468465216
00000100:00100000:1.0:1651532134.213243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.213251:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468465280
00000100:00100000:0.0:1651532134.213254:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468465472
00000100:00100000:1.0:1651532134.213256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.213257:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3844
00000100:00100000:0.0:1651532134.213259:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468465216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.213262:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.213265:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41064f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa17 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.213273:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41064f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa17 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.213277:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41064f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa17 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.213280:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532134.213290:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468465216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.213293:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3844
00000100:00100000:0.0:1651532134.213297:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468465536
00000100:00100000:0.0:1651532134.213301:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3845
00000100:00100000:0.0:1651532134.213302:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468465280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.213305:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.213307:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410656 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa1e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.213312:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410656 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa1e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.213316:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410656 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa1e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.213319:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532134.213322:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3846
00000100:00100000:1.0:1651532134.213324:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468465472:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532134.213324:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468465280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.213326:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3845
00010000:00010000:1.0:1651532134.213335:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.213339:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f41065d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa25 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.213340:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3847
00000100:00100000:0.0:1651532134.213341:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468465536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.213344:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.213346:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410664 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa2c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.213348:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f41065d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa25 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.213352:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410664 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa2c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.213356:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410664 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa2c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.213359:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:1.0:1651532134.213360:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f41065d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa25 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.213364:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:0.0:1651532134.213364:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468465536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.213367:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3847
00000100:00100000:1.0:1651532134.213373:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468465472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.213376:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3846
00000100:00100000:1.0:1651532134.213699:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.213707:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.213714:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468465728
00000100:00100000:1.0:1651532134.213725:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468465856
00000100:00100000:0.0:1651532134.213734:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3848
00000100:00100000:1.0:1651532134.213736:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3849
00000100:00100000:0.0:1651532134.213736:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468465728:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532134.213738:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468465856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.213740:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.213742:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.213743:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41066b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa33 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.213746:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410672 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa3a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.213750:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41066b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa33 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.213754:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410672 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa3a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.213754:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41066b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa33 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.213758:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410672 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa3a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.213758:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:1.0:1651532134.213761:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:0.0:1651532134.213768:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468465728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.213769:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468465856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.213770:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3848
00000100:00100000:1.0:1651532134.213779:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3849
00000100:00100000:1.0:1651532134.214018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.214026:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468465984
00000100:00100000:1.0:1651532134.214033:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3850
00000100:00100000:1.0:1651532134.214035:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468465984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532134.214038:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.214041:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410679 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa41 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.214049:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410679 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa41 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.214053:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410679 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa41 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.214056:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532134.214068:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468465984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.214071:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3850
00000001:00080000:1.0:1651532134.320605:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793835 is committed
00010000:00010000:1.0:1651532134.320620:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.320624:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.320656:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468460736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557968us (558042us total) trans 158913793835 rc 0/0
00010000:00010000:0.0:1651532134.320657:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.320659:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4344
00010000:00010000:0.0:1651532134.320662:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065aed440 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.320663:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.320666:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.320672:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.320673:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.320673:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.320676:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.320684:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.320687:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410576 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10383359] (req 2232320->10383359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.320701:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.320705:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.321075:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.321087:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.321095:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468466304
00000100:00100000:0.0:1651532134.321097:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.321110:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468466240
00000100:00100000:1.0:1651532134.321115:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4353
00000100:00100000:1.0:1651532134.321117:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468466304:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532134.321125:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.321140:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532134.321141:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532134.321142:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.321142:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4354
00000100:00100000:0.0:1651532134.321144:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468466240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532134.321145:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.321151:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.321152:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468466432
00010000:00010000:0.0:1651532134.321155:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532134.321156:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.321159:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3851
00010000:00010000:0.0:1651532134.321159:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.321160:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468466432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.321162:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532134.321162:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.321164:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.321167:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f41068e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa48 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.321167:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.321169:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.321173:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.321175:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f41068e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa48 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.321179:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f41068e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa48 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.321182:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532134.321197:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468466432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.321200:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3851
00000100:00100000:0.0:1651532134.321208:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.321244:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468466624
00000100:00100000:1.0:1651532134.321254:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3852
00000100:00100000:1.0:1651532134.321256:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468466624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532134.321259:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.321262:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410695 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa4f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.321269:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410695 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa4f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.321273:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410695 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa4f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.321279:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532134.321290:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468466624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.321293:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3852
00000100:00100000:1.0:1651532134.321534:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.321542:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468466816
00000100:00100000:1.0:1651532134.321553:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3853
00000100:00100000:1.0:1651532134.321554:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468466816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532134.321557:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.321561:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f41069c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa56 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.321568:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f41069c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa56 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.321572:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f41069c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa56 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.321575:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:1.0:1651532134.321587:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468466816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.321589:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3853
00000001:00080000:1.0:1651532134.387312:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793836 is committed
00010000:00010000:1.0:1651532134.387326:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387359:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.387377:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468462400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 508105us (508158us total) trans 158913793836 rc 0/0
00000100:00100000:1.0:1651532134.387381:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4345
00010000:00010000:1.0:1651532134.387388:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387391:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532134.387393:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387395:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387401:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.387401:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.387402:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387405:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387412:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387415:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4105c3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3977216->9281535] (req 3977216->9281535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387427:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387430:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387637:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387641:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.387661:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468462464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508375us (508425us total) trans 0 rc 45056/45056
00000100:00100000:1.0:1651532134.387664:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4346
00010000:00010000:0.0:1651532134.387665:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.387670:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.387671:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.387675:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.387680:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.387681:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.387682:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.387685:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.387694:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.387697:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4105ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9404415] (req 786432->9404415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387698:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.387702:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.387834:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.387847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.387863:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468466944
00000100:00100000:0.0:1651532134.387872:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468467072
00000100:00100000:0.0:1651532134.387877:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3854
00000100:00100000:0.0:1651532134.387879:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468466944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.387882:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.387886:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4106a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa5d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.387894:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4106a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa5d expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.387898:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4106a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa5d expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.387902:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532134.387915:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468466944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.387918:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3854
00000100:00100000:0.0:1651532134.387923:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3855
00000100:00100000:0.0:1651532134.387925:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468467072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.387927:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.387930:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4106aa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa64 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.387935:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4106aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa64 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.387939:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4106aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa64 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.387945:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532134.387950:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468467072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.387953:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3855
00000100:00100000:0.0:1651532134.388065:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.388093:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468467328
00000100:00100000:0.0:1651532134.388098:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.388108:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.388118:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468467264
00000100:00100000:0.0:1651532134.388121:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.388127:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4355
00000100:00100000:1.0:1651532134.388129:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468467328:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532134.388132:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4356
00000100:00100000:0.0:1651532134.388134:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468467264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532134.388136:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.388140:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532134.388142:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.388142:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.388144:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532134.388145:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.388149:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532134.388150:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.388153:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532134.388154:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.388157:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.388158:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.388161:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.388161:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.388171:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468467392
00000100:00100000:0.0:1651532134.388177:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468467456
00000100:00100000:0.0:1651532134.388186:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3856
00000100:00100000:0.0:1651532134.388187:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468467392:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532134.388189:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3857
00010000:00010000:0.0:1651532134.388190:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532134.388191:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468467456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.388192:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4106bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa6b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.388194:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.388197:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa72 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.388199:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4106bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa6b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.388203:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4106bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa6b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.388204:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa72 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.388207:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532134.388208:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa72 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.388215:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:0.0:1651532134.388218:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468467392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.388221:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3856
00000100:00100000:1.0:1651532134.388230:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468467456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.388233:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3857
00000100:00100000:0.0:1651532134.388516:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.388531:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.388537:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468467712
00000100:00100000:0.0:1651532134.388538:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468467776
00000100:00100000:1.0:1651532134.388549:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3858
00000100:00100000:1.0:1651532134.388550:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468467712:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532134.388553:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3859
00010000:00010000:1.0:1651532134.388554:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532134.388555:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468467776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532134.388557:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa79 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.388558:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.388562:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4106d4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa80 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.388564:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa79 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.388569:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa79 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.388569:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4106d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa80 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.388573:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532134.388573:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4106d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa80 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.388577:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532134.388583:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468467712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.388584:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468467776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.388586:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3858
00000100:00100000:0.0:1651532134.388587:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3859
00000100:00100000:0.0:1651532134.388838:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.388844:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468468032
00000100:00100000:0.0:1651532134.388851:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3860
00000100:00100000:0.0:1651532134.388852:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468468032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.388856:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.388859:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4106db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa87 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.388866:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4106db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa87 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.388870:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4106db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa87 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.388873:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532134.388888:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468468032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.388890:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3860
00000100:00100000:0.0:1651532134.389112:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.389119:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468468160
00000100:00100000:0.0:1651532134.389125:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3861
00000100:00100000:0.0:1651532134.389127:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468468160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.389130:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.389133:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4106e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa8e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.389140:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4106e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa8e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.389144:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4106e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa8e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.389147:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532134.389163:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468468160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.389165:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3861
00000001:00080000:1.0:1651532134.495694:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793837 is committed
00010000:00010000:1.0:1651532134.495708:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.495714:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.495735:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468463104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507973us (508030us total) trans 158913793837 rc 0/0
00000100:00100000:1.0:1651532134.495738:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4347
00010000:00010000:0.0:1651532134.495738:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.495743:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.495744:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.495750:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.495755:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.495756:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.495757:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.495760:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.495763:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.495763:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.495764:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.495767:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.495774:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.495777:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f4105ed lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1953792->9641983] (req 1953792->9641983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.495782:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.495784:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.495791:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.495796:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.496079:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532134.496105:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496110:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496114:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496123:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.496129:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468463168:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508345us (508416us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532134.496138:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4348
00000100:00100000:1.0:1651532134.496140:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468463808:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391608us (391658us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532134.496143:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4349
00010000:00010000:0.0:1651532134.496145:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496148:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.496149:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496151:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496152:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496154:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532134.496157:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496158:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496160:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496161:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4105f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->5357567] (req 622592->5357567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496166:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.496166:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.496167:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.496167:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468468352
00010000:00010000:1.0:1651532134.496170:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.496174:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3862
00000100:00100000:0.0:1651532134.496176:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468468352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532134.496177:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496179:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.496180:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410609 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6737920->9703423] (req 6737920->9703423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496181:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4106e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa95 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496185:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496188:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496188:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4106e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa95 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.496192:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4106e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa95 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.496195:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532134.496202:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468468352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.496205:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3862
00000100:00100000:0.0:1651532134.496566:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.496586:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.496595:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468468608
00000100:00100000:0.0:1651532134.496595:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.496601:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.496606:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468468736
00000100:00100000:0.0:1651532134.496608:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468468800
00000100:00100000:1.0:1651532134.496612:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4357
00000100:00100000:1.0:1651532134.496614:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468468608:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532134.496621:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496626:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532134.496627:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.496633:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468468864
00010000:00010000:1.0:1651532134.496637:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532134.496637:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.496641:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3863
00000100:00100000:0.0:1651532134.496642:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468468800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.496646:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.496647:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496650:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496650:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4106f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aa9c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.496657:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4358
00000100:00100000:1.0:1651532134.496659:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468468736:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532134.496660:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4106f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa9c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.496664:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496664:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4106f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aa9c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.496667:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532134.496667:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:1.0:1651532134.496668:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496671:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532134.496671:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.496677:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.496677:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468468800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (91us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532134.496680:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.496680:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3863
00000100:00100000:0.0:1651532134.496684:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3864
00000100:00100000:0.0:1651532134.496686:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468468864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.496688:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532134.496698:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532134.496698:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410705 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aaa3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496704:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410705 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aaa3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.496708:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410705 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aaa3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.496712:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532134.496718:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468468864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.496721:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3864
00000100:00100000:0.0:1651532134.496725:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468468992
00000100:00100000:0.0:1651532134.496729:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3865
00000100:00100000:0.0:1651532134.496730:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468468992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.496733:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.496735:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41070c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aaaa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.496740:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41070c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aaaa expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.496744:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41070c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aaaa expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.496747:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532134.496757:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468468992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.496759:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3865
00000001:00080000:1.0:1651532134.588691:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793838 is committed
00010000:00010000:1.0:1651532134.588706:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.588709:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.588730:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468463744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 484165us (484239us total) trans 158913793838 rc 0/0
00000100:00100000:1.0:1651532134.588733:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4350
00010000:00010000:0.0:1651532134.588737:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.588742:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.588743:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.588746:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.588752:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.588753:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.588754:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.588757:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.588765:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.588768:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410610 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2527232->10375167] (req 2527232->10375167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.588773:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.588776:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.589096:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.589126:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.589134:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.589144:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.589145:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468469568
00000100:00100000:1.0:1651532134.589153:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468469440
00000100:00100000:0.0:1651532134.589161:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468469632
00000100:00100000:0.0:1651532134.589168:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3866
00000100:00100000:0.0:1651532134.589170:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468469568:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532134.589172:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468469376
00000100:00100000:1.0:1651532134.589178:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4359
00000100:00100000:1.0:1651532134.589180:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468469440:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532134.589188:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.589192:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410713 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aab1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.589194:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.589199:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532134.589200:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532134.589201:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.589206:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.589207:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410713 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aab1 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.589211:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410713 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aab1 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532134.589213:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3867
00000100:00100000:1.0:1651532134.589215:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468469632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.589215:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532134.589217:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.589220:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410721 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aab8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.589227:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468469568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.589230:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3866
00010000:00010000:1.0:1651532134.589233:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410721 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aab8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.589237:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410721 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aab8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.589241:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:0.0:1651532134.589245:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4360
00000100:00100000:0.0:1651532134.589247:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468469376:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532134.589250:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468469632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.589253:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3867
00010000:00010000:0.0:1651532134.589254:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.589258:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532134.589259:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.589261:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.589264:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532134.589265:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.589268:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532134.589271:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.589274:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.589278:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.589285:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468469696
00000100:00100000:0.0:1651532134.589292:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3868
00000100:00100000:0.0:1651532134.589293:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468469696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.589295:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.589297:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41072f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aabf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.589303:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41072f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aabf expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.589307:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41072f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aabf expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.589310:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532134.589323:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468469696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.589337:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3868
00000100:00100000:1.0:1651532134.589526:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.589538:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468469888
00000100:00100000:0.0:1651532134.589545:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3869
00000100:00100000:0.0:1651532134.589547:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468469888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.589550:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.589553:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410736 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aac6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.589561:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410736 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aac6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.589564:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410736 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aac6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.589568:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532134.589581:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468469888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.589583:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3869
00000100:00100000:1.0:1651532134.589629:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.589639:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468470016
00000100:00100000:0.0:1651532134.589645:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3870
00000100:00100000:0.0:1651532134.589647:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468470016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.589650:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.589653:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41073d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aacd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.589660:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41073d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aacd expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.589664:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41073d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aacd expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.589667:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532134.589679:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468470016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.589682:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3870
00000001:00080000:1.0:1651532134.730378:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793839 is committed
00010000:00010000:0.0:1651532134.730408:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730413:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.730434:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468464896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 517740us (517781us total) trans 158913793839 rc 0/0
00000100:00100000:0.0:1651532134.730438:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4351
00010000:00010000:0.0:1651532134.730445:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730448:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.730449:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730452:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730460:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.730460:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.730461:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730465:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730468:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.730468:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.730469:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730471:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730478:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730480:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41063a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2502656->8396799] (req 2502656->8396799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.730485:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730489:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.730490:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730492:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.730866:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.730877:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468470336
00000100:00100000:1.0:1651532134.730879:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.730893:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468470400
00000100:00100000:0.0:1651532134.730898:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3871
00000100:00100000:1.0:1651532134.730900:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.730900:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468470336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.730903:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.730907:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410744 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aad4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730917:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532134.730918:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468470528
00010000:00010000:0.0:1651532134.730920:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410744 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aad4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.730924:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410744 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aad4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532134.730926:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3872
00000100:00100000:1.0:1651532134.730927:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e28b58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468470400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.730928:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:1.0:1651532134.730931:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.730935:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f41074b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aadb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.730941:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468470336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.730944:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3871
00010000:00010000:1.0:1651532134.730948:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532134.730949:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3873
00010000:00010000:1.0:1651532134.730951:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f41074b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aadb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532134.730951:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468470528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.730954:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.730955:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f41074b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aadb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.730956:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410752 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aae2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.730959:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00010000:00010000:0.0:1651532134.730961:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.730963:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410752 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aae2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532134.730967:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e28b58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468470400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (87us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532134.730970:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410752 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aae2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.730973:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532134.730979:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468470528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.730980:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3872
00000100:00100000:0.0:1651532134.730981:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3873
00010000:00010000:0.0:1651532134.730993:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.730996:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.731011:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468466304:12345-10.240.43.64@tcp:3:fio.0 Request processed in 409894us (409937us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532134.731014:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4353
00010000:00010000:1.0:1651532134.731021:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.731026:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731026:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731029:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.731030:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731039:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.731043:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468464960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 518338us (518379us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532134.731046:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4352
00010000:00010000:0.0:1651532134.731047:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731050:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410680 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->10375167] (req 987136->10375167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731053:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731056:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.731057:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731060:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731063:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.731063:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.731064:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731067:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731073:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731076:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410641 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->8007679] (req 4530176->8007679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731081:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731084:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.731533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.731545:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468470720
00000100:00100000:1.0:1651532134.731551:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.731554:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3874
00000100:00100000:0.0:1651532134.731556:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468470720:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532134.731559:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532134.731559:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532134.731568:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532134.731569:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410759 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aae9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.731574:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532134.731581:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410759 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aae9 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532134.731583:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532134.731586:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410759 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aae9 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532134.731589:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468470784
00010000:00010000:0.0:1651532134.731589:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532134.731607:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468470656
00000100:00100000:0.0:1651532134.731607:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468470720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.731610:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3874
00000100:00100000:1.0:1651532134.731616:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4361
00000100:00100000:1.0:1651532134.731618:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468470784:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532134.731620:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468470912
00000100:00100000:0.0:1651532134.731623:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468470976
00010000:00010000:1.0:1651532134.731625:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.731625:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468471168
00000100:00100000:0.0:1651532134.731628:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3875
00010000:00010000:1.0:1651532134.731630:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532134.731630:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468470912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532134.731631:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731632:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.731635:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410767 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aaf0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.731643:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532134.731643:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.731648:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731648:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410767 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aaf0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.731652:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731652:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410767 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aaf0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.731656:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532134.731660:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3876
00000100:00100000:1.0:1651532134.731662:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468470976:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532134.731662:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468470912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (94us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532134.731664:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532134.731665:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3875
00010000:00010000:1.0:1651532134.731667:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f41076e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aaf7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.731669:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3877
00000100:00100000:0.0:1651532134.731670:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468471168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.731673:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.731674:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f41076e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aaf7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.731675:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410775 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aafe expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.731679:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f41076e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aaf7 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.731680:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410775 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aafe expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.731682:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00010000:00010000:0.0:1651532134.731684:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410775 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aafe expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.731688:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532134.731691:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468470976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.731693:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468471168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.731694:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3876
00000100:00100000:0.0:1651532134.731703:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3877
00000100:00100000:0.0:1651532134.731710:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4362
00000100:00100000:0.0:1651532134.731712:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468470656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532134.731717:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731721:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532134.731722:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532134.731723:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.731726:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.731969:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.731979:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468471360
00000100:00100000:0.0:1651532134.731987:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3878
00000100:00100000:0.0:1651532134.731988:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468471360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.731991:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.731994:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f410783 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab05 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.732001:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f410783 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab05 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.732008:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f410783 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab05 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.732011:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532134.732034:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468471360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.732038:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3878
00000100:00100000:1.0:1651532134.732058:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.732068:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468471488
00000100:00100000:0.0:1651532134.732074:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3879
00000100:00100000:0.0:1651532134.732075:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468471488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.732078:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.732081:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41078a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab0c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.732088:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41078a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab0c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.732092:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41078a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab0c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.732095:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532134.732107:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468471488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.732110:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3879
00000100:00100000:1.0:1651532134.732285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.732295:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468471616
00000100:00100000:0.0:1651532134.732301:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3880
00000100:00100000:0.0:1651532134.732303:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468471616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.732306:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.732309:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410791 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab13 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.732316:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410791 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab13 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.732319:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410791 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab13 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.732323:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532134.732343:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468471616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.732346:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3880
00000100:00100000:1.0:1651532134.732446:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.732456:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468471808
00000100:00100000:0.0:1651532134.732463:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3881
00000100:00100000:0.0:1651532134.732464:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468471808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.732467:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.732471:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410798 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab1a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.732477:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410798 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab1a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.732484:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410798 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab1a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.732487:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532134.732499:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468471808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.732502:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3881
00000001:00080000:1.0:1651532134.855354:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793840 is committed
00010000:00010000:0.0:1651532134.855384:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855388:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.855409:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ad9bc26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468466240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 534265us (534322us total) trans 158913793840 rc 0/0
00000100:00100000:0.0:1651532134.855412:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4354
00010000:00010000:0.0:1651532134.855419:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855423:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.855424:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855427:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855434:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.855435:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.855436:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855439:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855448:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855451:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410687 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1101824->10407935] (req 1101824->10407935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.855461:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.855465:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.855785:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.855817:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468472064
00000100:00100000:1.0:1651532134.855825:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.855827:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4363
00000100:00100000:0.0:1651532134.855834:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468472064:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532134.855837:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532134.855846:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855850:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532134.855851:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855854:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855857:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532134.855857:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.855861:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.855865:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855869:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855876:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855880:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.855883:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468467328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 467753us (467818us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532134.855886:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4355
00010000:00010000:0.0:1651532134.855887:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855890:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532134.855891:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.855893:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468472128
00010000:00010000:0.0:1651532134.855894:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855898:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.855899:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532134.855899:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.855901:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4364
00010000:00010000:0.0:1651532134.855902:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.855903:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468472128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532134.855909:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855910:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855913:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4106b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1724416->8531967] (req 1724416->8531967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855918:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855921:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.855925:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532134.855926:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.855929:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532134.855930:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.855934:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.855938:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.855945:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468472256
00000100:00100000:0.0:1651532134.855952:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3882
00000100:00100000:0.0:1651532134.855954:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468472256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.855957:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.855960:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4107ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab21 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.855967:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4107ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab21 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.855971:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4107ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab21 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.855974:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532134.855988:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468472256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (151us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.855991:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3882
00000100:00100000:1.0:1651532134.856313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.856324:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468472640
00000100:00100000:0.0:1651532134.856345:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3883
00000100:00100000:0.0:1651532134.856346:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468472640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532134.856350:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532134.856354:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab28 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.856361:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab28 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.856365:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab28 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.856368:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532134.856381:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468472640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.856384:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3883
00000001:00080000:1.0:1651532134.938695:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793841 is committed
00002000:00010000:0.0:1651532134.938725:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532133 -> 1651532134
00002000:00010000:0.0:1651532134.938727:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532132 -> 1651532134
00010000:00010000:0.0:1651532134.938729:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.938733:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.938755:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468467264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 550620us (550657us total) trans 158913793841 rc 0/0
00010000:00010000:1.0:1651532134.938758:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.938759:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4356
00010000:00010000:1.0:1651532134.938763:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532134.938764:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.938767:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.938773:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.938773:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532134.938781:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.938784:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.938800:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.938819:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4106b8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [970752->10104831] (req 970752->10104831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.938831:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.938836:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532134.939236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.939250:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532134.939261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532134.939262:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468472896
00000100:00100000:1.0:1651532134.939276:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468472832
00000100:00100000:1.0:1651532134.939284:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4365
00000100:00100000:1.0:1651532134.939286:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468472896:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532134.939286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532134.939298:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.939303:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532134.939304:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.939307:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.939314:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468472960
00000100:00100000:1.0:1651532134.939323:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468473152
00000100:00100000:1.0:1651532134.939337:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3884
00000100:00100000:1.0:1651532134.939339:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468472960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532134.939349:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.939353:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab2f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.939360:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab2f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.939365:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab2f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532134.939368:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a591db0, rc 0)
00000100:00100000:0.0:1651532134.939379:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4366
00000100:00100000:1.0:1651532134.939380:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468472960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532134.939381:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468472832:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532134.939383:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3884
00000100:00100000:1.0:1651532134.939388:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3885
00010000:00010000:0.0:1651532134.939389:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532134.939390:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468473152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532134.939392:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532134.939394:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4107d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab36 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.939394:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532134.939395:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.939398:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.939400:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532134.939401:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.939406:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4107d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab36 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.939406:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532134.939409:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.939411:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4107d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab36 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532134.939413:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532134.939423:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:1.0:1651532134.939429:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468473152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (148us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532134.939432:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3885
00000001:00080000:1.0:1651532135.072070:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793842 is committed
00010000:00010000:0.0:1651532135.072101:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072106:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.072123:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468468608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 575508us (575576us total) trans 158913793842 rc 0/0
00000100:00100000:0.0:1651532135.072126:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4357
00010000:00010000:0.0:1651532135.072133:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072136:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000467b1d5c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532135.072137:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072140:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072145:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.072146:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.072147:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072150:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072153:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.072154:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.072154:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072157:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072169:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072172:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f4106f0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->10280959] (req 61440->10280959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.072182:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.072186:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072203:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072206:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.072661:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.072674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.072680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.072682:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468473408
00000100:00100000:1.0:1651532135.072701:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468473536
00000100:00100000:1.0:1651532135.072704:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468473664
00000100:00100000:0.0:1651532135.072707:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3886
00000100:00100000:0.0:1651532135.072710:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468473408:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532135.072712:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3887
00000100:00100000:1.0:1651532135.072713:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468473536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.072713:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.072717:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.072717:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4107d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab3d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.072721:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4107de lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab44 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072723:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.072726:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4107d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab3d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.072727:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.072730:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4107de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab44 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.072730:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4107d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab3d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.072734:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4107de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab44 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.072734:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532135.072747:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468473408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.072750:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3886
00010000:00010000:1.0:1651532135.072753:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:0.0:1651532135.072756:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3888
00000100:00100000:0.0:1651532135.072757:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468473664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.072760:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532135.072762:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468473536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (88us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532135.072763:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4107e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab4b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.072765:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3887
00010000:00010000:0.0:1651532135.072768:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.072769:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4107e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab4b expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.072774:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4107e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab4b expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.072777:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:1.0:1651532135.072778:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.072782:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.072782:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468473664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.072785:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3888
00000100:00100000:1.0:1651532135.072799:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468468736:12345-10.240.43.64@tcp:3:fio.0 Request processed in 576139us (576204us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532135.072802:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4358
00010000:00010000:0.0:1651532135.072815:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072820:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.072835:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468469440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483654us (483739us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532135.072838:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4359
00010000:00010000:0.0:1651532135.072844:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072848:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532135.072849:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072852:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072860:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072863:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4106fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5505024->9727999] (req 5505024->9727999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072866:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072868:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532135.072869:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072872:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072875:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.072875:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.072876:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072879:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072886:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.072888:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f41071a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [442368->9211903] (req 442368->9211903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.072891:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.072895:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.073213:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.073229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.073240:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.073248:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.073258:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468473792
00000100:00100000:0.0:1651532135.073268:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468473728
00000100:00100000:0.0:1651532135.073274:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4367
00000100:00100000:0.0:1651532135.073275:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468473792:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532135.073278:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4368
00000100:00100000:1.0:1651532135.073281:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468473728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532135.073282:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.073286:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532135.073287:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.073289:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.073290:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532135.073291:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.073295:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532135.073304:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.073307:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532135.073308:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.073312:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.073313:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.073315:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.073316:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.073348:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468473920
00000100:00100000:1.0:1651532135.073363:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468474048
00000100:00100000:0.0:1651532135.073368:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3889
00000100:00100000:1.0:1651532135.073370:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3890
00000100:00100000:0.0:1651532135.073370:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468473920:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532135.073372:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468474048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.073373:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.073375:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.073376:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4107fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab52 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.073384:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4107fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab52 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.073385:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410801 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab59 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.073388:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4107fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab52 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.073391:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:1.0:1651532135.073393:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410801 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab59 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.073397:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410801 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab59 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.073401:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:0.0:1651532135.073402:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468473920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (162us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.073405:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3889
00000100:00100000:1.0:1651532135.073410:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468474048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (162us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.073413:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3890
00000100:00100000:0.0:1651532135.073418:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.073430:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468474176
00000100:00100000:1.0:1651532135.073439:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3891
00000100:00100000:1.0:1651532135.073441:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468474176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532135.073443:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532135.073444:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.073446:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410808 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab60 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.073453:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410808 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab60 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.073457:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410808 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab60 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.073460:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:0.0:1651532135.073465:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468474368
00000100:00100000:0.0:1651532135.073471:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3892
00000100:00100000:0.0:1651532135.073473:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468474368:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532135.073479:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468474176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (61us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532135.073481:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532135.073482:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3891
00010000:00010000:0.0:1651532135.073485:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41080f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab67 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.073493:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41080f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab67 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.073499:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41080f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab67 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.073503:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532135.073511:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468474368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.073514:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3892
00000100:00100000:0.0:1651532135.073727:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.073734:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468474624
00000100:00100000:0.0:1651532135.073747:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3893
00000100:00100000:0.0:1651532135.073749:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468474624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.073752:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.073756:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410816 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab6e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.073763:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410816 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab6e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.073767:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410816 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab6e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.073770:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532135.073784:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468474624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.073788:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3893
00000100:00100000:0.0:1651532135.073902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.073909:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.073922:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468474880
00000100:00100000:1.0:1651532135.073927:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468474816
00000100:00100000:0.0:1651532135.073931:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3894
00000100:00100000:0.0:1651532135.073933:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468474880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.073936:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.073939:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41081d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab7c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.073940:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3895
00000100:00100000:1.0:1651532135.073941:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468474816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.073945:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.073947:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41081d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab7c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.073948:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410824 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab75 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.073951:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41081d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab7c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.073954:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:1.0:1651532135.073958:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410824 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab75 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.073962:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410824 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab75 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532135.073966:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468474880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.073968:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3894
00010000:00010000:1.0:1651532135.073972:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532135.073980:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468474816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.073983:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3895
00000100:00100000:0.0:1651532135.074211:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.074230:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468475200
00000100:00100000:1.0:1651532135.074237:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3896
00000100:00100000:1.0:1651532135.074238:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468475200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.074242:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.074245:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f41082b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab83 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.074251:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f41082b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab83 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.074255:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f41082b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab83 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.074259:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532135.074268:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468475200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.074280:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3896
00000001:00080000:1.0:1651532135.205349:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793843 is committed
00010000:00010000:1.0:1651532135.205364:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205368:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.205389:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468469376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616142us (616263us total) trans 158913793843 rc 0/0
00000100:00100000:1.0:1651532135.205393:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4360
00010000:00010000:0.0:1651532135.205393:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205398:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532135.205399:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205402:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205408:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.205409:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.205410:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205413:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205416:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.205417:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.205417:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205420:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205428:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205431:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410728 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->7516159] (req 749568->7516159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205436:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205439:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205447:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205451:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.205789:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.205795:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.205800:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468475520
00000100:00100000:0.0:1651532135.205826:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468475584
00000100:00100000:1.0:1651532135.205835:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4369
00000100:00100000:1.0:1651532135.205837:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468475520:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532135.205843:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4370
00010000:00010000:1.0:1651532135.205844:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.205845:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468475584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532135.205848:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532135.205849:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205852:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205862:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532135.205863:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205867:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532135.205868:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205871:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532135.205872:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205875:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205876:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205879:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.205880:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205891:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205894:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.205920:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468470784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474301us (474369us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532135.205923:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4361
00010000:00010000:1.0:1651532135.205933:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205937:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532135.205938:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205941:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205947:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.205950:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410760 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1114112->3624959] (req 1114112->3624959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.206249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.206263:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.206272:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.206280:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468475840
00000100:00100000:0.0:1651532135.206285:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468476032
00000100:00100000:1.0:1651532135.206291:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468475968
00000100:00100000:1.0:1651532135.206295:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3897
00000100:00100000:1.0:1651532135.206296:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468475840:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532135.206299:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3898
00010000:00010000:1.0:1651532135.206300:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532135.206301:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468475968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.206303:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410840 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab8a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.206304:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.206308:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410847 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab91 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.206311:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410840 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab8a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.206316:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410840 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab8a expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.206316:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410847 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab91 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.206319:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00010000:00010000:0.0:1651532135.206320:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410847 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab91 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.206324:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532135.206339:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468475840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.206342:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3897
00000100:00100000:0.0:1651532135.206344:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468475968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.206347:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3899
00000100:00100000:1.0:1651532135.206349:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468476032:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532135.206349:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3898
00010000:00010000:1.0:1651532135.206352:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.206354:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f41084e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab98 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.206360:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f41084e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab98 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.206364:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f41084e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab98 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.206367:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532135.206373:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468476032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.206376:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3899
00000100:00100000:0.0:1651532135.206640:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.206659:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468476224
00000100:00100000:1.0:1651532135.206670:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3900
00000100:00100000:1.0:1651532135.206672:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468476224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.206675:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.206678:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410855 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ab9f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.206685:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410855 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab9f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.206689:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410855 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ab9f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.206703:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532135.206714:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468476224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.206717:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3900
00000001:00080000:1.0:1651532135.305381:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793844 is committed
00010000:00010000:0.0:1651532135.305413:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305417:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.305434:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468470656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 573721us (573875us total) trans 158913793844 rc 0/0
00000100:00100000:0.0:1651532135.305437:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4362
00010000:00010000:0.0:1651532135.305444:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305450:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532135.305451:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305454:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305458:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.305459:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.305460:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305463:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305470:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305473:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41077c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3842048->8962047] (req 3842048->8962047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305478:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305481:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.305827:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.305836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.305843:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468476352
00000100:00100000:1.0:1651532135.305859:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468476416
00000100:00100000:0.0:1651532135.305893:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4371
00000100:00100000:0.0:1651532135.305895:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468476352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532135.305904:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.305914:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4372
00010000:00010000:0.0:1651532135.305914:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532135.305915:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.305916:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468476416:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532135.305918:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532135.305919:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305924:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.305925:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.305927:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.305931:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532135.305932:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.305935:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532135.305936:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.305941:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.305945:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.305964:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.305982:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468476544
00000100:00100000:1.0:1651532135.305992:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3901
00000100:00100000:1.0:1651532135.305994:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468476544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.305998:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.306001:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f41086a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aba6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.306010:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f41086a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aba6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.306014:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f41086a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aba6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.306018:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532135.306031:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468476544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.306034:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3901
00000001:00080000:1.0:1651532135.388749:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793845 is committed
00010000:00010000:0.0:1651532135.388783:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.388787:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.388810:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.388815:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532135.388817:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.388822:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468472064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532991us (533036us total) trans 158913793845 rc 0/0
00010000:00010000:1.0:1651532135.388825:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.388827:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4363
00010000:00010000:1.0:1651532135.388834:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.388835:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.388836:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.388839:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.388842:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.388843:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.388844:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.388846:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.388854:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.388857:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41079f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->8781823] (req 2494464->8781823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.388862:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.388863:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.388867:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.388874:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389048:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389053:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.389061:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.389068:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468472896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449781us (449832us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532135.389071:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4365
00010000:00010000:1.0:1651532135.389074:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389077:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389080:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065453fc2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532135.389081:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389091:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.389093:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468472128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533189us (533268us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532135.389097:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4364
00010000:00010000:0.0:1651532135.389097:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389100:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f4107bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7839744->9924607] (req 7839744->9924607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389104:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389106:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133ac5f6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532135.389107:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389110:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389113:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.389114:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.389115:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389118:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389124:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389127:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f4107a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [192512->10047487] (req 192512->10047487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389132:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389135:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.389221:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.389232:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468476864
00000100:00100000:0.0:1651532135.389233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.389243:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468476928
00000100:00100000:1.0:1651532135.389250:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3902
00000100:00100000:1.0:1651532135.389252:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468476864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.389256:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532135.389256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532135.389260:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410871 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abb4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.389274:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410871 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abb4 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.389278:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410871 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abb4 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532135.389278:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468476800
00010000:00010000:1.0:1651532135.389282:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:0.0:1651532135.389285:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3903
00000100:00100000:0.0:1651532135.389287:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468476928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.389291:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532135.389295:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468476864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.389298:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3902
00010000:00010000:0.0:1651532135.389301:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410878 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abbb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.389303:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3904
00010000:00010000:0.0:1651532135.389309:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410878 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abbb expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532135.389312:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468476800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.389314:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410878 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abbb expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.389315:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.389317:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:1.0:1651532135.389318:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41087f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abad expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.389325:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41087f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abad expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532135.389326:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468476928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.389339:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3903
00010000:00010000:1.0:1651532135.389342:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41087f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abad expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.389345:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532135.389353:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468476800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.389356:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3904
00000100:00100000:0.0:1651532135.389562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.389573:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.389588:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468477120
00000100:00100000:0.0:1651532135.389598:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.389611:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468477056
00000100:00100000:0.0:1651532135.389613:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4373
00000100:00100000:0.0:1651532135.389616:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468477120:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532135.389622:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4374
00000100:00100000:1.0:1651532135.389624:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468477056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532135.389631:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.389633:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389635:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.389636:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532135.389637:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.389642:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532135.389644:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.389647:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532135.389648:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389657:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.389658:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.389662:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.389670:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468477184
00000100:00100000:0.0:1651532135.389674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.389686:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468477312
00000100:00100000:1.0:1651532135.389693:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3905
00000100:00100000:1.0:1651532135.389695:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468477184:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532135.389697:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532135.389698:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.389701:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410894 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abc2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.389703:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468477376
00010000:00010000:1.0:1651532135.389709:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410894 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abc2 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532135.389710:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3906
00000100:00100000:0.0:1651532135.389711:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468477312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.389714:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410894 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abc2 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.389715:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.389717:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00010000:00010000:0.0:1651532135.389718:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41089b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abc9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.389725:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41089b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abc9 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532135.389732:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468477184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.389735:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3905
00010000:00010000:0.0:1651532135.389736:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41089b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abc9 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532135.389741:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3907
00000100:00100000:1.0:1651532135.389743:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468477376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.389743:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532135.389745:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.389748:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f4108a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abd0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.389752:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468477312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (78us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532135.389755:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f4108a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abd0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532135.389755:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3906
00010000:00010000:1.0:1651532135.389759:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f4108a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abd0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.389762:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532135.389768:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468477376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.389771:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3907
00000100:00100000:0.0:1651532135.389841:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.389850:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468477568
00000100:00100000:1.0:1651532135.389861:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3908
00000100:00100000:1.0:1651532135.389862:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468477568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.389866:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.389868:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f4108a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abd7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.389876:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f4108a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abd7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.389880:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f4108a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abd7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.389883:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532135.389898:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468477568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.389901:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3908
00000100:00100000:0.0:1651532135.390119:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.390138:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468477824
00000100:00100000:0.0:1651532135.390142:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.390153:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468477952
00000100:00100000:1.0:1651532135.390159:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3909
00000100:00100000:1.0:1651532135.390161:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468477824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.390164:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532135.390165:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3910
00010000:00010000:1.0:1651532135.390167:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abde expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.390167:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468477952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.390171:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.390175:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abde expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.390175:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4108b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abe5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.390179:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abde expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.390182:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00010000:00010000:0.0:1651532135.390183:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4108b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abe5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.390187:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4108b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abe5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.390190:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532135.390194:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468477824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.390197:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3909
00000100:00100000:0.0:1651532135.390218:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468477952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.390221:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3910
00000100:00100000:0.0:1651532135.390250:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.390273:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468478144
00000100:00100000:0.0:1651532135.390281:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3911
00000100:00100000:0.0:1651532135.390283:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468478144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.390286:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.390290:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108be lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abec expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.390297:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abec expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.390300:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abec expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.390304:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532135.390313:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468478144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.390315:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3911
00000001:00080000:1.0:1651532135.513813:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793846 is committed
00010000:00010000:0.0:1651532135.513849:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.513854:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.513876:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.513877:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468472832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574495us (574632us total) trans 158913793846 rc 0/0
00000100:00100000:0.0:1651532135.513880:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4366
00010000:00010000:1.0:1651532135.513883:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532135.513884:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.513888:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.513893:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.513894:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.513895:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.513898:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.513907:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.513914:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.513917:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4107c9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3874816->9646079] (req 3874816->9646079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.513921:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.514207:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.514216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.514223:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.514234:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.514241:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468478528
00000100:00100000:0.0:1651532135.514251:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468478592
00000100:00100000:0.0:1651532135.514256:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4375
00000100:00100000:0.0:1651532135.514258:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468478528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532135.514265:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514270:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532135.514271:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514274:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532135.514274:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514279:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514282:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.514291:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468478720
00000100:00100000:0.0:1651532135.514296:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468478848
00000100:00100000:0.0:1651532135.514307:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3912
00000100:00100000:0.0:1651532135.514308:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468478720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.514311:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.514314:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4108cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abf3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.514315:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3913
00000100:00100000:1.0:1651532135.514318:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468478848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.514319:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.514322:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.514322:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4108cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abf3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.514325:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44abfa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514326:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4108cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abf3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.514339:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532135.514350:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468478720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (127us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532135.514352:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532135.514353:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3912
00010000:00010000:1.0:1651532135.514355:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abfa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.514359:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44abfa expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.514362:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00010000:00010000:0.0:1651532135.514364:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514368:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.514372:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468478848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (138us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.514382:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3913
00000100:00100000:0.0:1651532135.514384:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468473792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441108us (441172us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532135.514387:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4367
00010000:00010000:1.0:1651532135.514390:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.514392:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4376
00010000:00010000:1.0:1651532135.514393:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532135.514393:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468478592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532135.514394:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.514397:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514399:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.514402:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.514403:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.514404:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.514407:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514419:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532135.514420:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514423:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532135.514423:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514428:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.514430:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514431:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.514434:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4107ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2670592->7876607] (req 2670592->7876607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.514439:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.514442:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.514765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.514773:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468479168
00000100:00100000:0.0:1651532135.514780:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3914
00000100:00100000:0.0:1651532135.514782:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468479168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.514785:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.514789:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac01 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.514799:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac01 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.514822:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac01 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.514825:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532135.514836:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468479168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.514839:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3914
00000001:00080000:1.0:1651532135.647063:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793847 is committed
00010000:00010000:1.0:1651532135.647077:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.647082:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.647104:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468473728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 573822us (573874us total) trans 158913793847 rc 0/0
00000100:00100000:1.0:1651532135.647107:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4368
00010000:00010000:0.0:1651532135.647110:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647115:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532135.647116:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647119:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647125:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.647126:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.647127:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647130:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647140:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647143:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f4107f3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->10444799] (req 557056->10444799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647153:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647156:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.647511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.647526:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.647531:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468479296
00000100:00100000:0.0:1651532135.647532:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.647539:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.647544:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468479360
00000100:00100000:1.0:1651532135.647552:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4377
00000100:00100000:1.0:1651532135.647554:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468479296:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532135.647558:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4378
00000100:00100000:0.0:1651532135.647560:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468479360:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532135.647562:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.647566:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532135.647567:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647569:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.647570:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.647573:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532135.647574:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647579:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532135.647580:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647583:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532135.647584:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.647589:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647589:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.647592:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647593:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.647595:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.647600:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468479424
00000100:00100000:0.0:1651532135.647611:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468479552
00000100:00100000:0.0:1651532135.647616:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3915
00000100:00100000:1.0:1651532135.647618:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3916
00000100:00100000:0.0:1651532135.647618:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468479424:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532135.647620:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468479552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.647620:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.647623:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.647623:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4108f6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac08 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.647626:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f4108fd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac0f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.647631:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4108f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac08 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.647633:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f4108fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac0f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.647635:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4108f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac08 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.647638:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f4108fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac0f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.647638:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:1.0:1651532135.647642:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:0.0:1651532135.647651:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468479424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.647654:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3915
00000100:00100000:1.0:1651532135.647657:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468479552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.647660:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3916
00000100:00100000:0.0:1651532135.647938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.647956:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468479808
00000100:00100000:1.0:1651532135.647965:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3917
00000100:00100000:1.0:1651532135.647966:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468479808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.647970:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.647981:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410904 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac16 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.647989:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410904 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac16 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.647993:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410904 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac16 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.647997:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532135.648008:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468479808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.648011:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3917
00000100:00100000:0.0:1651532135.648104:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532135.648113:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232320
00000100:00100000:0.0:1651532135.648121:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 63
00000100:00100000:0.0:1651532135.648123:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232320:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532135.648129:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 630784 granted 352936512 pending 229376 free 81138851840 avail 76967796736
00000100:00100000:0.0:1651532135.648148:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232320:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 24us (44us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532135.648151:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 63
00000001:00080000:1.0:1651532135.755430:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793848 is committed
00010000:00010000:0.0:1651532135.755462:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.755467:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.755490:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468475520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549652us (549702us total) trans 158913793848 rc 0/0
00010000:00010000:1.0:1651532135.755491:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.755494:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4369
00010000:00010000:1.0:1651532135.755496:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532135.755497:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.755500:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.755506:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.755507:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.755508:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.755511:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.755521:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.755524:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410832 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->8450047] (req 2400256->8450047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.755528:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.755532:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.755842:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.755852:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468479936
00000100:00100000:0.0:1651532135.755854:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.755869:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468480064
00000100:00100000:1.0:1651532135.755877:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3918
00000100:00100000:1.0:1651532135.755878:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468479936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.755882:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.755884:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.755886:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.755887:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f41090b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac1d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.755898:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.755901:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f41090b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac1d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532135.755906:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468475584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 550060us (550110us total) trans 0 rc 45056/45056
00000100:00100000:0.0:1651532135.755909:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4370
00010000:00010000:1.0:1651532135.755911:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f41090b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac1d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.755914:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:0.0:1651532135.755918:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3919
00000100:00100000:0.0:1651532135.755920:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000013f1d10f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468480064:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532135.755924:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468479936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (82us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532135.755924:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532135.755927:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3918
00010000:00010000:0.0:1651532135.755927:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410912 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac24 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.755933:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.755934:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.755936:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410912 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac24 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.755937:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532135.755938:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.755940:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410912 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac24 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.755941:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.755943:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:1.0:1651532135.755946:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.755946:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.755947:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.755950:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.755950:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000013f1d10f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468480064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.755952:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3919
00010000:00010000:1.0:1651532135.755961:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.755964:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410839 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->9949183] (req 184320->9949183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.755989:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.755994:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.756415:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.756423:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.756430:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.756435:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.756441:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.756451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.756452:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468480448
00000100:00100000:0.0:1651532135.756460:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468480384
00000100:00100000:1.0:1651532135.756463:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468480576
00000100:00100000:1.0:1651532135.756466:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468480640
00000100:00100000:1.0:1651532135.756468:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468480768
00000100:00100000:0.0:1651532135.756470:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468480320
00000100:00100000:1.0:1651532135.756471:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3920
00000100:00100000:1.0:1651532135.756473:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468480448:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532135.756479:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4379
00000100:00100000:0.0:1651532135.756481:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468480384:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532135.756482:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.756486:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410919 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac2b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.756488:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.756493:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410919 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac2b expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.756493:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532135.756495:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532135.756495:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.756499:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410919 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac2b expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.756499:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.756503:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:0.0:1651532135.756506:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3921
00000100:00100000:0.0:1651532135.756508:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468480576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.756510:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.756512:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410927 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac32 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.756513:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468480448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.756516:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3920
00000100:00100000:1.0:1651532135.756521:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3922
00010000:00010000:0.0:1651532135.756522:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410927 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac32 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532135.756523:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468480640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.756525:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.756526:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410927 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac32 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.756527:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f41092e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac39 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.756530:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:1.0:1651532135.756533:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f41092e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac39 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.756537:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f41092e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac39 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532135.756538:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468480576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (103us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532135.756540:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:0.0:1651532135.756541:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3921
00000100:00100000:1.0:1651532135.756546:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468480640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.756546:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3923
00000100:00100000:1.0:1651532135.756548:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3922
00000100:00100000:0.0:1651532135.756548:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468480768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.756551:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.756553:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410935 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac40 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.756555:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4380
00000100:00100000:1.0:1651532135.756557:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468480320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532135.756558:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410935 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac40 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.756562:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.756562:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410935 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac40 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.756565:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:1.0:1651532135.756567:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532135.756568:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.756570:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468480768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.756573:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3923
00010000:00010000:1.0:1651532135.756583:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.756585:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532135.756586:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.756591:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.756594:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.756597:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.756976:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.756984:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.756990:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468481088
00000100:00100000:0.0:1651532135.756996:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468481024
00000100:00100000:0.0:1651532135.757007:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3924
00000100:00100000:0.0:1651532135.757009:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468481088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.757012:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.757016:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f410943 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac4e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.757017:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3925
00000100:00100000:1.0:1651532135.757019:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468481024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.757023:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.757024:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f410943 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac4e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.757026:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f41094a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac47 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.757027:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f410943 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac4e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.757031:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:1.0:1651532135.757034:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f41094a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac47 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.757037:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f41094a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac47 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532135.757043:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468481088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.757045:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3924
00010000:00010000:1.0:1651532135.757052:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532135.757061:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468481024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.757064:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3925
00000001:00080000:1.0:1651532135.879827:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793849 is committed
00010000:00010000:0.0:1651532135.879863:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879868:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.879888:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468476352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 573992us (574061us total) trans 158913793849 rc 0/0
00000100:00100000:0.0:1651532135.879892:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4371
00010000:00010000:0.0:1651532135.879899:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879902:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532135.879903:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879906:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879911:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.879912:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.879912:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879915:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879919:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.879919:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532135.879920:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879923:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879938:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879942:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41085c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->10264575] (req 299008->10264575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879947:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.879950:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879950:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.879955:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879964:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.879967:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.879984:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468477120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 490368us (490423us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651532135.879986:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.879987:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4373
00010000:00010000:1.0:1651532135.879990:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532135.879991:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.879994:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880000:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880003:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410886 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->1261567] (req 1257472->1261567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880202:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880206:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.880223:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468476416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 574306us (574387us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532135.880227:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4372
00010000:00010000:1.0:1651532135.880234:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880237:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532135.880238:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880241:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880246:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.880247:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532135.880247:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880250:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880257:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880260:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410863 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2138112->9727999] (req 2138112->9727999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880265:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880267:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.880362:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.880382:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468481472
00000100:00100000:1.0:1651532135.880399:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4381
00000100:00100000:1.0:1651532135.880401:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468481472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532135.880408:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.880410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532135.880420:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532135.880420:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532135.880421:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880430:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532135.880431:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880436:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880439:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.880443:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532135.880448:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468481600
00000100:00100000:1.0:1651532135.880458:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468481664
00000100:00100000:1.0:1651532135.880464:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3926
00000100:00100000:1.0:1651532135.880466:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468481600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532135.880469:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532135.880472:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410958 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac55 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532135.880495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532135.880499:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410958 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac55 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.880503:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410958 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac55 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532135.880503:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468481536
00010000:00010000:1.0:1651532135.880506:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:0.0:1651532135.880514:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4382
00000100:00100000:0.0:1651532135.880516:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468481536:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532135.880520:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468481600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532135.880523:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3926
00000100:00100000:1.0:1651532135.880528:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468481792
00010000:00010000:0.0:1651532135.880529:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.880533:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3927
00000100:00100000:1.0:1651532135.880534:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468481664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.880534:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532135.880535:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880537:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.880538:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532135.880539:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410966 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac5c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.880539:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.880543:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.880547:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532135.880548:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410966 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac5c expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.880552:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410966 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac5c expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532135.880555:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:0.0:1651532135.880555:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3928
00000100:00100000:0.0:1651532135.880557:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468481792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.880560:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532135.880561:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468481664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (118us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532135.880562:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41096d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac63 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532135.880563:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3927
00010000:00010000:0.0:1651532135.880570:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41096d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac63 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.880577:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41096d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac63 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.880580:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532135.880602:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468481792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.880605:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3928
00000100:00100000:0.0:1651532135.880639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.880647:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468481856
00000100:00100000:0.0:1651532135.880653:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3929
00000100:00100000:0.0:1651532135.880655:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c75e9d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468481856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.880658:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.880661:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410974 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac6a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.880668:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410974 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac6a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.880672:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410974 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac6a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.880675:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532135.880684:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c75e9d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468481856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.880689:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3929
00000100:00100000:1.0:1651532135.880934:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.880946:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468481984
00000100:00100000:0.0:1651532135.880954:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3930
00000100:00100000:0.0:1651532135.880955:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468481984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.880959:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.880962:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41097b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac71 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.880969:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41097b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac71 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.880973:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41097b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac71 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.880976:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532135.880986:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468481984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.880989:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3930
00000100:00100000:1.0:1651532135.881032:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.881042:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468482176
00000100:00100000:0.0:1651532135.881049:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3931
00000100:00100000:0.0:1651532135.881051:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468482176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.881054:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.881057:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410982 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac78 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.881064:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410982 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac78 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.881068:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410982 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac78 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.881071:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532135.881081:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468482176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.881083:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3931
00000100:00100000:1.0:1651532135.881138:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532135.881147:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468482304
00000100:00100000:0.0:1651532135.881155:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3932
00000100:00100000:0.0:1651532135.881156:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468482304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532135.881159:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532135.881163:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410989 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac7f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532135.881169:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410989 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac7f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.881173:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410989 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac7f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532135.881177:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532135.881186:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468482304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532135.881188:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3932
00000001:00080000:1.0:1651532136.013758:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793850 is committed
00002000:00010000:1.0:1651532136.013773:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532134 -> 1651532135
00002000:00010000:1.0:1651532136.013774:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532134 -> 1651532135
00010000:00010000:1.0:1651532136.013777:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.013781:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.013815:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.013817:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468477056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 624192us (624243us total) trans 158913793850 rc 0/0
00010000:00010000:0.0:1651532136.013820:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532136.013821:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4374
00010000:00010000:0.0:1651532136.013821:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.013825:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.013830:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.013831:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.013832:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.013835:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.013843:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.013846:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f41088d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1511424->7385087] (req 1511424->7385087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.013851:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.013854:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.014228:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.014243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.014258:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.014266:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.014275:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.014284:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468482624
00000100:00100000:1.0:1651532136.014296:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468482560
00000100:00100000:1.0:1651532136.014304:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4383
00000100:00100000:1.0:1651532136.014306:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468482624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532136.014313:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.014317:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532136.014319:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532136.014319:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.014323:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.014348:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468482816
00000100:00100000:0.0:1651532136.014352:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468482880
00000100:00100000:1.0:1651532136.014354:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468482944
00000100:00100000:1.0:1651532136.014357:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3933
00000100:00100000:1.0:1651532136.014359:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468482816:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532136.014361:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3934
00010000:00010000:1.0:1651532136.014362:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532136.014363:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468482944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.014365:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410997 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac86 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.014367:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.014370:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41099e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac94 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.014373:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410997 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac86 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.014378:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410997 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac86 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.014379:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41099e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac94 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.014381:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00010000:00010000:0.0:1651532136.014383:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41099e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac94 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.014386:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532136.014395:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468482816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.014398:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3933
00000100:00100000:1.0:1651532136.014403:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3935
00000100:00100000:0.0:1651532136.014403:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468482944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (128us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.014405:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468482880:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532136.014406:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3934
00010000:00010000:1.0:1651532136.014407:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.014410:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4109a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac8d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.014414:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4384
00010000:00010000:1.0:1651532136.014415:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4109a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac8d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532136.014416:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468482560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532136.014419:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4109a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac8d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.014422:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00010000:00010000:0.0:1651532136.014423:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.014427:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532136.014428:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468482880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (162us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532136.014428:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.014430:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3935
00010000:00010000:0.0:1651532136.014433:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.014436:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532136.014437:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.014441:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.014444:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.014447:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532136.080464:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793851 is committed
00010000:00010000:0.0:1651532136.080497:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.080502:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.080524:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468478528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566265us (566317us total) trans 158913793851 rc 0/0
00010000:00010000:1.0:1651532136.080527:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.080527:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4375
00010000:00010000:1.0:1651532136.080531:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.080533:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.080536:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.080542:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.080542:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.080543:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.080546:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.080556:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.080559:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4108c5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1466368->10170367] (req 1466368->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.080566:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.080573:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.080891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.080903:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.080915:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468483200
00010000:00010000:0.0:1651532136.080922:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.080924:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468483328
00010000:00010000:0.0:1651532136.080926:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.080932:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3936
00000100:00100000:1.0:1651532136.080934:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b5a93ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468483200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.080942:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.080946:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4109b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ac9b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.080949:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468478592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566555us (566732us total) trans 0 rc 40960/40960
00010000:00010000:1.0:1651532136.080952:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532136.080952:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4376
00010000:00010000:1.0:1651532136.080955:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4109b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac9b expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.080959:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4109b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ac9b expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532136.080960:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3937
00010000:00010000:1.0:1651532136.080962:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:0.0:1651532136.080962:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468483328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.080966:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.080969:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4109ba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aca2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.080971:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b5a93ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468483200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.080974:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3936
00010000:00010000:0.0:1651532136.080975:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.080978:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4109ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aca2 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.080981:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.080982:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4109ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aca2 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.080984:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.080985:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.080988:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.080988:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:1.0:1651532136.080992:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.080993:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.080994:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.080995:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468483328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.080997:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3937
00010000:00010000:1.0:1651532136.081000:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.081006:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.081009:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4108da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1105920->10096639] (req 1105920->10096639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.081014:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.081017:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.081496:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.081528:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.081536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.081544:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.081551:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468483520
00000100:00100000:0.0:1651532136.081564:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468483456
00000100:00100000:1.0:1651532136.081575:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4385
00000100:00100000:1.0:1651532136.081577:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e688b703 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468483520:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532136.081577:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4386
00000100:00100000:0.0:1651532136.081579:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ec70ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468483456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532136.081586:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.081587:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.081590:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532136.081592:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.081594:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532136.081595:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.081602:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532136.081603:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.081606:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532136.081607:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.081611:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.081612:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.081615:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.081615:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.081623:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468483584
00000100:00100000:0.0:1651532136.081628:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468483904
00000100:00100000:1.0:1651532136.081630:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3938
00000100:00100000:1.0:1651532136.081631:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468483584:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532136.081636:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3939
00000100:00100000:0.0:1651532136.081638:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468483904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.081639:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.081641:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.081642:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f4109cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aca9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.081644:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44acb0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.081650:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f4109cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aca9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.081651:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acb0 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.081654:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f4109cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aca9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.081656:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acb0 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.081657:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00010000:00010000:0.0:1651532136.081659:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532136.081672:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468483584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (136us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.081675:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3938
00000100:00100000:0.0:1651532136.081678:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468483904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (133us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.081681:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3939
00000001:00080000:1.0:1651532136.180486:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793852 is committed
00010000:00010000:1.0:1651532136.180501:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.180516:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.180537:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468479296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532982us (533027us total) trans 158913793852 rc 0/0
00000100:00100000:1.0:1651532136.180541:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4377
00010000:00010000:0.0:1651532136.180541:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180547:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532136.180548:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180551:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180558:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.180558:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.180559:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180563:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180566:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.180566:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.180567:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180569:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180577:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180580:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f4108e8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9371647] (req 397312->9371647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180586:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180589:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180612:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.180616:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.180867:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.180885:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.180901:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468484288
00010000:00010000:0.0:1651532136.180903:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.180908:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468484352
00010000:00010000:0.0:1651532136.180908:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.180912:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3940
00000100:00100000:1.0:1651532136.180914:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468484288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.180924:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.180928:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f4109dd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44acb7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.180928:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468480384:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424446us (424513us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532136.180932:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4379
00010000:00010000:1.0:1651532136.180933:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.180936:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f4109dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acb7 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.180940:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f4109dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acb7 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.180942:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.180943:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00010000:00010000:0.0:1651532136.180946:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.180951:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468484288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.180970:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3940
00000100:00100000:1.0:1651532136.180976:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3941
00000100:00100000:1.0:1651532136.180977:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468484352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.180980:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532136.180986:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468479360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533425us (533460us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532136.180989:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4378
00010000:00010000:1.0:1651532136.180996:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4109e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44acbe expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.181002:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.181004:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4109e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acbe expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532136.181007:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532136.181008:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f4109e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acbe expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.181011:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532136.181018:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468484352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.181021:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3941
00000100:00100000:1.0:1651532136.181025:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468484480
00000100:00100000:1.0:1651532136.181029:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3942
00000100:00100000:1.0:1651532136.181030:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468484480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.181033:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.181044:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181048:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532136.181049:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181053:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.181056:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4109eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44acc5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181058:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181061:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410920 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4292608->8687615] (req 4292608->8687615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181065:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.181067:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.181068:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532136.181069:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.181070:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4109eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acc5 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.181072:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.181074:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f4109eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acc5 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.181075:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.181076:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.181077:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532136.181077:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181080:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.181089:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468484480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.181092:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3942
00010000:00010000:0.0:1651532136.181108:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181112:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4108ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5320704->10354687] (req 5320704->10354687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181123:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181126:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.181439:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.181451:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.181460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.181542:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468484672
00000100:00100000:0.0:1651532136.181559:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468484544
00000100:00100000:0.0:1651532136.181568:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4387
00000100:00100000:0.0:1651532136.181570:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468484672:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532136.181573:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4388
00000100:00100000:1.0:1651532136.181576:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468484544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532136.181578:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181582:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532136.181583:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.181584:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181586:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532136.181587:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.181602:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532136.181603:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.181606:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532136.181607:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181611:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.181612:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181615:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.181624:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468484864
00010000:00010000:1.0:1651532136.181626:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.181630:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3943
00000100:00100000:0.0:1651532136.181632:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468484864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.181635:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.181647:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410a00 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44accc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181655:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410a00 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44accc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.181659:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410a00 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44accc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.181663:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532136.181679:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468484864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (218us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.181682:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3943
00000100:00100000:1.0:1651532136.181725:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.181737:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468485056
00000100:00100000:0.0:1651532136.181744:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3944
00000100:00100000:0.0:1651532136.181746:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468485056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.181749:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.181752:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410a07 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44acd3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.181760:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410a07 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acd3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.181764:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410a07 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acd3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.181767:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532136.181776:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468485056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.181779:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3944
00000100:00100000:1.0:1651532136.181975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.181985:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468485184
00000100:00100000:0.0:1651532136.181993:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3945
00000100:00100000:0.0:1651532136.181994:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468485184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.181998:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.182001:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a0e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44acda expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.182008:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a0e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acda expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.182012:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a0e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acda expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.182015:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532136.182025:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468485184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.182027:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3945
00000100:00100000:1.0:1651532136.182133:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.182146:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468485376
00000100:00100000:0.0:1651532136.182153:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3946
00000100:00100000:0.0:1651532136.182155:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468485376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.182158:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.182161:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a15 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ace1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.182167:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a15 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ace1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.182171:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a15 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ace1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.182175:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532136.182184:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468485376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.182186:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3946
00000001:00080000:1.0:1651532136.238884:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793853 is committed
00010000:00010000:0.0:1651532136.238914:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.238919:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.238940:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468480320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482382us (482516us total) trans 158913793853 rc 0/0
00000100:00100000:0.0:1651532136.238944:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4380
00010000:00010000:0.0:1651532136.238951:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.238954:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532136.238955:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.238958:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.238963:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.238964:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.238965:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.238968:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.238977:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.238980:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f41093c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10035199] (req 835584->10035199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.238991:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.238996:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.239296:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.239313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.239324:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.239342:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468485696
00000100:00100000:0.0:1651532136.239352:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468485632
00000100:00100000:0.0:1651532136.239360:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4389
00000100:00100000:0.0:1651532136.239362:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468485696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532136.239369:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.239373:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532136.239374:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.239377:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532136.239378:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.239382:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.239386:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.239393:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4390
00000100:00100000:0.0:1651532136.239395:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468485632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532136.239399:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.239402:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532136.239403:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.239407:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468485888
00010000:00010000:0.0:1651532136.239409:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532136.239410:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.239413:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.239416:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.239421:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3947
00000100:00100000:1.0:1651532136.239423:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468485888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.239426:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.239430:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410a2a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ace8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.239438:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410a2a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ace8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.239443:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410a2a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ace8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.239457:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:1.0:1651532136.239469:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468485888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (145us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.239471:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3947
00000100:00100000:0.0:1651532136.239721:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.239741:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468486016
00000100:00100000:1.0:1651532136.239755:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3948
00000100:00100000:1.0:1651532136.239757:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468486016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.239760:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.239764:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a31 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44acef expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.239771:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a31 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acef expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.239775:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a31 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acef expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.239778:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00000100:00100000:1.0:1651532136.239789:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468486016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.239792:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3948
00000100:00100000:0.0:1651532136.240042:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.240061:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468486144
00000100:00100000:1.0:1651532136.240072:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3949
00000100:00100000:1.0:1651532136.240074:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468486144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.240085:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.240088:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410a38 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44acf6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.240095:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410a38 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acf6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.240099:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410a38 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acf6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.240103:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532136.240113:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468486144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.240116:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3949
00000001:00080000:1.0:1651532136.372215:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793854 is committed
00010000:00010000:1.0:1651532136.372230:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372234:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.372255:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468481472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491854us (491893us total) trans 158913793854 rc 0/0
00010000:00010000:0.0:1651532136.372258:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.372259:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4381
00010000:00010000:0.0:1651532136.372263:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ab9ffa21 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532136.372264:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372268:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372274:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.372275:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.372275:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372279:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372282:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.372283:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.372283:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372286:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372294:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372297:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410951 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1298432->8609791] (req 1298432->8609791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372302:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372304:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372305:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372319:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.372701:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.372709:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.372724:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.372728:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468486272
00000100:00100000:1.0:1651532136.372736:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468486400
00000100:00100000:0.0:1651532136.372737:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468486528
00000100:00100000:0.0:1651532136.372741:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3950
00000100:00100000:0.0:1651532136.372743:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468486272:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532136.372747:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3951
00010000:00010000:0.0:1651532136.372747:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532136.372749:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468486528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.372751:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410a3f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44acfd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372753:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.372757:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410a46 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad0b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372759:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.372762:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.372762:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410a3f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acfd expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.372765:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410a46 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad0b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.372767:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410a3f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44acfd expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.372770:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410a46 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad0b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.372770:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:1.0:1651532136.372773:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:1.0:1651532136.372781:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468486528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.372781:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468486272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.372784:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3950
00000100:00100000:1.0:1651532136.372786:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3951
00000100:00100000:0.0:1651532136.372789:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3952
00000100:00100000:0.0:1651532136.372791:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468486400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.372793:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.372796:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410a4d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad04 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372798:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372828:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372831:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.372839:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410a4d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad04 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532136.372844:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468482624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358538us (358627us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532136.372844:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410a4d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad04 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532136.372847:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4383
00010000:00010000:0.0:1651532136.372847:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532136.372855:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468486400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (146us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.372858:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3952
00010000:00010000:1.0:1651532136.372861:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372865:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.372866:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372869:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372871:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372874:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372880:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372890:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410990 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->10039295] (req 311296->10039295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.372891:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468481536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 492374us (492481us total) trans 0 rc 28672/28672
00010000:00010000:1.0:1651532136.372894:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.372894:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4382
00010000:00010000:1.0:1651532136.372896:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.372897:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372907:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372911:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.372912:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.372913:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372916:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372944:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372949:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.372953:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.372960:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41095f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [585728->10108927] (req 585728->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.373305:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.373337:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468486656
00000100:00100000:1.0:1651532136.373341:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.373351:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468486592
00000100:00100000:1.0:1651532136.373355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.373359:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4391
00000100:00100000:0.0:1651532136.373361:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468486656:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532136.373367:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532136.373368:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.373377:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4392
00010000:00010000:0.0:1651532136.373379:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532136.373380:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468486592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532136.373380:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.373386:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532136.373387:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.373388:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.373391:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.373392:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532136.373394:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.373397:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532136.373398:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.373401:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.373402:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.373406:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.373414:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468486784
00000100:00100000:1.0:1651532136.373421:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468486912
00000100:00100000:0.0:1651532136.373423:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3953
00000100:00100000:0.0:1651532136.373425:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468486784:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532136.373426:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3954
00000100:00100000:1.0:1651532136.373428:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468486912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.373428:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.373431:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.373431:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410a62 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad12 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.373433:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410a69 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad19 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.373438:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410a62 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad12 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.373441:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410a69 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad19 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.373442:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410a62 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad12 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.373445:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410a69 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad19 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.373446:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:1.0:1651532136.373448:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:0.0:1651532136.373461:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468486784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.373464:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3953
00000100:00100000:1.0:1651532136.373466:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468486912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.373469:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3954
00000100:00100000:0.0:1651532136.373484:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.373509:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468487040
00000100:00100000:0.0:1651532136.373512:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.373520:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468487104
00000100:00100000:1.0:1651532136.373528:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3955
00000100:00100000:1.0:1651532136.373530:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468487040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532136.373531:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3956
00010000:00010000:1.0:1651532136.373533:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532136.373533:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468487104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.373536:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410a70 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad20 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.373537:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.373540:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410a77 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad27 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.373543:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410a70 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad20 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.373547:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410a70 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad20 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.373547:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410a77 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad27 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.373550:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00010000:00010000:0.0:1651532136.373551:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410a77 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad27 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.373554:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532136.373557:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468487040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.373560:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3955
00000100:00100000:0.0:1651532136.373562:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468487104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.373564:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3956
00000100:00100000:0.0:1651532136.373978:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.373986:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.373999:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468487296
00000100:00100000:1.0:1651532136.374003:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468487488
00000100:00100000:0.0:1651532136.374009:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3957
00000100:00100000:0.0:1651532136.374011:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b94b4005 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468487296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.374014:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532136.374016:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3958
00010000:00010000:0.0:1651532136.374017:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a7e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad2e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.374018:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000005eb034c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468487488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.374021:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.374025:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410a85 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad35 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.374027:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a7e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad2e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.374032:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a7e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad2e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.374033:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410a85 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad35 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.374035:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:1.0:1651532136.374037:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410a85 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad35 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.374040:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:0.0:1651532136.374047:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b94b4005 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468487296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.374050:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3957
00000100:00100000:1.0:1651532136.374055:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000005eb034c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468487488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.374057:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3958
00000100:00100000:0.0:1651532136.374284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.374302:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468487616
00000100:00100000:1.0:1651532136.374310:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3959
00000100:00100000:1.0:1651532136.374312:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005259aa0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468487616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.374315:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.374318:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410a8c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad3c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.374325:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410a8c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad3c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.374338:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410a8c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad3c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.374342:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:1.0:1651532136.374352:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005259aa0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468487616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.374355:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3959
00000100:00100000:0.0:1651532136.374556:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.374566:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468487808
00000100:00100000:1.0:1651532136.374573:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3960
00000100:00100000:1.0:1651532136.374575:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f32eacfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468487808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.374578:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.374580:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410a93 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad43 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.374587:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410a93 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad43 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.374591:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410a93 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad43 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.374594:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532136.374603:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f32eacfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468487808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.374606:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3960
00000001:00080000:1.0:1651532136.438951:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793855 is committed
00010000:00010000:0.0:1651532136.438986:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.438991:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.439008:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468482560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 424591us (424765us total) trans 158913793855 rc 0/0
00000100:00100000:0.0:1651532136.439011:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4384
00010000:00010000:0.0:1651532136.439018:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439022:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532136.439023:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439026:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439031:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.439032:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.439033:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439036:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439049:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439052:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4109ac lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4751360->10022911] (req 4751360->10022911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.439060:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.439064:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.439391:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.439399:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.439411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.439426:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468487936
00000100:00100000:0.0:1651532136.439426:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468488000
00000100:00100000:0.0:1651532136.439439:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4393
00000100:00100000:0.0:1651532136.439441:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7ce9547 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468488000:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532136.439445:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4394
00000100:00100000:1.0:1651532136.439447:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007f4a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468487936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532136.439448:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439452:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.439454:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439454:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439457:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532136.439457:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.439463:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532136.439464:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.439467:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532136.439468:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.439473:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439473:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.439476:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439476:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.439488:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468488064
00010000:00010000:1.0:1651532136.439491:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.439496:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3961
00000100:00100000:0.0:1651532136.439498:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000711d02d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468488064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.439500:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439501:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.439504:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410aa8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad4a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439509:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.439512:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410aa8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad4a expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532136.439515:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e688b703 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468483520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 357938us (358020us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532136.439516:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410aa8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad4a expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532136.439518:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4385
00010000:00010000:0.0:1651532136.439519:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532136.439525:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.439527:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000711d02d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468488064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (116us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532136.439529:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.439530:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.439530:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3961
00010000:00010000:1.0:1651532136.439533:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.439537:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.439538:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.439539:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.439542:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.439552:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.439555:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f4109c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5750784->7757823] (req 5750784->7757823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439556:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439560:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.439882:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.439893:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468488256
00000100:00100000:0.0:1651532136.439902:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3962
00000100:00100000:0.0:1651532136.439904:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468488256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.439907:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.439911:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410aaf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad51 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.439918:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410aaf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad51 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.439922:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410aaf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad51 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.439926:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532136.439936:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468488256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.439939:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3962
00000001:00080000:1.0:1651532136.522314:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793856 is committed
00010000:00010000:0.0:1651532136.522359:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.522366:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.522387:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ec70ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468483456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 440807us (440859us total) trans 158913793856 rc 0/0
00010000:00010000:1.0:1651532136.522389:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.522391:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4386
00010000:00010000:1.0:1651532136.522394:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.522395:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522398:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522404:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.522404:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.522405:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522408:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522417:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522420:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4109c8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->9596927] (req 475136->9596927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.522428:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.522432:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.522638:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.522671:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.522685:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468488512
00000100:00100000:0.0:1651532136.522687:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.522696:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468488576
00010000:00010000:0.0:1651532136.522697:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.522701:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4395
00010000:00010000:0.0:1651532136.522701:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.522703:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468488512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532136.522710:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522714:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532136.522715:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.522715:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468484672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341144us (341276us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532136.522718:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4387
00010000:00010000:1.0:1651532136.522721:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532136.522722:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.522723:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4396
00000100:00100000:0.0:1651532136.522725:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468488576:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532136.522726:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522729:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.522732:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.522736:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.522737:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.522740:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532136.522741:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.522741:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522744:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.522745:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.522746:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522748:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.522749:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522753:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.522753:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.522754:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522757:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522765:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522768:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4109f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [815104->8699903] (req 815104->8699903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522773:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.522776:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.522793:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468488640
00000100:00100000:0.0:1651532136.522800:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3963
00000100:00100000:0.0:1651532136.522815:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468488640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.522818:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.522822:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410ac4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad58 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.522835:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410ac4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad58 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.522839:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410ac4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad58 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.522843:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532136.522851:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468488640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (164us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.522854:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3963
00000100:00100000:0.0:1651532136.523084:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.523093:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.523103:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468488832
00000100:00100000:0.0:1651532136.523111:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468488768
00000100:00100000:0.0:1651532136.523116:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3964
00000100:00100000:0.0:1651532136.523118:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468488832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.523121:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.523125:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410acb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad66 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.523132:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410acb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad66 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.523136:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410acb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad66 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.523139:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532136.523148:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468488832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.523151:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3964
00000100:00100000:0.0:1651532136.523155:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3965
00000100:00100000:0.0:1651532136.523157:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468488768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.523161:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.523163:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410ad2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad5f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.523168:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410ad2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad5f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.523172:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410ad2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad5f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.523175:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532136.523180:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468488768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.523182:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3965
00000100:00100000:0.0:1651532136.523225:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.523233:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468488960
00000100:00100000:0.0:1651532136.523244:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3966
00000100:00100000:0.0:1651532136.523246:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089cddc36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468488960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.523249:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.523252:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ad9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad6d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.523259:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ad9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad6d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.523266:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ad9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad6d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.523269:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532136.523279:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089cddc36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468488960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.523281:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3966
00000001:00080000:1.0:1651532136.630699:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793857 is committed
00010000:00010000:1.0:1651532136.630716:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.630720:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.630743:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468484544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449167us (449292us total) trans 158913793857 rc 0/0
00000100:00100000:1.0:1651532136.630747:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4388
00010000:00010000:1.0:1651532136.630755:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.630758:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.630759:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.630762:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.630768:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.630768:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.630769:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.630772:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.630789:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.630790:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.630792:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f4109f9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3440640->10469375] (req 3440640->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.630795:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.631198:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.631210:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.631218:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468489408
00000100:00100000:0.0:1651532136.631226:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.631228:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468489280
00000100:00100000:0.0:1651532136.631233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.631234:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4397
00000100:00100000:0.0:1651532136.631241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.631243:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468489408:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532136.631254:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.631256:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4398
00010000:00010000:1.0:1651532136.631258:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532136.631258:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468489280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532136.631259:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532136.631259:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631265:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.631267:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.631271:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532136.631272:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.631274:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468489344
00010000:00010000:0.0:1651532136.631276:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.631278:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00000100:00100000:1.0:1651532136.631279:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468489472
00010000:00010000:0.0:1651532136.631279:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.631281:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468489600
00010000:00010000:0.0:1651532136.631283:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.631284:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3967
00000100:00100000:1.0:1651532136.631286:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468489344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.631286:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631288:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.631289:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631291:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410aee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad74 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631296:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.631299:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410aee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad74 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.631300:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.631303:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631309:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410aee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad74 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.631318:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:0.0:1651532136.631322:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468485696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391959us (392026us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532136.631325:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4389
00000100:00100000:1.0:1651532136.631327:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468489344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.631341:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3967
00000100:00100000:0.0:1651532136.631344:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3968
00000100:00100000:0.0:1651532136.631346:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468489472:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532136.631347:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3969
00000100:00100000:1.0:1651532136.631349:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468489600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.631349:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.631352:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410af5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad7b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631353:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.631356:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410afc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad82 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.631358:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.631361:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.631361:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410af5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad7b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.631363:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410afc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad82 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.631365:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410af5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad7b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.631367:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410afc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad82 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.631368:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:1.0:1651532136.631370:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:0.0:1651532136.631375:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468489472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (143us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.631377:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468489600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.631378:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3968
00000100:00100000:1.0:1651532136.631380:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3969
00010000:00010000:1.0:1651532136.631387:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631391:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.631392:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631395:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631399:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.631400:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.631400:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631404:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.631422:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.631427:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631434:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631443:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410a1c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1654784->6033407] (req 1654784->6033407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.631847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.631859:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468489920
00000100:00100000:0.0:1651532136.631859:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.631869:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.631872:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468490112
00000100:00100000:1.0:1651532136.631875:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468490176
00000100:00100000:0.0:1651532136.631877:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3970
00000100:00100000:0.0:1651532136.631879:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468489920:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532136.631883:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3971
00010000:00010000:0.0:1651532136.631883:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532136.631884:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468490112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.631888:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.631896:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b03 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad89 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631897:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b0a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad90 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.631905:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b03 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad89 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.631906:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b0a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad90 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.631910:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b0a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad90 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.631910:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b03 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad89 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.631913:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00010000:00010000:0.0:1651532136.631913:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532136.631927:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468490112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.631930:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3971
00000100:00100000:0.0:1651532136.631933:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468489920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.631935:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3972
00000100:00100000:1.0:1651532136.631937:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468490176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532136.631937:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3970
00010000:00010000:1.0:1651532136.631939:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.631942:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410b11 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad97 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.631947:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410b11 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad97 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.631951:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410b11 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad97 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.631954:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532136.631960:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468490176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.631962:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3972
00000001:00080000:1.0:1651532136.730724:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793858 is committed
00010000:00010000:0.0:1651532136.730758:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.730763:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.730783:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.730787:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532136.730787:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468485632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491391us (491474us total) trans 158913793858 rc 0/0
00010000:00010000:1.0:1651532136.730788:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.730790:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4390
00010000:00010000:1.0:1651532136.730792:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.730798:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.730798:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.730799:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.730814:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.730824:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.730827:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410a23 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4231168->7901183] (req 4231168->7901183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.730836:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.730840:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.731184:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.731196:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.731202:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.731214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.731219:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468490752
00000100:00100000:0.0:1651532136.731225:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468490624
00000100:00100000:1.0:1651532136.731227:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468490944
00000100:00100000:1.0:1651532136.731236:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3973
00000100:00100000:1.0:1651532136.731237:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468490752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.731245:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532136.731245:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468490688
00010000:00010000:1.0:1651532136.731249:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410b18 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ad9e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.731253:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4399
00000100:00100000:0.0:1651532136.731255:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468490624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532136.731260:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.731263:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410b18 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad9e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.731263:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731267:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410b18 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ad9e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.731267:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532136.731268:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731271:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00010000:00010000:0.0:1651532136.731271:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532136.731272:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.731277:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.731280:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.731285:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468490752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.731288:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3973
00000100:00100000:1.0:1651532136.731293:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3974
00000100:00100000:1.0:1651532136.731294:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468490944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.731296:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731297:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.731299:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b26 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ada5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.731302:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731306:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.731307:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b26 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ada5 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.731318:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b26 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ada5 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532136.731320:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468486656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 357958us (358015us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532136.731322:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088dee364, rc 0)
00000100:00100000:0.0:1651532136.731323:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4391
00000100:00100000:1.0:1651532136.731328:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468490944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (114us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.731339:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4400
00000100:00100000:0.0:1651532136.731341:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468490688:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532136.731343:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3974
00010000:00010000:0.0:1651532136.731347:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.731351:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.731352:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.731352:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.731355:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532136.731355:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731359:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532136.731359:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731360:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731363:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.731363:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731368:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.731369:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.731369:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731372:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731379:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731382:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410a54 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->10248191] (req 45056->10248191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731387:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.731390:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.731723:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.731731:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468491136
00000100:00100000:0.0:1651532136.731739:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3975
00000100:00100000:0.0:1651532136.731740:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468491136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.731744:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.731748:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b34 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44adac expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.731756:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b34 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adac expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.731760:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b34 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adac expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.731764:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532136.731773:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468491136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.731776:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3975
00000001:00080000:1.0:1651532136.797394:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793859 is committed
00010000:00010000:1.0:1651532136.797409:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797416:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.797439:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468486592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 424059us (424110us total) trans 158913793859 rc 0/0
00000100:00100000:1.0:1651532136.797443:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4392
00010000:00010000:1.0:1651532136.797450:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797454:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fdc7f73d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.797455:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797458:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797463:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.797463:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.797464:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797467:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797484:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797485:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797487:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410a5b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4755456->9072639] (req 4755456->9072639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797490:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.797772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.797785:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.797793:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468491392
00000100:00100000:0.0:1651532136.797793:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.797799:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.797816:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468491328
00000100:00100000:1.0:1651532136.797823:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4401
00000100:00100000:1.0:1651532136.797825:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468491392:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532136.797826:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4402
00000100:00100000:0.0:1651532136.797829:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468491328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532136.797832:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797836:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.797837:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797837:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797840:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797842:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532136.797843:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797846:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797849:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532136.797849:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797854:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797856:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797860:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.797864:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468491520
00000100:00100000:1.0:1651532136.797873:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468491584
00000100:00100000:1.0:1651532136.797877:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3976
00010000:00010000:0.0:1651532136.797877:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.797879:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468491520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.797880:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797882:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.797884:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410b49 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44adb3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797889:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.797898:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410b49 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adb3 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532136.797902:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7ce9547 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468488000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358460us (358512us total) trans 0 rc 45056/45056
00010000:00010000:1.0:1651532136.797903:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410b49 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adb3 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532136.797906:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4393
00010000:00010000:1.0:1651532136.797907:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:0.0:1651532136.797914:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3977
00000100:00100000:1.0:1651532136.797916:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468491520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.797916:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468491584:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532136.797919:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3976
00010000:00010000:0.0:1651532136.797919:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532136.797922:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b50 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44adba expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797926:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797927:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.797930:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.797931:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797931:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b50 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adba expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.797934:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.797935:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b50 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adba expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.797938:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532136.797938:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:1.0:1651532136.797939:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.797940:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797942:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.797944:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468491584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.797947:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3977
00010000:00010000:1.0:1651532136.797949:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797952:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410a9a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [126976->9850879] (req 126976->9850879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797960:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.797963:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.798348:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.798366:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532136.798373:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468491776
00000100:00100000:0.0:1651532136.798380:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468491904
00000100:00100000:0.0:1651532136.798388:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3978
00000100:00100000:0.0:1651532136.798390:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468491776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.798393:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532136.798394:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3979
00000100:00100000:1.0:1651532136.798396:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468491904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532136.798397:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b57 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44adc1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.798400:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.798404:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410b5e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44adc8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.798405:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b57 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adc1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.798409:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b57 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adc1 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.798412:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410b5e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adc8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532136.798412:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:1.0:1651532136.798416:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410b5e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adc8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.798420:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:0.0:1651532136.798422:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468491776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532136.798425:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3978
00000100:00100000:1.0:1651532136.798429:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468491904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.798431:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3979
00000100:00100000:0.0:1651532136.798725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.798743:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468492288
00000100:00100000:1.0:1651532136.798756:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3980
00000100:00100000:1.0:1651532136.798758:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468492288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.798762:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.798765:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b65 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44adcf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.798772:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b65 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adcf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.798776:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b65 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adcf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.798779:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532136.798793:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468492288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.798796:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3980
00000100:00100000:0.0:1651532136.798996:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.799013:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468492416
00000100:00100000:1.0:1651532136.799023:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3981
00000100:00100000:1.0:1651532136.799025:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468492416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.799028:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.799031:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b6c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44add6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.799038:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b6c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44add6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.799042:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b6c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44add6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.799048:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067fbb32a, rc 0)
00000100:00100000:1.0:1651532136.799059:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468492416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.799062:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3981
00000001:00080000:1.0:1651532136.947411:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793860 is committed
00010000:00010000:1.0:1651532136.947427:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.947431:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.947455:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007f4a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468487936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 508007us (508055us total) trans 158913793860 rc 0/0
00000100:00100000:1.0:1651532136.947458:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4394
00010000:00010000:1.0:1651532136.947465:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.947469:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532136.947470:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.947473:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.947478:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.947478:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532136.947480:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.947483:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.947489:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.947497:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.947501:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410aa1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [417792->6488063] (req 417792->6488063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.947502:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.947930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.947941:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468492608
00000100:00100000:0.0:1651532136.947949:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.947962:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468492672
00000100:00100000:1.0:1651532136.947969:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4403
00000100:00100000:0.0:1651532136.947969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532136.947971:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468492608:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532136.947979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532136.947982:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.947987:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532136.947988:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532136.947988:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4404
00010000:00010000:1.0:1651532136.947990:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:0.0:1651532136.947990:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468492672:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532136.947991:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.947995:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.947999:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.948001:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.948004:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532136.948005:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.948008:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532136.948009:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.948013:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532136.948016:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532136.948018:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468492736
00000100:00100000:1.0:1651532136.948026:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468492864
00000100:00100000:1.0:1651532136.948033:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3982
00000100:00100000:1.0:1651532136.948034:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468492736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.948037:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.948039:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b81 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44addd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.948046:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b81 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44addd expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.948050:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b81 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44addd expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.948054:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc2c662, rc 0)
00000100:00100000:1.0:1651532136.948066:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468492736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.948069:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3982
00000100:00100000:1.0:1651532136.948073:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3983
00000100:00100000:1.0:1651532136.948075:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468492864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532136.948077:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532136.948079:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410b88 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ade4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532136.948085:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410b88 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ade4 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.948089:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410b88 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ade4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532136.948092:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532136.948097:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468492864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532136.948099:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3983
00000001:00080000:1.0:1651532137.014111:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793861 is committed
00010000:00010000:0.0:1651532137.014142:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.014147:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.014169:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468488512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491465us (491531us total) trans 158913793861 rc 0/0
00010000:00010000:1.0:1651532137.014171:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.014172:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4395
00010000:00010000:1.0:1651532137.014175:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df101e26 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.014176:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014180:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014185:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.014185:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.014186:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014192:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014195:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.014196:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.014196:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014199:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.014214:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014215:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014218:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410ab6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2146304->7417855] (req 2146304->7417855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.014218:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014224:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014227:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.014496:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.014515:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468493248
00000100:00100000:1.0:1651532137.014532:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3984
00010000:00010000:0.0:1651532137.014533:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.014534:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468493248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.014537:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.014537:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014541:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410b8f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44adeb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014552:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.014554:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410b8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adeb expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.014554:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468488576:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491828us (491884us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532137.014558:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410b8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adeb expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.014558:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4396
00010000:00010000:1.0:1651532137.014562:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:1.0:1651532137.014570:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468493248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.014573:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3984
00010000:00010000:1.0:1651532137.014579:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014583:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.014584:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014587:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014600:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014603:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410abd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4784128->7139327] (req 4784128->7139327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014615:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014619:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.014639:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468489408:12345-10.240.43.64@tcp:3:fio.0 Request processed in 383402us (383442us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532137.014642:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4397
00010000:00010000:1.0:1651532137.014648:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014652:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000966989a4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.014653:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014656:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014660:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.014660:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.014661:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014664:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014681:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014684:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410ae0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3932160->10080255] (req 3932160->10080255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.014686:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.014690:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.014899:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.014942:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.014943:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468493440
00000100:00100000:0.0:1651532137.014950:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468493504
00000100:00100000:1.0:1651532137.014957:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4405
00000100:00100000:1.0:1651532137.014958:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468493440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532137.014965:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.014970:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4406
00000100:00100000:0.0:1651532137.014972:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468493504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532137.014975:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532137.014976:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014978:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532137.014979:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.014979:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.014985:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532137.014986:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.014989:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532137.014990:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014993:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.014994:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.014997:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.014998:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.015092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.015103:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468493952
00000100:00100000:1.0:1651532137.015113:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3985
00000100:00100000:1.0:1651532137.015115:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468493952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.015118:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.015121:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410ba4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44adf2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.015138:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410ba4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adf2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.015143:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410ba4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adf2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.015146:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000da6660c4, rc 0)
00000100:00100000:1.0:1651532137.015158:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468493952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.015161:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3985
00000100:00100000:0.0:1651532137.015399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.015417:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468494080
00000100:00100000:1.0:1651532137.015427:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3986
00000100:00100000:1.0:1651532137.015428:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468494080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.015431:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.015434:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44adf9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.015441:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adf9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.015445:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44adf9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.015448:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000641bcd9e, rc 0)
00000100:00100000:1.0:1651532137.015460:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468494080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.015462:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3986
00000001:00080000:1.0:1651532137.114206:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793862 is committed
00010000:00010000:0.0:1651532137.114241:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.114246:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.114270:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.114270:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468489280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 483011us (483060us total) trans 158913793862 rc 0/0
00000100:00100000:0.0:1651532137.114274:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4398
00010000:00010000:1.0:1651532137.114275:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.114276:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.114279:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.114284:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.114285:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.114286:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.114289:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.114298:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.114302:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410ae7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->8347647] (req 4788224->8347647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.114308:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.114315:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.114666:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.114674:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.114686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.114695:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.114697:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468494208
00000100:00100000:0.0:1651532137.114702:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468494336
00000100:00100000:1.0:1651532137.114709:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468494272
00000100:00100000:0.0:1651532137.114710:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468494400
00000100:00100000:1.0:1651532137.114715:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4407
00000100:00100000:0.0:1651532137.114715:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3987
00000100:00100000:1.0:1651532137.114717:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468494208:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532137.114717:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468494336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.114721:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.114724:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.114725:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410bb9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae00 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.114728:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532137.114729:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.114732:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532137.114732:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.114739:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.114740:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410bb9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae00 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.114742:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.114744:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410bb9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae00 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.114748:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532137.114749:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4408
00000100:00100000:1.0:1651532137.114751:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468494272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532137.114756:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.114758:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468494336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (72us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532137.114759:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532137.114760:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.114761:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3987
00010000:00010000:1.0:1651532137.114765:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532137.114766:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.114766:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3988
00000100:00100000:0.0:1651532137.114768:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468494400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.114769:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.114771:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.114772:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.114773:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410bc7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae07 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.114779:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410bc7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae07 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.114783:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410bc7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae07 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.114786:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532137.114791:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468494400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.114794:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3988
00000100:00100000:0.0:1651532137.115158:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.115166:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468494528
00000100:00100000:0.0:1651532137.115181:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3989
00000100:00100000:0.0:1651532137.115182:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468494528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.115186:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.115190:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410bce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae0e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.115197:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410bce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae0e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.115204:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410bce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae0e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.115208:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532137.115218:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468494528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.115220:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3989
00000001:00080000:1.0:1651532137.239192:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793863 is committed
00002000:00010000:0.0:1651532137.239224:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532135 -> 1651532136
00010000:00010000:0.0:1651532137.239228:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239232:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239255:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.239255:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468490624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507999us (508090us total) trans 158913793863 rc 0/0
00000100:00100000:0.0:1651532137.239258:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4399
00010000:00010000:1.0:1651532137.239259:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.239260:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239263:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239268:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.239269:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.239270:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239273:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239279:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.239279:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.239280:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239283:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239304:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239307:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410b1f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->9805823] (req 172032->9805823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239313:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239314:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239316:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239318:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.239630:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.239647:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.239660:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468494720
00000100:00100000:0.0:1651532137.239665:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.239675:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468494784
00000100:00100000:1.0:1651532137.239679:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468494848
00000100:00100000:1.0:1651532137.239687:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3990
00000100:00100000:1.0:1651532137.239689:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468494720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.239693:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.239697:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410bd5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae15 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239700:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239705:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239711:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.239718:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410bd5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae15 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.239725:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468490688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508383us (508529us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532137.239728:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000966989a4/0xa29a79078f410bd5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae15 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.239728:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4400
00010000:00010000:1.0:1651532137.239732:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000966989a4, rc 0)
00000100:00100000:0.0:1651532137.239737:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3991
00000100:00100000:0.0:1651532137.239739:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468494784:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532137.239741:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468494720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (111us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532137.239743:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532137.239744:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3990
00010000:00010000:0.0:1651532137.239746:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410bdc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae1c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.239749:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3992
00000100:00100000:1.0:1651532137.239751:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468494848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.239752:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.239753:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.239755:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410bdc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae1c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.239756:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410be3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae23 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239759:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410bdc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae1c expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.239760:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.239762:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410be3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae23 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.239763:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:1.0:1651532137.239766:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467b1d5c/0xa29a79078f410be3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae23 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.239769:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000467b1d5c, rc 0)
00000100:00100000:0.0:1651532137.239769:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468494784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.239772:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3991
00000100:00100000:1.0:1651532137.239775:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468494848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.239777:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3992
00010000:00010000:0.0:1651532137.239785:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239789:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.239790:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239790:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.239793:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239798:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239816:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239819:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410b2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [274432->8986623] (req 274432->8986623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.239821:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468491392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441995us (442049us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532137.239823:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.239824:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4401
00010000:00010000:0.0:1651532137.239826:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088dee364 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532137.239826:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239829:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239833:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.239833:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.239834:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239840:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239847:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239849:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088dee364/0xa29a79078f410b3b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1056768->5652479] (req 1056768->5652479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239855:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.239858:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.240253:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.240279:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468495104
00000100:00100000:0.0:1651532137.240286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.240296:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.240301:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3993
00000100:00100000:1.0:1651532137.240303:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468495104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.240307:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.240310:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410bea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae2a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.240311:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.240320:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532137.240323:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410bea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae2a expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.240328:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df101e26/0xa29a79078f410bea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae2a expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.240328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532137.240341:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df101e26, rc 0)
00000100:00100000:0.0:1651532137.240344:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468495232
00000100:00100000:0.0:1651532137.240350:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468495360
00000100:00100000:1.0:1651532137.240352:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468495104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.240353:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468495424
00000100:00100000:1.0:1651532137.240355:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3993
00000100:00100000:0.0:1651532137.240357:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3994
00000100:00100000:0.0:1651532137.240359:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468495232:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532137.240361:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3995
00000100:00100000:1.0:1651532137.240363:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468495360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.240363:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.240365:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.240367:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410bf1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae31 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.240368:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410bf8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae38 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.240376:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410bf8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae38 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.240376:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410bf1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae31 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.240380:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc7f73d/0xa29a79078f410bf8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae38 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.240381:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410bf1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae31 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.240383:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fdc7f73d, rc 0)
00010000:00010000:0.0:1651532137.240384:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532137.240388:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468495360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.240391:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3995
00000100:00100000:0.0:1651532137.240393:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468495232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.240395:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3996
00000100:00100000:1.0:1651532137.240396:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468495424:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532137.240396:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3994
00010000:00010000:1.0:1651532137.240398:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.240400:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410bff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae3f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.240404:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468494976
00010000:00010000:1.0:1651532137.240406:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410bff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae3f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.240412:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aed440/0xa29a79078f410bff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae3f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.240412:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468495040
00010000:00010000:1.0:1651532137.240415:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065aed440, rc 0)
00000100:00100000:0.0:1651532137.240417:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4409
00000100:00100000:0.0:1651532137.240419:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468494976:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532137.240421:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468495424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.240423:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3996
00000100:00100000:1.0:1651532137.240431:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4410
00000100:00100000:1.0:1651532137.240432:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468495040:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532137.240433:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.240437:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532137.240438:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532137.240439:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.240439:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.240442:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.240443:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532137.240444:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.240449:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.240732:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.240740:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.240754:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468495552
00000100:00100000:1.0:1651532137.240759:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468495616
00000100:00100000:0.0:1651532137.240764:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3997
00000100:00100000:0.0:1651532137.240766:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468495552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.240770:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532137.240776:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3998
00000100:00100000:1.0:1651532137.240777:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468495616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.240779:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c14 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae46 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.240781:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.240784:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410c1b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae4d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.240787:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c14 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae46 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.240791:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c14 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae46 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.240794:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410c1b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae4d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.240795:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:1.0:1651532137.240798:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133ac5f6/0xa29a79078f410c1b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae4d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.240801:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000133ac5f6, rc 0)
00000100:00100000:1.0:1651532137.240828:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468495616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.240830:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3998
00000100:00100000:0.0:1651532137.240835:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468495552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 67us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.240838:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3997
00000100:00100000:1.0:1651532137.240870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.240889:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468495808
00000100:00100000:0.0:1651532137.240896:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3999
00000100:00100000:0.0:1651532137.240898:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468495808:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532137.240901:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532137.240901:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.240904:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c22 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae54 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.240908:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468495872
00010000:00010000:0.0:1651532137.240911:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c22 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae54 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532137.240914:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4000
00000100:00100000:1.0:1651532137.240916:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468495872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.240918:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c22 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae54 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.240919:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.240922:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410c29 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae5b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.240922:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:1.0:1651532137.240929:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410c29 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae5b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.240931:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468495808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (70us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532137.240933:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065453fc2/0xa29a79078f410c29 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae5b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.240934:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3999
00010000:00010000:1.0:1651532137.240939:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000065453fc2, rc 0)
00000100:00100000:1.0:1651532137.240947:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468495872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.240949:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4000
00000100:00100000:1.0:1651532137.241071:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.241078:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468496128
00000100:00100000:1.0:1651532137.241085:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4001
00000100:00100000:1.0:1651532137.241087:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468496128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.241090:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.241093:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410c30 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae62 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.241100:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410c30 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae62 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241104:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab9ffa21/0xa29a79078f410c30 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae62 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241108:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ab9ffa21, rc 0)
00000100:00100000:1.0:1651532137.241121:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468496128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.241124:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4001
00000100:00100000:1.0:1651532137.241196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.241203:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468496256
00000100:00100000:1.0:1651532137.241209:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4002
00000100:00100000:1.0:1651532137.241211:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468496256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.241214:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.241218:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410c37 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae69 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.241225:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410c37 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae69 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241229:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410c37 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae69 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241232:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532137.241236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.241252:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468496256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.241254:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4002
00000100:00100000:1.0:1651532137.241259:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468496320
00000100:00100000:1.0:1651532137.241273:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4003
00000100:00100000:1.0:1651532137.241274:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468496320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.241277:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.241280:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410c3e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae70 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.241286:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410c3e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae70 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241290:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410c3e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae70 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241293:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532137.241305:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468496320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.241307:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4003
00000100:00100000:0.0:1651532137.241368:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.241378:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468496512
00000100:00100000:1.0:1651532137.241386:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4004
00000100:00100000:1.0:1651532137.241387:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468496512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.241390:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.241393:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c45 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae77 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.241400:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c45 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae77 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241404:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c45 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae77 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241408:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532137.241417:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468496512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.241419:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4004
00000100:00100000:0.0:1651532137.241612:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.241630:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468496768
00000100:00100000:1.0:1651532137.241637:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4005
00000100:00100000:1.0:1651532137.241639:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468496768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.241643:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.241647:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410c4c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae7e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.241653:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410c4c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae7e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241657:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410c4c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae7e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241660:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532137.241670:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468496768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.241672:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4005
00000100:00100000:0.0:1651532137.241876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.241885:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468496896
00000100:00100000:1.0:1651532137.241893:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4006
00000100:00100000:1.0:1651532137.241895:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468496896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.241898:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.241901:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410c53 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae85 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.241908:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410c53 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae85 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241912:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410c53 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae85 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.241918:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532137.241928:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468496896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.241930:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4006
00000001:00080000:1.0:1651532137.347766:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793864 is committed
00010000:00010000:0.0:1651532137.347802:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.347818:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.347840:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.347841:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468491328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 550012us (550056us total) trans 158913793864 rc 0/0
00010000:00010000:1.0:1651532137.347844:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.347845:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.347845:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4402
00010000:00010000:1.0:1651532137.347849:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.347854:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.347855:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.347856:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.347859:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.347866:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.347869:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410b42 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1052672->8765439] (req 1052672->8765439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.347875:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.347886:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.348216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.348226:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.348233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.348244:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468497088
00000100:00100000:0.0:1651532137.348254:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468497024
00000100:00100000:0.0:1651532137.348262:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4411
00000100:00100000:0.0:1651532137.348264:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468497088:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532137.348272:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348277:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532137.348278:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532137.348278:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348282:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.348289:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4412
00000100:00100000:0.0:1651532137.348290:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468497024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532137.348294:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348298:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532137.348298:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348301:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348304:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348306:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348312:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532137.348313:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 7/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348317:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.348320:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468497344
00010000:00010000:0.0:1651532137.348320:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348323:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348326:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.348329:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.348341:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4007
00000100:00100000:1.0:1651532137.348343:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468497344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.348347:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.348351:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410c68 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae8c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.348358:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410c68 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae8c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.348362:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410c68 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae8c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.348366:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532137.348377:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468497344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (143us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.348379:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4007
00000001:00080000:1.0:1651532137.472774:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793865 is committed
00010000:00010000:1.0:1651532137.472790:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.472794:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.472818:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.472823:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067fbb32a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532137.472824:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.472831:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468492608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524859us (524901us total) trans 158913793865 rc 0/0
00010000:00010000:0.0:1651532137.472832:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.472834:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4403
00010000:00010000:0.0:1651532137.472839:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.472840:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.472841:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.472844:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.472852:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.472854:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067fbb32a/0xa29a79078f410b73 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3612672->10231807] (req 3612672->10231807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.472860:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.472863:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.473259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.473267:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.473278:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.473294:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468497664
00000100:00100000:0.0:1651532137.473294:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468497472
00000100:00100000:1.0:1651532137.473304:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468497792
00000100:00100000:1.0:1651532137.473308:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4008
00000100:00100000:1.0:1651532137.473310:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468497664:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532137.473311:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4009
00010000:00010000:1.0:1651532137.473313:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532137.473313:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468497472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.473316:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.473317:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410c6f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae9a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473321:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410c76 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ae93 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.473323:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.473326:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410c6f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae9a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.473340:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410c6f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae9a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.473344:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532137.473354:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468497664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.473357:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4008
00010000:00010000:0.0:1651532137.473361:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532137.473362:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4010
00000100:00100000:1.0:1651532137.473364:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468497792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.473365:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410c76 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae93 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.473366:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.473369:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410c7d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aea1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473370:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410c76 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ae93 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.473373:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.473374:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:1.0:1651532137.473375:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410c7d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aea1 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.473379:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410c7d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aea1 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.473382:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532137.473384:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468497472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 70us (125us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.473387:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4009
00000100:00100000:1.0:1651532137.473388:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468497792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.473391:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4010
00010000:00010000:0.0:1651532137.473402:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473405:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.473421:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468492672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 525430us (525472us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532137.473424:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4404
00010000:00010000:0.0:1651532137.473435:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473438:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532137.473439:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473445:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473449:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.473450:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.473451:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473454:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473466:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473469:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410b7a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->9715711] (req 2768896->9715711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.473475:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.473480:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.473884:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.473898:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.473904:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468497984
00000100:00100000:1.0:1651532137.473905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.473914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.473925:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.473925:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468497920
00000100:00100000:0.0:1651532137.473935:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4413
00000100:00100000:0.0:1651532137.473936:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468497984:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532137.473943:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473947:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532137.473948:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473954:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532137.473954:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473959:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473962:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.473969:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468498048
00000100:00100000:0.0:1651532137.473975:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468498176
00000100:00100000:0.0:1651532137.473977:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468498240
00000100:00100000:0.0:1651532137.473980:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4011
00000100:00100000:0.0:1651532137.473982:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468498048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.473984:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.473987:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410c8b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aea8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.473994:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410c8b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aea8 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.473998:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410c8b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aea8 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.474001:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532137.474002:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4414
00000100:00100000:1.0:1651532137.474005:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468497920:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532137.474016:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468498048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (111us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532137.474019:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.474019:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4011
00010000:00010000:1.0:1651532137.474024:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532137.474024:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4012
00010000:00010000:1.0:1651532137.474025:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.474025:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468498176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.474028:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532137.474028:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.474028:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.474030:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410c99 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aeaf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.474033:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.474036:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410c99 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aeaf expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.474037:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.474040:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410c99 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aeaf expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.474043:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532137.474044:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4013
00000100:00100000:1.0:1651532137.474046:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055424391 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468498240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.474049:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532137.474049:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468498176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (135us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532137.474051:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410ca0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aeb6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.474051:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4012
00010000:00010000:1.0:1651532137.474061:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410ca0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aeb6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.474065:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410ca0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aeb6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.474068:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532137.474077:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055424391 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468498240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (152us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.474079:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4013
00000001:00080000:1.0:1651532137.572810:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793866 is committed
00010000:00010000:1.0:1651532137.572826:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.572830:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.572854:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468493440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557895us (557955us total) trans 158913793866 rc 0/0
00000100:00100000:1.0:1651532137.572857:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4405
00010000:00010000:1.0:1651532137.572865:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.572868:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cc2c662 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.572869:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.572875:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.572880:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.572880:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.572881:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.572884:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.572897:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.572899:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.572901:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.572903:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc2c662/0xa29a79078f410b96 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8192->10108927] (req 8192->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.573183:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.573195:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.573201:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468498752
00000100:00100000:1.0:1651532137.573213:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468498880
00010000:00010000:0.0:1651532137.573216:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.573220:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4014
00000100:00100000:1.0:1651532137.573221:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468498752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.573224:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573225:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.573228:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410ca7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aebd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573234:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.573236:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410ca7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aebd expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.573243:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468493504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 558270us (558301us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532137.573246:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4406
00010000:00010000:1.0:1651532137.573250:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410ca7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aebd expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.573254:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532137.573262:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468498752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.573265:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4014
00000100:00100000:0.0:1651532137.573267:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4015
00000100:00100000:0.0:1651532137.573269:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468498880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.573273:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.573276:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410cae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aec4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.573282:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.573284:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410cae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aec4 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.573288:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410cae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aec4 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.573292:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532137.573293:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.573299:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468498880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (104us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.573301:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4015
00000100:00100000:0.0:1651532137.573307:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468499008
00000100:00100000:0.0:1651532137.573311:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4016
00000100:00100000:0.0:1651532137.573313:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468499008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.573315:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.573317:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410cb5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aecb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.573321:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.573323:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410cb5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aecb expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.573327:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410cb5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aecb expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.573342:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532137.573353:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468499008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (60us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532137.573355:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.573356:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4016
00010000:00010000:1.0:1651532137.573359:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.573361:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573364:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573369:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.573369:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.573370:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573373:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573380:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573384:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410b9d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4169728->6840319] (req 4169728->6840319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573396:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573399:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.573686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.573694:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.573705:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.573712:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468499072
00000100:00100000:0.0:1651532137.573721:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468499136
00000100:00100000:0.0:1651532137.573729:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4415
00000100:00100000:0.0:1651532137.573731:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468499072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532137.573738:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.573745:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532137.573746:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.573749:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532137.573749:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.573754:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.573757:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.573764:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4416
00000100:00100000:1.0:1651532137.573766:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468499136:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532137.573768:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468499328
00000100:00100000:0.0:1651532137.573776:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4017
00000100:00100000:0.0:1651532137.573778:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468499328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.573780:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.573780:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.573783:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410cca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aed2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573784:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532137.573786:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573788:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532137.573789:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.573795:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.573795:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410cca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aed2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.573798:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.573800:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410cca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aed2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.573819:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532137.573832:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468499328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.573835:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4017
00000100:00100000:0.0:1651532137.574077:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.574084:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468499584
00000100:00100000:0.0:1651532137.574097:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4018
00000100:00100000:0.0:1651532137.574099:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468499584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.574102:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.574105:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410cd1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aed9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.574112:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410cd1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aed9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.574116:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410cd1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aed9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.574120:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532137.574133:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468499584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.574136:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4018
00000001:00080000:1.0:1651532137.706138:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793867 is committed
00010000:00010000:1.0:1651532137.706153:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706157:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.706178:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468494208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 591460us (591513us total) trans 158913793867 rc 0/0
00000100:00100000:1.0:1651532137.706181:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4407
00010000:00010000:0.0:1651532137.706184:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706192:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000641bcd9e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532137.706193:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706196:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706202:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706203:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706204:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706207:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706210:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706211:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706211:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706214:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706216:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706217:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706217:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706220:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706223:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706224:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706225:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706227:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706241:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706244:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000641bcd9e/0xa29a79078f410bb2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->9576447] (req 1843200->9576447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706250:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706253:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706254:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706258:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706287:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706291:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706299:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706302:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706303:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706305:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.706321:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468495040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 465887us (466025us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532137.706324:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4410
00010000:00010000:1.0:1651532137.706344:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706348:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a591db0 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.706349:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706352:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706358:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706361:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a591db0/0xa29a79078f410c0d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1269760->1273855] (req 1269760->1273855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.706621:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.706633:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.706633:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468499904
00000100:00100000:0.0:1651532137.706649:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468499968
00000100:00100000:0.0:1651532137.706657:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4019
00000100:00100000:1.0:1651532137.706668:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4020
00000100:00100000:1.0:1651532137.706670:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468499968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.706674:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.706678:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410cd8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aee7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.706683:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468499904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.706688:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.706692:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410cdf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aee0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706693:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.706697:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410cd8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aee7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.706697:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706700:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410cdf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aee0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.706701:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410cd8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aee7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.706704:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532137.706704:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f410cdf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aee0 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.706708:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532137.706714:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468499968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.706716:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468499904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.706717:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4020
00000100:00100000:0.0:1651532137.706719:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4019
00010000:00010000:1.0:1651532137.706728:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706732:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706736:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706740:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.706743:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468494272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 591991us (592069us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532137.706746:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4408
00010000:00010000:1.0:1651532137.706751:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.706752:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468497088:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358488us (358537us total) trans 0 rc 65536/65536
00010000:00010000:1.0:1651532137.706754:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000da6660c4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.706755:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.706755:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4411
00010000:00010000:1.0:1651532137.706761:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706763:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706767:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706773:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706781:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6660c4/0xa29a79078f410bc0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5931008->7876607] (req 5931008->7876607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.706781:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754468494976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466361us (466495us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532137.706784:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4409
00010000:00010000:1.0:1651532137.706785:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706787:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.706788:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706789:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706791:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706792:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532137.706793:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706795:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706796:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.706797:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f410c5a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [176128->8638463] (req 176128->8638463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706801:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706801:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.706815:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706819:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706826:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.706829:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532137.706829:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f410c06 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [176128->4804607] (req 176128->4804607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706839:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706842:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.706845:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.706869:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468500096
00000100:00100000:0.0:1651532137.706882:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468500032
00000100:00100000:0.0:1651532137.706890:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4417
00000100:00100000:0.0:1651532137.706891:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468500096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532137.706897:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706901:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532137.706902:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706905:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.706912:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4418
00000100:00100000:0.0:1651532137.706913:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468500032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532137.706917:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706921:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532137.706922:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706925:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706927:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532137.706944:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706949:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706952:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.706955:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.707388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.707390:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.707402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.707403:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468500544
00000100:00100000:0.0:1651532137.707411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.707417:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468500288
00000100:00100000:0.0:1651532137.707418:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.707427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.707428:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4419
00000100:00100000:1.0:1651532137.707435:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468500544:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532137.707436:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468500224
00000100:00100000:0.0:1651532137.707441:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468500416
00010000:00010000:1.0:1651532137.707442:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.707444:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468500480
00000100:00100000:0.0:1651532137.707445:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468500672
00010000:00010000:1.0:1651532137.707446:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532137.707447:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.707448:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4021
00010000:00010000:1.0:1651532137.707450:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532137.707450:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.707450:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468500224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.707454:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.707455:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.707458:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.707458:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410cfb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aeee expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.707465:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410cfb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aeee expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532137.707466:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4420
00000100:00100000:1.0:1651532137.707467:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468500288:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532137.707469:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f410cfb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aeee expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.707473:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:1.0:1651532137.707480:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.707486:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468500224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.707488:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4021
00010000:00010000:1.0:1651532137.707489:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532137.707491:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532137.707491:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.707493:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4022
00010000:00010000:1.0:1651532137.707494:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.707495:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468500416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.707497:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.707499:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f410d09 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aef5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.707502:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4023
00000100:00100000:1.0:1651532137.707504:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468500480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.707505:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f410d09 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aef5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.707506:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.707509:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410d10 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aefc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.707509:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f410d09 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aef5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.707515:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:1.0:1651532137.707516:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410d10 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aefc expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.707520:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410d10 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aefc expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.707520:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468500416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.707523:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4022
00010000:00010000:1.0:1651532137.707524:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532137.707526:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4024
00000100:00100000:0.0:1651532137.707528:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468500672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.707530:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532137.707532:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468500480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (114us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532137.707532:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410d17 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af03 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.707535:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4023
00010000:00010000:0.0:1651532137.707537:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410d17 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af03 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.707541:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f410d17 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af03 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.707543:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532137.707548:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468500672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (121us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.707551:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4024
00000100:00100000:0.0:1651532137.707894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.707924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.707934:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.707940:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.707948:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468500864
00000100:00100000:0.0:1651532137.707949:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468500928
00000100:00100000:1.0:1651532137.707955:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468501184
00000100:00100000:0.0:1651532137.707955:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468501120
00000100:00100000:0.0:1651532137.707958:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4025
00000100:00100000:1.0:1651532137.707960:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4026
00000100:00100000:0.0:1651532137.707960:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468500864:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532137.707962:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468500928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.707963:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.707966:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.707966:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410d1e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af0a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.707970:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410d25 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af11 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.707974:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410d1e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af0a expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.707977:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410d25 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af11 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.707977:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f410d1e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af0a expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.707981:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410d25 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af11 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.707981:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:1.0:1651532137.707985:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532137.707993:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468500864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.707996:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4025
00000100:00100000:1.0:1651532137.708000:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468500928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.708001:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4027
00000100:00100000:0.0:1651532137.708002:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468501120:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532137.708003:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4026
00010000:00010000:0.0:1651532137.708005:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.708007:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410d2c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af18 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.708008:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4028
00000100:00100000:1.0:1651532137.708009:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468501184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.708012:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.708013:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410d2c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af18 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.708014:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d33 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af1f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.708020:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d33 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af1f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.708020:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f410d2c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af18 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.708023:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:1.0:1651532137.708024:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d33 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af1f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532137.708028:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468501120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (95us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532137.708030:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532137.708031:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4027
00000100:00100000:1.0:1651532137.708036:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468501184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.708038:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4028
00000100:00100000:0.0:1651532137.708358:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.708372:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.708383:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468501376
00000100:00100000:1.0:1651532137.708390:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468501440
00000100:00100000:1.0:1651532137.708397:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4029
00000100:00100000:1.0:1651532137.708399:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468501376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.708402:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.708406:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d3a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af26 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.708415:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4030
00000100:00100000:0.0:1651532137.708417:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468501440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.708418:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d3a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af26 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.708420:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.708422:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d3a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af26 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.708424:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410d41 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af2d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.708425:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532137.708431:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410d41 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af2d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532137.708438:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468501376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.708440:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4029
00010000:00010000:0.0:1651532137.708441:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f410d41 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af2d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.708445:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532137.708453:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468501440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.708457:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4030
00000100:00100000:1.0:1651532137.708468:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.708502:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468501760
00000100:00100000:0.0:1651532137.708512:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4031
00000100:00100000:0.0:1651532137.708514:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468501760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.708517:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.708520:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410d48 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af34 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.708527:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410d48 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af34 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.708531:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410d48 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af34 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.708534:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532137.708543:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468501760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.708546:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4031
00000100:00100000:1.0:1651532137.708762:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.708772:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468502080
00000100:00100000:0.0:1651532137.708782:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4032
00000100:00100000:0.0:1651532137.708784:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468502080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.708787:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.708790:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d4f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af3b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.708797:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d4f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af3b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.708824:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d4f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af3b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.708828:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532137.708838:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468502080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.708841:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4032
00000100:00100000:1.0:1651532137.709047:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.709057:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468502208
00000100:00100000:0.0:1651532137.709067:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4033
00000100:00100000:0.0:1651532137.709069:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468502208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.709072:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.709076:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d56 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af42 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.709083:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d56 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af42 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.709086:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d56 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af42 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.709090:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532137.709100:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468502208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.709102:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4033
00000001:00080000:1.0:1651532137.822815:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793868 is committed
00010000:00010000:0.0:1651532137.822849:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.822854:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.822878:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468497024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474587us (474652us total) trans 158913793868 rc 0/0
00010000:00010000:1.0:1651532137.822881:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.822882:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4412
00010000:00010000:1.0:1651532137.822886:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.822887:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.822891:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.822896:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.822897:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.822898:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.822901:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.822911:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.822914:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f410c61 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [131072->9302015] (req 131072->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.822920:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.822925:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823078:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823082:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.823099:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.823102:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468497984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 349165us (349219us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532137.823103:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532137.823104:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.823105:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4413
00010000:00010000:1.0:1651532137.823107:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.823112:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.823112:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532137.823113:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.823116:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.823123:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.823126:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f410c84 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4517888->7008255] (req 4517888->7008255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.823139:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.823143:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.823296:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.823352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.823362:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.823369:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468502400
00000100:00100000:0.0:1651532137.823382:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468502464
00000100:00100000:0.0:1651532137.823390:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4421
00000100:00100000:0.0:1651532137.823392:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468502400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532137.823399:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823404:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532137.823405:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823408:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823410:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532137.823411:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823415:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.823426:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4422
00000100:00100000:1.0:1651532137.823428:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468502464:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532137.823434:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.823437:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823437:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.823444:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532137.823445:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.823445:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468502528
00010000:00010000:1.0:1651532137.823448:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532137.823449:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.823456:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4034
00000100:00100000:0.0:1651532137.823458:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468502528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.823460:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823461:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.823464:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823464:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d6b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af49 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823472:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d6b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af49 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.823476:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d6b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af49 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.823479:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532137.823488:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468502528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.823490:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4034
00000100:00100000:0.0:1651532137.823516:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.823538:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468502848
00000100:00100000:0.0:1651532137.823548:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4035
00000100:00100000:0.0:1651532137.823549:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468502848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.823553:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.823556:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410d72 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af50 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823563:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410d72 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af50 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.823566:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410d72 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af50 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.823570:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532137.823580:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468502848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.823583:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4035
00000100:00100000:0.0:1651532137.823761:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.823768:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468502976
00000100:00100000:0.0:1651532137.823781:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4036
00000100:00100000:0.0:1651532137.823783:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468502976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.823786:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.823790:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410d79 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af57 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.823797:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410d79 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af57 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.823801:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410d79 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af57 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.823816:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532137.823827:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468502976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.823829:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4036
00000001:00080000:1.0:1651532137.939490:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793869 is committed
00010000:00010000:1.0:1651532137.939506:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.939510:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.939532:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468497920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 465527us (465634us total) trans 158913793869 rc 0/0
00010000:00010000:0.0:1651532137.939535:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532137.939536:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4414
00010000:00010000:0.0:1651532137.939543:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532137.939544:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.939548:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.939554:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.939554:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532137.939555:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.939558:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.939566:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.939569:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410c92 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->9322495] (req 1404928->9322495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.939580:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.939584:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.939917:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.939930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.939939:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.939947:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532137.939948:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468503168
00000100:00100000:0.0:1651532137.939956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.939965:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468503296
00000100:00100000:1.0:1651532137.939971:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468503232
00000100:00100000:0.0:1651532137.939984:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468503360
00000100:00100000:1.0:1651532137.939985:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4423
00000100:00100000:1.0:1651532137.939986:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468503168:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532137.939987:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468503424
00000100:00100000:0.0:1651532137.939991:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4037
00000100:00100000:0.0:1651532137.939992:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468503296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.939994:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.939996:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.939998:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532137.939999:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.940000:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410d87 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af5e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.940002:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532137.940003:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.940008:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.940009:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410d87 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af5e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.940012:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.940013:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410d87 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af5e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.940017:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532137.940019:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4038
00000100:00100000:1.0:1651532137.940021:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468503360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.940024:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532137.940026:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410d8e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af65 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.940031:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468503296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.940034:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4037
00000100:00100000:0.0:1651532137.940039:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4039
00000100:00100000:0.0:1651532137.940041:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468503424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532137.940043:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410d8e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af65 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.940043:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.940046:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410d95 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af6c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532137.940048:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410d8e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af65 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532137.940051:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532137.940052:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410d95 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af6c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.940056:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410d95 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af6c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.940059:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532137.940060:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468503360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532137.940063:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4038
00000100:00100000:0.0:1651532137.940066:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468503424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.940068:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4039
00000100:00100000:0.0:1651532137.940076:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4424
00000100:00100000:0.0:1651532137.940078:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468503232:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532137.940083:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.940087:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532137.940088:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.940091:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532137.940092:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.940096:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.940100:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532137.940411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.940419:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468503616
00000100:00100000:0.0:1651532137.940426:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4040
00000100:00100000:0.0:1651532137.940428:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468503616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.940431:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.940435:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410da3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af73 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.940442:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410da3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af73 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.940446:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410da3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af73 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.940471:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532137.940482:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468503616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.940485:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4040
00000100:00100000:1.0:1651532137.940497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.940520:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468503744
00000100:00100000:0.0:1651532137.940527:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4041
00000100:00100000:0.0:1651532137.940528:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468503744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.940531:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.940535:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410daa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af7a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.940542:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410daa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af7a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.940546:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410daa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af7a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.940549:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532137.940558:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468503744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.940561:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4041
00000100:00100000:1.0:1651532137.940719:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532137.940731:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468503936
00000100:00100000:0.0:1651532137.940739:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4042
00000100:00100000:0.0:1651532137.940741:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468503936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532137.940744:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532137.940747:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410db1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af81 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532137.940754:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410db1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af81 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.940758:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410db1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af81 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532137.940761:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532137.940771:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468503936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532137.940774:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4042
00000001:00080000:1.0:1651532138.072810:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793870 is committed
00010000:00010000:1.0:1651532138.072827:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072831:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.072850:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468499072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499118us (499164us total) trans 158913793870 rc 0/0
00000100:00100000:1.0:1651532138.072853:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4415
00010000:00010000:1.0:1651532138.072860:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072864:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.072865:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072868:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072873:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.072874:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.072875:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072878:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072881:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.072882:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.072882:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072885:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072898:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072902:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f410cbc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1302528->9818111] (req 1302528->9818111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072907:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.072912:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.072912:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.072917:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.073148:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.073152:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073156:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073160:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.073170:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468499136:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499403us (499476us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532138.073173:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4416
00010000:00010000:1.0:1651532138.073181:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.073181:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468500096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366288us (366352us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532138.073184:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532138.073184:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4417
00010000:00010000:1.0:1651532138.073185:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.073188:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073192:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.073193:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073195:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.073196:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410cc3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->9895935] (req 520192->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073197:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073200:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073205:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.073205:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.073206:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073209:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073219:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073222:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f410ce6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1261568->8511487] (req 1261568->8511487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073227:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073230:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.073479:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.073494:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.073495:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468504128
00000100:00100000:0.0:1651532138.073501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.073511:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468504192
00000100:00100000:0.0:1651532138.073512:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.073515:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468504320
00000100:00100000:1.0:1651532138.073517:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468504512
00000100:00100000:1.0:1651532138.073520:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4043
00000100:00100000:1.0:1651532138.073522:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468504128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.073526:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.073529:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410db8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af88 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.073537:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410db8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af88 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.073548:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410db8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af88 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.073552:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532138.073565:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468504128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.073568:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4043
00000100:00100000:1.0:1651532138.073573:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4044
00000100:00100000:1.0:1651532138.073575:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468504192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.073577:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.073580:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410dbf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af8f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.073588:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410dbf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af8f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.073592:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410dbf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af8f expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.073595:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532138.073601:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468504192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.073603:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4045
00000100:00100000:0.0:1651532138.073605:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468504320:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532138.073607:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4044
00010000:00010000:0.0:1651532138.073609:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532138.073611:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4046
00000100:00100000:1.0:1651532138.073612:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468504512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.073613:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410dc6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af96 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.073615:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.073617:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410dcd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44af9d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073622:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410dc6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af96 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.073623:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410dcd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af9d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.073626:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410dc6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af96 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.073627:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410dcd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44af9d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.073630:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532138.073630:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532138.073635:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468504512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.073639:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4046
00000100:00100000:0.0:1651532138.073640:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468504320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (139us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.073643:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4045
00000100:00100000:1.0:1651532138.073685:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.073699:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468504576
00000100:00100000:1.0:1651532138.073704:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.073714:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468504640
00000100:00100000:1.0:1651532138.073719:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4425
00000100:00100000:1.0:1651532138.073722:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468504576:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532138.073722:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4426
00000100:00100000:0.0:1651532138.073724:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468504640:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532138.073729:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073730:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.073733:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532138.073734:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532138.073735:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073740:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532138.073741:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073744:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532138.073745:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.073748:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073749:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.073753:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.074104:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.074117:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.074123:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468504768
00000100:00100000:1.0:1651532138.074125:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.074134:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468504960
00000100:00100000:0.0:1651532138.074137:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468505024
00000100:00100000:1.0:1651532138.074139:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4047
00000100:00100000:1.0:1651532138.074141:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468504768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.074145:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.074148:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410de2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afa4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.074156:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410de2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afa4 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532138.074164:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4048
00000100:00100000:0.0:1651532138.074166:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468504960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.074169:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.074171:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410de2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afa4 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.074173:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410de9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afab expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.074175:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532138.074181:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410de9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afab expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532138.074185:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468504768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (81us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532138.074185:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410de9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afab expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532138.074188:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4047
00010000:00010000:0.0:1651532138.074188:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532138.074193:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4049
00000100:00100000:1.0:1651532138.074195:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468505024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.074197:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532138.074197:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468504960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (80us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532138.074200:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410df0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afb2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.074200:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4048
00010000:00010000:1.0:1651532138.074206:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410df0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afb2 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.074210:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410df0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afb2 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.074213:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532138.074216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.074218:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468505024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.074221:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4049
00000100:00100000:1.0:1651532138.074225:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468505216
00000100:00100000:1.0:1651532138.074229:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4050
00000100:00100000:1.0:1651532138.074231:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468505216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.074233:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.074235:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410df7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afb9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.074240:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410df7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afb9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.074253:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410df7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afb9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.074256:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532138.074273:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468505216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.074275:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4050
00000100:00100000:1.0:1651532138.074562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.074570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.074581:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468505408
00000100:00100000:0.0:1651532138.074582:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468505536
00000100:00100000:1.0:1651532138.074590:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4051
00000100:00100000:1.0:1651532138.074592:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468505408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.074595:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532138.074595:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4052
00000100:00100000:0.0:1651532138.074597:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468505536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.074598:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410dfe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afc0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.074601:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.074605:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410dfe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afc0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.074612:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410dfe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afc0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.074613:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e05 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afc7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.074615:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532138.074620:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e05 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afc7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532138.074627:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468505408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.074629:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4051
00010000:00010000:0.0:1651532138.074630:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e05 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afc7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.074634:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532138.074643:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468505536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.074645:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4052
00000100:00100000:0.0:1651532138.074693:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.074701:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468505664
00000100:00100000:0.0:1651532138.074714:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4053
00000100:00100000:0.0:1651532138.074716:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468505664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.074719:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.074722:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e0c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afce expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.074730:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e0c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afce expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.074734:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e0c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afce expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.074737:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532138.074751:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468505664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.074756:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4053
00000100:00100000:0.0:1651532138.075012:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.075019:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468505792
00000100:00100000:0.0:1651532138.075026:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4054
00000100:00100000:0.0:1651532138.075028:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468505792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.075031:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.075034:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e13 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afd5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.075042:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e13 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afd5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.075045:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e13 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afd5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.075049:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532138.075065:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468505792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.075068:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4054
00000001:00080000:1.0:1651532138.139547:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793871 is committed
00002000:00010000:0.0:1651532138.139578:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532136 -> 1651532137
00002000:00010000:0.0:1651532138.139580:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532135 -> 1651532137
00010000:00010000:0.0:1651532138.139583:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.139587:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.139612:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468500032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432698us (432767us total) trans 158913793871 rc 0/0
00010000:00010000:1.0:1651532138.139613:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.139616:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4418
00010000:00010000:1.0:1651532138.139618:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.139619:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139622:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139628:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.139629:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.139630:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139633:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139636:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.139637:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.139638:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139641:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139658:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139661:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f410ced lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2764800->9379839] (req 2764800->9379839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139667:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139670:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139686:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139690:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.139706:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468500288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 432238us (432304us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532138.139710:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4420
00010000:00010000:1.0:1651532138.139716:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139720:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139774:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139778:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.139779:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139783:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139788:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.139791:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410d02 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6377472->6381567] (req 6377472->6381567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.139991:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.140019:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468506112
00000100:00100000:0.0:1651532138.140026:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.140034:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.140036:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468506176
00000100:00100000:0.0:1651532138.140040:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.140042:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4427
00000100:00100000:1.0:1651532138.140044:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468506112:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532138.140047:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468506240
00010000:00010000:1.0:1651532138.140051:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.140055:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532138.140055:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468506304
00010000:00010000:1.0:1651532138.140056:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.140063:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4055
00000100:00100000:0.0:1651532138.140065:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468506240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.140066:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.140068:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.140069:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532138.140070:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.140072:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e21 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afdc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.140074:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.140077:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.140081:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.140081:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e21 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afdc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.140085:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e21 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afdc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532138.140088:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4428
00010000:00010000:0.0:1651532138.140088:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532138.140089:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468506176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532138.140094:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.140098:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532138.140099:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.140101:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532138.140102:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.140105:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.140108:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.140117:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468506240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.140120:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4055
00000100:00100000:1.0:1651532138.140122:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4056
00000100:00100000:1.0:1651532138.140124:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468506304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.140126:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.140129:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e2f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afe3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.140135:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e2f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afe3 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532138.140137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532138.140139:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e2f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afe3 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.140143:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532138.140152:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468506304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.140154:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4056
00000100:00100000:0.0:1651532138.140165:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468506368
00000100:00100000:0.0:1651532138.140172:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4057
00000100:00100000:0.0:1651532138.140174:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468506368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.140177:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.140180:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e36 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afea expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.140188:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e36 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afea expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.140192:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e36 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afea expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.140195:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532138.140204:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468506368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.140206:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4057
00000100:00100000:1.0:1651532138.140492:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.140507:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.140518:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468506496
00000100:00100000:0.0:1651532138.140529:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468506624
00000100:00100000:0.0:1651532138.140534:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4058
00000100:00100000:0.0:1651532138.140536:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468506496:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532138.140538:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4059
00010000:00010000:0.0:1651532138.140539:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532138.140540:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468506624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.140542:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e3d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aff1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.140544:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.140548:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e44 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44aff8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.140549:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e3d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aff1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.140554:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e3d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aff1 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.140555:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e44 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aff8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.140558:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532138.140559:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e44 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44aff8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.140563:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532138.140568:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468506496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.140570:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4058
00000100:00100000:1.0:1651532138.140571:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468506624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.140573:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4059
00000001:00080000:1.0:1651532138.181496:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793872 is committed
00010000:00010000:1.0:1651532138.181510:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.181514:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.181535:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468500544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474104us (474148us total) trans 158913793872 rc 0/0
00010000:00010000:0.0:1651532138.181537:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.181538:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4419
00010000:00010000:0.0:1651532138.181542:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532138.181543:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181547:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181552:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.181553:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.181554:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181557:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181564:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181570:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410cf4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6500352->6504447] (req 6500352->6504447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.181578:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.181583:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.181862:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.181878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.181879:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.181887:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468507008
00000100:00100000:1.0:1651532138.181897:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468506944
00000100:00100000:1.0:1651532138.181907:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4429
00000100:00100000:1.0:1651532138.181909:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468507008:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532138.181921:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.181921:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4430
00000100:00100000:0.0:1651532138.181923:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468506944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532138.181925:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532138.181926:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.181930:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181932:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181936:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.181937:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181940:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532138.181941:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181945:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181948:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.181961:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468507072
00000100:00100000:0.0:1651532138.181968:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4060
00000100:00100000:0.0:1651532138.181970:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc2a4de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468507072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.181974:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.181976:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e59 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44afff expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.181983:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e59 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afff expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.181987:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e59 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44afff expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.181991:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532138.182004:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc2a4de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468507072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.182006:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4060
00000001:00080000:1.0:1651532138.306275:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793873 is committed
00010000:00010000:1.0:1651532138.306289:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.306293:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.306316:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468502400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482923us (483020us total) trans 158913793873 rc 0/0
00000100:00100000:1.0:1651532138.306319:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4421
00010000:00010000:1.0:1651532138.306327:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.306342:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.306343:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.306347:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.306352:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.306353:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.306353:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.306356:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.306372:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.306374:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.306377:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f410d5d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [487424->7806975] (req 487424->7806975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.306377:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.306696:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532138.306713:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.306717:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.306736:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.306739:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468502464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483310us (483388us total) trans 0 rc 57344/57344
00000100:00100000:0.0:1651532138.306743:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4422
00010000:00010000:1.0:1651532138.306744:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.306746:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.306749:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.306751:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468507328
00010000:00010000:1.0:1651532138.306754:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.306754:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.306755:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.306760:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4061
00010000:00010000:1.0:1651532138.306762:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.306762:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468507328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.306765:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.306769:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.306769:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e60 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b006 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.306773:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410d64 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->9039871] (req 929792->9039871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.306776:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e60 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b006 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.306778:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.306780:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410e60 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b006 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.306781:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.306784:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532138.306790:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468507328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.306793:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4061
00000100:00100000:1.0:1651532138.307264:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.307278:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.307284:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468507520
00000100:00100000:1.0:1651532138.307286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.307295:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.307304:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.307305:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468507648
00000100:00100000:1.0:1651532138.307314:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4431
00000100:00100000:1.0:1651532138.307316:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468507520:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532138.307322:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4432
00000100:00100000:0.0:1651532138.307324:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468507648:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532138.307329:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.307340:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e6e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.307342:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532138.307343:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.307346:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532138.307346:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.307350:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.307351:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.307352:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e6e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.307356:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e6e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.307357:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.307360:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.307369:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e6e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.307372:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e6e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.307374:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468507776
00000100:00100000:1.0:1651532138.307384:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468507840
00000100:00100000:1.0:1651532138.307387:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468507968
00000100:00100000:1.0:1651532138.307390:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4062
00000100:00100000:1.0:1651532138.307392:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468507776:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532138.307393:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468507648:12345-10.240.43.64@tcp:3:fio.0 Request processed in 69us (115us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651532138.307395:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532138.307396:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4432
00010000:00010000:1.0:1651532138.307398:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410e75 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b00d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.307405:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4063
00000100:00100000:0.0:1651532138.307406:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468507840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.307408:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410e75 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b00d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.307409:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.307412:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410e75 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b00d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.307413:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410e7c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b014 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.307415:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532138.307420:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410e7c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b014 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.307424:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410e7c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b014 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532138.307427:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468507776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (140us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.307429:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4062
00010000:00010000:0.0:1651532138.307429:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532138.307434:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4064
00000100:00100000:1.0:1651532138.307436:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468507968:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532138.307436:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468507840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (141us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532138.307438:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532138.307439:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4063
00010000:00010000:1.0:1651532138.307440:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410e83 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b01b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.307445:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e6e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.307446:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410e83 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b01b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.307448:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.307450:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410e83 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b01b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.307450:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e6e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.307453:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532138.307453:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e6e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.307457:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e6e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.307458:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468507968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (154us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532138.307460:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410e6e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.307461:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4064
00000100:00100000:1.0:1651532138.307868:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.307881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.307890:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.307896:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468508096
00000100:00100000:1.0:1651532138.307897:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468508160
00000100:00100000:1.0:1651532138.307903:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468508352
00000100:00100000:0.0:1651532138.307905:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4065
00000100:00100000:1.0:1651532138.307907:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4066
00000100:00100000:0.0:1651532138.307907:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468508096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532138.307909:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468508160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.307910:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.307912:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.307913:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410e8a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b022 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.307916:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410e91 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b029 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.307924:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410e8a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b022 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.307925:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410e91 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b029 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.307928:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410e8a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b022 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.307929:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410e91 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b029 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.307932:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532138.307932:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532138.307942:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468508096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.307943:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468508160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.307945:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4066
00000100:00100000:0.0:1651532138.307947:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4065
00000100:00100000:1.0:1651532138.307949:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4067
00000100:00100000:1.0:1651532138.307951:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468508352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.307953:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.307955:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410e98 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b030 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.307960:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410e98 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b030 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.307964:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410e98 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b030 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.307967:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532138.307971:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468508352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.307974:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4067
00000100:00100000:1.0:1651532138.308253:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.308260:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468508544
00000100:00100000:1.0:1651532138.308271:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4068
00000100:00100000:1.0:1651532138.308272:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468508544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.308276:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.308279:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410e9f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b037 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.308286:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410e9f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b037 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.308290:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410e9f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b037 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.308304:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532138.308316:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468508544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.308319:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4068
00000100:00100000:1.0:1651532138.308556:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.308563:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468508672
00000100:00100000:1.0:1651532138.308573:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4069
00000100:00100000:1.0:1651532138.308575:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468508672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.308578:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.308582:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ea6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b03e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.308589:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ea6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b03e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.308593:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ea6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b03e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.308596:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532138.308608:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468508672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.308610:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4069
00000001:00080000:1.0:1651532138.406288:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793874 is committed
00010000:00010000:1.0:1651532138.406303:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406317:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.406346:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468503168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466358us (466429us total) trans 158913793874 rc 0/0
00000100:00100000:1.0:1651532138.406349:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4423
00010000:00010000:1.0:1651532138.406356:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406360:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.406361:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406364:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406369:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.406369:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.406370:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406374:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406377:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.406377:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.406378:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406383:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406396:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406399:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410d80 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2338816->9011199] (req 2338816->9011199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406405:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406408:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406412:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406418:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406617:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406622:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.406644:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468503232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466565us (466713us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532138.406647:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4424
00010000:00010000:0.0:1651532138.406655:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406659:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532138.406660:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406663:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406669:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406671:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410d9c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3973120->9338879] (req 3973120->9338879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.406883:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.406893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.406902:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468508928
00000100:00100000:0.0:1651532138.406903:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.406913:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468508864
00000100:00100000:1.0:1651532138.406923:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4433
00000100:00100000:1.0:1651532138.406925:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c75e9d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468508928:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532138.406933:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4434
00000100:00100000:0.0:1651532138.406935:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b5a93ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468508864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532138.406937:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406942:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532138.406943:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406943:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406946:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406951:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532138.406951:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406956:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532138.406957:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406960:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532138.406961:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406965:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406966:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406968:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.406969:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.406971:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.406981:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468509056
00000100:00100000:0.0:1651532138.406988:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4070
00000100:00100000:0.0:1651532138.406989:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468509056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.406992:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.406995:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410ebb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b045 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.407002:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410ebb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b045 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.407007:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410ebb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b045 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.407010:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532138.407024:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468509056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (120us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.407026:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4070
00000100:00100000:0.0:1651532138.407255:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.407263:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468509376
00000100:00100000:0.0:1651532138.407269:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4071
00000100:00100000:0.0:1651532138.407271:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468509376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.407275:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.407278:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410ec2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b04c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.407285:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410ec2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b04c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.407289:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410ec2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b04c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.407292:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532138.407309:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468509376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.407312:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4071
00000001:00080000:1.0:1651532138.564635:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793875 is committed
00002000:00010000:1.0:1651532138.564648:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532137 -> 1651532138
00002000:00010000:1.0:1651532138.564650:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532137 -> 1651532138
00010000:00010000:1.0:1651532138.564652:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.564656:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.564679:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468504576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490957us (490994us total) trans 158913793875 rc 0/0
00000100:00100000:1.0:1651532138.564683:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4425
00010000:00010000:1.0:1651532138.564690:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.564694:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.564695:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.564698:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.564703:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.564704:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.564705:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.564708:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.564718:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.564728:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.564729:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410dd4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1593344->3399679] (req 1593344->3399679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.564734:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.565031:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.565043:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.565052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.565055:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468509568
00000100:00100000:0.0:1651532138.565059:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.565069:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468509504
00000100:00100000:1.0:1651532138.565076:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4435
00000100:00100000:1.0:1651532138.565078:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468509568:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532138.565078:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468509632
00010000:00010000:1.0:1651532138.565084:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.565087:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468509696
00010000:00010000:1.0:1651532138.565091:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.565092:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.565092:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4072
00000100:00100000:0.0:1651532138.565093:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468509632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.565095:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532138.565096:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.565097:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.565100:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.565102:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410ed0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b053 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.565103:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.565108:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532138.565110:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4436
00010000:00010000:0.0:1651532138.565111:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410ed0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b053 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532138.565112:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468509504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532138.565116:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.565116:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410ed0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b053 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.565119:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532138.565120:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532138.565121:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.565123:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532138.565124:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.565127:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.565134:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468509632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.565137:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4072
00010000:00010000:1.0:1651532138.565138:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.565142:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4073
00000100:00100000:0.0:1651532138.565144:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468509696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.565146:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.565149:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410ede lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b05a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.565154:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.565156:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410ede lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b05a expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.565163:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410ede lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b05a expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.565166:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532138.565175:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468509696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.565177:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4073
00010000:00010000:0.0:1651532138.565188:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.565192:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.565209:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468504640:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491485us (491505us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532138.565211:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.565212:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4426
00010000:00010000:1.0:1651532138.565216:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.565217:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.565220:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.565225:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.565225:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.565226:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.565229:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.565236:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.565239:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f410ddb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->10014719] (req 602112->10014719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.565245:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.565249:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.565624:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.565634:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.565645:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.565651:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468509824
00000100:00100000:1.0:1651532138.565658:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468509952
00000100:00100000:1.0:1651532138.565660:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468510144
00000100:00100000:1.0:1651532138.565663:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4074
00000100:00100000:1.0:1651532138.565665:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468509824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.565669:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.565672:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410ee5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b061 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.565680:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410ee5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b061 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.565685:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410ee5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b061 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.565688:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532138.565693:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4075
00000100:00100000:0.0:1651532138.565695:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468509952:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532138.565701:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468509824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.565704:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4074
00010000:00010000:0.0:1651532138.565705:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532138.565709:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4076
00010000:00010000:0.0:1651532138.565709:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410eec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b068 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.565710:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468510144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.565713:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.565715:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410ef3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b06f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.565718:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410eec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b068 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.565722:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410eec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b068 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.565724:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410ef3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b06f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.565726:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532138.565728:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410ef3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b06f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.565731:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532138.565735:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468509952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.565737:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468510144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.565737:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4075
00000100:00100000:1.0:1651532138.565740:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4076
00000100:00100000:1.0:1651532138.566025:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.566032:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468510400
00000100:00100000:1.0:1651532138.566039:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4077
00000100:00100000:1.0:1651532138.566041:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468510400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.566044:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.566048:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410efa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b076 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.566054:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410efa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b076 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.566058:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410efa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b076 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.566062:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532138.566078:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468510400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.566080:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4077
00000001:00080000:1.0:1651532138.656286:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793876 is committed
00010000:00010000:0.0:1651532138.656318:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656323:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.656355:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468506112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516310us (516364us total) trans 158913793876 rc 0/0
00000100:00100000:0.0:1651532138.656359:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4427
00010000:00010000:0.0:1651532138.656367:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656371:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532138.656372:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656378:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656383:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.656384:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.656385:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656388:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656391:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.656392:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.656393:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656395:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656402:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656404:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410e1a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->7450623] (req 4026368->7450623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656409:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656413:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656413:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656416:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.656689:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.656698:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.656708:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.656710:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468510656
00000100:00100000:1.0:1651532138.656728:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.656733:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468510720
00000100:00100000:0.0:1651532138.656742:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4437
00000100:00100000:1.0:1651532138.656744:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468510784
00000100:00100000:0.0:1651532138.656744:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468510656:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532138.656751:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468510848
00000100:00100000:1.0:1651532138.656759:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4078
00000100:00100000:1.0:1651532138.656760:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468510784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.656762:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656764:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.656767:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410f08 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b07d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656768:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532138.656769:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656771:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532138.656772:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656775:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.656778:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656779:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410f08 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b07d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.656781:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656783:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410f08 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b07d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.656789:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532138.656789:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4438
00000100:00100000:0.0:1651532138.656791:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468510720:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532138.656797:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.656802:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468510784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.656819:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4078
00010000:00010000:0.0:1651532138.656821:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.656822:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.656824:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4079
00010000:00010000:0.0:1651532138.656825:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00000100:00100000:1.0:1651532138.656826:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468510848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.656826:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656829:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.656830:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656831:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410f16 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b084 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656833:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656836:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.656838:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410f16 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b084 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.656842:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410f16 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b084 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.656843:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656846:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532138.656846:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.656852:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468510848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.656862:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4079
00000100:00100000:0.0:1651532138.656865:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468507008:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474955us (475003us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532138.656868:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4429
00010000:00010000:1.0:1651532138.656870:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656873:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.656874:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656878:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656883:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656885:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410e4b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->9707519] (req 1036288->9707519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656897:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656900:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656914:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656918:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532138.656919:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.656925:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468506176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 516835us (516900us total) trans 0 rc 49152/49152
00010000:00010000:0.0:1651532138.656925:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.656928:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4428
00010000:00010000:0.0:1651532138.656930:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.656931:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.656932:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656935:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656938:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.656938:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.656939:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656942:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656964:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656967:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.656968:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656970:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410e28 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->10186751] (req 163840->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656976:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.656979:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.657204:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.657215:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.657225:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.657233:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468511168
00000100:00100000:1.0:1651532138.657256:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4439
00000100:00100000:1.0:1651532138.657258:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468511168:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532138.657271:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.657275:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532138.657277:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.657280:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.657280:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.657292:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468510976
00000100:00100000:0.0:1651532138.657344:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468511040
00000100:00100000:0.0:1651532138.657353:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4080
00000100:00100000:0.0:1651532138.657355:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468510976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.657358:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.657363:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410f24 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b08b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.657371:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410f24 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b08b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657376:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f410f24 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b08b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657379:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532138.657383:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468511104
00000100:00100000:0.0:1651532138.657390:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468510976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (186us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.657393:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4080
00000100:00100000:1.0:1651532138.657394:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4440
00000100:00100000:1.0:1651532138.657396:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468511104:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532138.657398:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4081
00000100:00100000:0.0:1651532138.657399:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468511040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.657402:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.657403:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.657404:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410f32 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b092 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.657407:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.657408:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532138.657408:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.657413:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.657413:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410f32 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b092 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657417:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f410f32 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b092 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657420:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532138.657425:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468511040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (210us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.657428:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4081
00000100:00100000:1.0:1651532138.657430:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.657445:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468511360
00000100:00100000:0.0:1651532138.657455:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4082
00000100:00100000:0.0:1651532138.657456:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468511360:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532138.657459:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532138.657459:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.657462:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410f39 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b099 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.657468:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410f39 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b099 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657472:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f410f39 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b099 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657475:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532138.657481:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468511360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.657484:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4082
00000100:00100000:0.0:1651532138.657488:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468511424
00000100:00100000:0.0:1651532138.657492:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4083
00000100:00100000:0.0:1651532138.657493:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468511424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.657496:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.657498:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410f40 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0a0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.657503:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410f40 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0a0 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657507:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410f40 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0a0 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657510:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532138.657520:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468511424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.657522:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4083
00000100:00100000:0.0:1651532138.657854:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.657862:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.657872:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.657873:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468511616
00000100:00100000:0.0:1651532138.657878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.657881:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468511680
00000100:00100000:1.0:1651532138.657883:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468511872
00000100:00100000:0.0:1651532138.657884:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468511936
00000100:00100000:1.0:1651532138.657887:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4084
00000100:00100000:1.0:1651532138.657888:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754468511616:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532138.657890:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4085
00010000:00010000:1.0:1651532138.657892:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532138.657892:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754468511680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.657895:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410f47 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0a7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.657897:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.657901:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410f4e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0ae expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.657903:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410f47 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0a7 expref: 24 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.657908:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410f47 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0a7 expref: 25 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657908:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410f4e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0ae expref: 25 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.657911:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532138.657912:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410f4e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0ae expref: 24 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657915:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532138.657922:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754468511616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.657923:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754468511680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.657924:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4084
00000100:00100000:0.0:1651532138.657926:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4085
00000100:00100000:1.0:1651532138.657929:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4086
00000100:00100000:1.0:1651532138.657931:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468511872:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532138.657931:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4087
00000100:00100000:0.0:1651532138.657932:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468511936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.657933:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.657935:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410f55 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0b5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.657935:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.657937:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410f5c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0bc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.657941:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410f55 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0b5 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657942:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410f5c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0bc expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.657945:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410f55 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0b5 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.657946:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410f5c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0bc expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.657948:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532138.657952:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532138.657954:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468511872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.657956:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4086
00000100:00100000:0.0:1651532138.657957:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468511936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.657960:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4087
00000100:00100000:0.0:1651532138.658300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.658307:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468512128
00000100:00100000:0.0:1651532138.658313:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4088
00000100:00100000:0.0:1651532138.658315:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468512128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.658318:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.658322:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f63 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0c3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.658329:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f63 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0c3 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.658343:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f63 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0c3 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.658347:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532138.658362:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468512128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.658365:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4088
00000100:00100000:0.0:1651532138.658600:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.658607:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468512576
00000100:00100000:0.0:1651532138.658614:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4089
00000100:00100000:0.0:1651532138.658615:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468512576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.658619:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.658622:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f6a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0ca expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.658629:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f6a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0ca expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.658633:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f6a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0ca expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.658636:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532138.658652:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468512576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532138.658654:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4089
00000001:00080000:1.0:1651532138.781300:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793878 is committed
00010000:00010000:1.0:1651532138.781321:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781325:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781348:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.781356:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468507520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474039us (474100us total) trans 158913793878 rc 0/0
00010000:00010000:0.0:1651532138.781357:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.781359:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4431
00000100:00100000:0.0:1651532138.781377:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b24d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468506944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599453us (599499us total) trans 158913793877 rc 0/0
00010000:00010000:1.0:1651532138.781378:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.781380:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4430
00010000:00010000:1.0:1651532138.781382:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.781383:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781386:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781393:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781396:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f410e67 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1482752->6037503] (req 1482752->6037503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781399:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781402:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.781402:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781405:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781408:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.781409:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.781409:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781412:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781419:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781421:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781428:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781430:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f410e52 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9809920->9814015] (req 9809920->9814015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.781785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.781819:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.781832:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468512896
00000100:00100000:0.0:1651532138.781833:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.781839:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.781840:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468512768
00000100:00100000:1.0:1651532138.781852:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4090
00000100:00100000:1.0:1651532138.781853:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468512896:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532138.781855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532138.781857:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.781861:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410f71 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0d8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.781861:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468512832
00010000:00010000:1.0:1651532138.781866:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.781869:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410f71 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0d8 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532138.781872:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468512960
00010000:00010000:1.0:1651532138.781873:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f410f71 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0d8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.781876:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532138.781881:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4441
00000100:00100000:0.0:1651532138.781883:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468512832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532138.781890:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.781892:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468512896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (108us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.781895:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4090
00010000:00010000:0.0:1651532138.781895:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532138.781896:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781899:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.781900:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468513152
00010000:00010000:0.0:1651532138.781901:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.781904:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4091
00010000:00010000:0.0:1651532138.781904:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:1.0:1651532138.781905:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468512768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532138.781905:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781908:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.781909:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781910:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410f7f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0d1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781912:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781915:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781918:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.781919:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410f7f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0d1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.781919:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781923:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f410f7f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0d1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.781927:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532138.781931:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.781932:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468512768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.781934:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4091
00010000:00010000:0.0:1651532138.781934:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.781938:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4092
00000100:00100000:1.0:1651532138.781940:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468513152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.781942:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.781944:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410f86 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0df expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.781947:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.781949:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410f86 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0df expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532138.781949:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c75e9d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468508928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375023us (375066us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532138.781952:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4433
00010000:00010000:1.0:1651532138.781953:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f410f86 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0df expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.781955:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532138.781957:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4442
00000100:00100000:0.0:1651532138.781958:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468512960:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532138.781960:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468513152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.781963:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4092
00010000:00010000:0.0:1651532138.781964:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781970:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.781971:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781974:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532138.781974:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781978:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781981:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781988:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781991:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532138.781992:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781995:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.781999:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.782000:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.782000:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.782006:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.782012:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.782015:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f410ead lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10117119] (req 1691648->10117119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.782020:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.782023:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.782436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.782447:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.782479:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468513344
00000100:00100000:1.0:1651532138.782486:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468513600
00000100:00100000:1.0:1651532138.782491:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4093
00000100:00100000:1.0:1651532138.782492:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468513344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.782495:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.782499:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410f94 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0e6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.782506:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410f94 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0e6 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.782510:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f410f94 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0e6 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.782513:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532138.782525:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468513344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.782528:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4093
00000100:00100000:1.0:1651532138.782532:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4094
00000100:00100000:1.0:1651532138.782534:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468513600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.782536:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.782538:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410f9b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0ed expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.782547:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410f9b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0ed expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.782550:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410f9b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0ed expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.782553:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532138.782558:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468513600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.782561:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4094
00000100:00100000:1.0:1651532138.782906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.782914:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.782920:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468513792
00000100:00100000:1.0:1651532138.782926:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468513920
00000100:00100000:1.0:1651532138.782930:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4095
00000100:00100000:1.0:1651532138.782932:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468513792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.782935:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.782938:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fa2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0f4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.782945:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fa2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0f4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.782949:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fa2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0f4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.782955:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532138.782968:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468513792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.782971:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4095
00000100:00100000:1.0:1651532138.782976:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4096
00000100:00100000:1.0:1651532138.782977:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468513920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.782980:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.782982:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410fa9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b0fb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.782988:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410fa9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0fb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.783001:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410fa9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b0fb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.783004:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532138.783013:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468513920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.783016:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4096
00000100:00100000:0.0:1651532138.783222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.783241:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468514048
00000100:00100000:1.0:1651532138.783248:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4097
00000100:00100000:1.0:1651532138.783249:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468514048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.783253:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.783256:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410fb0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b102 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.783263:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410fb0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b102 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.783267:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410fb0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b102 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.783270:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532138.783280:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468514048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.783283:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4097
00000001:00080000:1.0:1651532138.881347:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793879 is committed
00010000:00010000:0.0:1651532138.881382:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.881387:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.881405:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b5a93ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468508864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474470us (474512us total) trans 158913793879 rc 0/0
00000100:00100000:0.0:1651532138.881409:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4434
00010000:00010000:0.0:1651532138.881416:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.881419:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532138.881421:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.881423:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.881428:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.881429:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532138.881430:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.881433:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.881445:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.881448:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f410eb4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [806912->9658367] (req 806912->9658367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881456:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881460:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881620:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881624:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.881640:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468509568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316562us (316610us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532138.881645:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4435
00010000:00010000:1.0:1651532138.881651:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881655:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532138.881656:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881659:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881664:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.881664:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532138.881665:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881668:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881674:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881677:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f410ec9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1990656->8445951] (req 1990656->8445951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881682:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.881685:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.881976:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.881984:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.881995:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.881995:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468514304
00000100:00100000:1.0:1651532138.882001:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.882006:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468514368
00000100:00100000:1.0:1651532138.882008:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532138.882016:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4443
00000100:00100000:0.0:1651532138.882018:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468514304:12345-10.240.43.64@tcp:4:fio
00010000:00010000:0.0:1651532138.882025:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.882029:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532138.882030:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.882033:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532138.882034:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.882038:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.882042:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532138.882049:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4444
00000100:00100000:0.0:1651532138.882051:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468514368:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532138.882055:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.882059:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532138.882059:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.882062:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532138.882063:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.882066:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.882069:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532138.882077:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468514432
00000100:00100000:0.0:1651532138.882081:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468514496
00000100:00100000:0.0:1651532138.882085:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468514624
00000100:00100000:1.0:1651532138.882087:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4098
00000100:00100000:1.0:1651532138.882089:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468514432:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532138.882089:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4099
00000100:00100000:0.0:1651532138.882091:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468514496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.882092:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532138.882094:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.882096:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410fc5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b109 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532138.882096:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410fcc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b110 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.882104:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410fc5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b109 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.882105:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410fcc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b110 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.882109:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f410fc5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b109 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532138.882110:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410fcc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b110 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.882112:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532138.882113:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532138.882126:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468514432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (131us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.882129:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4098
00000100:00100000:0.0:1651532138.882132:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468514496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.882133:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4100
00000100:00100000:1.0:1651532138.882135:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b94b4005 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468514624:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532138.882135:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4099
00010000:00010000:1.0:1651532138.882139:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.882142:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410fd3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b117 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.882147:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410fd3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b117 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.882151:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f410fd3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b117 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.882154:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532138.882184:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b94b4005 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468514624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (176us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.882187:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4100
00000100:00100000:0.0:1651532138.882398:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.882417:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468514944
00000100:00100000:1.0:1651532138.882428:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4101
00000100:00100000:1.0:1651532138.882430:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468514944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.882433:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.882436:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fda lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b11e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.882444:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fda lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b11e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.882448:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fda lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b11e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.882454:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532138.882464:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468514944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.882467:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4101
00000100:00100000:0.0:1651532138.882558:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532138.882569:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468515072
00000100:00100000:1.0:1651532138.882579:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4102
00000100:00100000:1.0:1651532138.882581:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468515072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532138.882584:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532138.882587:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b125 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532138.882593:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b125 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.882597:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b125 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532138.882600:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532138.882610:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468515072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532138.882612:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4102
00000001:00080000:1.0:1651532139.031354:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793880 is committed
00010000:00010000:1.0:1651532139.031370:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.031377:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.031399:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468509504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466286us (466356us total) trans 158913793880 rc 0/0
00000100:00100000:1.0:1651532139.031403:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4436
00010000:00010000:0.0:1651532139.031405:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.031413:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532139.031414:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.031418:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.031424:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.031424:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.031425:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.031429:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.031437:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.031440:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f410ed7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1744896->7794687] (req 1744896->7794687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.031445:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.031448:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.031815:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.031824:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.031832:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.031838:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468515456
00000100:00100000:1.0:1651532139.031851:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468515392
00000100:00100000:1.0:1651532139.031857:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4445
00000100:00100000:1.0:1651532139.031859:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000005eb034c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468515456:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532139.031866:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.031871:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532139.031872:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.031875:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.031883:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4446
00000100:00100000:1.0:1651532139.031884:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005259aa0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468515392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532139.031889:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.031892:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532139.031893:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.031894:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468515648
00010000:00010000:1.0:1651532139.031895:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.031898:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532139.031898:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.031902:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.031904:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4103
00010000:00010000:1.0:1651532139.031905:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.031906:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f32eacfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468515648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.031909:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.031910:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.031914:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ff6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b12c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.031922:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ff6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b12c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.031927:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ff6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b12c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.031930:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532139.031948:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f32eacfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468515648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.031951:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4103
00000001:00080000:1.0:1651532139.123024:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793881 is committed
00010000:00010000:0.0:1651532139.123056:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123061:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.123085:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468510656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466340us (466387us total) trans 158913793881 rc 0/0
00000100:00100000:0.0:1651532139.123089:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4437
00010000:00010000:0.0:1651532139.123097:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123103:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532139.123104:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123107:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123112:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.123113:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.123113:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123116:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123120:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.123120:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.123121:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123124:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123126:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.123127:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.123127:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123130:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123141:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123144:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f410f01 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->10465279] (req 1613824->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123146:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123150:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123151:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123153:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123167:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123171:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123181:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123185:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.123192:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468511168:12345-10.240.43.64@tcp:3:fio.0 Request processed in 465934us (465966us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532139.123195:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4439
00010000:00010000:1.0:1651532139.123203:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123206:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532139.123207:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123210:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123216:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123218:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f410f1d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5500928->5505023] (req 5500928->5505023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123409:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123414:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.123435:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468510720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466643us (466726us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532139.123438:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4438
00010000:00010000:0.0:1651532139.123446:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123449:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532139.123450:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123453:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123459:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123480:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f410f0f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1409024->10055679] (req 1409024->10055679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.123487:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.123497:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468516032
00000100:00100000:1.0:1651532139.123506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.123523:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468516096
00000100:00100000:1.0:1651532139.123533:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4447
00000100:00100000:1.0:1651532139.123535:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000711d02d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468516032:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532139.123542:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4448
00000100:00100000:0.0:1651532139.123545:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468516096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532139.123553:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123557:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.123558:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123561:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532139.123562:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123562:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123568:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.123569:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532139.123570:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123575:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123575:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123579:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.123593:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.123603:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468516160
00000100:00100000:0.0:1651532139.123614:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4104
00000100:00100000:0.0:1651532139.123616:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468516160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.123619:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.123622:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41100b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b133 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123629:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41100b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b133 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.123634:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41100b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b133 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.123637:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532139.123650:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468516160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.123653:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4104
00000100:00100000:1.0:1651532139.123719:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.123729:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468516224
00000100:00100000:1.0:1651532139.123730:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.123737:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468516288
00000100:00100000:1.0:1651532139.123738:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4105
00000100:00100000:1.0:1651532139.123740:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468516224:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532139.123742:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4106
00000100:00100000:0.0:1651532139.123743:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468516288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.123744:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.123747:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411012 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b13a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123747:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.123750:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411019 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b141 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.123755:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411012 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b13a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.123757:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411019 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b141 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.123760:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411012 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b13a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.123761:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411019 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b141 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.123763:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532139.123764:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532139.123773:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468516224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.123773:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468516288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (44us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.123776:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4106
00000100:00100000:1.0:1651532139.123778:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4105
00000100:00100000:1.0:1651532139.123915:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.123926:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468516416
00000100:00100000:0.0:1651532139.123936:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4107
00000100:00100000:0.0:1651532139.123938:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008a6a04a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468516416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.123941:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.123945:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411020 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b148 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.123952:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411020 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b148 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.123956:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411020 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b148 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.123959:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532139.123972:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008a6a04a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468516416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.123974:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4107
00000100:00100000:1.0:1651532139.124143:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.124153:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468516672
00000100:00100000:0.0:1651532139.124164:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4108
00000100:00100000:0.0:1651532139.124165:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468516672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.124169:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.124172:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411027 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b14f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.124179:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411027 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b14f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.124183:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411027 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b14f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.124186:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532139.124198:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468516672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.124201:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4108
00000100:00100000:1.0:1651532139.124243:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.124253:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468516800
00000100:00100000:0.0:1651532139.124262:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4109
00000100:00100000:0.0:1651532139.124263:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468516800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.124268:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.124271:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41102e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b156 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.124277:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41102e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b156 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.124281:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41102e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b156 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.124284:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532139.124295:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468516800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.124297:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4109
00000001:00080000:1.0:1651532139.189716:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793882 is committed
00010000:00010000:0.0:1651532139.189746:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.189751:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.189772:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468511104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532375us (532493us total) trans 158913793882 rc 0/0
00000100:00100000:0.0:1651532139.189776:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4440
00010000:00010000:0.0:1651532139.189783:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.189787:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532139.189788:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.189791:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.189796:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.189797:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.189798:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.189801:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.189820:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.189823:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f410f2b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10260480->10264575] (req 10260480->10264575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.189826:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.189831:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.190032:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.190050:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468517056
00000100:00100000:1.0:1651532139.190056:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.190086:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468516992
00000100:00100000:0.0:1651532139.190094:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4449
00000100:00100000:0.0:1651532139.190096:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468517056:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532139.190102:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.190107:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532139.190108:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.190111:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532139.190112:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.190116:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.190119:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.190126:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4450
00000100:00100000:0.0:1651532139.190128:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468516992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532139.190132:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.190136:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532139.190137:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.190139:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532139.190140:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.190143:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.190146:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.190159:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.190177:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468517120
00000100:00100000:0.0:1651532139.190184:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4110
00000100:00100000:0.0:1651532139.190185:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468517120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.190188:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.190191:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411043 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b15d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.190198:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411043 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b15d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.190202:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411043 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b15d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.190205:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532139.190219:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468517120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.190221:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4110
00000001:00080000:1.0:1651532139.264983:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793883 is committed
00010000:00010000:1.0:1651532139.264998:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.265002:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.265020:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468512832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 483136us (483201us total) trans 158913793883 rc 0/0
00000100:00100000:1.0:1651532139.265023:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4441
00010000:00010000:1.0:1651532139.265030:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.265036:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532139.265037:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.265040:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.265045:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.265046:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.265047:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.265049:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.265062:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.265065:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f410f78 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->10481663] (req 2768896->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265079:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265084:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.265500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.265513:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.265520:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.265528:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468517248
00000100:00100000:1.0:1651532139.265535:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468517376
00000100:00100000:0.0:1651532139.265542:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468517440
00000100:00100000:1.0:1651532139.265543:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4111
00000100:00100000:1.0:1651532139.265545:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468517248:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532139.265546:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4112
00000100:00100000:0.0:1651532139.265548:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468517376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.265550:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.265552:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.265554:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41104a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b164 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265556:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411051 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b16b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.265560:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.265562:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.265563:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41104a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b164 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.265565:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411051 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b16b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.265567:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41104a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b164 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.265569:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411051 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b16b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.265571:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532139.265573:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532139.265581:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468517248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.265582:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468517376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.265584:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4111
00000100:00100000:0.0:1651532139.265586:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4112
00000100:00100000:1.0:1651532139.265589:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4113
00000100:00100000:1.0:1651532139.265591:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468517440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.265593:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.265596:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411058 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b172 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265600:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265603:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.265607:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.265609:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411058 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b172 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.265613:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411058 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b172 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532139.265615:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468512960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483656us (483776us total) trans 0 rc 45056/45056
00000100:00100000:0.0:1651532139.265618:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4442
00010000:00010000:1.0:1651532139.265619:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532139.265623:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.265625:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468517440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (106us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532139.265627:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532139.265628:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4113
00010000:00010000:0.0:1651532139.265628:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265631:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265635:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.265636:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.265637:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265640:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265646:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265649:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f410f8d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1495040->10301439] (req 1495040->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265654:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.265657:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.266101:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.266111:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.266113:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468517696
00000100:00100000:1.0:1651532139.266119:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.266125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.266125:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468517760
00000100:00100000:0.0:1651532139.266135:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4451
00000100:00100000:1.0:1651532139.266136:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.266137:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468517696:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532139.266146:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532139.266149:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.266156:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4452
00000100:00100000:1.0:1651532139.266158:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468517760:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532139.266158:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532139.266159:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.266162:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.266164:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532139.266165:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.266167:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.266169:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.266171:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532139.266172:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.266175:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532139.266176:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.266180:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.266181:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.266183:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.266187:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.266190:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468517824
00000100:00100000:1.0:1651532139.266195:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468517952
00000100:00100000:0.0:1651532139.266195:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468518080
00000100:00100000:0.0:1651532139.266197:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468518208
00000100:00100000:0.0:1651532139.266201:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4114
00000100:00100000:0.0:1651532139.266202:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468517824:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532139.266203:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4115
00000100:00100000:1.0:1651532139.266204:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468518080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.266205:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.266207:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.266207:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41106d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b179 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.266209:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411074 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b187 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.266214:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41106d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b179 expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.266216:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411074 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b187 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.266219:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41106d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b179 expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.266221:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411074 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b187 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.266222:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532139.266224:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532139.266237:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468517824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.266240:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4114
00000100:00100000:1.0:1651532139.266243:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468518080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.266245:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4116
00000100:00100000:1.0:1651532139.266246:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4115
00000100:00100000:0.0:1651532139.266246:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468517952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.266249:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.266251:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41107b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b180 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.266252:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4117
00000100:00100000:1.0:1651532139.266253:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468518208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.266256:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.266257:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41107b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b180 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.266258:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411082 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b18e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.266261:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41107b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b180 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.266265:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411082 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b18e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.266265:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532139.266269:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411082 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b18e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532139.266271:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468517952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (145us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532139.266272:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532139.266273:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4116
00000100:00100000:1.0:1651532139.266278:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468518208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (132us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.266280:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4117
00000100:00100000:1.0:1651532139.266579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.266590:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468518336
00000100:00100000:1.0:1651532139.266591:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.266599:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4118
00000100:00100000:1.0:1651532139.266601:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468518336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.266604:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.266608:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411089 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b195 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.266611:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468518400
00000100:00100000:0.0:1651532139.266618:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4119
00000100:00100000:0.0:1651532139.266620:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468518400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.266621:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411089 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b195 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.266623:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.266625:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411089 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b195 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.266626:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411090 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b19c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.266629:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532139.266634:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411090 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b19c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.266637:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411090 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b19c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532139.266638:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468518336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.266641:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4118
00010000:00010000:0.0:1651532139.266641:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532139.266649:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468518400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.266652:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4119
00000100:00100000:1.0:1651532139.266667:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.266680:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468518592
00000100:00100000:0.0:1651532139.266686:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4120
00000100:00100000:0.0:1651532139.266688:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468518592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.266691:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.266693:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411097 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1a3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.266700:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411097 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1a3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.266704:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411097 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1a3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.266707:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532139.266723:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468518592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.266725:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4120
00000100:00100000:1.0:1651532139.266897:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.266907:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468518784
00000100:00100000:0.0:1651532139.266913:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4121
00000100:00100000:0.0:1651532139.266915:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468518784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.266918:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.266921:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41109e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1aa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.266928:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41109e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1aa expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.266932:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41109e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1aa expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.266938:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532139.266951:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468518784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.266954:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4121
00000001:00080000:1.0:1651532139.414743:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793884 is committed
00010000:00010000:0.0:1651532139.414774:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.414779:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.414801:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468514304:12345-10.240.43.64@tcp:4:fio Request processed in 532782us (532825us total) trans 158913793884 rc 0/0
00010000:00010000:1.0:1651532139.414813:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.414815:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4443
00010000:00010000:1.0:1651532139.414817:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532139.414818:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.414822:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.414827:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.414828:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.414829:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.414832:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.414835:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.414836:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.414837:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.414839:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.414851:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.414858:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.414862:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f410fb7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1134592->9019391] (req 1134592->9019391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.414862:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.414872:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.414875:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.415238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.415246:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.415252:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532139.415275:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415279:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.415283:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.415287:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.415304:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000005eb034c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468515456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 383444us (383501us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532139.415307:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4445
00000100:00100000:1.0:1651532139.415310:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468514368:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533258us (533325us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532139.415314:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4444
00010000:00010000:0.0:1651532139.415314:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415318:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532139.415319:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415322:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415327:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415330:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f410fe8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1634304->7446527] (req 1634304->7446527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.415359:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468519232
00010000:00010000:0.0:1651532139.415367:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415370:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532139.415371:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415374:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.415375:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468519360
00000100:00100000:1.0:1651532139.415378:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468519488
00010000:00010000:0.0:1651532139.415378:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.415379:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.415380:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.415381:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4122
00000100:00100000:1.0:1651532139.415382:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468519232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.415383:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.415386:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.415390:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4110a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1b1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415393:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415396:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f410fbe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->8372223] (req 385024->8372223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.415404:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4110a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1b1 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532139.415405:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4123
00000100:00100000:0.0:1651532139.415407:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468519360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.415408:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4110a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1b1 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.415411:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.415412:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532139.415414:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4110ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1b8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.415425:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468519232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (187us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.415428:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4122
00010000:00010000:0.0:1651532139.415429:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4110ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1b8 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532139.415433:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4124
00010000:00010000:0.0:1651532139.415433:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4110ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1b8 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532139.415434:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468519488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.415437:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.415437:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532139.415439:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4110b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1bf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.415445:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4110b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1bf expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532139.415445:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468519360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (199us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.415448:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4123
00010000:00010000:1.0:1651532139.415449:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4110b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1bf expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.415452:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532139.415458:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468519488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (206us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.415461:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4124
00010000:00010000:1.0:1651532139.415468:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.415471:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.415720:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.415734:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.415740:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468519616
00000100:00100000:0.0:1651532139.415742:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468519680
00000100:00100000:1.0:1651532139.415755:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4453
00000100:00100000:1.0:1651532139.415757:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468519616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532139.415763:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.415768:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532139.415774:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.415778:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532139.415778:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.415778:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4454
00000100:00100000:0.0:1651532139.415780:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468519680:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532139.415783:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.415786:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415788:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415792:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532139.415793:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415796:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532139.415797:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415801:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.415819:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.415976:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.415984:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.415994:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.415995:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468519936
00000100:00100000:0.0:1651532139.416003:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468520128
00000100:00100000:1.0:1651532139.416012:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468520192
00000100:00100000:1.0:1651532139.416017:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4125
00000100:00100000:1.0:1651532139.416018:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468519936:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532139.416019:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4126
00000100:00100000:0.0:1651532139.416021:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468520128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.416024:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.416028:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4110c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1cd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.416035:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4110c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1cd expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.416036:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.416040:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1c6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.416040:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4110c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1cd expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.416043:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532139.416049:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1c6 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.416053:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1c6 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532139.416057:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468520128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.416060:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4126
00010000:00010000:1.0:1651532139.416063:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532139.416065:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4127
00000100:00100000:0.0:1651532139.416067:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468520192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.416069:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532139.416072:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468519936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (97us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532139.416072:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4110d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1d4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.416075:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4125
00010000:00010000:0.0:1651532139.416078:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4110d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1d4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.416082:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4110d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1d4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.416085:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532139.416091:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468520192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.416094:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4127
00000100:00100000:0.0:1651532139.416301:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.416324:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468520384
00000100:00100000:0.0:1651532139.416341:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4128
00000100:00100000:0.0:1651532139.416343:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468520384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.416346:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.416350:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4110dd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1db expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.416357:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4110dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1db expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532139.416360:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532139.416361:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4110dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1db expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.416364:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532139.416374:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468520384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.416376:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4128
00000100:00100000:0.0:1651532139.416380:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468520448
00000100:00100000:0.0:1651532139.416389:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4129
00000100:00100000:0.0:1651532139.416391:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468520448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.416393:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.416396:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4110e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1e2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.416401:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4110e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1e2 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.416405:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4110e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1e2 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.416408:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532139.416430:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468520448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.416433:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4129
00000100:00100000:0.0:1651532139.416477:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.416484:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468520640
00000100:00100000:0.0:1651532139.416490:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4130
00000100:00100000:0.0:1651532139.416491:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468520640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.416494:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.416498:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4110eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1e9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.416504:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4110eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1e9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.416508:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4110eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1e9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.416512:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532139.416527:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468520640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.416530:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4130
00000100:00100000:0.0:1651532139.416646:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.416653:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468520768
00000100:00100000:0.0:1651532139.416659:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4131
00000100:00100000:0.0:1651532139.416661:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468520768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.416664:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.416667:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4110f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1f0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.416673:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4110f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1f0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.416677:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4110f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1f0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.416681:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532139.416696:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468520768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.416698:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4131
00000001:00080000:1.0:1651532139.481437:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793885 is committed
00010000:00010000:1.0:1651532139.481453:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481457:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.481480:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005259aa0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468515392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449594us (449655us total) trans 158913793885 rc 0/0
00000100:00100000:1.0:1651532139.481485:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4446
00010000:00010000:1.0:1651532139.481493:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481496:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532139.481497:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481500:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481505:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.481506:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.481507:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481510:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481513:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.481514:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.481514:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481526:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481539:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481545:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f410fef lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [901120->9527295] (req 901120->9527295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481551:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.481552:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481554:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.481560:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.481586:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.481590:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.481607:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468516096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358061us (358100us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651532139.481610:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.481610:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4448
00010000:00010000:1.0:1651532139.481614:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532139.481615:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481618:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481623:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481626:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f410ffd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1503232->1507327] (req 1503232->1507327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.481896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.481905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.481915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.481935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.481944:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.481955:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468521088
00000100:00100000:0.0:1651532139.481966:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468521152
00000100:00100000:1.0:1651532139.481968:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4455
00000100:00100000:1.0:1651532139.481971:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468521088:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532139.481973:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4456
00000100:00100000:0.0:1651532139.481975:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468521152:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532139.481979:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481983:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532139.481984:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481987:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532139.481988:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.481989:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.481992:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.481994:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532139.481995:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.482001:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532139.482001:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.482005:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.482006:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.482010:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.482014:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468521280
00000100:00100000:0.0:1651532139.482019:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468521408
00000100:00100000:1.0:1651532139.482021:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468521536
00000100:00100000:0.0:1651532139.482024:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4132
00000100:00100000:0.0:1651532139.482026:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468521280:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532139.482027:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4133
00000100:00100000:1.0:1651532139.482029:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468521408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.482029:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.482031:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411107 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1f7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.482032:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.482034:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41110e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b1fe expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.482038:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411107 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1f7 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.482042:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41110e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1fe expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.482043:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411107 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1f7 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.482046:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532139.482049:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41110e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b1fe expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.482052:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532139.482060:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468521280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.482065:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4132
00000100:00100000:0.0:1651532139.482070:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4134
00000100:00100000:0.0:1651532139.482072:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468521536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.482074:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.482077:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411115 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b205 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.482082:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411115 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b205 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532139.482083:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468521408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (148us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.482086:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4133
00010000:00010000:0.0:1651532139.482086:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411115 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b205 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.482089:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532139.482095:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468521536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (151us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.482097:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4134
00000100:00100000:0.0:1651532139.482390:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.482397:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468521728
00000100:00100000:0.0:1651532139.482404:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4135
00000100:00100000:0.0:1651532139.482406:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468521728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.482409:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.482412:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41111c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b20c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.482422:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41111c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b20c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.482426:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41111c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b20c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.482429:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532139.482457:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468521728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.482460:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4135
00000100:00100000:0.0:1651532139.482481:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.482487:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468521920
00000100:00100000:0.0:1651532139.482493:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4136
00000100:00100000:0.0:1651532139.482494:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468521920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.482498:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.482500:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411123 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b213 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.482507:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411123 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b213 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.482511:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411123 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b213 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.482514:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532139.482529:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468521920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.482532:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4136
00000001:00080000:1.0:1651532139.648122:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793886 is committed
00002000:00010000:1.0:1651532139.648135:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532138 -> 1651532139
00002000:00010000:1.0:1651532139.648137:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532138 -> 1651532139
00010000:00010000:1.0:1651532139.648139:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648143:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.648164:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000711d02d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468516032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524628us (524678us total) trans 158913793886 rc 0/0
00000100:00100000:1.0:1651532139.648167:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4447
00010000:00010000:0.0:1651532139.648167:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648172:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532139.648173:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648177:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648183:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.648183:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.648184:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648187:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648195:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648198:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411004 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9887743] (req 1523712->9887743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648202:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648214:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.648492:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.648501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.648514:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.648525:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468522112
00000100:00100000:1.0:1651532139.648529:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468522176
00000100:00100000:0.0:1651532139.648538:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4457
00000100:00100000:0.0:1651532139.648539:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468522112:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532139.648540:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4458
00000100:00100000:1.0:1651532139.648542:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468522176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532139.648546:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648549:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648551:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532139.648552:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648554:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532139.648555:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648559:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.648560:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648563:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532139.648563:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648567:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648568:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648571:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648571:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.648579:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468522240
00010000:00010000:1.0:1651532139.648581:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648584:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.648604:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4137
00000100:00100000:1.0:1651532139.648606:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468517056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458509us (458574us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532139.648606:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468522240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.648609:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532139.648610:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4449
00010000:00010000:0.0:1651532139.648612:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411138 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b21a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648617:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648617:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.648620:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532139.648620:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411138 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b21a expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.648621:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648624:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648629:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.648629:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411138 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b21a expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.648630:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.648630:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648633:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648633:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532139.648643:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648647:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411035 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [843776->10211327] (req 843776->10211327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.648648:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468522240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.648651:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4137
00010000:00010000:0.0:1651532139.648658:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.648661:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532139.648661:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.648677:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.648708:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.648716:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468522432
00000100:00100000:1.0:1651532139.648722:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468522304
00000100:00100000:1.0:1651532139.648724:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468522496
00000100:00100000:1.0:1651532139.648726:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4138
00000100:00100000:1.0:1651532139.648728:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468522432:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532139.648729:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4139
00010000:00010000:1.0:1651532139.648732:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532139.648732:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468522304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.648735:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41113f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b228 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648735:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.648738:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411146 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b221 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.648743:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41113f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b228 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.648746:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411146 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b221 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.648747:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41113f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b228 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.648750:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411146 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b221 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.648751:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532139.648756:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532139.648760:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468522432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.648762:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4138
00000100:00100000:0.0:1651532139.648765:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468522304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.648768:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4139
00000100:00100000:0.0:1651532139.648773:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4140
00000100:00100000:0.0:1651532139.648786:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468522496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.648789:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.648792:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41114d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b22f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.648798:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41114d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b22f expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.648801:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41114d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b22f expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.648818:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532139.648830:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468522496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.648833:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4140
00000100:00100000:1.0:1651532139.649166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.649183:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468522944
00000100:00100000:0.0:1651532139.649191:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4141
00000100:00100000:0.0:1651532139.649193:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468522944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.649196:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.649199:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411154 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b236 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.649206:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411154 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b236 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.649210:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411154 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b236 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.649214:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532139.649229:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468522944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.649232:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4141
00000100:00100000:1.0:1651532139.649471:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.649482:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468523264
00000100:00100000:0.0:1651532139.649490:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4142
00000100:00100000:0.0:1651532139.649491:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468523264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.649494:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.649497:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41115b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b23d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.649505:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41115b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b23d expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.649509:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41115b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b23d expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.649512:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532139.649527:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468523264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.649530:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4142
00000001:00080000:1.0:1651532139.690055:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793887 is committed
00010000:00010000:0.0:1651532139.690088:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.690092:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.690112:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468516992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499983us (500056us total) trans 158913793887 rc 0/0
00000100:00100000:0.0:1651532139.690115:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4450
00010000:00010000:1.0:1651532139.690116:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690121:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532139.690122:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690128:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690133:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.690134:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.690135:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690138:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690147:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690150:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41103c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4657152->4661247] (req 4657152->4661247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.690154:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.690158:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.690438:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.690450:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.690454:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468523392
00000100:00100000:1.0:1651532139.690457:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468523456
00000100:00100000:0.0:1651532139.690472:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4459
00000100:00100000:0.0:1651532139.690479:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468523392:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532139.690480:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4460
00000100:00100000:1.0:1651532139.690482:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468523456:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532139.690486:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690498:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.690503:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532139.690504:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.690510:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532139.690511:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690515:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532139.690516:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690521:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532139.690522:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690526:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.690526:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.690529:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.690530:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532139.839802:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793888 is committed
00010000:00010000:0.0:1651532139.839837:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.839842:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.839861:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468517696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 573723us (573759us total) trans 158913793888 rc 0/0
00000100:00100000:0.0:1651532139.839864:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4451
00010000:00010000:0.0:1651532139.839871:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.839874:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532139.839875:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.839878:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.839884:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.839884:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.839885:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.839888:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.839900:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.839903:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41105f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->9891839] (req 655360->9891839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.839912:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.839917:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840109:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840114:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.840131:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468517760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 573972us (574019us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532139.840134:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4452
00010000:00010000:1.0:1651532139.840140:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840144:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532139.840145:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840148:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840153:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.840153:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.840154:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840157:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840164:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840167:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411066 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2174976->9351167] (req 2174976->9351167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840171:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840174:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.840236:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.840244:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468523712
00000100:00100000:0.0:1651532139.840252:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4143
00000100:00100000:0.0:1651532139.840254:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468523712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.840258:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.840262:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411170 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b244 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.840270:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411170 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b244 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.840274:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411170 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b244 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.840281:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532139.840322:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468523712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.840325:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4143
00000100:00100000:1.0:1651532139.840448:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.840465:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468523776
00000100:00100000:1.0:1651532139.840481:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4461
00000100:00100000:1.0:1651532139.840483:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468523776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532139.840490:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840495:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532139.840495:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840498:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532139.840499:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840503:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.840507:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532139.898193:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793889 is committed
00010000:00010000:1.0:1651532139.898208:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898211:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.898234:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468519616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482476us (482514us total) trans 158913793889 rc 0/0
00000100:00100000:1.0:1651532139.898239:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4453
00010000:00010000:1.0:1651532139.898246:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898250:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532139.898251:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898254:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898259:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.898259:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.898260:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898263:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898280:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898283:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4110ba lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [724992->10215423] (req 724992->10215423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.898288:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.898293:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.898582:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.898596:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524096
00000100:00100000:0.0:1651532139.898602:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.898608:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524160
00000100:00100000:0.0:1651532139.898610:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.898618:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4462
00000100:00100000:1.0:1651532139.898620:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468524096:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532139.898623:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532139.898627:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.898629:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532139.898631:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532139.898632:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898641:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532139.898641:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898646:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.898646:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4463
00000100:00100000:0.0:1651532139.898648:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468524160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532139.898649:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.898657:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524288
00000100:00100000:1.0:1651532139.898663:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524224
00000100:00100000:1.0:1651532139.898665:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524352
00000100:00100000:1.0:1651532139.898668:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4144
00010000:00010000:0.0:1651532139.898674:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411185 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.898675:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468524288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.898678:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.898679:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532139.898680:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.898681:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41118c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b252 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.898681:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411185 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.898685:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411185 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898686:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.898689:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41118c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b252 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.898696:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41118c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b252 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.898698:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411185 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898700:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532139.898701:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411185 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.898714:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468524288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.898717:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4144
00000100:00100000:1.0:1651532139.898721:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4145
00000100:00100000:1.0:1651532139.898723:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468524224:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532139.898723:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468524160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 74us (121us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651532139.898726:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532139.898726:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4463
00010000:00010000:1.0:1651532139.898728:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411193 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b24b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898732:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.898734:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411193 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b24b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.898735:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411185 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898738:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411193 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b24b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.898738:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532139.898739:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411185 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898741:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532139.898742:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411185 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.898747:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468524224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (124us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532139.898747:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411185 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.898750:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4145
00010000:00010000:0.0:1651532139.898750:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411185 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.898753:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4146
00000100:00100000:1.0:1651532139.898755:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468524352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.898757:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.898759:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41119a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b259 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.898759:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.898765:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898768:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.898770:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41119a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b259 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.898780:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41119a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b259 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532139.898782:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468519680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483001us (483047us total) trans 0 rc 36864/36864
00010000:00010000:1.0:1651532139.898783:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532139.898785:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4454
00000100:00100000:1.0:1651532139.898789:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468524352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (160us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.898792:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4146
00010000:00010000:1.0:1651532139.898799:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898802:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532139.898814:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532139.898817:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898824:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898829:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.898830:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532139.898831:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898834:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898840:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898843:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4110c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->8998911] (req 897024->8998911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898857:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898879:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.898913:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524480
00000100:00100000:1.0:1651532139.898921:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4147
00000100:00100000:1.0:1651532139.898922:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468524480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.898925:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.898936:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4111a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b260 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.898944:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4111a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b260 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.898951:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4111a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b260 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.898954:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532139.898966:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468524480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (164us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.898969:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4147
00000100:00100000:0.0:1651532139.899274:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.899283:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.899289:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.899299:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524800
00000100:00100000:0.0:1651532139.899299:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.899308:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532139.899316:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524608
00000100:00100000:1.0:1651532139.899319:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524928
00000100:00100000:0.0:1651532139.899320:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524672
00000100:00100000:1.0:1651532139.899323:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4148
00000100:00100000:1.0:1651532139.899324:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468524800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.899328:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532139.899330:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468524736
00010000:00010000:1.0:1651532139.899339:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4111a8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b26e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.899348:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4464
00000100:00100000:0.0:1651532139.899350:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468524672:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532139.899353:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4111a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b26e expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532139.899357:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4111a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b26e expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.899357:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.899360:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532139.899362:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532139.899363:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.899366:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532139.899367:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.899374:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468524800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.899379:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4148
00010000:00010000:0.0:1651532139.899380:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.899384:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4149
00010000:00010000:0.0:1651532139.899384:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.899385:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468524608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532139.899388:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532139.899390:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b267 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532139.899391:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4465
00000100:00100000:0.0:1651532139.899392:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468524736:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532139.899397:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b267 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.899397:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.899400:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532139.899401:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.899417:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532139.899418:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.899422:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b267 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.899422:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532139.899425:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532139.899425:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532139.899431:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468524608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (132us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532139.899433:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4149
00000100:00100000:0.0:1651532139.899435:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4150
00000100:00100000:0.0:1651532139.899437:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468524928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.899440:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.899443:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4111c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b275 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.899450:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4111c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b275 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.899454:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4111c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b275 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.899458:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532139.899467:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468524928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (159us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.899469:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4150
00000100:00100000:0.0:1651532139.899485:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.899516:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468525056
00000100:00100000:0.0:1651532139.899527:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4151
00000100:00100000:0.0:1651532139.899528:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468525056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.899532:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.899535:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4111cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b27c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.899542:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4111cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b27c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.899546:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4111cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b27c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.899550:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532139.899576:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468525056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.899579:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4151
00000100:00100000:0.0:1651532139.899836:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.899843:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468525248
00000100:00100000:0.0:1651532139.899853:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4152
00000100:00100000:0.0:1651532139.899855:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468525248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.899858:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.899862:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b283 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.899869:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b283 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.899873:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b283 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.899876:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532139.899886:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468525248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.899888:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4152
00000100:00100000:0.0:1651532139.900104:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532139.900111:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468525568
00000100:00100000:0.0:1651532139.900125:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4153
00000100:00100000:0.0:1651532139.900127:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468525568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532139.900131:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532139.900134:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4111d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b28a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532139.900141:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4111d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b28a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.900145:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4111d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b28a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532139.900148:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532139.900157:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468525568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532139.900160:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4153
00000001:00080000:1.0:1651532140.006578:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793890 is committed
00010000:00010000:1.0:1651532140.006593:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.006598:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.006621:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468521088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524650us (524726us total) trans 158913793890 rc 0/0
00000100:00100000:1.0:1651532140.006626:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4455
00010000:00010000:1.0:1651532140.006634:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.006638:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.006639:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.006642:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.006647:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.006647:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.006648:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.006651:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.006671:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.006674:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4110f9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1957888->8916991] (req 1957888->8916991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.006683:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.006688:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.006977:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532140.006993:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.006997:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.007014:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2b2196 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468521152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 525039us (525109us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532140.007018:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4456
00010000:00010000:0.0:1651532140.007024:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007028:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532140.007029:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007032:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007037:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532140.007037:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532140.007038:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007041:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007048:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007051:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411100 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1994752->10416127] (req 1994752->10416127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007058:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007061:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.007082:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468525824
00000100:00100000:0.0:1651532140.007096:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4154
00000100:00100000:0.0:1651532140.007098:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e587fb7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468525824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.007101:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.007104:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4111e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b291 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007111:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4111e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b291 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.007116:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4111e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b291 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.007119:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532140.007125:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e587fb7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468525824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (149us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.007128:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4154
00000100:00100000:0.0:1651532140.007626:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.007636:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.007642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.007651:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.007653:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468526016
00000100:00100000:0.0:1651532140.007660:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.007669:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468526144
00000100:00100000:1.0:1651532140.007673:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4466
00000100:00100000:1.0:1651532140.007675:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468526016:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532140.007681:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4467
00010000:00010000:1.0:1651532140.007682:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.007682:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468526144:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532140.007686:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532140.007687:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.007690:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532140.007690:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.007691:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007695:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532140.007696:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007699:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532140.007699:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.007703:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007704:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.007707:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007707:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.007716:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468526272
00000100:00100000:0.0:1651532140.007716:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468526080
00000100:00100000:0.0:1651532140.007725:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468526400
00000100:00100000:0.0:1651532140.007728:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4155
00000100:00100000:1.0:1651532140.007730:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4156
00000100:00100000:0.0:1651532140.007730:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468526080:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532140.007732:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468526272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.007733:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.007735:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.007736:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4111f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b298 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.007738:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4111fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b29f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007742:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4111f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b298 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.007746:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4111fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b29f expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.007747:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4111f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b298 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.007750:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4111fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b29f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.007750:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532140.007754:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532140.007761:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468526080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.007762:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468526272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.007763:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4155
00000100:00100000:1.0:1651532140.007765:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4156
00000100:00100000:0.0:1651532140.007768:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4157
00000100:00100000:0.0:1651532140.007770:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468526400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.007772:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.007782:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411203 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2a6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.007789:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411203 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2a6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.007793:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411203 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2a6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.007796:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532140.007818:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468526400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.007821:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4157
00000100:00100000:0.0:1651532140.008196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.008203:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.008217:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.008226:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468526528
00000100:00100000:1.0:1651532140.008228:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468526720
00000100:00100000:0.0:1651532140.008235:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468526848
00000100:00100000:0.0:1651532140.008239:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4158
00000100:00100000:1.0:1651532140.008241:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4159
00000100:00100000:0.0:1651532140.008241:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468526528:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532140.008243:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468526720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.008244:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.008246:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.008248:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41120a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2ad expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.008249:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411211 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2b4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.008255:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41120a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2ad expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.008257:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411211 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2b4 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.008259:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41120a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2ad expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.008261:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411211 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2b4 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.008263:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532140.008264:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532140.008272:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468526720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.008272:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468526528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.008275:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4159
00000100:00100000:0.0:1651532140.008276:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4158
00000100:00100000:1.0:1651532140.008279:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4160
00000100:00100000:1.0:1651532140.008281:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468526848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.008283:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.008285:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411218 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2bb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.008290:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411218 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2bb expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.008294:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411218 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2bb expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.008297:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532140.008301:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468526848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.008304:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4160
00000001:00080000:1.0:1651532140.098246:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793891 is committed
00010000:00010000:0.0:1651532140.098279:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.098285:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098308:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.098309:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468522112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449768us (449816us total) trans 158913793891 rc 0/0
00000100:00100000:0.0:1651532140.098312:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4457
00010000:00010000:1.0:1651532140.098313:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.098314:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098317:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098322:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.098323:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.098324:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098330:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098354:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098358:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41112a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2707456->10006527] (req 2707456->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098363:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098366:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.098645:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.098657:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.098663:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468527104
00000100:00100000:0.0:1651532140.098673:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468527232
00000100:00100000:1.0:1651532140.098681:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4161
00000100:00100000:1.0:1651532140.098683:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468527104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.098686:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532140.098687:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4162
00010000:00010000:1.0:1651532140.098689:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41121f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2c2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.098689:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468527232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.098693:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.098695:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.098697:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41121f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2c2 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.098697:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411226 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2c9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098701:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41121f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2c2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.098703:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.098705:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532140.098706:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411226 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2c9 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.098711:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411226 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2c9 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.098714:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532140.098718:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468527104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.098720:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4161
00000100:00100000:0.0:1651532140.098729:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468527232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.098732:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4162
00010000:00010000:1.0:1651532140.098733:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098737:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.098749:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468522176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 450207us (450248us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532140.098752:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4458
00010000:00010000:1.0:1651532140.098757:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098760:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.098761:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098764:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098778:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.098778:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.098779:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098785:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098795:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.098797:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411131 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->7962623] (req 520192->7962623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.098798:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.098833:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.099125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.099136:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468527552
00000100:00100000:0.0:1651532140.099136:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.099144:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.099149:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468527488
00000100:00100000:1.0:1651532140.099156:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4468
00000100:00100000:1.0:1651532140.099158:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468527552:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532140.099164:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.099168:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532140.099169:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532140.099170:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.099173:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.099173:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4469
00000100:00100000:0.0:1651532140.099175:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468527488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532140.099184:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.099188:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532140.099189:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.099192:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.099195:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532140.099196:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.099200:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.099203:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.099209:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.099216:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468527680
00000100:00100000:0.0:1651532140.099224:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4163
00000100:00100000:0.0:1651532140.099226:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468527680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.099228:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.099231:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41123b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2d0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.099238:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41123b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2d0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.099242:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41123b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2d0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.099262:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532140.099274:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468527680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (129us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.099277:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4163
00000100:00100000:0.0:1651532140.099292:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.099318:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468527744
00000100:00100000:0.0:1651532140.099325:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4164
00000100:00100000:0.0:1651532140.099327:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468527744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.099330:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.099342:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411242 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2d7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.099349:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411242 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2d7 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.099353:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411242 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2d7 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.099356:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532140.099366:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468527744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.099368:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4164
00000100:00100000:0.0:1651532140.099554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.099561:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468527872
00000100:00100000:0.0:1651532140.099567:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4165
00000100:00100000:0.0:1651532140.099569:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468527872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.099573:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.099576:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411249 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2de expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.099583:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411249 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2de expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.099587:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411249 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2de expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.099592:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532140.099602:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468527872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.099604:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4165
00000001:00080000:1.0:1651532140.198278:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793892 is committed
00010000:00010000:0.0:1651532140.198311:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.198330:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.198359:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468523392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507879us (507921us total) trans 158913793892 rc 0/0
00000100:00100000:0.0:1651532140.198362:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4459
00010000:00010000:0.0:1651532140.198369:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.198373:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532140.198374:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.198377:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.198382:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532140.198382:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532140.198383:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.198386:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.198398:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.198401:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411162 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->10215423] (req 1273856->10215423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198411:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198418:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198686:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198690:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.198709:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468523456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508226us (508259us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532140.198712:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4460
00010000:00010000:1.0:1651532140.198719:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198723:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.198724:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198726:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198740:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.198740:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.198741:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198747:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198753:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198756:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411169 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->6709247] (req 1351680->6709247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198762:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.198765:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.198799:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.198826:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468528192
00000100:00100000:1.0:1651532140.198837:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4166
00000100:00100000:1.0:1651532140.198839:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468528192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.198849:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532140.198851:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532140.198853:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411250 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2e5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.198860:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468528320
00010000:00010000:1.0:1651532140.198861:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411250 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2e5 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.198865:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411250 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2e5 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532140.198872:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4167
00010000:00010000:1.0:1651532140.198874:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532140.198874:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468528320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.198878:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.198882:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411257 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2ec expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.198888:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468528192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.198891:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4166
00010000:00010000:0.0:1651532140.198896:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411257 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2ec expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.198900:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411257 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2ec expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.198904:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532140.198912:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468528320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.198925:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4167
00000100:00100000:0.0:1651532140.199040:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.199050:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.199058:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.199065:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468528512
00000100:00100000:0.0:1651532140.199077:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468528576
00000100:00100000:0.0:1651532140.199084:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4470
00000100:00100000:0.0:1651532140.199086:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468528512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532140.199093:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.199098:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532140.199099:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.199102:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4471
00010000:00010000:0.0:1651532140.199102:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532140.199102:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.199104:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468528576:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532140.199107:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.199110:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.199112:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.199116:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532140.199117:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.199117:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468528704
00010000:00010000:1.0:1651532140.199120:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532140.199121:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.199125:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4168
00000100:00100000:0.0:1651532140.199127:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468528704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.199132:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.199136:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.199137:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.199140:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41126c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2f3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.199146:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41126c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2f3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.199151:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41126c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2f3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.199154:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532140.199164:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468528704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.199167:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4168
00000100:00100000:0.0:1651532140.199279:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.199286:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468528832
00000100:00100000:0.0:1651532140.199300:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4169
00000100:00100000:0.0:1651532140.199302:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468528832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.199306:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.199310:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411273 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b2fa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.199317:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411273 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2fa expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.199321:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411273 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b2fa expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.199324:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532140.199344:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468528832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.199347:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4169
00000100:00100000:0.0:1651532140.199584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.199591:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468529088
00000100:00100000:0.0:1651532140.199605:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4170
00000100:00100000:0.0:1651532140.199607:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468529088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.199610:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.199614:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41127a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b301 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.199621:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41127a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b301 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.199625:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41127a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b301 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.199628:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532140.199637:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468529088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.199640:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4170
00000001:00080000:1.0:1651532140.339916:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793893 is committed
00010000:00010000:1.0:1651532140.339932:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.339938:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.339961:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468523776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499477us (499513us total) trans 158913793893 rc 0/0
00000100:00100000:1.0:1651532140.339965:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4461
00010000:00010000:1.0:1651532140.339972:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.339975:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.339977:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.339979:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.339985:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.339985:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.339986:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.339989:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.339996:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.340008:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411177 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->6463487] (req 987136->6463487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.340014:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.340017:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.340309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.340343:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468529280
00000100:00100000:0.0:1651532140.340355:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4171
00000100:00100000:0.0:1651532140.340357:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468529280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.340361:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.340365:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411281 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b308 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.340374:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411281 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b308 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.340378:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411281 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b308 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.340382:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532140.340392:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468529280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.340395:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4171
00000001:00080000:1.0:1651532140.467985:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793894 is committed
00010000:00010000:1.0:1651532140.468000:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468004:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.468026:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468524096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 569405us (569444us total) trans 158913793894 rc 0/0
00000100:00100000:1.0:1651532140.468029:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4462
00010000:00010000:1.0:1651532140.468037:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468040:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.468041:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468044:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468049:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.468050:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.468051:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468054:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468063:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.468072:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468075:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41117e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3551232->7024639] (req 3551232->7024639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.468078:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.468297:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.468311:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.468322:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468529536
00000100:00100000:1.0:1651532140.468343:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468529472
00000100:00100000:1.0:1651532140.468361:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4472
00000100:00100000:1.0:1651532140.468363:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468529536:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532140.468370:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468374:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532140.468375:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532140.468376:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468379:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.468386:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4473
00000100:00100000:1.0:1651532140.468388:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468529472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532140.468392:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468395:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532140.468396:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468399:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468401:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532140.468402:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468406:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468409:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.468412:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532140.587509:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793895 is committed
00010000:00010000:0.0:1651532140.587543:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587551:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.587573:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.587573:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468524672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 688223us (688300us total) trans 158913793895 rc 0/0
00010000:00010000:1.0:1651532140.587577:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532140.587577:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4464
00010000:00010000:1.0:1651532140.587579:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.587589:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.587594:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.587595:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.587595:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.587598:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.587608:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587616:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.587618:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4111af lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4513792->4517887] (req 4513792->4517887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587620:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587826:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587830:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.587844:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468524736:12345-10.240.43.64@tcp:3:fio.0 Request processed in 688451us (688561us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532140.587847:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4465
00010000:00010000:0.0:1651532140.587854:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587857:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532140.587858:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587877:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587892:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532140.587893:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532140.587894:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587897:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587909:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.587912:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4111bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->8974335] (req 57344->8974335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.587916:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.587921:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.587938:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.587961:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468529728
00000100:00100000:1.0:1651532140.587980:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4172
00000100:00100000:1.0:1651532140.587982:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468529728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.587985:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.587996:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411296 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b30f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.588005:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411296 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b30f expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.588009:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411296 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b30f expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.588012:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532140.588027:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468529728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.588030:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4172
00000100:00100000:0.0:1651532140.588229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.588236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.588243:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.588252:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468529984
00000100:00100000:0.0:1651532140.588252:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468529920
00000100:00100000:1.0:1651532140.588269:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4173
00000100:00100000:0.0:1651532140.588269:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468529856
00000100:00100000:1.0:1651532140.588271:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468529984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.588274:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532140.588279:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4474
00000100:00100000:0.0:1651532140.588281:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468529920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532140.588283:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41129d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b316 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.588288:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.588291:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41129d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b316 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.588293:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532140.588294:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.588307:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532140.588308:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.588312:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41129d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b316 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.588312:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.588315:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532140.588316:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.588324:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4475
00000100:00100000:1.0:1651532140.588329:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468529984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.588340:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4173
00000100:00100000:0.0:1651532140.588341:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468529856:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532140.588347:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.588351:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532140.588352:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.588354:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532140.588355:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.588359:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.588362:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532140.640041:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793896 is committed
00002000:00010000:1.0:1651532140.640054:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532139 -> 1651532140
00002000:00010000:1.0:1651532140.640056:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532139 -> 1651532140
00010000:00010000:1.0:1651532140.640058:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640062:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.640084:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468526016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 632408us (632458us total) trans 158913793896 rc 0/0
00000100:00100000:1.0:1651532140.640087:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4466
00010000:00010000:1.0:1651532140.640094:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640098:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.640099:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640102:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640107:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.640107:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.640108:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640111:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640124:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.640124:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.640125:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640128:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640141:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640144:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4111e7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10448895] (req 577536->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640150:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640153:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.640154:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.640158:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.640536:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.640543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532140.640564:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640568:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.640574:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.640579:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.640591:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468527552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 541432us (541466us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532140.640594:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4468
00000100:00100000:0.0:1651532140.640598:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468526144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 632915us (632956us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532140.640601:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.640602:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4467
00010000:00010000:1.0:1651532140.640605:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.640606:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640609:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.640609:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.640613:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.640614:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.640614:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640617:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41122d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->8585215] (req 90112->8585215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.640617:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.640624:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468530176
00000100:00100000:1.0:1651532140.640630:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468530432
00000100:00100000:1.0:1651532140.640634:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4174
00010000:00010000:0.0:1651532140.640634:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532140.640635:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532140.640636:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468530176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.640636:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640639:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.640639:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640642:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4112b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b31d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.640646:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.640649:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4111ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->8691711] (req 307200->8691711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640651:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4112b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b31d expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.640655:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640656:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4112b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b31d expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.640658:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640659:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532140.640665:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468530176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (131us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.640668:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4174
00000100:00100000:1.0:1651532140.640672:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4175
00000100:00100000:1.0:1651532140.640673:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468530432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.640676:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.640678:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4112b9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b324 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.640683:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4112b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b324 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.640687:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4112b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b324 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.640690:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532140.640695:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468530432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (151us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.640699:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4175
00000100:00100000:0.0:1651532140.641156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.641164:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.641174:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468530624
00000100:00100000:0.0:1651532140.641174:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.641182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.641190:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.641197:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468530560
00000100:00100000:0.0:1651532140.641199:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.641203:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4476
00000100:00100000:1.0:1651532140.641205:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b94b4005 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468530624:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532140.641206:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468530688
00010000:00010000:1.0:1651532140.641212:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.641212:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468530752
00000100:00100000:0.0:1651532140.641214:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468530944
00010000:00010000:1.0:1651532140.641216:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532140.641216:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468531072
00010000:00010000:1.0:1651532140.641217:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.641220:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00000100:00100000:0.0:1651532140.641220:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4176
00010000:00010000:1.0:1651532140.641221:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.641221:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468530688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.641225:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.641225:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.641228:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.641229:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4112c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b32b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.641235:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4477
00000100:00100000:1.0:1651532140.641237:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f32eacfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468530560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532140.641237:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4112c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b32b expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.641242:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.641242:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4112c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b32b expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.641245:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532140.641247:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532140.641248:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.641251:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532140.641251:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.641255:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.641255:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468530688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (82us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532140.641257:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.641258:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4176
00000100:00100000:0.0:1651532140.641263:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4177
00000100:00100000:0.0:1651532140.641264:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468530752:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532140.641265:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4178
00000100:00100000:1.0:1651532140.641266:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468530944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.641267:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.641268:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.641269:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4112d5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b332 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.641271:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4112dc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b339 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.641275:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4112d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b332 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.641277:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4112dc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b339 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.641281:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4112dc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b339 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.641282:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4112d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b332 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.641285:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532140.641285:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532140.641290:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468530752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.641292:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4177
00000100:00100000:1.0:1651532140.641294:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468530944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.641296:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4179
00000100:00100000:1.0:1651532140.641297:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4178
00000100:00100000:0.0:1651532140.641297:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468531072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.641300:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.641301:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4112e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b340 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.641306:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4112e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b340 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.641310:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4112e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b340 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.641313:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532140.641318:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468531072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.641320:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4179
00000100:00100000:0.0:1651532140.641564:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.641572:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468531200
00000100:00100000:0.0:1651532140.641586:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4180
00000100:00100000:0.0:1651532140.641587:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468531200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.641591:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.641594:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4112ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b347 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.641601:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4112ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b347 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.641605:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4112ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b347 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.641608:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532140.641618:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468531200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.641620:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4180
00000100:00100000:0.0:1651532140.641676:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.641684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.641694:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468531392
00000100:00100000:1.0:1651532140.641701:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468531584
00000100:00100000:1.0:1651532140.641706:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4181
00000100:00100000:1.0:1651532140.641707:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468531392:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532140.641708:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4182
00010000:00010000:1.0:1651532140.641710:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532140.641710:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468531584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.641713:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4112f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b34e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.641714:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.641717:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4112f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b355 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.641721:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4112f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b34e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.641724:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4112f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b355 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.641725:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4112f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b34e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.641728:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532140.641731:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4112f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b355 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.641735:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532140.641742:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468531392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.641745:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4181
00000100:00100000:0.0:1651532140.641750:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468531584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.641752:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4182
00000100:00100000:0.0:1651532140.641779:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.641816:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468531648
00000100:00100000:0.0:1651532140.641825:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4183
00000100:00100000:0.0:1651532140.641827:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468531648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.641830:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.641833:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4112ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b35c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.641840:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4112ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b35c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.641844:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4112ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b35c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.641848:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532140.641857:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468531648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.641861:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4183
00000100:00100000:0.0:1651532140.642018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.642025:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468531968
00000100:00100000:0.0:1651532140.642036:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4184
00000100:00100000:0.0:1651532140.642038:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468531968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.642041:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.642052:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411306 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b363 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.642059:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411306 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b363 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.642063:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411306 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b363 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.642066:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532140.642076:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468531968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.642079:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4184
00000100:00100000:0.0:1651532140.642135:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.642142:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468532096
00000100:00100000:0.0:1651532140.642153:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4185
00000100:00100000:0.0:1651532140.642154:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468532096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.642158:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.642161:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41130d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b36a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.642168:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41130d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b36a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.642172:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41130d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b36a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.642175:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532140.642184:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468532096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.642187:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4185
00000100:00100000:0.0:1651532140.642413:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.642420:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468532352
00000100:00100000:0.0:1651532140.642433:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4186
00000100:00100000:0.0:1651532140.642435:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468532352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.642438:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.642442:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411314 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b371 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.642448:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411314 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b371 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.642452:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411314 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b371 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.642455:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532140.642465:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468532352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.642468:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4186
00000100:00100000:0.0:1651532140.642676:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.642683:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468532480
00000100:00100000:0.0:1651532140.642696:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4187
00000100:00100000:0.0:1651532140.642697:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468532480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.642701:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.642705:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f41131b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b378 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.642711:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f41131b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b378 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.642715:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f41131b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b378 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.642719:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000087dc8b1c, rc 0)
00000100:00100000:0.0:1651532140.642728:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468532480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.642731:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4187
00000001:00080000:1.0:1651532140.740059:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793897 is committed
00010000:00010000:0.0:1651532140.740088:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.740093:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.740117:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468527488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 640941us (640980us total) trans 158913793897 rc 0/0
00010000:00010000:1.0:1651532140.740118:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.740120:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4469
00010000:00010000:1.0:1651532140.740123:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.740124:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740127:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740133:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.740134:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.740135:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740138:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740147:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.740157:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740158:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411234 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->5500927] (req 540672->5500927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.740161:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.740562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.740572:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.740582:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.740583:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468532672
00000100:00100000:0.0:1651532140.740588:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.740598:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468532736
00000100:00100000:1.0:1651532140.740602:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4478
00000100:00100000:1.0:1651532140.740603:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468532672:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532140.740611:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4479
00000100:00100000:0.0:1651532140.740613:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468532736:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532140.740616:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740621:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532140.740621:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740622:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740625:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532140.740626:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.740630:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532140.740631:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.740634:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532140.740635:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740641:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.740642:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740645:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.740646:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.740653:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468532800
00000100:00100000:1.0:1651532140.740655:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468532992
00000100:00100000:0.0:1651532140.740664:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4188
00000100:00100000:1.0:1651532140.740666:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4189
00000100:00100000:0.0:1651532140.740666:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468532800:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532140.740668:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468532992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.740668:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.740671:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.740671:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f411330 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b37f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.740674:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411337 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b386 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.740678:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f411330 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b37f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.740682:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411337 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b386 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.740682:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f411330 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b37f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.740685:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000035f6d17d, rc 0)
00010000:00010000:1.0:1651532140.740686:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411337 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b386 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.740689:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532140.740696:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468532800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (114us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.740698:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4188
00000100:00100000:1.0:1651532140.740699:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468532992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.740702:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4189
00000100:00100000:0.0:1651532140.741001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.741015:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.741027:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468533184
00000100:00100000:1.0:1651532140.741034:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468533312
00000100:00100000:1.0:1651532140.741042:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4190
00000100:00100000:1.0:1651532140.741043:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468533184:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532140.741045:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4191
00010000:00010000:1.0:1651532140.741046:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532140.741047:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468533312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.741050:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41133e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b38d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.741051:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.741055:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f411345 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b394 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.741057:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41133e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b38d expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.741061:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41133e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b38d expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.741062:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f411345 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b394 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.741065:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532140.741066:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f411345 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b394 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.741070:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000603f6abd, rc 0)
00000100:00100000:1.0:1651532140.741078:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468533184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.741080:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4190
00000100:00100000:0.0:1651532140.741085:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468533312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.741088:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4191
00000100:00100000:0.0:1651532140.768125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532140.768133:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232640
00000100:00100000:0.0:1651532140.768142:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 64
00000100:00100000:0.0:1651532140.768144:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232640:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532140.768149:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 745472 granted 354329152 pending 172032 free 81138851840 avail 76966047744
00000100:00100000:0.0:1651532140.768161:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232640:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 16us (37us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532140.768164:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 64
00000001:00080000:1.0:1651532140.924518:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793898 is committed
00010000:00010000:0.0:1651532140.924551:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.924559:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924580:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.924581:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468528512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 725493us (725541us total) trans 158913793898 rc 0/0
00000100:00100000:0.0:1651532140.924584:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4470
00010000:00010000:1.0:1651532140.924585:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.924586:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924589:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924595:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.924596:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.924597:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924600:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924603:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.924603:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.924604:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924607:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.924621:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924624:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.924626:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924627:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41125e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [675840->5861375] (req 675840->5861375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924633:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924636:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.924858:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.924863:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924870:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924875:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.924878:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468529536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 456514us (456581us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532140.924881:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4472
00010000:00010000:0.0:1651532140.924888:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.924890:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468528576:12345-10.240.43.64@tcp:3:fio.0 Request processed in 725786us (725840us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532140.924891:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532140.924893:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.924894:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4471
00010000:00010000:0.0:1651532140.924896:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924901:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.924901:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.924904:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411288 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->9084927] (req 212992->9084927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924905:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.924906:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924909:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924914:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.924914:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.924915:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924918:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924925:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924927:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411265 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [819200->7512063] (req 819200->7512063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924943:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.924946:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.925018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.925045:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.925056:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468533632
00000100:00100000:1.0:1651532140.925059:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468533696
00000100:00100000:0.0:1651532140.925066:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4192
00000100:00100000:0.0:1651532140.925068:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468533632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.925072:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532140.925073:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4193
00000100:00100000:1.0:1651532140.925075:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468533696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.925075:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f41134c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b39b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.925078:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.925082:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411353 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3a2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.925084:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f41134c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b39b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.925088:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f41134c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b39b expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.925090:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411353 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3a2 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.925091:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000603f6abd, rc 0)
00010000:00010000:1.0:1651532140.925094:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411353 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3a2 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.925098:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532140.925101:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468533632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.925104:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4192
00000100:00100000:1.0:1651532140.925105:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468533696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.925108:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4193
00000100:00100000:0.0:1651532140.925203:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.925213:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.925220:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468533824
00000100:00100000:0.0:1651532140.925256:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468533760
00000100:00100000:0.0:1651532140.925267:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4480
00000100:00100000:0.0:1651532140.925269:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468533824:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532140.925279:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.925281:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4481
00000100:00100000:1.0:1651532140.925284:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468533760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532140.925284:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532140.925285:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.925289:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.925291:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.925298:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532140.925299:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.925302:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.925304:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532140.925305:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532140.925306:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.925315:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532140.925321:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.925325:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.925328:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.925348:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468534016
00000100:00100000:1.0:1651532140.925355:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468533952
00000100:00100000:1.0:1651532140.925362:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4194
00000100:00100000:1.0:1651532140.925364:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468534016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.925367:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.925370:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411368 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3b0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.925380:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411368 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3b0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532140.925382:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4195
00000100:00100000:0.0:1651532140.925384:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468533952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.925385:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411368 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3b0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.925387:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.925388:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532140.925391:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f41136f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3a9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.925401:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468534016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.925404:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4194
00010000:00010000:0.0:1651532140.925405:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f41136f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3a9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.925413:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f41136f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3a9 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.925416:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022e189ae, rc 0)
00000100:00100000:0.0:1651532140.925425:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468533952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.925428:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4195
00000100:00100000:0.0:1651532140.925443:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.925471:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468534144
00000100:00100000:0.0:1651532140.925481:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4196
00000100:00100000:0.0:1651532140.925483:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468534144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.925486:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532140.925489:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411376 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3b7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.925496:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411376 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3b7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.925500:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411376 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3b7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.925503:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d25e63b7, rc 0)
00000100:00100000:0.0:1651532140.925512:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468534144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532140.925517:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4196
00000001:00080000:1.0:1651532140.990030:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793899 is committed
00010000:00010000:1.0:1651532140.990045:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990049:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.990073:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468529472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 521684us (521762us total) trans 158913793899 rc 0/0
00000100:00100000:1.0:1651532140.990076:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4473
00010000:00010000:1.0:1651532140.990084:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990088:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532140.990089:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990092:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990097:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.990098:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.990099:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990102:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990122:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990126:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41128f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1056768->10039295] (req 1056768->10039295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.990136:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.990141:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.990423:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.990434:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468534592
00000100:00100000:0.0:1651532140.990434:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.990442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.990448:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468534528
00000100:00100000:1.0:1651532140.990455:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4482
00000100:00100000:1.0:1651532140.990456:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468534592:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532140.990458:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532140.990468:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532140.990469:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4483
00000100:00100000:0.0:1651532140.990471:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468534528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532140.990472:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.990473:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990479:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532140.990480:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.990480:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990484:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.990485:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532140.990486:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.990489:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532140.990490:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990493:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.990494:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.990498:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.990502:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468534720
00000100:00100000:1.0:1651532140.990508:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468534784
00010000:00010000:0.0:1651532140.990508:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.990512:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4197
00010000:00010000:0.0:1651532140.990512:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.990514:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468534720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.990516:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.990519:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41138b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3be expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990524:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532140.990527:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41138b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3be expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532140.990527:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468529920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 402245us (402298us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532140.990530:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4474
00010000:00010000:1.0:1651532140.990531:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41138b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3be expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.990534:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532140.990536:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.990540:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532140.990541:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.990543:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468534720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (101us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532140.990544:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.990546:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4197
00010000:00010000:0.0:1651532140.990548:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532140.990549:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532140.990550:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4198
00010000:00010000:0.0:1651532140.990550:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.990552:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468534784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532140.990552:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990554:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.990556:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411392 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3c5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532140.990559:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990562:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411392 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3c5 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.990562:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4112a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [212992->8425471] (req 212992->8425471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990566:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411392 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3c5 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532140.990567:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.990569:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532140.990569:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532140.990573:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468534784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.990575:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4198
00000100:00100000:0.0:1651532140.990953:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532140.990967:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.990976:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468534976
00000100:00100000:1.0:1651532140.990983:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468535104
00000100:00100000:1.0:1651532140.990988:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4199
00000100:00100000:1.0:1651532140.990989:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468534976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.990992:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.990996:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411399 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3cc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.991006:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411399 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3cc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.991010:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411399 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3cc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.991013:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532140.991027:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468534976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.991029:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4199
00000100:00100000:1.0:1651532140.991034:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4200
00000100:00100000:1.0:1651532140.991035:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468535104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.991038:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.991040:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3d3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.991046:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3d3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.991058:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3d3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.991062:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532140.991072:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468535104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.991075:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4200
00000100:00100000:0.0:1651532140.991266:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532140.991283:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468535360
00000100:00100000:1.0:1651532140.991290:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4201
00000100:00100000:1.0:1651532140.991292:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bab7d89b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468535360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532140.991295:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532140.991298:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3da expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532140.991305:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3da expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.991308:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3da expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532140.991312:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532140.991325:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bab7d89b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468535360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532140.991327:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4201
00000001:00080000:1.0:1651532141.081715:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793900 is committed
00010000:00010000:0.0:1651532141.081749:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.081753:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.081775:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.081776:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468529856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 493449us (493539us total) trans 158913793900 rc 0/0
00010000:00010000:1.0:1651532141.081780:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532141.081780:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4475
00010000:00010000:1.0:1651532141.081781:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.081787:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.081793:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.081794:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.081794:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.081798:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.081824:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.081828:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4112ab lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2777088->10027007] (req 2777088->10027007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.081835:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.081838:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.082111:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.082130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.082141:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468535488
00000100:00100000:0.0:1651532141.082141:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.082149:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.082169:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468535552
00000100:00100000:0.0:1651532141.082173:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4484
00000100:00100000:0.0:1651532141.082175:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468535488:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532141.082180:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4485
00000100:00100000:1.0:1651532141.082182:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468535552:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532141.082184:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.082189:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532141.082190:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.082190:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.082193:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532141.082193:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.082197:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.082198:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.082201:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532141.082202:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.082205:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.082206:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.082209:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.082209:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.082222:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.082222:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468535680
00010000:00010000:1.0:1651532141.082226:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.082232:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468535744
00000100:00100000:0.0:1651532141.082237:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4202
00000100:00100000:0.0:1651532141.082238:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468535680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.082241:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.082244:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3e1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.082252:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b94b4005 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468530624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441046us (441096us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532141.082255:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4476
00010000:00010000:0.0:1651532141.082256:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.082259:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3e1 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.082262:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.082267:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3e1 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.082268:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532141.082269:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.082270:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000603f6abd, rc 0)
00010000:00010000:1.0:1651532141.082272:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.082276:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.082277:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.082278:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.082279:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468535680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (137us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532141.082281:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.082281:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4202
00000100:00100000:0.0:1651532141.082286:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4203
00010000:00010000:1.0:1651532141.082287:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.082288:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468535744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.082290:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4112c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2125824->6926335] (req 2125824->6926335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.082290:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.082292:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f4113c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3e8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.082295:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.082298:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.082298:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f4113c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3e8 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.082302:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f4113c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3e8 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.082305:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077af4bf9, rc 0)
00000100:00100000:0.0:1651532141.082309:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468535744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (160us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.082312:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4203
00000001:00080000:1.0:1651532141.190115:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793901 is committed
00010000:00010000:1.0:1651532141.190130:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.190135:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.190157:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f32eacfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468530560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 548919us (548993us total) trans 158913793901 rc 0/0
00010000:00010000:0.0:1651532141.190159:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.190160:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4477
00010000:00010000:0.0:1651532141.190164:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532141.190166:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.190169:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.190175:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.190175:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.190176:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.190179:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.190189:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.190192:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4112ce lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1564672->9596927] (req 1564672->9596927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.190201:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.190204:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.190525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.190536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.190545:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.190563:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468536192
00000100:00100000:0.0:1651532141.190565:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.190580:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468536128
00000100:00100000:1.0:1651532141.190587:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4486
00000100:00100000:1.0:1651532141.190589:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468536192:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532141.190596:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.190600:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532141.190601:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532141.190602:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.190605:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.190612:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4487
00000100:00100000:1.0:1651532141.190613:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468536128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532141.190617:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.190623:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532141.190624:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.190627:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.190629:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532141.190630:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.190634:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.190637:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.190640:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.190647:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468536320
00000100:00100000:1.0:1651532141.190652:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468536384
00000100:00100000:0.0:1651532141.190655:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4204
00000100:00100000:0.0:1651532141.190658:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468536320:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532141.190663:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4205
00000100:00100000:1.0:1651532141.190665:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468536384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.190667:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.190667:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.190670:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3f6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.190672:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f4113df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3ef expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.190681:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3f6 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.190682:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f4113df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3ef expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.190686:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3f6 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.190686:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f4113df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3ef expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.190689:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532141.190690:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077af4bf9, rc 0)
00000100:00100000:1.0:1651532141.190700:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468536384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.190700:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468536320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (155us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.190703:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4205
00000100:00100000:0.0:1651532141.190704:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4204
00000001:00080000:1.0:1651532141.298451:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793902 is committed
00010000:00010000:0.0:1651532141.298487:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298492:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298515:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.298515:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a6c9e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468532672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557910us (557953us total) trans 158913793902 rc 0/0
00010000:00010000:1.0:1651532141.298520:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532141.298520:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4478
00010000:00010000:1.0:1651532141.298521:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298524:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298530:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.298530:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.298531:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298534:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298537:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.298538:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.298539:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298541:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298559:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298563:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411322 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [159744->9793535] (req 159744->9793535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298563:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298567:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298573:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298576:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298768:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298773:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298814:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298818:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000035f6d17d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532141.298819:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298822:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.298827:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468533824:12345-10.240.43.64@tcp:3:fio.0 Request processed in 373556us (373623us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532141.298828:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.298830:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4480
00010000:00010000:1.0:1651532141.298831:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f41135a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->9322495] (req 1859584->9322495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298881:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298885:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298905:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.298909:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031c21c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468532736:12345-10.240.43.64@tcp:3:fio.0 Request processed in 558295us (558336us total) trans 0 rc 53248/53248
00000100:00100000:1.0:1651532141.298912:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4479
00010000:00010000:0.0:1651532141.298918:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087dc8b1c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532141.298920:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298923:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298929:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.298930:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.298930:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298934:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298943:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.298946:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411329 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->10309631] (req 1712128->10309631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298947:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.298951:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.298992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.299016:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468536704
00000100:00100000:0.0:1651532141.299024:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4206
00000100:00100000:0.0:1651532141.299026:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468536704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.299030:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.299034:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f4113e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b3fd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.299041:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f4113e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3fd expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.299046:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f4113e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b3fd expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.299049:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077af4bf9, rc 0)
00000100:00100000:0.0:1651532141.299059:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468536704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.299062:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4206
00000100:00100000:0.0:1651532141.299275:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.299285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.299292:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.299298:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.299305:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468536960
00000100:00100000:0.0:1651532141.299314:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468537024
00000100:00100000:0.0:1651532141.299320:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4488
00000100:00100000:0.0:1651532141.299321:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468536960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532141.299328:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.299343:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532141.299344:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.299346:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4489
00010000:00010000:0.0:1651532141.299348:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532141.299348:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.299349:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468537024:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532141.299353:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.299356:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.299357:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.299364:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532141.299365:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.299365:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468537152
00010000:00010000:1.0:1651532141.299368:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532141.299368:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.299374:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468537216
00000100:00100000:0.0:1651532141.299380:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4207
00000100:00100000:0.0:1651532141.299382:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468537152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.299383:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.299385:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.299387:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.299388:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f4113fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b404 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.299394:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4208
00010000:00010000:0.0:1651532141.299395:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f4113fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b404 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532141.299396:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468537216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.299399:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.299399:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f4113fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b404 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.299402:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008bdd51b3, rc 0)
00010000:00010000:1.0:1651532141.299410:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411402 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b40b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.299413:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468537152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (120us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.299415:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4207
00010000:00010000:1.0:1651532141.299431:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411402 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b40b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.299435:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411402 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b40b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.299439:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532141.299461:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468537216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (162us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.299464:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4208
00000100:00100000:0.0:1651532141.299480:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.299491:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468537472
00000100:00100000:1.0:1651532141.299501:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4209
00000100:00100000:1.0:1651532141.299503:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468537472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.299513:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.299516:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411409 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b412 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.299523:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411409 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b412 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.299527:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411409 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b412 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.299530:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532141.299542:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468537472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.299545:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4209
00000100:00100000:0.0:1651532141.299746:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.299762:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.299769:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468537600
00000100:00100000:0.0:1651532141.299770:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468537792
00000100:00100000:1.0:1651532141.299779:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4210
00000100:00100000:1.0:1651532141.299781:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468537600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.299784:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532141.299786:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4211
00010000:00010000:1.0:1651532141.299787:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411410 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b419 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.299788:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468537792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.299791:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.299795:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f411417 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b420 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.299796:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411410 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b419 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.299800:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411410 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b419 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.299814:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532141.299819:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f411417 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b420 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.299823:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f411417 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b420 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.299827:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f67c21a7, rc 0)
00000100:00100000:1.0:1651532141.299831:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468537600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.299833:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4210
00000100:00100000:0.0:1651532141.299840:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468537792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.299843:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4211
00000100:00100000:0.0:1651532141.299887:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.299910:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468537920
00000100:00100000:0.0:1651532141.299918:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4212
00000100:00100000:0.0:1651532141.299919:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468537920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.299922:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.299926:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f41141e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b427 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.299933:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f41141e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b427 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.299937:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f41141e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b427 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.299940:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043f2db54, rc 0)
00000100:00100000:0.0:1651532141.299949:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468537920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.299953:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4212
00000100:00100000:0.0:1651532141.300113:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.300120:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.300126:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468538048
00000100:00100000:0.0:1651532141.300132:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468538176
00000100:00100000:0.0:1651532141.300141:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4213
00000100:00100000:1.0:1651532141.300143:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4214
00000100:00100000:0.0:1651532141.300143:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468538048:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532141.300145:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468538176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.300146:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.300148:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.300150:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411425 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b42e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.300151:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41142c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b435 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.300157:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411425 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b42e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.300158:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41142c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b435 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.300161:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411425 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b42e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.300162:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41142c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b435 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.300164:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532141.300165:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532141.300174:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468538176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.300174:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468538048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.300176:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4213
00000100:00100000:1.0:1651532141.300178:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4214
00000100:00100000:0.0:1651532141.300391:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.300398:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468538432
00000100:00100000:0.0:1651532141.300410:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4215
00000100:00100000:0.0:1651532141.300412:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468538432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.300415:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.300418:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411433 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b43c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.300426:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411433 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b43c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.300429:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411433 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b43c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.300433:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532141.300442:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468538432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.300444:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4215
00000100:00100000:0.0:1651532141.300634:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.300641:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468538624
00000100:00100000:1.0:1651532141.300653:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4216
00000100:00100000:1.0:1651532141.300655:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468538624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.300658:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.300661:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41143a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b443 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.300667:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41143a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b443 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.300671:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41143a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b443 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.300674:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532141.300687:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468538624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.300689:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4216
00000100:00100000:0.0:1651532141.300871:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.300881:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468538752
00000100:00100000:1.0:1651532141.300891:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4217
00000100:00100000:1.0:1651532141.300893:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468538752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.300896:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.300898:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411441 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b44a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.300905:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411441 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b44a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.300909:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411441 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b44a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.300912:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532141.300923:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468538752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.300926:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4217
00000001:00080000:1.0:1651532141.423470:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793903 is committed
00010000:00010000:1.0:1651532141.423485:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423489:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.423511:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468533760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 498227us (498298us total) trans 158913793903 rc 0/0
00000100:00100000:1.0:1651532141.423515:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4481
00010000:00010000:1.0:1651532141.423522:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423526:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532141.423527:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423530:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423536:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.423536:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.423537:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423540:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423547:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.423554:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.423559:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423560:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411361 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [512000->10010623] (req 512000->10010623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.423876:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.423888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.423896:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468538880
00000100:00100000:0.0:1651532141.423896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.423905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.423914:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468538944
00000100:00100000:0.0:1651532141.423918:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.423921:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4490
00000100:00100000:1.0:1651532141.423923:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468538880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532141.423929:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.423932:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4491
00010000:00010000:1.0:1651532141.423934:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532141.423934:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468538944:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532141.423935:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423937:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532141.423938:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.423943:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423945:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.423948:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.423949:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.423952:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532141.423953:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423956:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.423957:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.423960:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.423965:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468539072
00000100:00100000:1.0:1651532141.423973:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468539136
00000100:00100000:1.0:1651532141.423976:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468539008
00010000:00010000:0.0:1651532141.423978:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.423979:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4218
00000100:00100000:1.0:1651532141.423980:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468539072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.423982:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423983:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.423986:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411456 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b458 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.423997:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.424000:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411456 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b458 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532141.424001:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468534592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433544us (433579us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532141.424004:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411456 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b458 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532141.424004:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4482
00010000:00010000:1.0:1651532141.424008:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532141.424013:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4219
00000100:00100000:0.0:1651532141.424015:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468539136:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532141.424016:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468539072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (120us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532141.424018:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532141.424019:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4218
00010000:00010000:0.0:1651532141.424021:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41145d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b45f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.424024:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4220
00000100:00100000:1.0:1651532141.424026:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468539008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.424026:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.424028:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.424029:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41145d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b45f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.424031:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411464 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b451 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.424033:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41145d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b45f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.424035:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.424037:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411464 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b451 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.424037:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532141.424040:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411464 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b451 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.424043:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532141.424043:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468539136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.424045:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4219
00000100:00100000:1.0:1651532141.424049:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468539008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.424051:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4220
00010000:00010000:1.0:1651532141.424057:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.424060:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532141.424061:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.424064:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.424068:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.424069:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.424070:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.424073:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.424091:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.424095:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.424105:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.424113:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41137d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [704512->9662463] (req 704512->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.424423:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.424446:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468539264
00000100:00100000:1.0:1651532141.424456:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4221
00000100:00100000:1.0:1651532141.424458:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468539264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.424461:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.424464:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41146b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b466 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.424471:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41146b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b466 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.424475:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41146b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b466 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.424479:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532141.424491:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468539264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.424494:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4221
00000100:00100000:0.0:1651532141.424535:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.424544:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468539392
00000100:00100000:1.0:1651532141.424553:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4222
00000100:00100000:1.0:1651532141.424554:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468539392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.424557:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.424560:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411472 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b46d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.424566:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411472 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b46d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.424570:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411472 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b46d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.424573:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532141.424584:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468539392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.424586:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4222
00000001:00080000:1.0:1651532141.515132:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793904 is committed
00010000:00010000:0.0:1651532141.515166:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.515171:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515193:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.515195:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468534528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524723us (524760us total) trans 158913793904 rc 0/0
00010000:00010000:1.0:1651532141.515198:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d25e63b7 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532141.515199:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.515199:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4483
00010000:00010000:1.0:1651532141.515205:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515210:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.515210:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.515211:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515214:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515224:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.515233:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515234:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411384 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3989504->8818687] (req 3989504->8818687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.515237:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.515577:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.515585:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.515591:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.515603:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.515608:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468539968
00000100:00100000:1.0:1651532141.515620:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468540032
00000100:00100000:1.0:1651532141.515626:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4223
00000100:00100000:1.0:1651532141.515628:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468539968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.515632:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.515635:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411479 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b474 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515643:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411479 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b474 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.515650:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411479 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b474 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.515653:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532141.515666:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468539968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.515669:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4223
00000100:00100000:1.0:1651532141.515674:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4224
00000100:00100000:1.0:1651532141.515675:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468540032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.515678:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.515680:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411480 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b47b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.515683:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468539776
00010000:00010000:1.0:1651532141.515686:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411480 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b47b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.515689:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411480 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b47b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.515692:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532141.515693:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468539840
00000100:00100000:1.0:1651532141.515697:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468540032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (94us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.515704:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4492
00000100:00100000:0.0:1651532141.515706:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468539776:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532141.515707:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4224
00010000:00010000:0.0:1651532141.515713:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.515714:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4493
00000100:00100000:1.0:1651532141.515716:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468539840:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532141.515718:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532141.515719:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515722:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.515722:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532141.515723:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515730:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532141.515731:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515734:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532141.515735:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515739:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.515739:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.515743:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.515743:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.516011:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.516029:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468540160
00000100:00100000:1.0:1651532141.516038:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4225
00000100:00100000:1.0:1651532141.516039:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468540160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.516043:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.516045:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411495 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b482 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.516053:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411495 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b482 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.516060:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411495 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b482 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.516063:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532141.516079:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468540160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.516082:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4225
00000001:00080000:1.0:1651532141.611543:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793905 is committed
00010000:00010000:0.0:1651532141.611577:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.611582:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611603:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.611604:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468535488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 529428us (529493us total) trans 158913793905 rc 0/0
00010000:00010000:1.0:1651532141.611608:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022e189ae already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532141.611608:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4484
00010000:00010000:1.0:1651532141.611609:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611612:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611617:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.611618:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.611619:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611622:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611625:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.611626:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.611626:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611629:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611646:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611649:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f4113ae lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9388031] (req 688128->9388031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611655:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611658:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611686:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611690:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611920:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611937:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.611955:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.611960:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468536192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 421370us (421435us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532141.611963:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4486
00010000:00010000:1.0:1651532141.611974:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611978:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.611981:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532141.611982:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.611985:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.611988:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468535552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 529806us (529858us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532141.611991:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4485
00010000:00010000:0.0:1651532141.611991:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.611995:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4113ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->9650175] (req 1060864->9650175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611996:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.611999:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532141.612000:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.612003:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.612008:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.612008:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.612009:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.612014:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.612020:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.612021:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532141.612044:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4113b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [200704->5599231] (req 200704->5599231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.612051:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.612055:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.612057:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468540416
00000100:00100000:1.0:1651532141.612064:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4226
00000100:00100000:1.0:1651532141.612066:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468540416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.612069:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.612071:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41149c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b489 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.612079:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41149c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b489 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.612082:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41149c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b489 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.612085:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532141.612092:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468540416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.612102:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4226
00000100:00100000:0.0:1651532141.612360:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.612371:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468540608
00000100:00100000:0.0:1651532141.612371:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.612380:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.612388:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.612393:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468540544
00000100:00100000:1.0:1651532141.612401:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4494
00000100:00100000:1.0:1651532141.612403:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468540608:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532141.612408:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4495
00010000:00010000:1.0:1651532141.612409:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.612410:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468540544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532141.612413:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.612414:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532141.612415:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.612418:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.612419:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.612423:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532141.612424:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.612426:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468540736
00010000:00010000:0.0:1651532141.612427:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.612430:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:1.0:1651532141.612431:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468540800
00010000:00010000:0.0:1651532141.612431:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.612435:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4227
00010000:00010000:0.0:1651532141.612435:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.612436:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468540736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.612439:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.612439:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.612441:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b490 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.612442:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.612447:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b490 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.612451:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b490 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.612465:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532141.612473:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468540736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.612476:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4227
00000100:00100000:1.0:1651532141.612481:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4228
00000100:00100000:1.0:1651532141.612482:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468540800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.612485:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.612487:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b497 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.612493:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b497 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.612497:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b497 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.612500:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532141.612504:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468540800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (116us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.612507:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4228
00000100:00100000:0.0:1651532141.612530:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.612558:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468540928
00000100:00100000:0.0:1651532141.612570:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4229
00000100:00100000:0.0:1651532141.612572:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468540928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.612575:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.612579:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4114bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b49e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.612587:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4114bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b49e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.612592:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4114bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b49e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.612595:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532141.612619:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468540928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.612622:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4229
00000100:00100000:0.0:1651532141.612838:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.612845:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468541120
00000100:00100000:0.0:1651532141.612856:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4230
00000100:00100000:0.0:1651532141.612857:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468541120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.612861:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.612864:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4a5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.612872:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4a5 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.612876:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4a5 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.612879:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532141.612889:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468541120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.612892:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4230
00000001:00080000:1.0:1651532141.744958:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793906 is committed
00002000:00010000:0.0:1651532141.744990:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532140 -> 1651532141
00010000:00010000:0.0:1651532141.744993:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.744997:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745023:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.745023:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468536128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 554408us (554486us total) trans 158913793906 rc 0/0
00000100:00100000:0.0:1651532141.745026:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4487
00010000:00010000:1.0:1651532141.745030:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532141.745031:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745035:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745042:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.745042:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.745043:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745046:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745064:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.745065:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.745069:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745071:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4113d1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->5316607] (req 196608->5316607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.745417:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.745425:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.745432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.745439:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468541568
00000100:00100000:1.0:1651532141.745463:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468541504
00000100:00100000:0.0:1651532141.745467:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4496
00000100:00100000:0.0:1651532141.745470:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468541568:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532141.745481:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4497
00000100:00100000:1.0:1651532141.745483:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468541504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532141.745484:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.745489:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532141.745490:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745492:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.745493:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532141.745493:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745497:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532141.745499:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745505:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532141.745505:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.745509:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745510:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.745513:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.745513:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.745523:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468541696
00000100:00100000:0.0:1651532141.745532:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4231
00000100:00100000:0.0:1651532141.745534:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468541696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.745536:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.745539:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4114db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4ac expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.745547:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4114db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4ac expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.745551:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4114db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4ac expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.745554:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532141.745565:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468541696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (132us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.745568:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4231
00000001:00080000:1.0:1651532141.894855:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793907 is committed
00002000:00010000:0.0:1651532141.894886:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532140 -> 1651532141
00010000:00010000:0.0:1651532141.894889:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.894893:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.894911:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468536960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 595589us (595636us total) trans 158913793907 rc 0/0
00000100:00100000:0.0:1651532141.894914:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4488
00010000:00010000:0.0:1651532141.894921:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.894924:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000603f6abd already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532141.894926:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.894928:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.894933:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.894934:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.894935:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.894938:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.894950:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.894953:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f4113ed lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [978944->9785343] (req 978944->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.894962:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.894967:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.895320:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.895327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.895348:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.895357:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468541952
00000100:00100000:0.0:1651532141.895365:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468542016
00000100:00100000:1.0:1651532141.895370:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468542144
00000100:00100000:0.0:1651532141.895372:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4232
00000100:00100000:0.0:1651532141.895374:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468541952:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532141.895376:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4233
00000100:00100000:1.0:1651532141.895378:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468542016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.895378:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.895381:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4114e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4b3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.895382:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.895387:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4114e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4ba expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.895387:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.895390:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4114e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4b3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.895393:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.895395:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4114e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4b3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.895396:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4114e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4ba expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.895399:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532141.895401:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4114e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4ba expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.895405:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532141.895409:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468541952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.895411:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4232
00000100:00100000:1.0:1651532141.895414:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468542016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.895416:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4234
00000100:00100000:1.0:1651532141.895418:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4233
00000100:00100000:0.0:1651532141.895418:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468542144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.895420:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.895423:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4114f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4c1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.895427:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.895429:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4114f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4c1 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.895431:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.895435:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.895439:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4114f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4c1 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.895442:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532141.895447:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468537024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 596098us (596162us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532141.895448:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468542144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.895450:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4489
00000100:00100000:0.0:1651532141.895451:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4234
00010000:00010000:1.0:1651532141.895456:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.895460:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532141.895461:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.895464:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.895471:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.895472:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.895473:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.895476:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.895495:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.895499:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.895508:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.895517:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4113f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->5640191] (req 647168->5640191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.895925:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.895933:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468542272
00000100:00100000:0.0:1651532141.895941:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.895952:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468542336
00000100:00100000:1.0:1651532141.895961:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4498
00000100:00100000:1.0:1651532141.895963:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468542272:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532141.895969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532141.895970:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.895975:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532141.895976:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.895977:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4499
00010000:00010000:1.0:1651532141.895979:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532141.895980:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.895980:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468542336:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532141.895988:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.895995:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532141.895996:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.896001:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532141.896002:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.896006:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.896007:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.896010:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.896010:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.896019:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468542400
00000100:00100000:0.0:1651532141.896031:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4235
00000100:00100000:0.0:1651532141.896033:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083b26f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468542400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.896036:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.896045:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411505 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4c8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.896053:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411505 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4c8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.896057:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411505 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4c8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.896060:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532141.896071:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083b26f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468542400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.896076:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4235
00000001:00080000:1.0:1651532141.994882:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793908 is committed
00010000:00010000:0.0:1651532141.994916:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.994921:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.994944:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.994944:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468538880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 571020us (571069us total) trans 158913793908 rc 0/0
00000100:00100000:0.0:1651532141.994948:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4490
00010000:00010000:1.0:1651532141.994949:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532141.994950:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.994953:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.994959:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.994960:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532141.994961:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.994963:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.994973:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.994982:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.994986:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.994994:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411448 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [880640->9863167] (req 880640->9863167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.995343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532141.995361:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.995365:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.995379:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468538944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 571444us (571491us total) trans 0 rc 49152/49152
00000100:00100000:0.0:1651532141.995382:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4491
00010000:00010000:0.0:1651532141.995388:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.995392:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532141.995393:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.995396:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.995401:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.995401:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532141.995402:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.995405:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.995412:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.995415:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41144f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [163840->8433663] (req 163840->8433663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.995420:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.995423:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.995443:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468542912
00000100:00100000:0.0:1651532141.995458:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4236
00000100:00100000:0.0:1651532141.995459:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468542912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.995463:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.995466:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41150c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4cf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.995473:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41150c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4cf expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.995477:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41150c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4cf expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.995481:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532141.995488:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468542912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (155us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.995490:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4236
00000100:00100000:0.0:1651532141.995939:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.995973:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.995981:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.995987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.995996:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532141.995997:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468543296
00000100:00100000:0.0:1651532141.996004:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468543168
00000100:00100000:1.0:1651532141.996007:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468543360
00000100:00100000:1.0:1651532141.996010:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468543488
00000100:00100000:1.0:1651532141.996014:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4237
00000100:00100000:0.0:1651532141.996014:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468543232
00000100:00100000:1.0:1651532141.996015:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000186dea31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468543296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532141.996019:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532141.996019:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4500
00000100:00100000:0.0:1651532141.996021:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb1a7802 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468543168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532141.996023:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411513 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4d6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.996028:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.996032:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411513 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4d6 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.996035:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532141.996036:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.996039:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532141.996040:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.996044:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411513 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4d6 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.996044:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.996048:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532141.996048:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532141.996055:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4501
00000100:00100000:0.0:1651532141.996057:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f4fc3f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468543232:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532141.996062:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000186dea31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468543296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.996065:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4237
00010000:00010000:0.0:1651532141.996068:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532141.996070:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4238
00000100:00100000:1.0:1651532141.996071:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba128a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468543360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.996071:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532141.996072:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.996074:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.996075:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532141.996075:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.996077:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411528 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4dd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.996079:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.996082:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.996083:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411528 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4dd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.996087:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411528 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4dd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.996090:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532141.996090:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4239
00000100:00100000:0.0:1651532141.996092:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5946202 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468543488:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532141.996095:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba128a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468543360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (108us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532141.996095:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532141.996097:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4238
00010000:00010000:0.0:1651532141.996097:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41152f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4e4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.996104:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41152f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4e4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.996108:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41152f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4e4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.996111:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532141.996120:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5946202 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468543488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.996122:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4239
00000100:00100000:0.0:1651532141.996451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.996458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.996471:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.996481:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468543680
00000100:00100000:1.0:1651532141.996483:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468543744
00000100:00100000:0.0:1651532141.996490:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468543872
00000100:00100000:0.0:1651532141.996494:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4240
00000100:00100000:1.0:1651532141.996496:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4241
00000100:00100000:0.0:1651532141.996496:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac9b1854 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468543680:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532141.996498:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468543744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.996499:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.996501:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.996502:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411536 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4eb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.996504:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41153d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4f2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.996510:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411536 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4eb expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.996511:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41153d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4f2 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.996514:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411536 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4eb expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.996515:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41153d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4f2 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.996517:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532141.996519:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532141.996527:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468543744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.996527:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac9b1854 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468543680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.996530:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4240
00000100:00100000:1.0:1651532141.996531:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4241
00000100:00100000:0.0:1651532141.996534:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4242
00000100:00100000:0.0:1651532141.996536:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a079a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468543872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.996538:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532141.996540:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411544 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b4f9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.996546:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411544 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4f9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.996550:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411544 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b4f9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.996556:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532141.996561:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a079a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468543872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.996563:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4242
00000100:00100000:0.0:1651532141.996899:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.996907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532141.996919:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468544064
00000100:00100000:1.0:1651532141.996923:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468544192
00000100:00100000:0.0:1651532141.996929:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4243
00000100:00100000:0.0:1651532141.996931:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e22cbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468544064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.996934:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532141.996936:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4244
00000100:00100000:1.0:1651532141.996938:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468544192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532141.996938:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41154b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b500 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532141.996941:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532141.996944:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411552 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b507 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532141.996945:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41154b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b500 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.996949:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41154b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b500 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.996951:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411552 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b507 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532141.996952:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532141.996955:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411552 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b507 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532141.996958:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532141.996962:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e22cbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468544064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532141.996964:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4243
00000100:00100000:1.0:1651532141.996966:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468544192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532141.996968:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4244
00000001:00080000:1.0:1651532142.128185:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793909 is committed
00010000:00010000:0.0:1651532142.128219:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128227:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128250:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.128251:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468539776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 612544us (612674us total) trans 158913793909 rc 0/0
00000100:00100000:0.0:1651532142.128254:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4492
00010000:00010000:1.0:1651532142.128255:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532142.128256:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128262:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128268:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.128268:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.128269:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128272:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128276:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.128276:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.128277:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128279:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128296:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128299:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411487 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [204800->9760767] (req 204800->9760767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128304:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128307:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128347:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128351:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.128564:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532142.128591:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.128591:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468544448
00010000:00010000:1.0:1651532142.128595:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.128618:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468539840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 612901us (613033us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532142.128620:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4245
00000100:00100000:1.0:1651532142.128622:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4493
00000100:00100000:0.0:1651532142.128622:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468544448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.128626:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.128630:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411559 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b50e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128633:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128636:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128641:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.128649:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411559 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b50e expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532142.128650:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468540608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 516246us (516290us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532142.128652:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4494
00010000:00010000:0.0:1651532142.128653:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411559 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b50e expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.128657:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532142.128658:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128664:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532142.128665:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.128665:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468544448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (102us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532142.128668:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.128668:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4245
00010000:00010000:1.0:1651532142.128674:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.128676:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41148e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->8462335] (req 1064960->8462335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128676:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128679:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532142.128680:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128683:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128688:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.128689:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.128689:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128692:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128700:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128703:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4114a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7598080->10174463] (req 7598080->10174463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128708:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128711:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.128755:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.128784:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468544640
00000100:00100000:0.0:1651532142.128795:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4246
00000100:00100000:0.0:1651532142.128796:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3144eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468544640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.128800:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.128820:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411560 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b515 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.128828:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411560 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b515 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.128832:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411560 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b515 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.128835:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532142.128860:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3144eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468544640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.128863:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4246
00000100:00100000:0.0:1651532142.129178:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.129189:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468544704
00000100:00100000:0.0:1651532142.129191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.129200:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.129208:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468544832
00000100:00100000:1.0:1651532142.129216:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4502
00000100:00100000:1.0:1651532142.129218:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468544704:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532142.129219:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532142.129229:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.129229:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4503
00000100:00100000:0.0:1651532142.129232:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468544832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532142.129234:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532142.129235:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.129238:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532142.129239:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.129240:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.129245:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532142.129247:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.129249:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532142.129250:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.129254:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.129255:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.129258:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.129258:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.129266:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468545024
00000100:00100000:1.0:1651532142.129272:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4247
00000100:00100000:1.0:1651532142.129274:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468545024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.129276:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.129279:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411575 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b51c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.129280:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468545088
00010000:00010000:1.0:1651532142.129286:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411575 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b51c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532142.129289:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4248
00010000:00010000:1.0:1651532142.129290:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411575 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b51c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532142.129291:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000349b5dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468545088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.129293:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532142.129294:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.129297:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41157c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b523 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.129306:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468545024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.129309:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4247
00010000:00010000:0.0:1651532142.129310:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41157c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b523 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.129315:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41157c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b523 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.129321:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532142.129330:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000349b5dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468545088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.129341:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4248
00000100:00100000:0.0:1651532142.129390:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.129417:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468545216
00000100:00100000:0.0:1651532142.129428:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4249
00000100:00100000:0.0:1651532142.129429:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468545216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.129433:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.129436:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411583 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b52a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.129443:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411583 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b52a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.129447:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411583 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b52a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.129451:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532142.129460:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468545216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.129462:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4249
00000001:00080000:1.0:1651532142.228216:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793910 is committed
00010000:00010000:0.0:1651532142.228248:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228256:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.228278:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468540544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 615867us (615906us total) trans 158913793910 rc 0/0
00010000:00010000:1.0:1651532142.228279:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.228281:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4495
00010000:00010000:1.0:1651532142.228283:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532142.228284:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228288:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228293:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.228294:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.228295:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228298:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228307:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228315:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228317:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4114aa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->9326591] (req 86016->9326591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228319:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.228658:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.228667:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.228674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.228679:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.228690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.228702:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468545664
00010000:00010000:0.0:1651532142.228708:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.228711:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468545728
00010000:00010000:0.0:1651532142.228712:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.228713:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468545920
00000100:00100000:1.0:1651532142.228716:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4250
00000100:00100000:1.0:1651532142.228718:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468545664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.228727:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532142.228730:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468541568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483259us (483313us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532142.228731:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41158a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b531 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.228733:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4496
00010000:00010000:1.0:1651532142.228736:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532142.228738:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468545600
00010000:00010000:1.0:1651532142.228739:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41158a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b531 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.228743:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41158a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b531 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532142.228749:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468545536
00010000:00010000:1.0:1651532142.228751:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532142.228755:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4504
00000100:00100000:0.0:1651532142.228757:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468545600:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532142.228761:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468545664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (87us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532142.228763:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.228764:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4250
00010000:00010000:0.0:1651532142.228767:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532142.228769:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4251
00010000:00010000:0.0:1651532142.228769:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532142.228769:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.228770:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468545728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.228773:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.228773:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228775:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411598 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b538 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228780:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532142.228780:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4505
00000100:00100000:0.0:1651532142.228781:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468545536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532142.228782:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411598 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b538 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.228785:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411598 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b538 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.228785:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228789:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532142.228790:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228791:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532142.228793:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228795:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00000100:00100000:1.0:1651532142.228796:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468545728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (117us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532142.228796:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.228798:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4251
00010000:00010000:0.0:1651532142.228800:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.228802:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4252
00010000:00010000:0.0:1651532142.228817:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.228820:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468545920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.228820:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228822:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.228825:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4115a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b53f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228830:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.228831:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4115a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b53f expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.228835:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4115a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b53f expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.228839:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532142.228845:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468545920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (154us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.228847:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4252
00010000:00010000:0.0:1651532142.228865:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228869:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532142.228870:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228873:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228878:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.228879:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.228879:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228883:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228889:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228891:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.228892:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4114cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3047424->7032831] (req 3047424->7032831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.228895:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.229213:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.229220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.229226:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.229236:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468546048
00000100:00100000:0.0:1651532142.229242:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468546176
00000100:00100000:0.0:1651532142.229245:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468546240
00000100:00100000:0.0:1651532142.229248:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4253
00000100:00100000:0.0:1651532142.229249:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468546048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.229253:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.229256:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b546 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.229264:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b546 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.229268:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b546 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.229272:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532142.229281:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468546048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.229283:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4254
00000100:00100000:1.0:1651532142.229285:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468546176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532142.229285:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4253
00010000:00010000:1.0:1651532142.229289:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532142.229289:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4255
00000100:00100000:0.0:1651532142.229291:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468546240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.229292:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b54d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.229293:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.229296:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4115bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b554 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.229300:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b54d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.229301:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4115bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b554 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.229304:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b54d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.229305:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4115bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b554 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.229307:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532142.229309:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532142.229316:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468546176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.229319:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4254
00000100:00100000:0.0:1651532142.229320:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468546240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.229323:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4255
00000100:00100000:1.0:1651532142.268855:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1651532142.268863:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000641df69a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966863680:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532142.269116:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000641df69a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966863680:10.240.43.61@tcp:400:kworker/u4:2.0
00000001:00080000:1.0:1651532142.379019:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793911 is committed
00010000:00010000:1.0:1651532142.379035:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.379039:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.379060:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468541504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 633577us (633635us total) trans 158913793911 rc 0/0
00000100:00100000:1.0:1651532142.379064:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4497
00010000:00010000:0.0:1651532142.379072:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379077:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532142.379078:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379081:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379088:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.379088:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.379090:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379093:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379103:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379106:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4114d4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->8548351] (req 2326528->8548351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.379113:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.379118:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.379434:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.379442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.379450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.379470:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468546880
00000100:00100000:0.0:1651532142.379480:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4256
00000100:00100000:0.0:1651532142.379482:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468546880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.379486:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.379489:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4115c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b55b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379497:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4115c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b55b expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.379501:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4115c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b55b expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.379505:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532142.379515:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468546880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.379519:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468546752
00000100:00100000:0.0:1651532142.379520:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4256
00000100:00100000:1.0:1651532142.379533:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468546688
00000100:00100000:1.0:1651532142.379541:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4506
00000100:00100000:1.0:1651532142.379543:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468546752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532142.379550:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.379555:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532142.379556:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.379561:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4507
00000100:00100000:0.0:1651532142.379563:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468546688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532142.379568:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532142.379569:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379570:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379576:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532142.379577:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379580:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532142.379581:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.379584:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379585:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.379588:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.379588:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532142.494878:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793912 is committed
00010000:00010000:1.0:1651532142.494892:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.494896:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.494919:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468542272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 598955us (598994us total) trans 158913793912 rc 0/0
00010000:00010000:0.0:1651532142.494920:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.494922:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4498
00010000:00010000:0.0:1651532142.494925:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532142.494926:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.494932:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.494938:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.494939:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.494940:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.494943:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.494951:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.494954:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4114f7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->9781247] (req 442368->9781247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.494965:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.494969:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.495202:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.495216:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468547200
00010000:00010000:1.0:1651532142.495223:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.495226:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4257
00010000:00010000:1.0:1651532142.495227:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.495228:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468547200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.495232:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.495241:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4115d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b562 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.495248:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468542336:12345-10.240.43.64@tcp:3:fio.0 Request processed in 599267us (599306us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532142.495251:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4499
00010000:00010000:0.0:1651532142.495251:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.495254:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4115d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b562 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.495261:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4115d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b562 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.495262:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495266:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532142.495267:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495270:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495281:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.495281:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532142.495282:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.495283:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495286:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.495290:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468547200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (89us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532142.495296:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495298:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4114fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9269248->10346495] (req 9269248->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.495299:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4257
00010000:00010000:0.0:1651532142.495307:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.495310:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.495317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.495380:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468547392
00000100:00100000:1.0:1651532142.495392:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4258
00000100:00100000:1.0:1651532142.495394:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468547392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.495397:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.495401:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4115de lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b569 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495409:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4115de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b569 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.495413:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4115de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b569 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.495417:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532142.495429:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468547392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.495432:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4258
00000100:00100000:0.0:1651532142.495671:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.495682:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468547584
00000100:00100000:0.0:1651532142.495682:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.495692:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.495703:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468547520
00000100:00100000:1.0:1651532142.495712:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4508
00000100:00100000:1.0:1651532142.495714:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468547584:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532142.495717:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4509
00000100:00100000:0.0:1651532142.495719:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468547520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532142.495721:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495728:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532142.495728:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495729:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495732:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532142.495732:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.495737:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532142.495739:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.495741:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532142.495742:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495756:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495760:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.495768:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.495770:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468547712
00010000:00010000:0.0:1651532142.495772:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.495779:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4259
00000100:00100000:1.0:1651532142.495780:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468547712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.495783:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.495786:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4115f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b570 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.495792:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4115f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b570 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.495796:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4115f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b570 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.495827:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532142.495838:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468547712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (146us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.495841:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4259
00000001:00080000:1.0:1651532142.561602:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793913 is committed
00010000:00010000:0.0:1651532142.561636:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.561641:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.561663:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.561663:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb1a7802 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468543168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565641us (565725us total) trans 158913793913 rc 0/0
00010000:00010000:1.0:1651532142.561667:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532142.561667:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4500
00010000:00010000:1.0:1651532142.561668:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.561672:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.561677:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.561678:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.561679:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.561682:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.561691:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.561694:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41151a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9834495] (req 1077248->9834495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.561701:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.561705:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.562005:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.562017:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.562023:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468547968
00000100:00100000:0.0:1651532142.562024:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.562032:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468548032
00000100:00100000:1.0:1651532142.562035:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468548160
00000100:00100000:1.0:1651532142.562038:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4260
00010000:00010000:0.0:1651532142.562038:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.562040:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468547968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.562044:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.562045:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562047:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4115fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b577 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562053:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.562056:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4115fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b577 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532142.562062:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f4fc3f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468543232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566004us (566089us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532142.562065:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4501
00010000:00010000:1.0:1651532142.562067:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4115fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b577 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.562071:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532142.562072:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.562075:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532142.562076:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.562079:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.562080:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468547968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.562083:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4260
00010000:00010000:0.0:1651532142.562084:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.562085:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.562086:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.562088:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4261
00000100:00100000:1.0:1651532142.562089:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468548032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.562089:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562092:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.562097:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.562100:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411521 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1679360->8703999] (req 1679360->8703999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562106:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411601 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b57e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.562108:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4262
00000100:00100000:0.0:1651532142.562110:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468548160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.562114:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.562115:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411601 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b57e expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.562117:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411608 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b585 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562119:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411601 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b57e expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.562123:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532142.562124:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411608 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b585 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.562128:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411608 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b585 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532142.562129:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468548032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (112us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532142.562131:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532142.562132:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4261
00010000:00010000:1.0:1651532142.562139:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.562139:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468548160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (115us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.562141:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4262
00010000:00010000:1.0:1651532142.562142:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.562638:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.562651:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.562671:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468548352
00000100:00100000:1.0:1651532142.562677:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.562689:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468548288
00000100:00100000:1.0:1651532142.562692:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.562703:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4510
00000100:00100000:1.0:1651532142.562706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.562706:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468548352:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532142.562717:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4511
00010000:00010000:0.0:1651532142.562718:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.562719:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468548288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532142.562722:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532142.562723:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.562726:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532142.562727:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.562727:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.562731:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562734:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532142.562736:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562738:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532142.562739:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.562743:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562744:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562747:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.562751:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468548416
00000100:00100000:0.0:1651532142.562759:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468548672
00000100:00100000:0.0:1651532142.562762:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468548800
00000100:00100000:0.0:1651532142.562766:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4263
00000100:00100000:0.0:1651532142.562767:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468548416:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532142.562768:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4264
00000100:00100000:1.0:1651532142.562770:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468548672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.562770:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.562772:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.562773:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41161d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b58c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562775:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411624 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b593 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.562780:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41161d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b58c expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.562782:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411624 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b593 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.562784:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41161d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b58c expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.562786:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411624 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b593 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.562788:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532142.562790:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532142.562815:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468548672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (123us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.562818:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4264
00000100:00100000:0.0:1651532142.562824:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468548416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (154us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.562825:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4265
00000100:00100000:1.0:1651532142.562826:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468548800:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532142.562828:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4263
00010000:00010000:1.0:1651532142.562829:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.562832:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41162b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b59a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.562838:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41162b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b59a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.562842:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41162b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b59a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.562845:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532142.562851:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468548800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (145us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.562853:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4265
00000100:00100000:1.0:1651532142.563153:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.563161:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.563167:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.563177:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468548928
00000100:00100000:0.0:1651532142.563178:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468548992
00000100:00100000:1.0:1651532142.563187:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468549184
00000100:00100000:1.0:1651532142.563191:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4266
00000100:00100000:1.0:1651532142.563192:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468548928:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532142.563194:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4267
00000100:00100000:0.0:1651532142.563196:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468548992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.563197:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.563199:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.563200:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411632 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5a1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.563203:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411639 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5a8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.563207:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411632 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5a1 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.563211:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411632 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5a1 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.563211:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411639 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5a8 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.563215:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532142.563215:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411639 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5a8 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.563218:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532142.563226:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468548928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.563229:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4266
00000100:00100000:0.0:1651532142.563232:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468548992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.563234:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4268
00000100:00100000:1.0:1651532142.563235:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468549184:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532142.563236:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4267
00010000:00010000:1.0:1651532142.563238:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.563240:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411640 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5af expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.563245:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411640 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5af expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.563249:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411640 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5af expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.563255:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532142.563260:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468549184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.563263:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4268
00000001:00080000:1.0:1651532142.694909:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793914 is committed
00002000:00010000:1.0:1651532142.694923:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532141 -> 1651532142
00002000:00010000:1.0:1651532142.694924:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532141 -> 1651532142
00010000:00010000:1.0:1651532142.694927:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.694931:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.694947:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468544704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565728us (565770us total) trans 158913793914 rc 0/0
00000100:00100000:1.0:1651532142.694950:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4502
00010000:00010000:1.0:1651532142.694956:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.694960:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532142.694961:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.694964:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.694972:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.694972:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.694973:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.694976:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.694979:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.694980:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.694980:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.694983:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.694996:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.694999:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411567 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->9654271] (req 147456->9654271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.695011:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.695016:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695039:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695043:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.695331:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.695353:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532142.695376:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695381:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.695384:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.695398:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468545600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466640us (466740us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532142.695401:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4504
00010000:00010000:0.0:1651532142.695401:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695408:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695411:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532142.695413:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695415:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.695417:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468544832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566185us (566226us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532142.695421:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.695421:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4503
00010000:00010000:1.0:1651532142.695423:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411591 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4923392->9306111] (req 4923392->9306111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695427:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695432:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532142.695433:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695435:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695439:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.695439:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.695440:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695443:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695451:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.695458:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695462:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41156e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->8343551] (req 1085440->8343551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.695462:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.695470:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468549504
00000100:00100000:1.0:1651532142.695480:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468549568
00000100:00100000:1.0:1651532142.695487:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4269
00000100:00100000:1.0:1651532142.695488:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468549504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.695492:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.695500:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411647 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5b6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.695500:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4270
00000100:00100000:0.0:1651532142.695502:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468549568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.695505:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.695507:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411647 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5b6 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.695509:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41164e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5bd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695512:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411647 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5b6 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.695515:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532142.695517:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41164e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5bd expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.695521:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41164e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5bd expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532142.695522:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468549504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (192us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532142.695524:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532142.695525:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4269
00000100:00100000:0.0:1651532142.695532:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468549568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (179us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.695535:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4270
00000100:00100000:0.0:1651532142.695825:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.695834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.695853:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.695854:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468549696
00000100:00100000:0.0:1651532142.695861:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468549632
00000100:00100000:1.0:1651532142.695865:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4512
00000100:00100000:1.0:1651532142.695867:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468549696:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532142.695875:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4513
00000100:00100000:0.0:1651532142.695877:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468549632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532142.695879:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695883:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532142.695884:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.695885:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695887:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532142.695888:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.695892:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532142.695893:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.695896:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532142.695897:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695900:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.695901:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.695905:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.695907:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.695989:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468549824
00000100:00100000:0.0:1651532142.695998:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4271
00000100:00100000:1.0:1651532142.696000:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.696000:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468549824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.696003:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.696006:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411663 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5c4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.696009:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532142.696014:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411663 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5c4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532142.696015:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468549952
00010000:00010000:0.0:1651532142.696018:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411663 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5c4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532142.696020:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468550080
00010000:00010000:0.0:1651532142.696022:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532142.696023:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4272
00000100:00100000:1.0:1651532142.696024:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468549952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.696027:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.696030:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41166a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5cb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.696033:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468549824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (180us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.696036:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4271
00010000:00010000:1.0:1651532142.696038:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41166a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5cb expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532142.696040:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4273
00010000:00010000:1.0:1651532142.696042:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41166a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5cb expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532142.696042:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468550080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.696045:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532142.696045:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.696047:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411671 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5d2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.696052:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411671 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5d2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.696056:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411671 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5d2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532142.696067:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468549952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.696069:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4272
00010000:00010000:0.0:1651532142.696076:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532142.696084:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468550080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.696087:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4273
00000100:00100000:1.0:1651532142.696446:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.696460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.696469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.696471:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468550208
00000100:00100000:1.0:1651532142.696477:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468550272
00000100:00100000:0.0:1651532142.696482:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468550464
00000100:00100000:0.0:1651532142.696487:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4274
00000100:00100000:0.0:1651532142.696488:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468550208:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532142.696489:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4275
00000100:00100000:1.0:1651532142.696490:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468550464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.696492:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.696494:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.696495:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411678 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5d9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.696497:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41167f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5e7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.696502:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411678 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5d9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.696504:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41167f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5e7 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.696506:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411678 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5d9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.696508:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41167f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5e7 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.696510:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532142.696512:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532142.696520:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468550464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.696520:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468550208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.696523:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4275
00000100:00100000:0.0:1651532142.696525:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4274
00000100:00100000:1.0:1651532142.696528:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4276
00000100:00100000:1.0:1651532142.696529:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468550272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.696531:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.696533:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411686 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5e0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.696538:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411686 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5e0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.696545:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411686 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5e0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.696548:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532142.696552:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468550272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.696555:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4276
00000100:00100000:1.0:1651532142.696922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.696929:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.696936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.696946:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468550656
00000100:00100000:0.0:1651532142.696946:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468550720
00000100:00100000:1.0:1651532142.696954:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468550912
00000100:00100000:1.0:1651532142.696958:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4277
00000100:00100000:1.0:1651532142.696960:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468550656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532142.696961:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4278
00010000:00010000:1.0:1651532142.696963:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532142.696963:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468550720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.696966:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41168d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5ee expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.696967:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.696970:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411694 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5f5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.696974:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41168d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5ee expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.696977:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411694 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5f5 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.696978:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41168d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5ee expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.696981:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532142.696981:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411694 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5f5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.696985:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532142.696993:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468550656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.696996:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4277
00000100:00100000:0.0:1651532142.696999:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468550720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.697000:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4279
00000100:00100000:1.0:1651532142.697002:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083b26f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468550912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532142.697002:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4278
00010000:00010000:1.0:1651532142.697004:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.697007:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41169b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b5fc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.697012:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41169b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5fc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.697016:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41169b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b5fc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.697019:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532142.697025:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083b26f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468550912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.697027:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4279
00000100:00100000:1.0:1651532142.697331:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.697348:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.697354:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468551104
00000100:00100000:1.0:1651532142.697363:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468551168
00000100:00100000:1.0:1651532142.697370:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4280
00000100:00100000:1.0:1651532142.697371:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468551104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.697375:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532142.697375:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4281
00000100:00100000:0.0:1651532142.697377:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000186dea31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468551168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.697378:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b603 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.697381:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.697384:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b60a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.697385:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b603 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.697389:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b603 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.697392:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532142.697392:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b60a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.697396:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b60a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532142.697403:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468551104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.697406:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4280
00010000:00010000:0.0:1651532142.697407:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532142.697416:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000186dea31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468551168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.697419:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4281
00000100:00100000:1.0:1651532142.697633:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.697644:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468551488
00000100:00100000:0.0:1651532142.697651:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4282
00000100:00100000:0.0:1651532142.697653:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba128a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468551488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.697656:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.697659:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b611 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.697666:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b611 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.697670:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b611 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.697673:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532142.697683:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba128a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468551488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532142.697685:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4282
00000001:00080000:1.0:1651532142.803272:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793915 is committed
00010000:00010000:0.0:1651532142.803308:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.803312:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.803342:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468545536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574551us (574665us total) trans 158913793915 rc 0/0
00010000:00010000:1.0:1651532142.803344:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.803346:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4505
00010000:00010000:1.0:1651532142.803349:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532142.803350:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803354:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803360:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.803360:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.803361:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803367:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803375:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.803381:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803386:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41159f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3997696->10305535] (req 3997696->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.803386:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.803736:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.803747:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.803759:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.803764:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468551744
00000100:00100000:0.0:1651532142.803765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.803771:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.803782:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468551808
00000100:00100000:1.0:1651532142.803792:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4514
00000100:00100000:1.0:1651532142.803794:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468551744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532142.803794:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.803798:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803802:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803819:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532142.803820:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803823:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532142.803823:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.803827:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468546752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424283us (424393us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532142.803828:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.803830:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4506
00010000:00010000:1.0:1651532142.803831:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.803836:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4515
00000100:00100000:0.0:1651532142.803838:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468551808:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532142.803841:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468551872
00000100:00100000:1.0:1651532142.803848:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468552000
00000100:00100000:1.0:1651532142.803850:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468552064
00000100:00100000:1.0:1651532142.803853:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4283
00000100:00100000:1.0:1651532142.803855:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468551872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532142.803855:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803857:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532142.803859:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.803860:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4116c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b618 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.803860:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.803863:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532142.803864:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803867:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.803869:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803870:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4116c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b618 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.803873:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803874:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4116c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b618 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.803878:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532142.803881:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.803884:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532142.803885:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.803887:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468551872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (128us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532142.803888:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.803889:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4283
00010000:00010000:0.0:1651532142.803893:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.803893:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532142.803894:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4284
00000100:00100000:1.0:1651532142.803895:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468552000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.803898:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.803900:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4116cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b61f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.803900:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.803903:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803908:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4116cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b61f expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.803911:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803912:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4116cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b61f expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.803914:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4115c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2494464->10412031] (req 2494464->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803915:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532142.803919:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.803920:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468552000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (154us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.803922:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4284
00010000:00010000:0.0:1651532142.803922:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532142.803925:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4285
00000100:00100000:1.0:1651532142.803927:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468552064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.803929:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.803931:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4116d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b626 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.803936:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4116d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b626 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.803939:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4116d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b626 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.803942:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532142.803947:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468552064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (176us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.803950:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4285
00000100:00100000:0.0:1651532142.804298:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.804317:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468552192
00000100:00100000:1.0:1651532142.804324:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4286
00000100:00100000:1.0:1651532142.804326:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468552192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.804329:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.804332:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4116da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b62d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.804349:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4116da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b62d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.804353:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4116da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b62d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.804356:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532142.804370:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468552192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.804372:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4286
00000100:00100000:0.0:1651532142.804562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.804579:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468552576
00000100:00100000:1.0:1651532142.804586:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4287
00000100:00100000:1.0:1651532142.804588:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468552576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.804591:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.804594:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4116e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b634 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.804601:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4116e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b634 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.804605:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4116e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b634 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.804608:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532142.804622:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468552576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.804624:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4287
00000001:00080000:1.0:1651532142.936618:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793916 is committed
00010000:00010000:0.0:1651532142.936650:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.936655:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.936679:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.936679:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468546688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557115us (557236us total) trans 158913793916 rc 0/0
00000100:00100000:0.0:1651532142.936682:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4507
00010000:00010000:1.0:1651532142.936684:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532142.936685:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.936689:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.936694:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.936695:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.936696:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.936699:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.936707:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.936710:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4115d0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4489216->8634367] (req 4489216->8634367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.936716:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.936721:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.937007:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.937016:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532142.937022:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.937033:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468552832
00000100:00100000:0.0:1651532142.937037:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468552704
00000100:00100000:1.0:1651532142.937044:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4288
00000100:00100000:1.0:1651532142.937045:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468552832:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532142.937048:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468552768
00010000:00010000:1.0:1651532142.937049:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.937052:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4116e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b63b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.937057:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4516
00000100:00100000:0.0:1651532142.937059:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468552704:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532142.937065:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.937066:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937067:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4116e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b63b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.937071:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532142.937072:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.937075:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532142.937076:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937079:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4116e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b63b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532142.937080:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937083:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532142.937084:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.937094:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4517
00000100:00100000:1.0:1651532142.937097:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468552832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.937100:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4288
00000100:00100000:0.0:1651532142.937102:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468552768:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532142.937108:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.937111:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532142.937112:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.937114:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532142.937115:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.937119:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.937122:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.937132:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532142.937135:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937146:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937150:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532142.937151:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.937153:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468547584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441438us (441482us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532142.937154:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.937158:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4508
00010000:00010000:1.0:1651532142.937159:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.937160:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532142.937161:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937164:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937173:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937176:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4115e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3354624->5046271] (req 3354624->5046271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937185:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937188:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532142.937443:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.937459:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468553152
00000100:00100000:1.0:1651532142.937468:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4289
00000100:00100000:1.0:1651532142.937470:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468553152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.937473:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.937477:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4116fd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b642 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937485:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4116fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b642 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.937489:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4116fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b642 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.937493:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532142.937510:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468553152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.937512:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4289
00000100:00100000:0.0:1651532142.937755:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532142.937772:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468553280
00000100:00100000:1.0:1651532142.937780:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4290
00000100:00100000:1.0:1651532142.937782:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468553280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532142.937785:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532142.937797:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411704 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b649 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532142.937818:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411704 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b649 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.937822:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411704 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b649 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532142.937825:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532142.937838:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468553280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532142.937841:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4290
00000001:00080000:1.0:1651532143.053235:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793917 is committed
00010000:00010000:1.0:1651532143.053252:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053256:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.053281:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468547520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557560us (557598us total) trans 158913793917 rc 0/0
00010000:00010000:0.0:1651532143.053282:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.053284:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4509
00010000:00010000:0.0:1651532143.053288:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532143.053289:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053293:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053299:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.053299:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.053300:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053303:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053311:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053314:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4115ec lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3440640->9256959] (req 3440640->9256959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053319:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053322:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.053675:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.053683:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.053694:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.053695:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468553536
00000100:00100000:1.0:1651532143.053700:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.053706:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.053707:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468553472
00000100:00100000:1.0:1651532143.053714:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.053726:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4518
00000100:00100000:0.0:1651532143.053728:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5946202 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468553536:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532143.053738:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4519
00000100:00100000:1.0:1651532143.053740:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac9b1854 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468553472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532143.053740:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053744:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.053745:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053749:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053749:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053753:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532143.053754:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053760:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053763:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532143.053764:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053767:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053770:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053774:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053782:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053786:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.053789:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468548352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491083us (491151us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532143.053792:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.053793:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4510
00010000:00010000:1.0:1651532143.053795:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.053796:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053799:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.053800:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468553664
00010000:00010000:1.0:1651532143.053814:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.053819:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.053820:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.053821:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468553728
00010000:00010000:1.0:1651532143.053823:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.053824:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468553792
00000100:00100000:0.0:1651532143.053826:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468553856
00000100:00100000:0.0:1651532143.053829:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4291
00010000:00010000:1.0:1651532143.053830:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.053830:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468553664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.053832:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41160f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->8450047] (req 643072->8450047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053834:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.053837:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411719 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b650 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053838:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.053841:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053845:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411719 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b650 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.053849:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411719 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b650 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.053853:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532143.053862:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468553664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (168us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.053865:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4291
00000100:00100000:1.0:1651532143.053867:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4292
00000100:00100000:1.0:1651532143.053869:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a079a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468553728:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532143.053869:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4293
00000100:00100000:0.0:1651532143.053871:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e22cbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468553792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.053872:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.053873:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.053875:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411720 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b657 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053875:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411727 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b65e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053881:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411727 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b65e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.053883:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411720 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b657 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.053887:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411720 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b657 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.053888:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411727 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b65e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.053891:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532143.053891:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532143.053896:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e22cbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468553792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (190us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.053898:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a079a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468553728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (197us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.053899:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4293
00000100:00100000:1.0:1651532143.053901:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4292
00000100:00100000:0.0:1651532143.053902:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4294
00000100:00100000:0.0:1651532143.053904:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468553856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.053906:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.053908:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41172e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b665 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.053913:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41172e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b665 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.053917:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41172e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b665 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.053920:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532143.053925:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468553856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (211us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.053927:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4294
00000001:00080000:1.0:1651532143.153325:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793918 is committed
00010000:00010000:1.0:1651532143.153351:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153355:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.153378:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468548288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 590658us (590726us total) trans 158913793918 rc 0/0
00000100:00100000:1.0:1651532143.153381:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4511
00010000:00010000:1.0:1651532143.153389:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153392:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.153393:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153396:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153401:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.153402:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.153403:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153406:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153422:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153426:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411616 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1220608->2936831] (req 1220608->2936831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153431:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153434:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.153643:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.153667:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468554304
00000100:00100000:0.0:1651532143.153672:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.153688:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468554240
00000100:00100000:0.0:1651532143.153689:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.153697:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4520
00000100:00100000:1.0:1651532143.153699:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468554304:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532143.153711:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.153713:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4521
00010000:00010000:1.0:1651532143.153715:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532143.153715:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468554240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532143.153716:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153719:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532143.153720:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153724:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.153725:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153728:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.153731:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532143.153732:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.153735:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532143.153736:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.153740:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.153744:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153748:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153751:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.153752:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468554368
00000100:00100000:0.0:1651532143.153770:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4295
00000100:00100000:0.0:1651532143.153772:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030a5b84a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468554368:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532143.153775:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468549696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 457908us (457951us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532143.153775:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.153778:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411743 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b66c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.153779:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4512
00010000:00010000:0.0:1651532143.153786:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.153789:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411743 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b66c expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.153793:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411743 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b66c expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.153797:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532143.153820:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030a5b84a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468554368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.153823:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4295
00010000:00010000:1.0:1651532143.153853:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153857:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.153859:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153862:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153866:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.153867:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.153868:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153871:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153881:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.153883:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411655 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->10481663] (req 143360->10481663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.153884:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.153889:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.154137:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.154149:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.154164:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468554496
00000100:00100000:1.0:1651532143.154171:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468554560
00000100:00100000:1.0:1651532143.154175:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4296
00000100:00100000:1.0:1651532143.154177:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468554496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.154180:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.154184:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41174a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b673 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.154191:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41174a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b673 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.154195:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41174a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b673 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.154201:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532143.154216:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468554496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.154218:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4296
00000100:00100000:1.0:1651532143.154223:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4297
00000100:00100000:1.0:1651532143.154225:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3144eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468554560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.154227:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.154230:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411751 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b67a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.154235:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411751 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b67a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.154239:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411751 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b67a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.154242:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532143.154261:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3144eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468554560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.154263:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4297
00000100:00100000:0.0:1651532143.154269:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.154319:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468554688
00000100:00100000:1.0:1651532143.154326:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4298
00000100:00100000:1.0:1651532143.154327:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468554688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.154331:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.154344:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411758 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b681 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.154351:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411758 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b681 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.154355:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411758 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b681 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.154358:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532143.154372:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468554688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.154375:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4298
00000100:00100000:1.0:1651532143.154590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.154598:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.154604:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468555008
00000100:00100000:1.0:1651532143.154609:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468555072
00000100:00100000:1.0:1651532143.154617:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4299
00000100:00100000:1.0:1651532143.154619:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083b26f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468555008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.154622:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532143.154622:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4300
00010000:00010000:1.0:1651532143.154625:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41175f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b688 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.154625:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468555072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.154629:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.154632:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41175f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b688 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.154633:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411766 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b68f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.154636:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41175f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b688 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.154640:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532143.154642:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411766 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b68f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.154646:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411766 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b68f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532143.154652:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083b26f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468555008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.154654:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4299
00010000:00010000:0.0:1651532143.154657:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532143.154666:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468555072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.154669:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4300
00000001:00080000:1.0:1651532143.244983:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793919 is committed
00010000:00010000:0.0:1651532143.245014:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.245019:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.245040:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468549632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549162us (549206us total) trans 158913793919 rc 0/0
00010000:00010000:1.0:1651532143.245044:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.245044:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4513
00010000:00010000:1.0:1651532143.245048:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.245049:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245052:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245058:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.245059:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.245059:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245062:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245070:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245073:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41165c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4894720->8441855] (req 4894720->8441855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.245080:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.245084:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.245436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.245443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.245455:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.245460:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468555392
00000100:00100000:1.0:1651532143.245470:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468555328
00000100:00100000:1.0:1651532143.245480:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4522
00000100:00100000:1.0:1651532143.245482:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468555392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532143.245489:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245493:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532143.245494:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245497:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532143.245498:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245502:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245505:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.245513:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4523
00000100:00100000:1.0:1651532143.245514:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468555328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532143.245518:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245522:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532143.245523:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245525:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532143.245526:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245529:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.245532:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.245534:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468555584
00000100:00100000:0.0:1651532143.245546:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4301
00000100:00100000:0.0:1651532143.245548:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468555584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.245552:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.245556:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41177b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b696 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.245565:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41177b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b696 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.245569:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41177b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b696 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.245572:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532143.245583:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468555584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.245586:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4301
00000001:00080000:1.0:1651532143.353349:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793920 is committed
00010000:00010000:0.0:1651532143.353383:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.353388:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.353411:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468551744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549616us (549675us total) trans 158913793920 rc 0/0
00010000:00010000:1.0:1651532143.353412:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.353414:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4514
00010000:00010000:1.0:1651532143.353416:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.353417:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.353420:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.353426:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.353427:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.353428:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.353431:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.353440:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.353448:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.353451:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4116b7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1433600->9752575] (req 1433600->9752575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.353455:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.353699:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532143.353715:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.353719:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.353737:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.353740:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f532ccd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468551808:12345-10.240.43.64@tcp:3:fio.0 Request processed in 549901us (549992us total) trans 0 rc 57344/57344
00010000:00010000:1.0:1651532143.353741:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.353742:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.353743:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4515
00010000:00010000:1.0:1651532143.353744:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.353749:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.353749:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.353750:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.353751:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468555712
00010000:00010000:1.0:1651532143.353753:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.353761:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4302
00010000:00010000:1.0:1651532143.353768:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.353769:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468555712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.353771:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4116be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9379839] (req 262144->9379839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.353772:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.353776:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411782 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b69d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.353781:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.353784:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.353784:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411782 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b69d expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.353788:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411782 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b69d expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.353794:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532143.353802:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468555712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.353822:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4302
00000100:00100000:0.0:1651532143.353866:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.353892:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468555904
00000100:00100000:0.0:1651532143.353902:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4303
00000100:00100000:0.0:1651532143.353904:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468555904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.353907:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.353911:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411789 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6a4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.353918:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411789 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6a4 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.353922:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411789 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6a4 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.353926:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532143.353935:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468555904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.353937:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4303
00000100:00100000:0.0:1651532143.354178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.354186:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.354214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.354222:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.354232:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468556096
00000100:00100000:0.0:1651532143.354232:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468556224
00000100:00100000:1.0:1651532143.354241:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468556288
00000100:00100000:0.0:1651532143.354241:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468556160
00000100:00100000:1.0:1651532143.354246:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4304
00000100:00100000:0.0:1651532143.354247:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4524
00000100:00100000:1.0:1651532143.354248:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468556096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532143.354249:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468556224:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532143.354252:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.354255:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411790 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6ab expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.354256:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.354261:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532143.354262:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.354265:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532143.354265:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.354271:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.354272:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411790 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6ab expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.354274:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.354276:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411790 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6ab expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354280:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532143.354281:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4525
00000100:00100000:0.0:1651532143.354283:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468556160:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532143.354288:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.354293:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468556096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.354296:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4304
00010000:00010000:0.0:1651532143.354298:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532143.354300:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.354301:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4305
00000100:00100000:1.0:1651532143.354302:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468556288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.354302:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532143.354303:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.354305:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.354307:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.354308:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4117a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6b2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.354310:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.354313:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4117a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6b2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354317:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4117a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6b2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354320:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532143.354325:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468556288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.354328:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4305
00000100:00100000:0.0:1651532143.354407:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.354417:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468556416
00000100:00100000:1.0:1651532143.354424:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4306
00000100:00100000:1.0:1651532143.354426:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468556416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.354429:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.354432:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4117ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6b9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.354439:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4117ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6b9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354443:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4117ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6b9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354449:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532143.354468:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468556416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.354470:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4306
00000100:00100000:0.0:1651532143.354570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.354579:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468556608
00000100:00100000:1.0:1651532143.354585:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4307
00000100:00100000:1.0:1651532143.354587:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468556608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.354590:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532143.354591:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532143.354593:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4117b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6c0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.354613:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4117b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6c0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354617:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4117b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6c0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354620:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532143.354632:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468556608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.354635:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4307
00000100:00100000:1.0:1651532143.354639:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468556672
00000100:00100000:1.0:1651532143.354646:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4308
00000100:00100000:1.0:1651532143.354648:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468556672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.354658:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.354661:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4117ba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6c7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.354667:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4117ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6c7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354671:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4117ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6c7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354674:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532143.354685:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468556672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.354688:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4308
00000100:00100000:0.0:1651532143.354881:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.354890:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468556928
00000100:00100000:0.0:1651532143.354893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.354904:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4309
00000100:00100000:1.0:1651532143.354906:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468556928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.354909:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.354912:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6ce expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.354919:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6ce expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354922:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6ce expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354928:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532143.354940:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468556928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.354943:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4309
00000100:00100000:1.0:1651532143.354947:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468557056
00000100:00100000:1.0:1651532143.354954:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4310
00000100:00100000:1.0:1651532143.354955:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468557056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.354958:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.354969:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4117c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6d5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.354976:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4117c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6d5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354980:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4117c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6d5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.354983:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532143.354994:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468557056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.354996:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4310
00000100:00100000:0.0:1651532143.355172:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.355182:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468557184
00000100:00100000:1.0:1651532143.355188:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4311
00000100:00100000:1.0:1651532143.355189:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468557184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.355193:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.355196:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4117cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6dc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.355202:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4117cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6dc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.355205:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4117cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6dc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.355209:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532143.355221:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468557184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.355223:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4311
00000001:00080000:1.0:1651532143.453369:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793921 is committed
00010000:00010000:1.0:1651532143.453385:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453389:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.453411:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468552704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516351us (516405us total) trans 158913793921 rc 0/0
00000100:00100000:1.0:1651532143.453414:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4516
00010000:00010000:1.0:1651532143.453422:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453428:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.453429:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453432:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453437:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.453437:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.453438:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453450:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453454:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.453454:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.453455:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453458:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453469:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453473:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4116ef lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8790015] (req 741376->8790015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.453482:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453485:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.453487:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453488:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.453721:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.453731:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.453732:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468557504
00000100:00100000:1.0:1651532143.453749:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468557568
00000100:00100000:0.0:1651532143.453751:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.453760:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468557632
00000100:00100000:1.0:1651532143.453764:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4312
00000100:00100000:1.0:1651532143.453766:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468557504:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532143.453767:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4313
00010000:00010000:1.0:1651532143.453769:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532143.453769:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468557568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.453773:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4117d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6e3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.453773:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.453777:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4117dd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6ea expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453779:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.453781:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4117d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6e3 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.453783:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.453786:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4117d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6e3 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.453786:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4117dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6ea expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.453789:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532143.453791:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4117dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6ea expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.453794:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532143.453817:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468557504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.453820:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4312
00000100:00100000:0.0:1651532143.453825:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468557568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.453826:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4314
00000100:00100000:1.0:1651532143.453827:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468557632:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532143.453828:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4313
00010000:00010000:1.0:1651532143.453830:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.453833:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4117e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6f1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453838:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.453840:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4117e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6f1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.453841:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.453845:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453849:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4117e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6f1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.453858:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532143.453861:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468552768:12345-10.240.43.64@tcp:3:fio.0 Request processed in 516758us (516845us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532143.453864:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4517
00000100:00100000:1.0:1651532143.453865:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468557632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.453868:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4314
00010000:00010000:1.0:1651532143.453879:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453883:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.453894:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5946202 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468553536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 400166us (400220us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532143.453908:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.453915:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532143.453916:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.453919:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.453924:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4518
00010000:00010000:0.0:1651532143.453925:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.453928:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4116f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->10301439] (req 118784->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453931:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453935:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.453936:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453939:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453944:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.453945:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.453945:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453948:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453955:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453958:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41170b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7319552->9539583] (req 7319552->9539583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453963:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.453966:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.454287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.454296:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.454304:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.454310:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.454317:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468557824
00000100:00100000:1.0:1651532143.454358:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468557888
00000100:00100000:1.0:1651532143.454370:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4526
00000100:00100000:1.0:1651532143.454372:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468557888:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532143.454373:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4527
00000100:00100000:0.0:1651532143.454375:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468557824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532143.454379:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.454383:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532143.454383:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.454384:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.454387:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532143.454388:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.454393:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532143.454394:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.454400:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532143.454400:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.454404:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.454405:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.454408:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.454408:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.454417:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468558016
00000100:00100000:0.0:1651532143.454426:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468558144
00000100:00100000:0.0:1651532143.454431:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4315
00000100:00100000:0.0:1651532143.454432:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468558016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532143.454435:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4316
00010000:00010000:0.0:1651532143.454435:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532143.454437:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468558144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.454438:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4117f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6f8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.454440:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.454445:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4117f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6f8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.454449:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4117f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6f8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.454452:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411800 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b6ff expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.454453:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532143.454459:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411800 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6ff expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532143.454461:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468558016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (157us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.454464:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4315
00010000:00010000:1.0:1651532143.454467:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411800 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b6ff expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.454470:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532143.454479:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468558144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (169us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.454481:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.454482:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4316
00000100:00100000:1.0:1651532143.454487:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468558272
00000100:00100000:1.0:1651532143.454498:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4317
00000100:00100000:1.0:1651532143.454499:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468558272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.454502:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.454505:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411807 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b706 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.454511:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411807 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b706 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.454524:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411807 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b706 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.454527:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532143.454541:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468558272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.454544:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4317
00000100:00100000:0.0:1651532143.454750:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.454767:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468558400
00000100:00100000:1.0:1651532143.454777:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4318
00000100:00100000:1.0:1651532143.454779:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468558400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.454782:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.454785:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41180e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b70d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.454791:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41180e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b70d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.454795:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41180e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b70d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.454798:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532143.454821:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468558400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.454824:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4318
00000100:00100000:0.0:1651532143.455038:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.455056:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468558656
00000100:00100000:1.0:1651532143.455066:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4319
00000100:00100000:1.0:1651532143.455067:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468558656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.455070:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.455073:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411815 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b714 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.455080:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411815 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b714 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.455087:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411815 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b714 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.455090:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532143.455101:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468558656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.455104:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4319
00000001:00080000:1.0:1651532143.561698:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793922 is committed
00010000:00010000:1.0:1651532143.561712:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.561716:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.561737:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac9b1854 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468553472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507997us (508054us total) trans 158913793922 rc 0/0
00000100:00100000:1.0:1651532143.561740:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4519
00010000:00010000:0.0:1651532143.561741:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.561746:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532143.561747:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.561751:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.561756:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.561757:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.561758:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.561761:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.561771:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.561774:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411712 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9175039] (req 1454080->9175039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.561784:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.561787:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.562081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.562090:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.562097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.562102:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.562119:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468558848
00010000:00010000:0.0:1651532143.562123:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.562128:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.562131:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468558784
00000100:00100000:1.0:1651532143.562139:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4528
00000100:00100000:1.0:1651532143.562141:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000186dea31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468558848:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532143.562155:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.562156:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468554304:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408456us (408514us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532143.562159:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.562160:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.562160:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4520
00010000:00010000:1.0:1651532143.562163:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532143.562164:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.562167:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4529
00010000:00010000:1.0:1651532143.562168:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.562169:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba128a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468558784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532143.562171:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.562176:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.562178:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.562180:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532143.562181:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.562184:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532143.562185:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.562188:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.562189:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.562189:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.562192:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.562197:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.562197:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.562198:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.562199:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.562202:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.562210:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.562213:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411735 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5914624->10235903] (req 5914624->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.562218:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.562221:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468558976
00010000:00010000:0.0:1651532143.562221:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.562228:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468559040
00000100:00100000:1.0:1651532143.562235:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4320
00000100:00100000:1.0:1651532143.562236:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468558976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.562239:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.562242:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41182a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b71b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.562249:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41182a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b71b expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532143.562252:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4321
00010000:00010000:1.0:1651532143.562253:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41182a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b71b expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532143.562254:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e22cbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468559040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.562256:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532143.562257:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.562260:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411831 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b722 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.562264:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468558976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (167us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.562267:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4320
00010000:00010000:0.0:1651532143.562268:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411831 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b722 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.562272:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411831 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b722 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.562275:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532143.562282:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e22cbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468559040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (179us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.562284:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4321
00000100:00100000:0.0:1651532143.562671:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.562679:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.562690:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468559232
00000100:00100000:0.0:1651532143.562690:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468559296
00000100:00100000:1.0:1651532143.562704:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4322
00000100:00100000:1.0:1651532143.562706:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468559232:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532143.562706:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4323
00000100:00100000:0.0:1651532143.562708:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468559296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.562709:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.562712:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.562713:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411838 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b729 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.562716:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41183f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b730 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.562720:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411838 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b729 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.562724:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411838 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b729 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.562724:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41183f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b730 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.562728:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532143.562728:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41183f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b730 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.562732:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532143.562737:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468559232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.562740:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4322
00000100:00100000:0.0:1651532143.562740:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468559296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.562743:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4323
00000001:00080000:1.0:1651532143.703347:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793923 is committed
00002000:00010000:0.0:1651532143.703377:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532142 -> 1651532143
00010000:00010000:0.0:1651532143.703381:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703384:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.703407:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468554240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549691us (549735us total) trans 158913793923 rc 0/0
00010000:00010000:1.0:1651532143.703408:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.703411:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4521
00010000:00010000:1.0:1651532143.703412:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.703414:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.703419:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.703425:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.703426:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.703426:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.703430:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.703437:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703444:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.703447:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41173c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2691072->10129407] (req 2691072->10129407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703448:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.703776:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.703786:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.703799:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.703823:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468559616
00000100:00100000:0.0:1651532143.703827:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.703836:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468559680
00000100:00100000:1.0:1651532143.703844:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4530
00000100:00100000:1.0:1651532143.703846:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468559616:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532143.703851:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468559808
00010000:00010000:1.0:1651532143.703853:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.703857:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532143.703858:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.703862:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468560000
00000100:00100000:0.0:1651532143.703869:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4324
00000100:00100000:0.0:1651532143.703871:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468559808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.703874:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532143.703875:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703875:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.703879:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703879:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41184d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b737 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.703882:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703885:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.703888:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41184d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b737 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532143.703892:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4325
00010000:00010000:0.0:1651532143.703892:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41184d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b737 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532143.703894:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468560000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.703896:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.703896:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532143.703899:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411854 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b73e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.703904:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532143.703908:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468559808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.703911:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4324
00010000:00010000:1.0:1651532143.703912:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411854 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b73e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.703917:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411854 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b73e expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.703920:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532143.703920:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4531
00000100:00100000:0.0:1651532143.703922:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468559680:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532143.703928:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.703929:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468560000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (107us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532143.703932:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.703933:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.703934:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4325
00010000:00010000:0.0:1651532143.703935:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532143.703936:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703940:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703944:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703954:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703957:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.703971:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468555392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458488us (458535us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532143.703974:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4522
00010000:00010000:0.0:1651532143.703980:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703983:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532143.703984:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703987:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703992:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.703992:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.703993:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.703996:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.704008:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.704011:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41176d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->6533119] (req 516096->6533119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.704017:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.704021:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.704344:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.704353:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.704361:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.704367:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468560192
00000100:00100000:1.0:1651532143.704378:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468560256
00000100:00100000:1.0:1651532143.704380:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468560320
00000100:00100000:0.0:1651532143.704384:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4326
00000100:00100000:0.0:1651532143.704386:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a079a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468560192:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532143.704387:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4327
00000100:00100000:1.0:1651532143.704389:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468560256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.704390:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.704392:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.704394:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411862 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b745 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.704396:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411869 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b74c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.704402:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411862 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b745 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.704404:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411869 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b74c expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.704406:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411862 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b745 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.704408:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411869 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b74c expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.704410:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532143.704412:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532143.704420:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468560256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.704420:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a079a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468560192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.704423:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4326
00000100:00100000:1.0:1651532143.704425:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4327
00000100:00100000:0.0:1651532143.704428:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4328
00000100:00100000:0.0:1651532143.704430:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468560320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.704433:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.704435:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411870 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b753 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.704440:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411870 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b753 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.704444:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411870 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b753 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.704447:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532143.704453:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468560320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.704456:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4328
00000100:00100000:1.0:1651532143.704738:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.704750:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468560640
00000100:00100000:0.0:1651532143.704762:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4329
00000100:00100000:0.0:1651532143.704764:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468560640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.704767:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.704770:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411877 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b75a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.704777:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411877 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b75a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.704781:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411877 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b75a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.704784:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532143.704794:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468560640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.704797:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4329
00000100:00100000:1.0:1651532143.705030:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.705041:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468560832
00000100:00100000:0.0:1651532143.705051:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4330
00000100:00100000:0.0:1651532143.705053:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468560832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.705056:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.705059:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41187e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b761 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.705065:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41187e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b761 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.705070:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41187e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b761 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.705073:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532143.705083:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468560832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.705085:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4330
00000001:00080000:1.0:1651532143.836699:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793924 is committed
00010000:00010000:1.0:1651532143.836715:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.836719:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.836737:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468555328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 591221us (591293us total) trans 158913793924 rc 0/0
00000100:00100000:1.0:1651532143.836740:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4523
00010000:00010000:1.0:1651532143.836746:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.836750:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.836751:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.836754:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.836758:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.836759:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.836760:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.836765:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.836778:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.836781:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411774 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10346495] (req 65536->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.836793:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.836798:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.837137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.837146:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.837153:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.837167:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.837169:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468561216
00000100:00100000:0.0:1651532143.837186:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468561280
00000100:00100000:1.0:1651532143.837187:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468561024
00000100:00100000:0.0:1651532143.837194:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4331
00000100:00100000:0.0:1651532143.837196:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468561216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.837200:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532143.837202:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468560960
00010000:00010000:0.0:1651532143.837204:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411885 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b768 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.837211:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4532
00000100:00100000:1.0:1651532143.837213:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468561024:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532143.837215:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.837218:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411885 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b768 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.837219:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.837222:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411885 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b768 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.837223:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.837224:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532143.837225:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.837226:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532143.837228:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.837236:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468561216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.837238:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4533
00000100:00100000:0.0:1651532143.837238:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4331
00000100:00100000:1.0:1651532143.837240:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468560960:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532143.837243:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4332
00010000:00010000:1.0:1651532143.837244:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.837245:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468561280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.837247:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532143.837247:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.837248:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.837249:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41189a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b76f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.837251:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.837253:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532143.837254:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.837259:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.837261:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.837262:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41189a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b76f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.837264:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.837266:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41189a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b76f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.837267:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.837269:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532143.837274:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468561280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.837277:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4332
00010000:00010000:0.0:1651532143.837287:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.837291:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.837317:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468556224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483068us (483131us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532143.837320:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.837321:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4524
00010000:00010000:1.0:1651532143.837327:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.837328:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.837331:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.837347:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.837348:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.837349:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.837352:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.837368:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.837371:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411797 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3502080->7741439] (req 3502080->7741439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.837371:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.837375:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532143.903389:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793925 is committed
00010000:00010000:0.0:1651532143.903419:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903424:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.903446:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468556160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549162us (549232us total) trans 158913793925 rc 0/0
00000100:00100000:0.0:1651532143.903449:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4525
00010000:00010000:0.0:1651532143.903456:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903460:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532143.903461:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903464:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903477:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.903478:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.903479:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903482:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903489:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903491:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41179e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1290240->9846783] (req 1290240->9846783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.903495:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.903499:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.903767:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.903781:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468561664
00000100:00100000:1.0:1651532143.903787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.903813:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.903816:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468561600
00000100:00100000:0.0:1651532143.903831:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4534
00000100:00100000:1.0:1651532143.903832:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.903833:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096a49a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468561664:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532143.903838:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532143.903840:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903844:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.903845:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903847:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532143.903848:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.903850:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4535
00000100:00100000:1.0:1651532143.903853:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000386cd267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468561600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532143.903855:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903859:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.903861:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.903865:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532143.903866:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.903867:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468561728
00010000:00010000:1.0:1651532143.903869:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532143.903870:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.903877:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468561792
00000100:00100000:0.0:1651532143.903880:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468561856
00010000:00010000:1.0:1651532143.903881:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.903882:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4333
00000100:00100000:0.0:1651532143.903884:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468561728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.903885:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903887:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.903890:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4118af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b776 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903895:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.903897:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4118af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b776 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.903899:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.903905:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903909:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4118af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b776 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.903912:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532143.903924:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005992cf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468557888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449552us (449628us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532143.903927:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4526
00000100:00100000:0.0:1651532143.903929:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468561728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (125us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.903932:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4333
00010000:00010000:1.0:1651532143.903934:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.903937:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4334
00010000:00010000:1.0:1651532143.903938:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532143.903938:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468561792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.903939:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903941:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532143.903942:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903943:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4118b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b77d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.903946:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.903947:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.903948:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.903950:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903956:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4118b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b77d expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.903960:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.903965:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4117eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2084864->10268671] (req 2084864->10268671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903966:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4118b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b77d expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.903969:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532143.903973:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4335
00000100:00100000:1.0:1651532143.903974:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468561856:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532143.903975:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468561792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (144us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532143.903978:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532143.903978:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4334
00010000:00010000:1.0:1651532143.903981:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b784 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903984:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.903987:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.903988:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b784 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.903992:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b784 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.903995:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532143.904002:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468561856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (164us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.904005:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4335
00000100:00100000:0.0:1651532143.904320:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.904347:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.904348:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468561984
00000100:00100000:1.0:1651532143.904361:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468562176
00000100:00100000:1.0:1651532143.904368:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4336
00000100:00100000:1.0:1651532143.904370:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468561984:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532143.904373:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4337
00010000:00010000:1.0:1651532143.904374:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532143.904375:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008993a7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468562176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532143.904377:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b78b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.904380:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.904384:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4118cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b792 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.904385:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b78b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.904389:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b78b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.904392:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4118cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b792 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.904396:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4118cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b792 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.904404:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532143.904414:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532143.904415:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468561984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.904418:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4336
00000100:00100000:0.0:1651532143.904423:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008993a7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468562176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.904426:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4337
00000100:00100000:0.0:1651532143.904684:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.904691:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468562368
00000100:00100000:0.0:1651532143.904705:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4338
00000100:00100000:0.0:1651532143.904707:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000457cec44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468562368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.904711:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.904714:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4118d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b799 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.904721:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4118d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b799 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.904725:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4118d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b799 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.904729:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532143.904742:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000457cec44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468562368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.904745:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4338
00000100:00100000:0.0:1651532143.904945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.904953:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468562560
00000100:00100000:0.0:1651532143.904966:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4339
00000100:00100000:0.0:1651532143.904968:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000505165d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468562560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.904971:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.904974:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4118d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7a0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.904981:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4118d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7a0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.904985:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4118d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7a0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.904988:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532143.905000:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000505165d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468562560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.905003:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4339
00000100:00100000:0.0:1651532143.905209:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.905216:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468562688
00000100:00100000:0.0:1651532143.905229:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4340
00000100:00100000:0.0:1651532143.905231:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee47d2de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468562688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.905235:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.905238:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4118e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7a7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.905245:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4118e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7a7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.905249:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4118e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7a7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.905252:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532143.905264:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee47d2de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468562688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.905266:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4340
00000100:00100000:0.0:1651532143.905463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.905470:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468562816
00000100:00100000:0.0:1651532143.905483:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4341
00000100:00100000:0.0:1651532143.905485:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098feaaed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468562816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.905488:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.905491:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4118e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7ae expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.905498:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4118e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7ae expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.905505:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4118e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7ae expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.905508:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532143.905519:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098feaaed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468562816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.905521:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4341
00000100:00100000:0.0:1651532143.905700:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.905707:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468562944
00000100:00100000:0.0:1651532143.905720:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4342
00000100:00100000:0.0:1651532143.905722:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5035c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468562944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.905725:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.905728:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4118ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7b5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.905735:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4118ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7b5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.905739:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4118ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7b5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.905742:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532143.905754:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5035c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468562944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.905758:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4342
00000001:00080000:1.0:1651532143.970131:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793926 is committed
00010000:00010000:0.0:1651532143.970163:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.970167:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970190:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.970190:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468557824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 515814us (515903us total) trans 158913793926 rc 0/0
00000100:00100000:0.0:1651532143.970193:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4527
00010000:00010000:1.0:1651532143.970195:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532143.970196:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970199:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970205:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.970206:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.970206:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970210:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970218:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970221:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4117f2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->4202495] (req 217088->4202495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.970227:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.970231:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.970544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.970553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.970565:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.970570:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468563200
00000100:00100000:0.0:1651532143.970571:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532143.970587:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468563072
00010000:00010000:0.0:1651532143.970589:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.970597:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4536
00000100:00100000:1.0:1651532143.970599:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008993a7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468563200:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532143.970599:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970606:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970610:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532143.970611:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970614:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532143.970614:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970624:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970628:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532143.970631:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000186dea31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468558848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408490us (408551us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532143.970635:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4528
00000100:00100000:1.0:1651532143.970637:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4537
00000100:00100000:1.0:1651532143.970639:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000457cec44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468563072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532143.970643:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970644:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970647:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532143.970648:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970651:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532143.970651:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970654:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.970654:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532143.970655:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970657:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.970659:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.970664:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468563264
00010000:00010000:0.0:1651532143.970664:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.970665:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532143.970666:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.970669:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468563392
00010000:00010000:0.0:1651532143.970669:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.970674:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4343
00000100:00100000:1.0:1651532143.970675:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000505165d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468563264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.970676:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970678:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.970679:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41181c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7004159] (req 761856->7004159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.970685:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.970687:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970689:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411903 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7bc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532143.970697:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411903 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7bc expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.970704:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411903 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7bc expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532143.970708:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532143.970710:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4344
00000100:00100000:0.0:1651532143.970712:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee47d2de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468563392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.970715:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532143.970717:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000505165d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468563264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (152us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532143.970718:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41190a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7c3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532143.970720:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4343
00010000:00010000:0.0:1651532143.970725:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41190a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7c3 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.970729:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41190a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7c3 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.970732:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532143.970739:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee47d2de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468563392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (167us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532143.970740:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.970741:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4344
00000100:00100000:0.0:1651532143.970747:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468563520
00000100:00100000:0.0:1651532143.970757:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4345
00000100:00100000:0.0:1651532143.970759:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468563520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.970762:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.970764:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411911 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7ca expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.970770:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411911 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7ca expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.970774:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411911 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7ca expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.970777:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532143.970787:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468563520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.970790:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4345
00000100:00100000:1.0:1651532143.971102:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.971113:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468563840
00000100:00100000:0.0:1651532143.971124:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4346
00000100:00100000:0.0:1651532143.971126:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468563840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.971130:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.971146:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411918 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7d1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.971155:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411918 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7d1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.971159:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411918 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7d1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.971162:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532143.971178:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468563840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.971181:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4346
00000100:00100000:1.0:1651532143.971211:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.971236:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468563968
00000100:00100000:0.0:1651532143.971243:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4347
00000100:00100000:0.0:1651532143.971245:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468563968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.971248:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.971250:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41191f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7d8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.971257:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41191f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7d8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.971261:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41191f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7d8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.971264:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532143.971273:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468563968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.971276:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4347
00000100:00100000:1.0:1651532143.971537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532143.971548:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468564160
00000100:00100000:0.0:1651532143.971560:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4348
00000100:00100000:0.0:1651532143.971562:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468564160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532143.971565:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532143.971569:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411926 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7df expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532143.971576:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411926 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7df expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.971583:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411926 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7df expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532143.971586:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532143.971596:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468564160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532143.971598:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4348
00000001:00080000:1.0:1651532144.078511:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793927 is committed
00010000:00010000:0.0:1651532144.078538:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.078544:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.078567:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba128a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468558784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516397us (516476us total) trans 158913793927 rc 0/0
00010000:00010000:1.0:1651532144.078569:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.078570:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4529
00010000:00010000:1.0:1651532144.078574:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.078575:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.078578:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.078584:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.078584:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.078585:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.078591:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.078598:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.078601:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411823 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3006464->9904127] (req 3006464->9904127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.078607:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.078611:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.078918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.078925:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.078932:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468564416
00000100:00100000:0.0:1651532144.078942:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468564480
00000100:00100000:0.0:1651532144.078948:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4538
00000100:00100000:0.0:1651532144.078950:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098feaaed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468564416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532144.078982:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.078988:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532144.078989:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.078992:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532144.078993:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.078997:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.079001:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.079009:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4539
00000100:00100000:0.0:1651532144.079010:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000daa08c35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468564480:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532144.079015:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.079019:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532144.079019:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.079022:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532144.079023:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.079027:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.079030:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.079101:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.079109:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468564736
00000100:00100000:0.0:1651532144.079122:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4349
00000100:00100000:0.0:1651532144.079124:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbd62f66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468564736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.079127:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.079131:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41193b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7e6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.079138:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41193b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7e6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.079143:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41193b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7e6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.079146:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532144.079172:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbd62f66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468564736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.079175:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4349
00000001:00080000:1.0:1651532144.228449:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793928 is committed
00010000:00010000:0.0:1651532144.228483:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228488:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228512:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.228512:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468559616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524664us (524736us total) trans 158913793928 rc 0/0
00000100:00100000:0.0:1651532144.228515:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4530
00010000:00010000:1.0:1651532144.228516:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.228517:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228520:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228526:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.228527:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.228527:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228531:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228536:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.228537:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.228538:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228540:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228561:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228564:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411846 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->8118271] (req 684032->8118271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228570:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228573:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228574:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228578:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.228881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.228889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532144.228910:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228915:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228918:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228928:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.228944:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468561024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391730us (391813us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532144.228948:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468559680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 525026us (525161us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532144.228949:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4532
00000100:00100000:0.0:1651532144.228952:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4531
00010000:00010000:1.0:1651532144.228957:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228959:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228960:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.228962:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228963:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532144.228964:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228965:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228969:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228970:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.228973:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41188c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->7843839] (req 3366912->7843839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228975:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.228976:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.228977:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228979:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.228980:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468564928
00000100:00100000:1.0:1651532144.228986:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468565056
00010000:00010000:0.0:1651532144.228991:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.228994:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41185b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3309568->7184383] (req 3309568->7184383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.228997:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4350
00000100:00100000:1.0:1651532144.228999:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b45bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468564928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.229002:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532144.229002:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4351
00000100:00100000:0.0:1651532144.229004:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070a794fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468565056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.229005:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411942 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7ed expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.229007:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.229010:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411949 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7f4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.229013:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411942 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7ed expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.229018:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411949 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7f4 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.229020:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411942 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7ed expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.229024:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532144.229025:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411949 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7f4 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.229029:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532144.229031:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b45bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468564928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (152us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.229034:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4350
00000100:00100000:0.0:1651532144.229036:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070a794fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468565056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (148us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.229039:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4351
00010000:00010000:1.0:1651532144.229041:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.229045:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.229456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.229466:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.229476:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.229477:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468565248
00000100:00100000:0.0:1651532144.229485:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.229496:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468565312
00000100:00100000:0.0:1651532144.229500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.229504:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4540
00000100:00100000:1.0:1651532144.229511:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000637a5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468565248:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532144.229515:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4541
00000100:00100000:0.0:1651532144.229517:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070e4f762 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468565312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532144.229518:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.229523:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532144.229524:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.229526:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532144.229526:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.229527:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.229532:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532144.229533:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.229536:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532144.229536:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.229540:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.229541:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.229544:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.229545:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.229551:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468565376
00000100:00100000:0.0:1651532144.229554:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468565504
00000100:00100000:1.0:1651532144.229557:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468565568
00000100:00100000:0.0:1651532144.229560:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4352
00000100:00100000:1.0:1651532144.229562:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4353
00000100:00100000:0.0:1651532144.229562:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3eb5fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468565376:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532144.229564:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b3108f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468565504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.229564:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.229567:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.229567:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41195e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b7fb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.229569:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411965 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b802 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.229574:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41195e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7fb expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.229576:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411965 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b802 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.229578:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41195e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b7fb expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.229581:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411965 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b802 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.229582:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532144.229584:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532144.229592:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3eb5fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468565376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.229593:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b3108f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468565504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.229594:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4352
00000100:00100000:1.0:1651532144.229596:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4353
00000100:00100000:0.0:1651532144.229599:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4354
00000100:00100000:0.0:1651532144.229601:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d3bbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468565568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.229603:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.229605:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41196c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b809 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.229611:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41196c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b809 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.229615:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41196c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b809 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.229618:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532144.229624:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d3bbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468565568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (131us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.229626:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4354
00000100:00100000:0.0:1651532144.229863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.229870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.229880:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468565760
00000100:00100000:0.0:1651532144.229881:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468565824
00000100:00100000:1.0:1651532144.229888:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4355
00000100:00100000:1.0:1651532144.229895:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468565760:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532144.229895:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4356
00000100:00100000:0.0:1651532144.229897:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468565824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.229898:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.229900:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.229901:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411973 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b810 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.229904:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41197a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b817 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.229908:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411973 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b810 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.229911:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41197a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b817 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.229912:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411973 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b810 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.229915:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532144.229915:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41197a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b817 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.229921:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532144.229928:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468565760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.229931:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4355
00000100:00100000:0.0:1651532144.229936:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468565824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.229939:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4356
00000100:00100000:0.0:1651532144.229988:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.229996:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468566016
00000100:00100000:0.0:1651532144.230006:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4357
00000100:00100000:0.0:1651532144.230008:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468566016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.230011:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.230014:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411981 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b81e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.230022:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411981 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b81e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.230026:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411981 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b81e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.230029:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532144.230038:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468566016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.230040:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4357
00000001:00080000:1.0:1651532144.328490:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793929 is committed
00010000:00010000:1.0:1651532144.328505:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328508:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.328531:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468560960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491290us (491384us total) trans 158913793929 rc 0/0
00000100:00100000:1.0:1651532144.328534:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4533
00010000:00010000:1.0:1651532144.328541:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328545:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.328546:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328549:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328554:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.328554:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.328555:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328558:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328579:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328582:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411893 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3203072->10113023] (req 3203072->10113023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.328591:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.328598:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.328870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.328889:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.328890:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468566336
00000100:00100000:0.0:1651532144.328898:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.328904:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468566400
00000100:00100000:1.0:1651532144.328912:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4542
00000100:00100000:1.0:1651532144.328914:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468566336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532144.328920:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.328921:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4543
00000100:00100000:0.0:1651532144.328923:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468566400:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532144.328927:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532144.328928:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328931:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532144.328931:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.328932:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.328936:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.328937:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.328940:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532144.328941:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328944:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.328946:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328948:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.328949:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.328960:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468566528
00010000:00010000:0.0:1651532144.328962:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.328967:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4358
00000100:00100000:1.0:1651532144.328968:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468566528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.328971:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.328974:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411996 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b825 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.328977:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.328981:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.328983:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411996 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b825 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.328994:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411996 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b825 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532144.328997:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096a49a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468561664:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425163us (425230us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532144.329000:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532144.329000:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4534
00000100:00100000:1.0:1651532144.329009:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468566528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.329012:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4358
00010000:00010000:1.0:1651532144.329018:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.329021:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.329022:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.329025:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.329038:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.329039:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.329040:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.329043:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.329050:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.329053:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f4118a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6803456->10256383] (req 6803456->10256383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.329061:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.329064:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.329273:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.329307:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468566720
00000100:00100000:0.0:1651532144.329318:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4359
00000100:00100000:0.0:1651532144.329320:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468566720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.329323:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.329327:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41199d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b82c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.329344:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41199d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b82c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.329349:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41199d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b82c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.329352:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532144.329362:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468566720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.329365:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4359
00000001:00080000:1.0:1651532144.395219:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793930 is committed
00010000:00010000:1.0:1651532144.395235:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395239:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.395262:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000386cd267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468561600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491409us (491474us total) trans 158913793930 rc 0/0
00000100:00100000:1.0:1651532144.395266:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4535
00010000:00010000:0.0:1651532144.395266:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395278:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532144.395280:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395283:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395289:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.395290:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.395291:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395294:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395301:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395304:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4118a8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9322495] (req 1830912->9322495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395313:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395317:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.395611:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.395619:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.395630:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.395631:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468566976
00000100:00100000:1.0:1651532144.395636:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.395645:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.395648:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468566912
00000100:00100000:1.0:1651532144.395655:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.395655:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4544
00000100:00100000:0.0:1651532144.395657:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468566976:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532144.395662:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468567040
00010000:00010000:0.0:1651532144.395664:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.395668:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468567104
00000100:00100000:1.0:1651532144.395671:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468567168
00010000:00010000:0.0:1651532144.395671:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.395672:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.395673:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468567232
00010000:00010000:0.0:1651532144.395675:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.395676:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4360
00000100:00100000:1.0:1651532144.395677:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc66c150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468567040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.395681:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532144.395682:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4545
00000100:00100000:0.0:1651532144.395684:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ae2c042 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468566912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532144.395685:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4119ab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b833 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395688:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395691:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.395693:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532144.395694:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395696:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395699:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532144.395700:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395704:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4119ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b833 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.395704:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395706:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395709:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4119ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b833 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.395710:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395712:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532144.395718:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4361
00000100:00100000:0.0:1651532144.395719:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468567104:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532144.395724:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc66c150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468567040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.395727:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4360
00010000:00010000:0.0:1651532144.395728:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.395731:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4119b9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b83a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.395732:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4362
00000100:00100000:1.0:1651532144.395734:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468567168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.395736:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.395736:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.395739:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4119c0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b841 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395739:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4119b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b83a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.395743:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4119b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b83a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.395746:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.395746:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532144.395748:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4119c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b841 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.395752:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4119c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b841 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.395755:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532144.395756:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468567104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.395759:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4361
00000100:00100000:1.0:1651532144.395760:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468567168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (116us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.395763:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4362
00000100:00100000:0.0:1651532144.395765:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4363
00000100:00100000:0.0:1651532144.395766:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468567232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.395769:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.395771:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4119c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b848 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395775:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395778:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395782:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.395784:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4119c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b848 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.395788:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4119c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b848 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532144.395789:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008993a7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468563200:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425190us (425246us total) trans 0 rc 40960/40960
00010000:00010000:0.0:1651532144.395791:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532144.395792:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4536
00010000:00010000:1.0:1651532144.395797:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.395797:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468567232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (142us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.395800:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4363
00010000:00010000:1.0:1651532144.395801:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.395802:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395825:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395830:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.395831:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.395832:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395835:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395841:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.395844:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4118f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10412031] (req 20480->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395862:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.395866:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.396275:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.396286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.396286:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468567360
00000100:00100000:0.0:1651532144.396300:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468567552
00000100:00100000:0.0:1651532144.396308:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4364
00000100:00100000:0.0:1651532144.396309:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468567360:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532144.396311:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4365
00000100:00100000:1.0:1651532144.396313:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468567552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.396313:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.396316:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4119ce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b84f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.396317:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.396320:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119d5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b856 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.396324:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4119ce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b84f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.396328:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b856 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.396329:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4119ce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b84f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.396332:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532144.396345:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b856 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.396349:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532144.396362:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468567552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.396364:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4365
00000100:00100000:0.0:1651532144.396372:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468567360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.396375:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4364
00000100:00100000:1.0:1651532144.396602:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.396613:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468567744
00000100:00100000:0.0:1651532144.396620:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4366
00000100:00100000:0.0:1651532144.396622:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468567744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.396625:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.396629:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4119dc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b85d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.396636:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4119dc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b85d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.396640:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4119dc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b85d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.396644:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532144.396657:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468567744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.396661:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4366
00000100:00100000:1.0:1651532144.396882:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.396892:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468567936
00000100:00100000:0.0:1651532144.396901:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4367
00000100:00100000:0.0:1651532144.396902:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468567936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.396906:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.396909:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4119e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b864 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.396916:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4119e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b864 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.396920:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4119e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b864 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.396923:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532144.396933:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468567936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.396936:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4367
00000001:00080000:1.0:1651532144.545191:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793931 is committed
00010000:00010000:0.0:1651532144.545223:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.545228:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.545251:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000457cec44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468563072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574611us (574697us total) trans 158913793931 rc 0/0
00000100:00100000:0.0:1651532144.545255:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4537
00010000:00010000:0.0:1651532144.545262:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.545266:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532144.545267:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.545270:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.545275:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.545276:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.545277:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.545280:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.545287:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.545290:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4118fc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [757760->8974335] (req 757760->8974335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.545295:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.545298:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.545544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.545557:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.545570:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468568128
00000100:00100000:1.0:1651532144.545580:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468568064
00000100:00100000:1.0:1651532144.545589:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4546
00000100:00100000:1.0:1651532144.545591:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3144eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468568128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532144.545599:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.545604:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532144.545605:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.545608:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532144.545608:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.545616:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.545619:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.545626:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4547
00000100:00100000:1.0:1651532144.545628:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083b26f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468568064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532144.545633:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.545636:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532144.545637:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.545639:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532144.545640:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.545643:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.545646:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.545694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.545702:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468568256
00000100:00100000:0.0:1651532144.545711:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4368
00000100:00100000:0.0:1651532144.545713:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468568256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.545716:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.545720:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4119f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b86b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.545728:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4119f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b86b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.545733:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4119f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b86b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.545736:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532144.545751:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468568256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.545754:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4368
00000100:00100000:0.0:1651532144.546029:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.546042:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468568512
00000100:00100000:0.0:1651532144.546054:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4369
00000100:00100000:0.0:1651532144.546057:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468568512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.546062:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.546067:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4119ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b872 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.546075:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4119ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b872 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.546082:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4119ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b872 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.546086:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532144.546103:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468568512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.546106:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4369
00000001:00080000:1.0:1651532144.611903:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793932 is committed
00010000:00010000:0.0:1651532144.611934:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.611939:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.611961:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098feaaed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468564416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 533010us (533043us total) trans 158913793932 rc 0/0
00000100:00100000:0.0:1651532144.611964:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4538
00010000:00010000:1.0:1651532144.611966:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.611971:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.611972:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.611976:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.611981:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.611982:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.611982:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.611986:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.612001:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.612002:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.612004:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41192d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3420160->9768959] (req 3420160->9768959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.612006:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.612251:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.612259:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532144.612274:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.612278:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.612300:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000daa08c35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468564480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533289us (533374us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532144.612302:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.612304:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4539
00010000:00010000:1.0:1651532144.612306:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.612307:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.612312:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468568640
00010000:00010000:1.0:1651532144.612313:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.612318:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.612318:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532144.612318:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468568704
00010000:00010000:1.0:1651532144.612319:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.612325:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4370
00000100:00100000:0.0:1651532144.612326:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468568640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.612327:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.612330:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.612334:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.612347:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411934 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1323008->9347071] (req 1323008->9347071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.612349:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411a06 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b879 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.612356:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4371
00000100:00100000:1.0:1651532144.612358:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468568704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.612362:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.612365:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411a0d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b880 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.612373:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411a0d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b880 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.612384:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411a06 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b879 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.612386:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411a0d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b880 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.612389:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411a06 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b879 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.612390:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532144.612392:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532144.612400:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468568704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (141us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.612401:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468568640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 74us (151us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.612403:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4371
00000100:00100000:0.0:1651532144.612405:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4370
00010000:00010000:1.0:1651532144.612411:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.612414:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.612422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.612437:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.612444:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468568832
00000100:00100000:0.0:1651532144.612449:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468568960
00000100:00100000:0.0:1651532144.612457:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4372
00000100:00100000:0.0:1651532144.612459:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468568832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.612462:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.612465:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411a14 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b887 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.612472:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411a14 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b887 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.612476:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411a14 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b887 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.612479:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532144.612489:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468568832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.612490:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4373
00000100:00100000:0.0:1651532144.612492:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4372
00000100:00100000:1.0:1651532144.612493:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468568960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.612496:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.612500:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411a1b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b88e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.612507:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411a1b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b88e expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.612511:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411a1b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b88e expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.612515:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532144.612527:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468568960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.612532:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4373
00000100:00100000:0.0:1651532144.612923:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.612930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.612936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.612946:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.612947:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468569344
00000100:00100000:0.0:1651532144.612952:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.612959:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468569408
00000100:00100000:1.0:1651532144.612962:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468569280
00000100:00100000:0.0:1651532144.612964:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.612965:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4374
00000100:00100000:1.0:1651532144.612967:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468569344:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532144.612970:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468569152
00010000:00010000:1.0:1651532144.612971:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.612975:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411a22 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b89c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.612979:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468569216
00010000:00010000:1.0:1651532144.612983:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411a22 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b89c expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532144.612985:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4548
00010000:00010000:1.0:1651532144.612987:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411a22 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b89c expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532144.612987:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468569152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532144.612990:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532144.612994:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.612998:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532144.612999:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.613001:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468569344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532144.613002:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00000100:00100000:1.0:1651532144.613003:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4374
00010000:00010000:0.0:1651532144.613003:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.613007:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.613008:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468569536
00000100:00100000:1.0:1651532144.613011:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4375
00010000:00010000:0.0:1651532144.613011:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.613013:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468569408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.613015:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.613018:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411a30 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8a3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.613018:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4549
00000100:00100000:0.0:1651532144.613019:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468569216:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532144.613024:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.613027:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532144.613028:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.613030:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532144.613031:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.613036:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.613037:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411a30 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8a3 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.613039:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.613041:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411a30 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8a3 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.613044:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532144.613047:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4376
00000100:00100000:0.0:1651532144.613048:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468569280:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532144.613050:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468569408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (105us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532144.613051:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532144.613053:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4375
00010000:00010000:0.0:1651532144.613053:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a3e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b895 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.613057:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4377
00000100:00100000:1.0:1651532144.613059:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468569536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.613059:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a3e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b895 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.613061:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.613063:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a3e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b895 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.613064:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a45 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8aa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.613067:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532144.613069:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a45 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8aa expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.613073:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a45 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8aa expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532144.613075:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468569280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (123us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532144.613076:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532144.613078:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4376
00000100:00100000:1.0:1651532144.613081:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468569536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.613090:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4377
00000100:00100000:0.0:1651532144.613443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.613458:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.613464:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468569664
00000100:00100000:0.0:1651532144.613465:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468569920
00000100:00100000:1.0:1651532144.613476:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4378
00000100:00100000:1.0:1651532144.613477:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468569664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.613481:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532144.613481:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4379
00000100:00100000:0.0:1651532144.613483:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468569920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.613484:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411a4c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8b1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.613486:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.613490:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411a53 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8b8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.613491:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411a4c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8b1 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.613495:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411a4c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8b1 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.613497:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411a53 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8b8 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.613498:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532144.613501:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411a53 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8b8 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.613505:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532144.613508:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468569664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.613511:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4378
00000100:00100000:0.0:1651532144.613513:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468569920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.613515:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4379
00000001:00080000:1.0:1651532144.753506:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793933 is committed
00010000:00010000:1.0:1651532144.753522:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.753526:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.753549:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000637a5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468565248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524037us (524113us total) trans 158913793933 rc 0/0
00010000:00010000:0.0:1651532144.753551:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.753553:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4540
00010000:00010000:0.0:1651532144.753556:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532144.753557:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.753560:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.753566:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.753567:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.753568:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.753571:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.753578:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.753581:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411950 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->6496255] (req 819200->6496255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.753586:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.753589:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.753913:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.753929:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468570240
00000100:00100000:1.0:1651532144.753931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.753944:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468570368
00000100:00100000:0.0:1651532144.753955:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4380
00000100:00100000:0.0:1651532144.753957:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468570240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.753960:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.753964:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411a5a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8bf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.753968:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4381
00010000:00010000:0.0:1651532144.753969:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532144.753971:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468570368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.753972:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411a5a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8bf expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.753975:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.753979:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411a61 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8c6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.753979:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411a5a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8bf expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.753983:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532144.753985:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.753987:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411a61 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8c6 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.753991:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411a61 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8c6 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532144.753995:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468570240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.753998:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4380
00010000:00010000:1.0:1651532144.754001:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532144.754009:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.754010:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468570368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.754013:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4381
00010000:00010000:0.0:1651532144.754013:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.754028:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070e4f762 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468565312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 524510us (524561us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532144.754031:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4541
00010000:00010000:0.0:1651532144.754042:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754045:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532144.754046:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754049:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754057:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.754057:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.754058:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754061:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754070:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754073:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411957 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5279744->7774207] (req 5279744->7774207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.754076:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.754080:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.754431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.754445:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.754450:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468570624
00000100:00100000:1.0:1651532144.754452:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.754461:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.754471:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468570560
00000100:00100000:0.0:1651532144.754472:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4550
00000100:00100000:0.0:1651532144.754474:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e22cbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468570624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532144.754480:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.754485:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4551
00000100:00100000:1.0:1651532144.754486:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a079a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468570560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532144.754490:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532144.754491:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.754494:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754494:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.754498:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532144.754499:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.754502:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.754502:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468570688
00010000:00010000:1.0:1651532144.754505:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532144.754506:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.754512:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468570816
00010000:00010000:1.0:1651532144.754516:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.754517:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4382
00000100:00100000:0.0:1651532144.754518:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468570688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.754520:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754521:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.754524:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411a76 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8cd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.754526:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754534:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411a76 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8cd expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.754539:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411a76 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8cd expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.754542:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532144.754555:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468570688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.754558:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4382
00000100:00100000:0.0:1651532144.754562:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4383
00000100:00100000:0.0:1651532144.754564:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468570816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.754567:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.754569:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411a7d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8d4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754574:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411a7d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8d4 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.754578:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411a7d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8d4 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.754582:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532144.754587:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468570816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (125us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.754589:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4383
00000100:00100000:1.0:1651532144.754856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.754874:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468571008
00000100:00100000:0.0:1651532144.754882:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4384
00000100:00100000:0.0:1651532144.754884:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468571008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.754887:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.754890:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411a84 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8db expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.754897:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411a84 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8db expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.754901:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411a84 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8db expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.754904:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532144.754920:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468571008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.754923:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4384
00000001:00080000:1.0:1651532144.853760:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793934 is committed
00010000:00010000:1.0:1651532144.853775:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853779:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.853796:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468566336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524881us (524926us total) trans 158913793934 rc 0/0
00000100:00100000:1.0:1651532144.853799:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4542
00010000:00010000:1.0:1651532144.853824:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853828:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.853829:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853833:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853838:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.853838:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.853839:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853843:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853846:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.853846:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.853847:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853850:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853868:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.853870:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853871:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411988 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4009984->9900031] (req 4009984->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.853875:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853881:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.853883:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.854136:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.854144:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.854188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532144.854189:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854198:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854204:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854214:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.854220:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468566400:12345-10.240.43.64@tcp:3:fio.0 Request processed in 525296us (525330us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532144.854223:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4543
00000100:00100000:0.0:1651532144.854229:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5c158b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468566976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458571us (458618us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532144.854232:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468571136
00000100:00100000:0.0:1651532144.854232:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4544
00000100:00100000:1.0:1651532144.854241:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468571200
00000100:00100000:1.0:1651532144.854244:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468571328
00000100:00100000:1.0:1651532144.854247:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4385
00010000:00010000:0.0:1651532144.854247:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.854248:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468571136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.854251:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.854252:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.854252:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854255:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411a8b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8e2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854255:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854261:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.854261:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854264:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411a8b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8e2 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.854264:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41198f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [819200->8622079] (req 819200->8622079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854268:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411a8b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8e2 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.854270:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854271:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532144.854273:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532144.854274:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854276:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.854278:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468571136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (143us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532144.854279:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.854280:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532144.854281:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4385
00010000:00010000:0.0:1651532144.854281:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854284:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.854285:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4386
00000100:00100000:1.0:1651532144.854286:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468571200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.854290:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.854290:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854292:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411a92 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8e9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854293:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4119a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2355200->3260415] (req 2355200->3260415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854298:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411a92 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8e9 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.854298:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854301:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854302:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411a92 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8e9 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.854305:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532144.854309:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468571200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (165us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.854311:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4386
00000100:00100000:1.0:1651532144.854314:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4387
00000100:00100000:1.0:1651532144.854316:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468571328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.854318:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.854320:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411a99 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8f0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854324:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411a99 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8f0 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.854328:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411a99 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8f0 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.854334:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532144.854352:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468571328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (164us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.854354:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4387
00000100:00100000:1.0:1651532144.854778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.854790:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.854799:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468571520
00000100:00100000:0.0:1651532144.854825:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4552
00000100:00100000:0.0:1651532144.854827:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468571520:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532144.854834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532144.854834:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854844:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532144.854846:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854849:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532144.854849:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.854852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532144.854854:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854862:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.854864:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468571648
00000100:00100000:1.0:1651532144.854872:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468571712
00000100:00100000:1.0:1651532144.854875:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468571840
00000100:00100000:0.0:1651532144.854878:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4388
00000100:00100000:0.0:1651532144.854880:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468571648:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532144.854882:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4389
00000100:00100000:1.0:1651532144.854883:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f341eb8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468571712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.854883:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.854886:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411aa7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8f7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.854887:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.854891:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411aae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b8fe expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854895:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411aa7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8f7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.854898:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411aae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8fe expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.854900:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411aa7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8f7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.854903:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411aae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b8fe expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.854903:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532144.854906:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532144.854918:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468571648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.854921:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4388
00000100:00100000:1.0:1651532144.854923:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f341eb8c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468571712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.854926:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4390
00000100:00100000:1.0:1651532144.854928:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4389
00000100:00100000:0.0:1651532144.854928:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468571840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.854931:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.854933:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411ab5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b905 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.854939:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411ab5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b905 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.854943:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411ab5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b905 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.854946:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532144.854952:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468571840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.854955:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4390
00000100:00100000:0.0:1651532144.854965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.855002:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468571456
00000100:00100000:1.0:1651532144.855012:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4553
00000100:00100000:1.0:1651532144.855014:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468571456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532144.855020:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.855024:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.855025:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.855028:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532144.855029:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.855033:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.855037:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.855262:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.855270:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.855275:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468571968
00000100:00100000:0.0:1651532144.855282:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468572160
00000100:00100000:0.0:1651532144.855293:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4391
00000100:00100000:0.0:1651532144.855295:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468571968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532144.855298:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.855302:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411ac3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b90c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.855303:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4392
00000100:00100000:1.0:1651532144.855305:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468572160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.855308:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532144.855309:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411ac3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b90c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.855311:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411aca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b913 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.855313:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411ac3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b90c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532144.855317:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532144.855321:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411aca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b913 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.855325:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411aca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b913 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532144.855329:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468571968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532144.855331:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4391
00010000:00010000:1.0:1651532144.855343:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532144.855353:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468572160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.855355:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4392
00000100:00100000:0.0:1651532144.855616:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.855634:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468572416
00000100:00100000:1.0:1651532144.855647:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4393
00000100:00100000:1.0:1651532144.855649:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468572416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.855652:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.855655:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411ad1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b91a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.855663:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411ad1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b91a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.855667:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411ad1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b91a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.855670:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532144.855680:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468572416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.855683:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4393
00000001:00080000:1.0:1651532144.953563:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793935 is committed
00010000:00010000:0.0:1651532144.953591:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.953598:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.953621:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ae2c042 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468566912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557936us (558001us total) trans 158913793935 rc 0/0
00010000:00010000:1.0:1651532144.953623:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.953625:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4545
00010000:00010000:1.0:1651532144.953627:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532144.953629:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.953632:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.953638:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.953638:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.953639:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.953642:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.953650:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.953661:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4119b2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->7045119] (req 397312->7045119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.953663:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.953669:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.953922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.953934:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.953939:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468572672
00000100:00100000:0.0:1651532144.953941:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.953957:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4394
00000100:00100000:1.0:1651532144.953959:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468572672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.953963:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.953967:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411ad8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b921 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532144.953974:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468572736
00010000:00010000:1.0:1651532144.953978:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532144.953981:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411ad8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b921 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532144.953984:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468572608
00010000:00010000:1.0:1651532144.953985:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411ad8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b921 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.953988:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532144.953990:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4554
00000100:00100000:0.0:1651532144.953992:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098606df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468572736:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532144.954002:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468572672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.954005:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4394
00010000:00010000:0.0:1651532144.954005:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954009:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.954010:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954013:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00000100:00100000:1.0:1651532144.954014:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4555
00010000:00010000:0.0:1651532144.954014:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.954015:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468572608:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532144.954019:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954021:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954023:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954026:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532144.954027:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954030:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532144.954030:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954037:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954041:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954046:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954049:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.954056:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532144.954064:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3144eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468568128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408472us (408527us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532144.954067:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4546
00010000:00010000:0.0:1651532144.954073:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954077:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532144.954078:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954081:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954085:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.954086:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532144.954087:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954090:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.954093:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468572800
00010000:00010000:0.0:1651532144.954099:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954102:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4119ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->10170367] (req 217088->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532144.954110:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4395
00000100:00100000:1.0:1651532144.954112:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468572800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.954115:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.954118:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411aed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b928 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954119:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532144.954123:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954125:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411aed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b928 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954129:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411aed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b928 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954132:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532144.954142:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468572800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.954145:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4395
00000100:00100000:0.0:1651532144.954303:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.954327:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468572928
00000100:00100000:1.0:1651532144.954353:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4396
00000100:00100000:1.0:1651532144.954355:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468572928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.954358:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.954361:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411af4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b92f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954369:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411af4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b92f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954373:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411af4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b92f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954376:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532144.954378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.954384:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468572928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.954386:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4396
00000100:00100000:1.0:1651532144.954390:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468572992
00000100:00100000:1.0:1651532144.954400:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4397
00000100:00100000:1.0:1651532144.954408:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468572992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.954411:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532144.954411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532144.954414:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411afb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b936 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954420:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411afb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b936 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954424:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411afb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b936 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954427:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532144.954439:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468572992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.954441:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4397
00000100:00100000:1.0:1651532144.954446:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468573056
00000100:00100000:1.0:1651532144.954449:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4398
00000100:00100000:1.0:1651532144.954451:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468573056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.954453:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.954463:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411b02 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b93d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954470:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411b02 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b93d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954473:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411b02 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b93d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954477:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532144.954483:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468573056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.954485:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4398
00000100:00100000:1.0:1651532144.954550:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.954556:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468573184
00000100:00100000:1.0:1651532144.954566:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4399
00000100:00100000:1.0:1651532144.954568:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468573184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.954571:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.954574:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b09 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b944 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954581:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b09 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b944 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954585:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b09 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b944 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954601:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532144.954612:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468573184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.954614:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4399
00000100:00100000:1.0:1651532144.954689:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.954695:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468573376
00000100:00100000:1.0:1651532144.954705:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4400
00000100:00100000:1.0:1651532144.954706:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000505165d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468573376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.954709:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.954712:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b10 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b94b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954719:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b10 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b94b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954723:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b10 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b94b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.954726:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532144.954737:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000505165d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468573376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.954740:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4400
00000100:00100000:1.0:1651532144.954968:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532144.954975:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468573760
00000100:00100000:1.0:1651532144.954985:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4401
00000100:00100000:1.0:1651532144.954986:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee47d2de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468573760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532144.954989:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532144.954992:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411b17 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b952 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532144.954999:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411b17 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b952 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.955003:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411b17 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b952 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532144.955006:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532144.955017:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee47d2de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468573760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532144.955020:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4401
00000001:00080000:1.0:1651532145.045239:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793936 is committed
00010000:00010000:0.0:1651532145.045271:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045276:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.045299:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083b26f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468568064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499670us (499742us total) trans 158913793936 rc 0/0
00000100:00100000:0.0:1651532145.045305:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4547
00010000:00010000:0.0:1651532145.045312:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045316:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532145.045317:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045320:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045325:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.045326:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.045327:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045330:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045346:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045349:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4119f1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1216512->7380991] (req 1216512->7380991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045355:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045357:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.045684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.045704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.045713:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.045734:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468574208
00000100:00100000:1.0:1651532145.045746:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4402
00000100:00100000:1.0:1651532145.045748:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468574208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.045752:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.045756:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411b1e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b959 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.045764:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411b1e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b959 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.045768:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411b1e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b959 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.045771:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532145.045782:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468574208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.045785:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4402
00000100:00100000:0.0:1651532145.045794:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468573888
00000100:00100000:0.0:1651532145.045819:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468573952
00000100:00100000:0.0:1651532145.045827:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4556
00000100:00100000:0.0:1651532145.045829:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468573888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532145.045836:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.045840:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4557
00010000:00010000:0.0:1651532145.045841:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532145.045842:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073eec7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468573952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532145.045842:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045845:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532145.045845:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.045850:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045850:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.045853:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.045854:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532145.045855:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.045858:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532145.045859:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.045867:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.045870:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532145.228528:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793937 is committed
00010000:00010000:0.0:1651532145.228561:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.228569:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228591:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.228592:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468569152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 615604us (615670us total) trans 158913793937 rc 0/0
00010000:00010000:1.0:1651532145.228596:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532145.228596:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4548
00010000:00010000:1.0:1651532145.228597:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228600:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228606:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.228606:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.228607:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228610:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228614:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.228614:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.228615:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228618:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228636:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228639:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411a29 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3637248->9084927] (req 3637248->9084927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.228646:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228649:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.228650:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228652:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.228940:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532145.228965:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.228969:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228972:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.228977:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.228990:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468569216:12345-10.240.43.64@tcp:3:fio.0 Request processed in 615970us (616060us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532145.228994:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4549
00000100:00100000:1.0:1651532145.228998:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e22cbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468570624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474523us (474567us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532145.229001:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4550
00010000:00010000:0.0:1651532145.229001:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229005:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532145.229006:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229009:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229015:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229017:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411a37 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4222976->10182655] (req 4222976->10182655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229021:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229024:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532145.229024:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229027:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229030:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.229031:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.229032:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229034:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229047:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.229050:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468574592
00010000:00010000:0.0:1651532145.229050:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411a68 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4435968->9895935] (req 4435968->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.229059:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4403
00010000:00010000:0.0:1651532145.229060:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.229061:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468574592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.229063:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.229064:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.229068:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411b33 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b960 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.229076:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411b33 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b960 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.229080:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411b33 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b960 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.229083:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532145.229091:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468574592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (152us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.229094:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4403
00000100:00100000:1.0:1651532145.229357:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.229366:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.229377:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.229384:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468574656
00000100:00100000:1.0:1651532145.229396:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468574784
00000100:00100000:1.0:1651532145.229404:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4558
00000100:00100000:1.0:1651532145.229406:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbd62f66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468574656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532145.229413:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.229417:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532145.229418:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.229423:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532145.229424:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.229428:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.229432:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.229439:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468574848
00000100:00100000:0.0:1651532145.229440:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4559
00000100:00100000:0.0:1651532145.229442:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b45bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468574784:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532145.229444:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4404
00000100:00100000:1.0:1651532145.229446:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070a794fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468574848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.229449:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.229451:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411b48 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b967 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229451:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229456:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532145.229457:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229460:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532145.229461:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.229466:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411b48 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b967 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.229470:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411b48 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b967 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.229473:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532145.229481:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.229483:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070a794fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468574848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.229488:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4404
00010000:00010000:0.0:1651532145.229488:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.229545:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.229555:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.229560:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468575040
00000100:00100000:1.0:1651532145.229569:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468575168
00000100:00100000:1.0:1651532145.229575:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4405
00000100:00100000:1.0:1651532145.229577:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3eb5fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468575040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.229580:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532145.229581:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4406
00010000:00010000:1.0:1651532145.229583:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411b4f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b96e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.229583:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b3108f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468575168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.229587:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.229590:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411b4f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b96e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.229591:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411b56 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b975 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.229594:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411b4f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b96e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.229597:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532145.229599:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411b56 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b975 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.229603:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411b56 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b975 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532145.229609:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3eb5fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468575040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.229611:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4405
00010000:00010000:0.0:1651532145.229613:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532145.229622:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b3108f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468575168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.229625:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4406
00000100:00100000:1.0:1651532145.229750:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.229760:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468575296
00000100:00100000:0.0:1651532145.229769:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4407
00000100:00100000:0.0:1651532145.229770:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d3bbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468575296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.229774:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.229777:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411b5d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b97c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229784:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411b5d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b97c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.229788:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411b5d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b97c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.229791:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532145.229801:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d3bbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468575296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.229819:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4407
00000100:00100000:1.0:1651532145.229927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.229937:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468575488
00000100:00100000:0.0:1651532145.229945:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4408
00000100:00100000:0.0:1651532145.229947:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468575488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.229950:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.229953:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411b64 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b983 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.229960:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411b64 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b983 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.229964:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411b64 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b983 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.229967:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532145.229977:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468575488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.229980:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4408
00000100:00100000:1.0:1651532145.230192:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.230203:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468575744
00000100:00100000:0.0:1651532145.230210:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4409
00000100:00100000:0.0:1651532145.230212:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468575744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.230215:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.230219:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411b6b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b98a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.230226:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411b6b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b98a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.230229:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411b6b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b98a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.230233:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532145.230242:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468575744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.230245:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4409
00000100:00100000:1.0:1651532145.230455:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.230466:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468575872
00000100:00100000:0.0:1651532145.230474:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4410
00000100:00100000:0.0:1651532145.230476:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468575872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.230479:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.230482:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b72 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b991 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.230489:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b72 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b991 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.230493:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b72 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b991 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.230496:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532145.230506:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468575872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.230508:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4410
00000100:00100000:1.0:1651532145.230730:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.230741:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468576000
00000100:00100000:0.0:1651532145.230748:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4411
00000100:00100000:0.0:1651532145.230750:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468576000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.230753:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.230756:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b79 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b998 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.230763:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b79 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b998 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.230767:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b79 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b998 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.230770:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532145.230780:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468576000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.230782:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4411
00000001:00080000:1.0:1651532145.370198:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793938 is committed
00010000:00010000:0.0:1651532145.370232:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370237:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.370259:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a079a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468570560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 615772us (615814us total) trans 158913793938 rc 0/0
00010000:00010000:1.0:1651532145.370262:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.370263:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4551
00010000:00010000:1.0:1651532145.370268:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532145.370269:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370273:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370279:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.370279:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.370280:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370283:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370293:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370302:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370304:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411a6f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [438272->6107135] (req 438272->6107135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370307:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.370613:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.370622:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.370629:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.370639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.370646:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468576192
00000100:00100000:0.0:1651532145.370656:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468576256
00000100:00100000:0.0:1651532145.370661:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4560
00000100:00100000:0.0:1651532145.370663:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468576192:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532145.370670:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370675:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532145.370676:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370681:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532145.370682:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370687:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370690:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.370697:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4561
00000100:00100000:0.0:1651532145.370699:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468576256:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532145.370703:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370706:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.370707:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370710:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532145.370710:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370713:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370716:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.370734:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468576448
00000100:00100000:0.0:1651532145.370745:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468576512
00000100:00100000:0.0:1651532145.370749:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4412
00000100:00100000:0.0:1651532145.370750:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468576448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.370753:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532145.370756:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4413
00010000:00010000:0.0:1651532145.370756:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411b8e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b99f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.370758:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468576512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.370761:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.370762:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.370764:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411b8e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b99f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.370766:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411b95 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9a6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.370768:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411b8e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b99f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.370772:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532145.370773:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.370775:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411b95 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9a6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.370780:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411b95 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9a6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532145.370782:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468576448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (153us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532145.370783:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532145.370785:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4412
00000100:00100000:1.0:1651532145.370793:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468576512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (154us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532145.370795:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.370796:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4413
00010000:00010000:0.0:1651532145.370799:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370828:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.370829:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468571520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 516001us (516051us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532145.370833:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532145.370834:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370837:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.370839:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4552
00010000:00010000:1.0:1651532145.370842:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.370842:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.370843:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370846:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370853:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370856:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411aa0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->8609791] (req 258048->8609791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370861:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.370864:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.371155:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.371163:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468576640
00000100:00100000:0.0:1651532145.371179:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4414
00000100:00100000:0.0:1651532145.371181:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468576640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.371185:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.371188:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411b9c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9ad expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.371196:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411b9c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9ad expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.371200:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411b9c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9ad expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.371204:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532145.371215:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468576640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.371217:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4414
00000001:00080000:1.0:1651532145.463157:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793939 is committed
00010000:00010000:1.0:1651532145.463171:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463175:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.463197:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468571456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 608181us (608231us total) trans 158913793939 rc 0/0
00000100:00100000:1.0:1651532145.463200:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4553
00010000:00010000:0.0:1651532145.463203:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.463208:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532145.463209:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.463215:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.463221:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.463222:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.463223:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.463226:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.463234:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.463237:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411abc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8294400->8298495] (req 8294400->8298495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463246:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463250:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.463461:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.463468:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.463486:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468576896
00010000:00010000:1.0:1651532145.463489:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463493:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.463498:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468576960
00000100:00100000:0.0:1651532145.463504:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4562
00000100:00100000:0.0:1651532145.463506:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468576896:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532145.463511:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098606df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468572736:12345-10.240.43.64@tcp:3:fio.0 Request processed in 509518us (509576us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532145.463514:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4554
00010000:00010000:0.0:1651532145.463519:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.463520:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4563
00000100:00100000:1.0:1651532145.463522:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468576960:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532145.463524:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532145.463525:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463529:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.463530:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532145.463531:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463534:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.463536:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463538:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532145.463539:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463543:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.463543:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.463547:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463550:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463556:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463559:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532145.463560:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463563:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463567:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.463568:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.463569:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463571:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463587:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463591:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411adf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10457087] (req 2805760->10457087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463596:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463599:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.463791:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.463843:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468577152
00000100:00100000:1.0:1651532145.463857:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4415
00000100:00100000:1.0:1651532145.463859:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468577152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.463863:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.463867:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411bb1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9b4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463875:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411bb1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9b4 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.463879:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411bb1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9b4 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.463882:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532145.463891:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468577152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.463891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.463901:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4415
00000100:00100000:1.0:1651532145.463906:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468577280
00000100:00100000:1.0:1651532145.463917:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4416
00000100:00100000:1.0:1651532145.463918:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468577280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.463921:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.463924:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411bb8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9bb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.463930:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411bb8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9bb expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.463934:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411bb8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9bb expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.463937:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532145.463948:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468577280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.463951:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4416
00000100:00100000:0.0:1651532145.464233:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.464251:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468577536
00000100:00100000:1.0:1651532145.464263:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4417
00000100:00100000:1.0:1651532145.464265:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468577536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.464269:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.464272:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411bbf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9c2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.464280:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411bbf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9c2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.464284:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411bbf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9c2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.464287:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532145.464298:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468577536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.464301:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4417
00000100:00100000:0.0:1651532145.464542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.464561:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468577664
00000100:00100000:1.0:1651532145.464574:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4418
00000100:00100000:1.0:1651532145.464576:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468577664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.464579:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.464582:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bc6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9c9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.464589:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bc6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9c9 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.464593:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bc6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9c9 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.464597:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532145.464607:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468577664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.464609:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4418
00000001:00080000:1.0:1651532145.554838:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793940 is committed
00010000:00010000:1.0:1651532145.554852:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.554856:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.554877:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468572608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 600861us (600935us total) trans 158913793940 rc 0/0
00000100:00100000:1.0:1651532145.554880:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4555
00010000:00010000:0.0:1651532145.554880:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.554884:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532145.554885:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.554889:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.554894:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.554895:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.554896:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.554910:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.554918:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.554921:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411ae6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [421888->7925759] (req 421888->7925759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.554926:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.554929:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.555227:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.555242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.555250:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.555257:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.555266:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468577920
00000100:00100000:1.0:1651532145.555278:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468577856
00000100:00100000:1.0:1651532145.555286:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4564
00000100:00100000:1.0:1651532145.555288:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc66c150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468577920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532145.555295:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.555300:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532145.555300:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4565
00010000:00010000:1.0:1651532145.555301:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532145.555301:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.555303:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468577856:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532145.555305:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.555311:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.555312:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468577984
00010000:00010000:0.0:1651532145.555316:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532145.555317:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.555320:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468578048
00000100:00100000:1.0:1651532145.555326:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4419
00000100:00100000:1.0:1651532145.555327:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468577984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.555330:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.555330:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.555333:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411bdb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9d0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.555349:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532145.555350:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.555356:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.555357:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411bdb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9d0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.555359:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.555361:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411bdb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9d0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.555362:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.555364:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532145.555372:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4420
00000100:00100000:0.0:1651532145.555373:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468578048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.555376:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.555379:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411be2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9d7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.555387:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468577984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.555390:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4419
00010000:00010000:0.0:1651532145.555400:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411be2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9d7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.555405:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411be2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9d7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.555408:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532145.555431:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468578048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (174us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.555434:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4420
00000100:00100000:1.0:1651532145.555639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.555650:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468578176
00000100:00100000:1.0:1651532145.555652:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.555665:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468578240
00000100:00100000:1.0:1651532145.555669:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4421
00000100:00100000:1.0:1651532145.555676:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468578176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532145.555676:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4422
00000100:00100000:0.0:1651532145.555678:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468578240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.555680:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.555682:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.555684:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411be9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9de expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.555685:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411bf0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9e5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.555691:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411be9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9de expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.555693:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411bf0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9e5 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.555695:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411be9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9de expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.555697:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411bf0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9e5 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.555699:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532145.555701:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532145.555708:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468578176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.555709:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468578240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.555711:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4421
00000100:00100000:0.0:1651532145.555713:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4422
00000001:00080000:1.0:1651532145.654877:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793941 is committed
00010000:00010000:0.0:1651532145.654909:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.654914:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.654946:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468573888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 609117us (609263us total) trans 158913793941 rc 0/0
00010000:00010000:1.0:1651532145.654949:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.654950:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4556
00010000:00010000:1.0:1651532145.654953:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532145.654954:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.654958:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.654963:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.654964:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.654965:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.654968:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.654976:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.654979:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411b25 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->8421375] (req 1880064->8421375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.654993:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.654997:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.655270:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.655288:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468578560
00000100:00100000:0.0:1651532145.655299:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4423
00000100:00100000:0.0:1651532145.655301:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468578560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.655303:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.655305:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.655307:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.655309:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411bf7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9ec expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.655315:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.655318:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411bf7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9ec expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.655322:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411bf7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9ec expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532145.655323:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073eec7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468573952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 609480us (609618us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532145.655325:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532145.655326:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4557
00010000:00010000:1.0:1651532145.655333:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.655334:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468578560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.655346:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4423
00010000:00010000:1.0:1651532145.655348:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532145.655350:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.655353:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.655358:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.655358:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.655359:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.655365:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.655372:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.655375:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411b2c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->9732095] (req 1294336->9732095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.655380:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.655383:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.655851:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.655859:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.655869:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.655869:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468578688
00000100:00100000:1.0:1651532145.655877:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.655886:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.655893:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468578752
00000100:00100000:1.0:1651532145.655895:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.655903:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4566
00000100:00100000:0.0:1651532145.655905:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468578688:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532145.655908:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468578880
00010000:00010000:0.0:1651532145.655912:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.655915:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468579008
00000100:00100000:1.0:1651532145.655917:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468579072
00010000:00010000:0.0:1651532145.655917:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532145.655918:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.655919:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468579136
00010000:00010000:0.0:1651532145.655921:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:1.0:1651532145.655922:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4424
00010000:00010000:0.0:1651532145.655922:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.655923:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468578880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.655926:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.655929:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.655929:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.655937:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4567
00000100:00100000:0.0:1651532145.655939:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468578752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532145.655941:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411c05 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9f3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.655944:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.655948:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532145.655949:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.655952:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532145.655952:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.655959:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411c05 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9f3 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.655959:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.655962:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.655964:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411c05 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9f3 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.655967:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532145.655969:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4425
00000100:00100000:0.0:1651532145.655970:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468579008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.655973:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.655975:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c13 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44b9fa expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.655980:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468578880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.655983:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4424
00010000:00010000:0.0:1651532145.655988:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c13 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9fa expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532145.655989:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4426
00000100:00100000:1.0:1651532145.655990:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468579072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.655993:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.655993:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c13 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44b9fa expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.655996:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411c1a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba01 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.655996:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532145.656002:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411c1a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba01 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532145.656005:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468579008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (128us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532145.656006:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411c1a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba01 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532145.656008:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4425
00010000:00010000:1.0:1651532145.656012:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532145.656014:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4427
00000100:00100000:0.0:1651532145.656016:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468579136:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532145.656018:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468579072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (132us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532145.656019:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532145.656020:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4426
00010000:00010000:0.0:1651532145.656021:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c21 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba08 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.656027:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c21 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba08 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.656031:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c21 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba08 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.656034:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532145.656039:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468579136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (144us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.656041:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4427
00000100:00100000:1.0:1651532145.656389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.656408:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468579264
00000100:00100000:0.0:1651532145.656421:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4428
00000100:00100000:0.0:1651532145.656422:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468579264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.656426:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.656429:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c28 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba0f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.656436:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c28 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba0f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.656440:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c28 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba0f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.656446:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532145.656457:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468579264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.656460:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4428
00000001:00080000:1.0:1651532145.763261:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793942 is committed
00002000:00010000:1.0:1651532145.763276:0:330054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532143 -> 1651532145
00002000:00010000:1.0:1651532145.763277:0:330054:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532142 -> 1651532145
00010000:00010000:1.0:1651532145.763280:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763284:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.763308:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbd62f66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468574656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 533901us (533950us total) trans 158913793942 rc 0/0
00010000:00010000:0.0:1651532145.763308:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.763311:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4558
00010000:00010000:0.0:1651532145.763313:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532145.763314:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763318:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763324:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.763324:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.763325:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763328:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763346:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763350:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411b3a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1622016->9748479] (req 1622016->9748479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763358:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763363:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763376:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763382:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.763404:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b45bea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468574784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533961us (534037us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532145.763407:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4559
00010000:00010000:1.0:1651532145.763414:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763417:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532145.763418:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763421:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763427:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.763427:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.763428:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763431:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763440:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763443:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411b41 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5242880->5246975] (req 5242880->5246975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763452:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763456:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.763720:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.763732:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.763739:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.763746:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468579584
00000100:00100000:1.0:1651532145.763753:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468579648
00000100:00100000:1.0:1651532145.763755:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468579776
00000100:00100000:1.0:1651532145.763758:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4429
00000100:00100000:1.0:1651532145.763760:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468579584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.763763:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.763767:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411c2f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba16 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763783:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411c2f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba16 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.763787:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411c2f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba16 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.763791:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532145.763801:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468579584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.763817:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4429
00000100:00100000:1.0:1651532145.763823:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4430
00000100:00100000:1.0:1651532145.763825:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468579648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.763828:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.763830:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411c36 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba1d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.763833:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4431
00000100:00100000:0.0:1651532145.763835:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468579776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.763837:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411c36 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba1d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.763839:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.763841:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411c36 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba1d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.763843:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c3d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba24 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763844:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532145.763851:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468579648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (119us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532145.763852:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c3d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba24 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532145.763853:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4430
00010000:00010000:0.0:1651532145.763856:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c3d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba24 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.763860:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532145.763869:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468579776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.763871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.763872:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4431
00000100:00100000:1.0:1651532145.763884:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468579840
00000100:00100000:0.0:1651532145.763895:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.763909:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468579904
00000100:00100000:0.0:1651532145.763910:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4568
00000100:00100000:0.0:1651532145.763912:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e94a2d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468579840:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532145.763915:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4569
00000100:00100000:1.0:1651532145.763917:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468579904:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532145.763920:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763923:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763924:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532145.763925:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763928:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532145.763929:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763933:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532145.763934:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763937:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532145.763937:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763963:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763963:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.763967:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.763967:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.764239:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.764247:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.764261:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468580032
00000100:00100000:1.0:1651532145.764267:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468580160
00000100:00100000:0.0:1651532145.764272:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4432
00000100:00100000:0.0:1651532145.764274:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468580032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.764277:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532145.764280:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4433
00010000:00010000:0.0:1651532145.764280:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c52 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba2b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.764282:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468580160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.764285:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.764288:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411c59 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba32 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.764288:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c52 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba2b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.764296:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411c59 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba32 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.764296:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c52 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba2b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.764299:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532145.764300:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411c59 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba32 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.764304:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532145.764312:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468580032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.764315:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4432
00000100:00100000:1.0:1651532145.764319:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468580160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.764321:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4433
00000001:00080000:1.0:1651532145.830038:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793943 is committed
00010000:00010000:0.0:1651532145.830070:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.830075:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.830098:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.830098:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468576192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 459434us (459485us total) trans 158913793943 rc 0/0
00000100:00100000:0.0:1651532145.830102:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4560
00010000:00010000:1.0:1651532145.830103:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532145.830104:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.830108:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.830113:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.830114:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.830115:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.830118:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.830128:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.830136:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.830138:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411b80 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [548864->10059775] (req 548864->10059775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.830140:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.830461:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.830479:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468580480
00000100:00100000:1.0:1651532145.830488:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4434
00000100:00100000:1.0:1651532145.830490:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468580480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.830498:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.830499:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.830503:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411c60 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba39 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.830505:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.830511:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.830514:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411c60 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba39 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.830518:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411c60 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba39 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.830521:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532145.830521:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468576256:12345-10.240.43.64@tcp:3:fio.0 Request processed in 459821us (459898us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532145.830524:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4561
00000100:00100000:1.0:1651532145.830530:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468580480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (70us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532145.830530:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.830533:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4434
00010000:00010000:0.0:1651532145.830534:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532145.830535:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.830538:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.830543:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.830544:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.830544:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.830547:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.830554:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.830557:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411b87 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->8781823] (req 69632->8781823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.830562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532145.830562:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.830565:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.830618:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468580608
00000100:00100000:1.0:1651532145.830626:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4435
00000100:00100000:1.0:1651532145.830628:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468580608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.830631:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.830634:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411c67 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba40 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.830641:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411c67 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba40 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.830645:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411c67 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba40 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.830651:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532145.830665:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468580608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.830667:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4435
00000100:00100000:1.0:1651532145.831046:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.831057:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.831058:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468580736
00000100:00100000:1.0:1651532145.831067:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.831078:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468580672
00000100:00100000:0.0:1651532145.831084:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4570
00000100:00100000:1.0:1651532145.831086:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.831086:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006ef6773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468580736:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532145.831093:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468580800
00010000:00010000:0.0:1651532145.831093:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.831098:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532145.831099:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532145.831099:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.831100:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468580928
00010000:00010000:0.0:1651532145.831103:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.831108:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4436
00000100:00100000:1.0:1651532145.831110:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7c7bf97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468580800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.831113:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532145.831116:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4571
00010000:00010000:1.0:1651532145.831117:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411c75 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba47 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.831117:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468580672:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532145.831122:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.831125:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411c75 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba47 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.831126:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532145.831127:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.831130:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.831132:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532145.831133:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.831136:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411c75 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba47 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.831137:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.831139:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532145.831140:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.831143:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.831151:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7c7bf97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468580800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.831155:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4437
00000100:00100000:0.0:1651532145.831157:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468580928:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532145.831158:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4436
00010000:00010000:0.0:1651532145.831160:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.831163:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411c83 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba4e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.831188:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411c83 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba4e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.831196:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411c83 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba4e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.831199:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532145.831206:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.831209:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468580928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.831211:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4437
00000100:00100000:0.0:1651532145.831217:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468581056
00000100:00100000:0.0:1651532145.831226:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4438
00000100:00100000:0.0:1651532145.831228:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468581056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.831231:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.831233:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411c8a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba55 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.831239:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411c8a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba55 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.831243:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411c8a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba55 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.831246:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532145.831256:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468581056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.831259:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4438
00000100:00100000:0.0:1651532145.831569:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.831577:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.831590:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468581248
00000100:00100000:1.0:1651532145.831596:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468581376
00000100:00100000:0.0:1651532145.831600:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4439
00000100:00100000:0.0:1651532145.831602:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468581248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.831605:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.831608:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411c91 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba5c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.831609:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4440
00000100:00100000:1.0:1651532145.831611:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468581376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.831614:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.831615:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411c91 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba5c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.831618:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411c98 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba63 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.831619:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411c91 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba5c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.831623:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532145.831625:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411c98 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba63 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.831629:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411c98 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba63 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532145.831635:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468581248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.831637:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4439
00010000:00010000:1.0:1651532145.831639:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532145.831647:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468581376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.831650:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4440
00000100:00100000:0.0:1651532145.831936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.831954:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468581696
00000100:00100000:1.0:1651532145.831962:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4441
00000100:00100000:1.0:1651532145.831963:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468581696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.831967:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.831970:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411c9f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba6a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.831980:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411c9f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba6a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.831983:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411c9f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba6a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.831987:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532145.831996:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468581696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.831998:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4441
00000100:00100000:0.0:1651532145.832189:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.832207:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468581888
00000100:00100000:1.0:1651532145.832215:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4442
00000100:00100000:1.0:1651532145.832216:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468581888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.832219:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.832223:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411ca6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba71 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.832229:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411ca6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba71 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.832233:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411ca6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba71 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.832236:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532145.832245:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468581888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532145.832249:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4442
00000100:00100000:0.0:1651532145.888100:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532145.888109:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232704
00000100:00100000:0.0:1651532145.888118:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 65
00000100:00100000:0.0:1651532145.888120:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232704:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532145.888126:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 745472 granted 350851648 pending 229376 free 81138851840 avail 76967366656
00000100:00100000:0.0:1651532145.888144:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232704:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (44us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532145.888147:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 65
00000001:00080000:1.0:1651532145.977797:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793944 is committed
00010000:00010000:0.0:1651532145.977840:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.977845:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.977868:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eed128a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468576896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 514361us (514408us total) trans 158913793944 rc 0/0
00010000:00010000:1.0:1651532145.977870:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.977872:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4562
00010000:00010000:1.0:1651532145.977876:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532145.977877:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977881:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977888:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.977888:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.977889:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977893:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977896:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.977897:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.977897:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977900:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977919:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977922:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f411ba3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1458176->7131135] (req 1458176->7131135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977929:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977932:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977957:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.977960:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.978228:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.978242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.978264:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468582016
00000100:00100000:0.0:1651532145.978268:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468582208
00000100:00100000:1.0:1651532145.978276:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4443
00000100:00100000:1.0:1651532145.978278:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468582016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532145.978278:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4444
00000100:00100000:0.0:1651532145.978280:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008949cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468582208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532145.978282:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.978283:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532145.978286:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411cad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba78 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.978287:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411cb4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba7f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978292:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532145.978294:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.978295:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411cad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba78 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.978297:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411cb4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba7f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.978300:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411cad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba78 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.978302:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411cb4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba7f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.978304:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532145.978306:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532145.978315:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468582016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.978315:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008949cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468582208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.978318:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4444
00000100:00100000:1.0:1651532145.978320:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4443
00010000:00010000:1.0:1651532145.978332:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978350:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.978365:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc66c150 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468577920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 423077us (423139us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532145.978368:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4564
00010000:00010000:1.0:1651532145.978378:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978381:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.978398:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e83f671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468576960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 514875us (514929us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532145.978400:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4563
00010000:00010000:0.0:1651532145.978403:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978406:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.978407:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532145.978408:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978410:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532145.978411:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.978412:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978414:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.978418:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978420:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.978421:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532145.978421:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.978421:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411bcd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8552447] (req 1822720->8552447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978424:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978434:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978437:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411baa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1073152->2793471] (req 1073152->2793471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.978437:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.978440:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.978913:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.978924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532145.978934:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.978935:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468582528
00000100:00100000:1.0:1651532145.978941:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.978953:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468582656
00000100:00100000:1.0:1651532145.978958:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468582464
00000100:00100000:0.0:1651532145.978959:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4445
00000100:00100000:0.0:1651532145.978960:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468582528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.978964:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532145.978972:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468582336
00010000:00010000:0.0:1651532145.978974:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411cbb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba86 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532145.978978:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4572
00000100:00100000:1.0:1651532145.978980:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468582464:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532145.978982:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411cbb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba86 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.978987:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411cbb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba86 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.978988:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.978990:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532145.978993:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532145.978994:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.978997:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532145.978998:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.979001:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468582528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (77us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532145.979002:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.979004:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4445
00010000:00010000:1.0:1651532145.979006:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532145.979009:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4446
00000100:00100000:0.0:1651532145.979011:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468582656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532145.979013:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4573
00010000:00010000:0.0:1651532145.979013:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532145.979014:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468582336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532145.979016:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411cc9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba8d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.979019:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.979022:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532145.979022:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411cc9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba8d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.979023:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.979026:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532145.979026:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.979029:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411cc9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba8d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532145.979030:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532145.979033:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.979035:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532145.979041:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468582656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.979044:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4446
00000100:00100000:1.0:1651532145.979408:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.979426:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468583104
00000100:00100000:0.0:1651532145.979439:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4447
00000100:00100000:0.0:1651532145.979440:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468583104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.979444:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.979447:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411cd7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba94 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.979454:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411cd7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba94 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.979458:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411cd7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba94 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.979461:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532145.979472:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468583104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.979474:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4447
00000100:00100000:1.0:1651532145.979704:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532145.979715:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468583296
00000100:00100000:0.0:1651532145.979725:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4448
00000100:00100000:0.0:1651532145.979727:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468583296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532145.979732:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532145.979735:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cde lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ba9b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532145.979742:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cde lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba9b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.979745:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cde lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ba9b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532145.979749:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532145.979759:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468583296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532145.979761:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4448
00000001:00080000:1.0:1651532146.104949:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793945 is committed
00010000:00010000:0.0:1651532146.104982:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.104988:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.105010:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dad61e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468577856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549706us (549767us total) trans 158913793945 rc 0/0
00010000:00010000:1.0:1651532146.105012:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.105014:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4565
00010000:00010000:1.0:1651532146.105017:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532146.105018:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.105021:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.105027:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.105027:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.105028:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.105031:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.105040:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.105043:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f411bd4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1298432->7778303] (req 1298432->7778303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.105052:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.105056:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.105370:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.105378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.105403:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468583616
00000100:00100000:0.0:1651532146.105410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.105419:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468583488
00000100:00100000:1.0:1651532146.105422:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4574
00000100:00100000:1.0:1651532146.105424:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f9bc190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468583616:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532146.105434:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4575
00010000:00010000:1.0:1651532146.105436:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.105436:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468583488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532146.105441:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532146.105442:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.105444:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.105445:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532146.105446:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.105450:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532146.105451:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.105454:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532146.105455:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.105458:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.105459:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.105462:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.105463:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.105470:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468583808
00000100:00100000:0.0:1651532146.105479:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4449
00000100:00100000:0.0:1651532146.105481:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468583808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.105485:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.105487:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411cf3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44baa2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.105495:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411cf3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44baa2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.105499:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411cf3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44baa2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.105502:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532146.105513:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468583808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.105516:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4449
00000001:00080000:1.0:1651532146.213278:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793946 is committed
00010000:00010000:0.0:1651532146.213309:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213313:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.213330:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468578688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557424us (557480us total) trans 158913793946 rc 0/0
00000100:00100000:0.0:1651532146.213333:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4566
00010000:00010000:0.0:1651532146.213350:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213354:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532146.213363:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213366:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213372:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.213372:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.213373:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213376:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213384:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213387:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411bfe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1982464->6479871] (req 1982464->6479871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213392:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213395:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213588:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213592:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.213622:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468578752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 557682us (557763us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532146.213624:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.213626:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4567
00010000:00010000:1.0:1651532146.213628:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532146.213629:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.213635:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.213641:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.213642:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.213643:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.213646:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.213662:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213662:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.213666:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411c0c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->7929855] (req 2248704->7929855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213666:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.213745:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.213753:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468584064
00000100:00100000:0.0:1651532146.213767:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4450
00000100:00100000:0.0:1651532146.213769:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468584064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.213772:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.213776:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411cfa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44baa9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.213823:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411cfa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44baa9 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.213828:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411cfa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44baa9 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.213832:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532146.213842:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468584064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 73us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.213845:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4450
00000100:00100000:0.0:1651532146.213915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.213923:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.213930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.214012:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468584192
00000100:00100000:0.0:1651532146.214028:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468584128
00000100:00100000:0.0:1651532146.214036:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4576
00000100:00100000:0.0:1651532146.214038:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468584192:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532146.214043:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4577
00000100:00100000:1.0:1651532146.214045:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468584128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532146.214053:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.214054:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411d01 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.214057:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532146.214058:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.214061:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532146.214062:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.214066:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.214067:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.214068:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411d01 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10289152->10293247] (req 10289152->10293247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.214072:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411d01 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10289152->10293247] (req 10289152->10293247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.214073:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.214077:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.214085:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411d01 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10289152->10293247] (req 10289152->10293247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.214088:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411d01 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10289152->10293247] (req 10289152->10293247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.214098:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411d01 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10289152->10293247] (req 10289152->10293247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.214104:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468584192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 65us (189us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532146.214107:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4576
00010000:00010000:1.0:1651532146.214112:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532146.214113:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411d01 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10289152->10293247] (req 10289152->10293247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.214116:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411d01 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10289152->10293247] (req 10289152->10293247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.214121:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411d01 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10289152->10293247] (req 10289152->10293247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.214124:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411d01 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [10289152->10293247] (req 10289152->10293247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.214130:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468584256
00000100:00100000:0.0:1651532146.214139:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4451
00000100:00100000:0.0:1651532146.214141:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468584256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.214144:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.214147:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411d0f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bab0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.214155:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411d0f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bab0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.214159:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411d0f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bab0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.214162:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532146.214169:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468584256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (246us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.214172:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4451
00000100:00100000:0.0:1651532146.214187:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.214226:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468584320
00000100:00100000:0.0:1651532146.214235:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4452
00000100:00100000:0.0:1651532146.214237:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468584320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.214240:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.214244:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d16 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bab7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.214250:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d16 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bab7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.214274:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d16 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bab7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.214277:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532146.214288:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468584320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.214290:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4452
00000100:00100000:0.0:1651532146.214463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.214470:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468584512
00000100:00100000:0.0:1651532146.214482:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4453
00000100:00100000:0.0:1651532146.214484:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468584512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.214487:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.214490:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d1d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44babe expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.214497:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d1d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44babe expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.214501:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d1d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44babe expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.214505:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532146.214514:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468584512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.214518:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4453
00000100:00100000:0.0:1651532146.214561:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.214568:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468584640
00000100:00100000:0.0:1651532146.214579:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4454
00000100:00100000:0.0:1651532146.214581:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468584640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.214584:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.214587:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d24 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bac5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.214594:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d24 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bac5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.214598:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d24 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bac5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.214601:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532146.214610:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468584640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.214612:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4454
00000001:00080000:1.0:1651532146.271691:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793947 is committed
00010000:00010000:0.0:1651532146.271727:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271732:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.271750:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e94a2d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468579840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507837us (507879us total) trans 158913793947 rc 0/0
00000100:00100000:0.0:1651532146.271754:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4568
00010000:00010000:0.0:1651532146.271761:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271765:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532146.271766:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271769:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271773:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.271774:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.271775:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271778:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271781:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.271781:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.271782:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271785:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271798:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.271811:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271815:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411c44 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9850879] (req 2359296->9850879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.271818:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271821:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.271824:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272069:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272073:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272077:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272087:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.272093:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006ef6773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468580736:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441006us (441054us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532146.272096:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4570
00000100:00100000:1.0:1651532146.272102:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754468579904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508184us (508206us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532146.272106:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4569
00010000:00010000:1.0:1651532146.272113:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272117:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532146.272118:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272121:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272129:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272134:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532146.272135:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272135:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272139:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411c6e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2379776->10440703] (req 2379776->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272139:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272155:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.272156:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.272156:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272160:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272167:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272169:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f411c4b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2543616->5840895] (req 2543616->5840895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272175:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272178:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.272282:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.272292:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468584896
00000100:00100000:1.0:1651532146.272308:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4578
00000100:00100000:1.0:1651532146.272310:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468584896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532146.272316:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272321:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532146.272322:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532146.272323:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272326:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.272385:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.272406:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.272410:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468585024
00000100:00100000:0.0:1651532146.272415:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.272425:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468585152
00000100:00100000:0.0:1651532146.272427:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468584960
00000100:00100000:1.0:1651532146.272430:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4455
00000100:00100000:1.0:1651532146.272432:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468585024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.272435:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.272438:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411d32 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bacc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.272438:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4579
00000100:00100000:0.0:1651532146.272440:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468584960:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532146.272447:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411d32 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bacc expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.272451:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f411d32 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bacc expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.272455:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532146.272465:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468585024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.272468:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4455
00000100:00100000:1.0:1651532146.272473:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4456
00000100:00100000:1.0:1651532146.272474:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468585152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.272480:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272485:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532146.272486:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.272486:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272488:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411d40 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bad3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272489:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272492:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532146.272493:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272497:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411d40 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bad3 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.272497:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272500:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272501:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f411d40 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bad3 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.272503:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272504:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532146.272510:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468585152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.272513:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4456
00000100:00100000:1.0:1651532146.272542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.272560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.272584:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468585280
00000100:00100000:1.0:1651532146.272592:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468585216
00000100:00100000:0.0:1651532146.272595:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4580
00000100:00100000:0.0:1651532146.272597:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468585280:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532146.272600:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4457
00000100:00100000:1.0:1651532146.272602:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059bf1b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468585216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.272603:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272605:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.272608:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411d4e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bada expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272610:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532146.272611:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272613:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532146.272614:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272623:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411d4e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bada expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.272623:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.272626:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272627:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f411d4e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bada expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.272630:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532146.272640:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059bf1b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468585216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.272643:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4457
00000100:00100000:0.0:1651532146.272864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.272875:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468585472
00000100:00100000:1.0:1651532146.272883:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4458
00000100:00100000:1.0:1651532146.272885:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468585472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.272888:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.272891:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411d55 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bae1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272899:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411d55 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bae1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.272903:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f411d55 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bae1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.272916:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532146.272928:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468585472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.272931:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4458
00000100:00100000:0.0:1651532146.272951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.272962:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468585664
00000100:00100000:1.0:1651532146.272969:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4459
00000100:00100000:1.0:1651532146.272970:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468585664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.272973:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.272976:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411d5c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bae8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.272983:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411d5c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bae8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.272987:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f411d5c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bae8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.272990:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532146.272997:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468585664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.272999:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4459
00000100:00100000:1.0:1651532146.273046:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.273053:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468585792
00000100:00100000:1.0:1651532146.273059:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4460
00000100:00100000:1.0:1651532146.273061:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468585792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.273065:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.273067:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411d63 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44baef expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.273074:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411d63 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44baef expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.273078:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f411d63 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44baef expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.273081:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532146.273094:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468585792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.273096:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4460
00000100:00100000:1.0:1651532146.273274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.273282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.273288:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468585920
00000100:00100000:1.0:1651532146.273292:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468586112
00000100:00100000:1.0:1651532146.273296:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4461
00000100:00100000:1.0:1651532146.273298:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468585920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.273301:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.273304:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411d6a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44baf6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.273310:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411d6a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44baf6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.273316:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f411d6a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44baf6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.273320:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532146.273332:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468585920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.273335:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4461
00000100:00100000:1.0:1651532146.273347:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4462
00000100:00100000:1.0:1651532146.273348:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468586112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.273351:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.273354:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411d71 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bafd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.273368:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411d71 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bafd expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.273372:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f411d71 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bafd expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.273375:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532146.273385:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468586112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.273387:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4462
00000100:00100000:0.0:1651532146.273607:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.273626:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468586368
00000100:00100000:1.0:1651532146.273634:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4463
00000100:00100000:1.0:1651532146.273635:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468586368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.273638:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.273642:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f411d78 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb04 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.273649:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f411d78 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb04 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.273653:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f411d78 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb04 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.273656:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000603f6abd, rc 0)
00000100:00100000:1.0:1651532146.273665:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468586368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.273667:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4463
00000001:00080000:1.0:1651532146.388373:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793948 is committed
00010000:00010000:0.0:1651532146.388405:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.388410:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.388429:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468580672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557311us (557372us total) trans 158913793948 rc 0/0
00000100:00100000:0.0:1651532146.388433:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4571
00010000:00010000:0.0:1651532146.388440:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.388444:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532146.388445:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.388448:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.388453:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.388454:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.388455:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.388458:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.388470:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.388473:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411c7c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9838591] (req 692224->9838591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.388483:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.388487:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.388910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.388921:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.388928:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.388939:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.388952:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468586688
00000100:00100000:0.0:1651532146.388953:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468586624
00000100:00100000:1.0:1651532146.388960:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468586816
00000100:00100000:0.0:1651532146.388966:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468586560
00000100:00100000:0.0:1651532146.388974:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4581
00000100:00100000:1.0:1651532146.388976:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4464
00000100:00100000:1.0:1651532146.388978:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468586688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.388983:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532146.388984:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468586624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532146.388987:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f411d7f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb0b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.388992:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.388992:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.388995:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f411d7f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb0b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.388996:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.388997:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389000:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532146.389001:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.389005:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603f6abd/0xa29a79078f411d7f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb0b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.389005:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.389009:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000603f6abd, rc 0)
00010000:00010000:0.0:1651532146.389009:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.389017:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4582
00000100:00100000:1.0:1651532146.389019:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468586688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.389019:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468586560:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532146.389022:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4464
00010000:00010000:0.0:1651532146.389023:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.389027:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4465
00010000:00010000:0.0:1651532146.389027:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532146.389028:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468586816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.389028:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389030:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532146.389031:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.389033:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f411d94 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb12 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389037:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.389040:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.389042:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.389043:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f411d94 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb12 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.389046:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e189ae/0xa29a79078f411d94 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb12 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.389046:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.389052:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022e189ae, rc 0)
00000100:00100000:1.0:1651532146.389058:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468586816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.389060:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4465
00010000:00010000:0.0:1651532146.389064:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389067:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.389086:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468582464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 410105us (410181us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532146.389089:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4572
00010000:00010000:0.0:1651532146.389101:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389105:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532146.389106:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389108:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389113:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.389114:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.389115:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389118:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389124:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.389126:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389126:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f411cc2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2019328->10461183] (req 2019328->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.389131:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.389419:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.389426:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.389433:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.389463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.389471:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468587008
00000100:00100000:0.0:1651532146.389477:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468587136
00000100:00100000:0.0:1651532146.389479:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468587200
00000100:00100000:0.0:1651532146.389481:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468587264
00000100:00100000:0.0:1651532146.389484:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4466
00000100:00100000:0.0:1651532146.389486:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468587008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.389489:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.389493:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411d9b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb19 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389501:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411d9b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb19 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532146.389503:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4467
00000100:00100000:1.0:1651532146.389505:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468587136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.389508:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411d9b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb19 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.389509:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.389512:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411da2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb20 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.389512:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532146.389520:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411da2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb20 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532146.389525:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468587008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.389528:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4466
00010000:00010000:1.0:1651532146.389531:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d25e63b7/0xa29a79078f411da2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb20 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532146.389533:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4468
00010000:00010000:1.0:1651532146.389535:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d25e63b7, rc 0)
00000100:00100000:0.0:1651532146.389535:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468587200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.389538:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.389540:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411da9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb27 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.389544:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468587136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (117us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532146.389546:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411da9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb27 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532146.389548:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4467
00010000:00010000:0.0:1651532146.389550:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411da9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb27 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.389553:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532146.389554:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4469
00000100:00100000:1.0:1651532146.389556:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468587264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.389558:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532146.389559:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468587200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (126us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532146.389560:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f411db0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb2e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.389561:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4468
00010000:00010000:1.0:1651532146.389566:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f411db0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb2e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.389570:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043f2db54/0xa29a79078f411db0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb2e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.389573:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043f2db54, rc 0)
00000100:00100000:1.0:1651532146.389578:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468587264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (116us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.389580:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4469
00000100:00100000:0.0:1651532146.389852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.389863:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468587392
00000100:00100000:1.0:1651532146.389875:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4470
00000100:00100000:1.0:1651532146.389877:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468587392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.389880:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.389883:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f411db7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb35 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.389890:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f411db7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb35 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.389894:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67c21a7/0xa29a79078f411db7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb35 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.389904:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f67c21a7, rc 0)
00000100:00100000:1.0:1651532146.389917:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468587392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.389920:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4470
00000100:00100000:0.0:1651532146.389939:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.389953:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468587456
00000100:00100000:1.0:1651532146.389962:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4471
00000100:00100000:1.0:1651532146.389964:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468587456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.389967:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.389970:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f411dbe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb3c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.389976:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f411dbe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb3c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.389980:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bdd51b3/0xa29a79078f411dbe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb3c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.389983:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008bdd51b3, rc 0)
00000100:00100000:1.0:1651532146.389990:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468587456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.389992:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4471
00000100:00100000:0.0:1651532146.390031:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.390041:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468587648
00000100:00100000:1.0:1651532146.390051:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4472
00000100:00100000:1.0:1651532146.390053:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468587648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.390056:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.390059:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f411dc5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb43 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.390065:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f411dc5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb43 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.390069:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077af4bf9/0xa29a79078f411dc5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb43 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.390072:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077af4bf9, rc 0)
00000100:00100000:1.0:1651532146.390081:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468587648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.390084:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4472
00000100:00100000:0.0:1651532146.390136:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.390146:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468587840
00000100:00100000:1.0:1651532146.390156:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4473
00000100:00100000:1.0:1651532146.390158:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468587840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.390161:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.390164:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411dcc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb4a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.390171:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411dcc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb4a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.390177:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087dc8b1c/0xa29a79078f411dcc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb4a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.390181:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000087dc8b1c, rc 0)
00000100:00100000:1.0:1651532146.390190:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468587840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.390192:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4473
00000100:00100000:0.0:1651532146.390237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.390247:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468588032
00000100:00100000:1.0:1651532146.390257:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4474
00000100:00100000:1.0:1651532146.390258:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468588032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.390261:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.390264:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f411dd3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb51 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.390271:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f411dd3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb51 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.390274:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035f6d17d/0xa29a79078f411dd3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb51 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.390278:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000035f6d17d, rc 0)
00000100:00100000:1.0:1651532146.390287:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468588032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.390289:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4474
00000100:00100000:0.0:1651532146.390324:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.390364:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468588160
00000100:00100000:1.0:1651532146.390375:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4475
00000100:00100000:1.0:1651532146.390377:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468588160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.390380:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.390383:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411dda lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb58 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.390392:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411dda lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb58 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.390396:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411dda lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb58 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.390400:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532146.390409:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468588160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.390411:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4475
00000001:00080000:1.0:1651532146.480117:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793949 is committed
00010000:00010000:1.0:1651532146.480132:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.480136:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.480157:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468582336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 501141us (501222us total) trans 158913793949 rc 0/0
00000100:00100000:1.0:1651532146.480160:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4573
00010000:00010000:0.0:1651532146.480160:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480166:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532146.480167:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480170:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480176:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.480177:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.480178:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480181:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480191:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480194:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f411cd0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10141695] (req 24576->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480203:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480207:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.480534:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.480543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.480554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.480555:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468588480
00000100:00100000:1.0:1651532146.480560:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.480568:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.480577:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468588544
00000100:00100000:0.0:1651532146.480589:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4583
00000100:00100000:0.0:1651532146.480591:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468588480:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532146.480592:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4584
00000100:00100000:1.0:1651532146.480594:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468588544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532146.480598:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.480603:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480603:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532146.480604:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480607:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532146.480607:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.480611:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.480612:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.480615:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532146.480616:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480620:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.480621:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480623:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.480624:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.480631:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468588608
00000100:00100000:1.0:1651532146.480632:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468588672
00000100:00100000:0.0:1651532146.480637:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468588736
00000100:00100000:1.0:1651532146.480639:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4476
00000100:00100000:1.0:1651532146.480640:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468588608:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532146.480641:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4477
00010000:00010000:1.0:1651532146.480643:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532146.480643:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468588672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.480646:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411def lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb5f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480646:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.480649:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411df6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb66 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.480650:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.480653:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411def lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb5f expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.480654:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.480657:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411def lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb5f expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.480657:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411df6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb66 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.480660:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532146.480661:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411df6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb66 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.480665:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532146.480670:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468588608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (116us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.480673:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4476
00000100:00100000:0.0:1651532146.480673:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468588672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.480676:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4477
00000100:00100000:1.0:1651532146.480678:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4478
00000100:00100000:1.0:1651532146.480679:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468588736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.480682:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.480684:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411dfd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb6d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480688:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480692:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.480695:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.480696:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411dfd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb6d expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.480700:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411dfd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb6d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532146.480703:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f9bc190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468583616:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375279us (375334us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532146.480706:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532146.480706:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4574
00000100:00100000:1.0:1651532146.480711:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468588736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (143us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532146.480711:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.480714:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4478
00010000:00010000:0.0:1651532146.480717:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532146.480718:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480721:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480725:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.480726:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.480726:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480729:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480736:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480739:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f411ce5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2445312->10436607] (req 2445312->10436607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480744:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.480746:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.481118:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.481126:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.481132:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.481142:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468588864
00000100:00100000:0.0:1651532146.481143:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468588992
00000100:00100000:1.0:1651532146.481151:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468589120
00000100:00100000:1.0:1651532146.481155:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4479
00000100:00100000:1.0:1651532146.481157:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468588864:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532146.481159:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4480
00010000:00010000:1.0:1651532146.481160:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532146.481161:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468588992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.481165:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.481171:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411e04 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb74 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.481173:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e0b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb7b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.481179:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411e04 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb74 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.481181:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e0b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb7b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.481183:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411e04 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb74 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.481185:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e0b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb7b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.481187:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532146.481189:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532146.481197:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468588864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.481198:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468588992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.481200:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4479
00000100:00100000:0.0:1651532146.481202:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4480
00000100:00100000:1.0:1651532146.481205:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4481
00000100:00100000:1.0:1651532146.481207:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468589120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.481210:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.481212:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e12 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb82 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.481217:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e12 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb82 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.481221:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e12 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb82 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.481224:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532146.481229:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468589120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.481232:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4481
00000100:00100000:1.0:1651532146.481566:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.481574:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468589504
00000100:00100000:1.0:1651532146.481580:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4482
00000100:00100000:1.0:1651532146.481582:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468589504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.481585:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.481588:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411e19 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb89 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.481595:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411e19 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb89 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.481602:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411e19 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb89 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.481605:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532146.481614:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468589504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.481617:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4482
00000100:00100000:1.0:1651532146.481842:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.481850:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468589632
00000100:00100000:1.0:1651532146.481857:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4483
00000100:00100000:1.0:1651532146.481858:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004888e338 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468589632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.481861:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.481864:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e20 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb90 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.481871:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e20 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb90 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.481875:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e20 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb90 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.481878:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532146.481887:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004888e338 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468589632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (45us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.481891:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4483
00000100:00100000:1.0:1651532146.482168:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.482175:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468589760
00000100:00100000:1.0:1651532146.482181:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4484
00000100:00100000:1.0:1651532146.482183:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468589760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.482186:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.482189:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e27 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb97 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.482196:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb97 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.482200:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb97 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.482203:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532146.482212:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468589760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (45us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.482215:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4484
00000001:00080000:1.0:1651532146.613421:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793950 is committed
00010000:00010000:0.0:1651532146.613452:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613457:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.613480:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468583488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 508043us (508102us total) trans 158913793950 rc 0/0
00000100:00100000:0.0:1651532146.613484:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4575
00010000:00010000:0.0:1651532146.613491:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613498:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532146.613499:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613502:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613507:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.613507:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.613508:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613511:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613515:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.613515:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.613516:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613518:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613528:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613531:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411cec lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->6946815] (req 659456->6946815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.613536:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.613541:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613543:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.613546:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.613949:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.613960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.613961:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468589952
00000100:00100000:1.0:1651532146.613969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.613975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.613980:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468590016
00000100:00100000:0.0:1651532146.613988:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4585
00000100:00100000:0.0:1651532146.613990:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468589952:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532146.613994:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4586
00000100:00100000:1.0:1651532146.613996:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468590016:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532146.613997:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.614002:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532146.614003:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.614005:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.614006:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532146.614006:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.614011:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532146.614012:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.614015:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532146.614015:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.614019:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.614020:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.614023:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.614023:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.614039:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468590272
00000100:00100000:0.0:1651532146.614045:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468590336
00000100:00100000:0.0:1651532146.614049:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4485
00000100:00100000:0.0:1651532146.614050:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468590272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.614053:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.614056:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411e3c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bb9e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.614063:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411e3c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb9e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.614068:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411e3c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bb9e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.614071:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532146.614085:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468590272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.614088:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4485
00000100:00100000:0.0:1651532146.614092:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4486
00000100:00100000:0.0:1651532146.614094:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468590336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.614097:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.614099:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e43 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bba5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.614105:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e43 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bba5 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.614109:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e43 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bba5 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.614112:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532146.614123:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468590336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (148us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.614126:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4486
00000100:00100000:1.0:1651532146.614373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.614381:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468590528
00000100:00100000:1.0:1651532146.614392:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4487
00000100:00100000:1.0:1651532146.614394:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468590528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.614398:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.614401:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e4a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbac expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.614409:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e4a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbac expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.614413:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e4a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbac expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.614416:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532146.614428:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468590528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.614431:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4487
00000001:00080000:1.0:1651532146.755041:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793952 is committed
00002000:00010000:1.0:1651532146.755061:0:330054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532145 -> 1651532146
00002000:00010000:1.0:1651532146.755063:0:330054:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532145 -> 1651532146
00010000:00010000:1.0:1651532146.755065:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755069:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755074:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755085:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.755088:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468584128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541042us (541158us total) trans 158913793952 rc 0/0
00000100:00100000:1.0:1651532146.755092:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4577
00000100:00100000:0.0:1651532146.755101:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468584896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482791us (482819us total) trans 158913793951 rc 0/0
00000100:00100000:0.0:1651532146.755105:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4578
00010000:00010000:0.0:1651532146.755113:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755117:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532146.755118:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755121:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755129:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755132:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f411d08 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5160960->10268671] (req 5160960->10268671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755135:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755139:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532146.755140:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755144:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755149:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.755150:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.755151:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755154:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755166:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755169:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f411d2b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2252800->2256895] (req 2252800->2256895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755175:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755178:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.755525:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.755537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.755537:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468590656
00000100:00100000:1.0:1651532146.755544:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.755558:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468590720
00000100:00100000:1.0:1651532146.755563:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.755568:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4587
00000100:00100000:0.0:1651532146.755570:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468590656:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532146.755586:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4588
00010000:00010000:0.0:1651532146.755586:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.755588:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468590720:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532146.755591:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532146.755592:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755595:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532146.755595:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755597:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755600:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755601:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.755602:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755605:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532146.755606:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755611:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755611:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755615:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.755622:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468590784
00010000:00010000:0.0:1651532146.755624:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.755627:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.755633:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468590912
00000100:00100000:1.0:1651532146.755637:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4488
00000100:00100000:1.0:1651532146.755639:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468590784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.755642:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.755644:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411e5f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbb3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.755648:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468584960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483207us (483241us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532146.755649:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532146.755651:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4579
00010000:00010000:1.0:1651532146.755652:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411e5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbb3 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.755659:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411e5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbb3 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532146.755659:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4489
00000100:00100000:0.0:1651532146.755660:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468590912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.755662:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532146.755663:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.755666:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411e66 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbba expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.755670:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468590784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (134us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532146.755672:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532146.755673:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4488
00010000:00010000:0.0:1651532146.755675:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411e66 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbba expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.755679:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411e66 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbba expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.755683:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532146.755684:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755688:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532146.755689:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.755689:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468590912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.755691:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4489
00010000:00010000:1.0:1651532146.755692:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755697:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.755697:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.755698:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755701:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755711:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755716:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411d39 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->9302015] (req 180224->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755725:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.755728:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.756042:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.756050:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.756062:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468591424
00000100:00100000:0.0:1651532146.756062:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468591168
00000100:00100000:1.0:1651532146.756075:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4490
00000100:00100000:1.0:1651532146.756077:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468591424:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532146.756078:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4491
00000100:00100000:0.0:1651532146.756079:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468591168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.756081:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.756083:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.756085:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e6d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbc8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.756086:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e74 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbc1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.756092:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e6d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbc8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.756094:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e74 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbc1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.756096:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e6d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbc8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.756098:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e74 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbc1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.756100:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:0.0:1651532146.756102:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532146.756113:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468591424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.756116:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4490
00000100:00100000:0.0:1651532146.756118:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468591168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.756121:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4491
00000001:00080000:1.0:1651532146.838444:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793953 is committed
00010000:00010000:1.0:1651532146.838459:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838463:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.838484:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468585280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565887us (565943us total) trans 158913793953 rc 0/0
00010000:00010000:0.0:1651532146.838486:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.838488:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4580
00010000:00010000:0.0:1651532146.838491:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532146.838492:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.838498:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.838503:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.838504:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.838505:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.838508:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.838516:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.838518:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411d47 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1413120->1417215] (req 1413120->1417215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838529:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838534:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.838780:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.838789:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.838799:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.838800:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468591744
00000100:00100000:1.0:1651532146.838826:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468591872
00000100:00100000:0.0:1651532146.838833:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4589
00000100:00100000:0.0:1651532146.838835:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008949cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468591744:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532146.838845:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4590
00000100:00100000:1.0:1651532146.838847:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468591872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532146.838847:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.838851:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532146.838852:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838855:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.838855:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532146.838856:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838859:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.838861:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838864:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532146.838864:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.838868:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838869:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838872:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.838872:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.838881:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468591808
00010000:00010000:1.0:1651532146.838883:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838886:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.838890:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4492
00000100:00100000:0.0:1651532146.838892:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468591808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.838895:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.838897:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411e89 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbcf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.838902:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532146.838905:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411e89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbcf expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532146.838911:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468586624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449925us (450021us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532146.838914:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4581
00010000:00010000:0.0:1651532146.838915:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411e89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbcf expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.838919:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532146.838922:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838925:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532146.838926:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.838927:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468591808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.838930:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4492
00010000:00010000:1.0:1651532146.838932:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838936:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.838937:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.838938:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838941:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838950:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838953:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f411d86 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1015808->8835071] (req 1015808->8835071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838971:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.838975:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.839359:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.839371:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.839371:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468592000
00000100:00100000:0.0:1651532146.839381:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468592256
00000100:00100000:0.0:1651532146.839388:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4493
00000100:00100000:0.0:1651532146.839390:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468592000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.839393:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.839397:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411e90 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbd6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.839404:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411e90 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbd6 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.839408:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411e90 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbd6 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.839411:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532146.839421:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468592000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.839424:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4493
00000100:00100000:0.0:1651532146.839428:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4494
00000100:00100000:0.0:1651532146.839429:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468592256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.839432:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.839434:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411e97 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbdd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.839439:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411e97 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbdd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.839443:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411e97 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbdd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.839446:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532146.839451:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468592256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.839454:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4494
00000100:00100000:1.0:1651532146.839770:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.839790:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468592448
00000100:00100000:0.0:1651532146.839801:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4495
00000100:00100000:0.0:1651532146.839813:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468592448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.839816:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.839819:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411e9e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbe4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.839826:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411e9e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbe4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.839830:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411e9e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbe4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.839833:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532146.839843:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468592448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.839846:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4495
00000100:00100000:1.0:1651532146.840065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.840075:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468592704
00000100:00100000:0.0:1651532146.840086:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4496
00000100:00100000:0.0:1651532146.840087:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468592704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.840092:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.840095:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411ea5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbeb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.840102:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411ea5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbeb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.840106:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411ea5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbeb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.840109:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532146.840119:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468592704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.840121:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4496
00000001:00080000:1.0:1651532146.938432:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793954 is committed
00010000:00010000:1.0:1651532146.938448:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938454:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.938472:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468586560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549452us (549550us total) trans 158913793954 rc 0/0
00000100:00100000:1.0:1651532146.938476:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4582
00010000:00010000:1.0:1651532146.938483:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938487:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532146.938488:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938491:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938496:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.938497:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532146.938498:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938501:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938514:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938520:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f411d8d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9756671] (req 462848->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.938526:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.938531:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532146.938820:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.938836:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468592960
00000100:00100000:0.0:1651532146.938837:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.938852:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468592832
00000100:00100000:0.0:1651532146.938855:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4591
00000100:00100000:0.0:1651532146.938857:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468592960:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532146.938863:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4592
00000100:00100000:1.0:1651532146.938875:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468592832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532146.938883:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.938883:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938887:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532146.938888:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938891:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532146.938892:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938896:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938900:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.938917:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532146.938918:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.938921:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532146.938922:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.938926:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.938930:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532146.938936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.938942:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468593024
00000100:00100000:1.0:1651532146.938943:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.938953:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468593088
00000100:00100000:0.0:1651532146.938959:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4497
00000100:00100000:0.0:1651532146.938961:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468593024:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532146.938964:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4498
00010000:00010000:0.0:1651532146.938964:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532146.938966:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468593088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.938967:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411eba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbf2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.938970:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.938973:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ec1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bbf9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.938974:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411eba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbf2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.938978:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411eba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbf2 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.938981:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ec1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbf9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.938985:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532146.938986:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ec1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bbf9 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.938989:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532146.938996:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468593024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.938998:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468593088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.938999:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4497
00000100:00100000:1.0:1651532146.939000:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4498
00000100:00100000:1.0:1651532146.939252:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.939260:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.939266:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468593216
00000100:00100000:1.0:1651532146.939272:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468593280
00000100:00100000:1.0:1651532146.939280:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4499
00000100:00100000:1.0:1651532146.939282:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468593216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532146.939284:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4500
00010000:00010000:1.0:1651532146.939285:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532146.939286:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468593280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532146.939289:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ec8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc00 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.939290:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532146.939294:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411ecf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc07 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.939296:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ec8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc00 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.939301:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411ecf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc07 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.939303:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ec8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc00 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.939305:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411ecf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc07 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.939306:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532146.939308:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532146.939318:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468593216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.939321:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4499
00000100:00100000:0.0:1651532146.939323:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468593280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.939326:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4500
00000100:00100000:1.0:1651532146.939583:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532146.939595:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532146.939595:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468593472
00000100:00100000:0.0:1651532146.939605:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468593536
00000100:00100000:0.0:1651532146.939612:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4501
00000100:00100000:0.0:1651532146.939614:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468593472:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532146.939617:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4502
00010000:00010000:0.0:1651532146.939618:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532146.939619:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468593536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532146.939622:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411ed6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc0e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532146.939623:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532146.939626:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411edd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc15 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532146.939629:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411ed6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc0e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.939633:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411edd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc15 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.939633:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411ed6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc0e expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532146.939637:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532146.939638:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411edd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc15 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532146.939641:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532146.939647:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468593472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532146.939648:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468593536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532146.939650:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4501
00000100:00100000:1.0:1651532146.939652:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4502
00000001:00080000:1.0:1651532147.071794:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793955 is committed
00010000:00010000:0.0:1651532147.071833:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.071838:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.071861:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468588480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 591269us (591327us total) trans 158913793955 rc 0/0
00000100:00100000:0.0:1651532147.071864:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4583
00010000:00010000:0.0:1651532147.071872:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.071876:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.071877:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.071880:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.071885:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.071886:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.071887:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.071890:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.071899:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.071903:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f411de1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2240512->9797631] (req 2240512->9797631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.071917:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.071924:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.072232:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.072240:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.072251:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468593792
00000100:00100000:1.0:1651532147.072260:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468593856
00000100:00100000:1.0:1651532147.072270:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4503
00000100:00100000:1.0:1651532147.072272:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468593792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.072276:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532147.072279:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4504
00010000:00010000:1.0:1651532147.072281:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411ee4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc23 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.072282:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468593856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.072286:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.072287:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.072290:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411eeb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc1c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.072291:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411ee4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc23 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.072295:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411ee4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc23 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.072295:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.072298:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411eeb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc1c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.072299:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532147.072305:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411eeb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc1c expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.072308:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532147.072312:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468593792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.072324:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4503
00000100:00100000:0.0:1651532147.072324:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468593856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.072326:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4504
00010000:00010000:1.0:1651532147.072353:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.072358:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072373:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072377:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.072378:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072382:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.072383:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468588544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 591788us (591840us total) trans 0 rc 49152/49152
00000100:00100000:1.0:1651532147.072386:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4584
00010000:00010000:0.0:1651532147.072386:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.072387:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.072388:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072391:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072398:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072404:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f411de8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->9555967] (req 454656->9555967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072409:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072412:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.072748:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.072765:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468594176
00000100:00100000:0.0:1651532147.072769:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.072776:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468594112
00000100:00100000:0.0:1651532147.072778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.072787:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4593
00000100:00100000:0.0:1651532147.072787:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.072789:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468594176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532147.072801:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.072818:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.072819:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532147.072819:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.072822:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532147.072823:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.072830:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.072831:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4594
00000100:00100000:1.0:1651532147.072832:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000505165d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468594112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532147.072852:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.072856:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.072856:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.072859:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.072861:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532147.072862:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.072866:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.072869:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.072872:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.072880:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468594240
00000100:00100000:1.0:1651532147.072885:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468594368
00000100:00100000:1.0:1651532147.072888:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468594432
00000100:00100000:1.0:1651532147.072890:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468594560
00000100:00100000:1.0:1651532147.072892:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4505
00000100:00100000:1.0:1651532147.072894:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee47d2de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468594240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.072897:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532147.072897:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4506
00000100:00100000:0.0:1651532147.072900:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070a794fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468594368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.072904:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.072907:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411f00 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc2a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072908:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411f07 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc31 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072916:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411f07 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc31 expref: 23 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.072920:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411f00 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc2a expref: 23 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.072920:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411f07 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc31 expref: 23 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.072927:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411f00 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc2a expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.072927:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532147.072934:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532147.072941:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070a794fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468594368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (154us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.072944:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4506
00000100:00100000:0.0:1651532147.072950:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4507
00000100:00100000:0.0:1651532147.072951:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3eb5fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468594432:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532147.072953:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee47d2de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468594240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (175us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532147.072954:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.072956:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411f0e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc38 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.072963:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411f0e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc38 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532147.072968:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4505
00000100:00100000:1.0:1651532147.072974:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4508
00000100:00100000:1.0:1651532147.072976:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b3108f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468594560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.072979:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.072979:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411f0e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc38 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.072982:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532147.072983:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f15 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc3f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.072989:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3eb5fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468594432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (168us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532147.072990:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f15 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc3f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532147.072992:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4507
00010000:00010000:1.0:1651532147.072994:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f15 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc3f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.073000:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532147.073007:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b3108f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468594560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (177us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.073009:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4508
00000100:00100000:0.0:1651532147.073313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.073329:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.073334:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468594688
00000100:00100000:0.0:1651532147.073343:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468594752
00000100:00100000:1.0:1651532147.073353:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4509
00000100:00100000:1.0:1651532147.073355:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d3bbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468594688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.073358:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532147.073360:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4510
00010000:00010000:1.0:1651532147.073361:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f411f1c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc46 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.073362:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468594752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.073366:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.073369:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f411f1c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc46 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.073369:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f23 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc4d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.073373:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f411f1c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc46 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.073376:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532147.073377:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f23 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc4d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.073381:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f23 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc4d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.073384:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532147.073387:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d3bbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468594688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.073390:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4509
00000100:00100000:0.0:1651532147.073392:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468594752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.073394:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4510
00000100:00100000:0.0:1651532147.073617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.073623:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468595136
00000100:00100000:0.0:1651532147.073630:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4511
00000100:00100000:0.0:1651532147.073631:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468595136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.073635:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.073637:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411f2a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc54 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.073644:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411f2a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc54 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.073649:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411f2a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc54 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.073655:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532147.073677:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468595136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.073682:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4511
00000001:00080000:1.0:1651532147.155152:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793956 is committed
00010000:00010000:0.0:1651532147.155184:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155189:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.155212:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468589952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541221us (541263us total) trans 158913793956 rc 0/0
00010000:00010000:1.0:1651532147.155213:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.155215:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4585
00010000:00010000:1.0:1651532147.155220:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532147.155221:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.155225:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.155231:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.155231:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.155232:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.155235:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.155243:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155248:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155252:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.155254:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f411e2e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3993600->6692863] (req 3993600->6692863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155437:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155441:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.155460:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468590016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 541464us (541500us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532147.155464:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4586
00010000:00010000:0.0:1651532147.155471:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155474:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.155476:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155479:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155484:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.155484:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.155485:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155488:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155495:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155514:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f411e35 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9662463] (req 925696->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155521:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155524:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.155580:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.155589:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.155595:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468595264
00000100:00100000:0.0:1651532147.155602:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468595328
00000100:00100000:0.0:1651532147.155611:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4512
00000100:00100000:0.0:1651532147.155612:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468595264:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532147.155615:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4513
00010000:00010000:0.0:1651532147.155616:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532147.155618:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468595328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.155619:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411f31 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc5b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.155622:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.155626:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f411f38 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc62 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.155637:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f411f38 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc62 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.155641:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f411f38 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc62 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.155641:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411f31 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc5b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.155645:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532147.155646:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411f31 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc5b expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.155650:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532147.155656:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468595328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.155659:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4513
00000100:00100000:0.0:1651532147.155687:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468595264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 73us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.155690:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4512
00000100:00100000:0.0:1651532147.155718:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.155801:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468595392
00000100:00100000:0.0:1651532147.155827:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4595
00000100:00100000:0.0:1651532147.155829:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468595392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532147.155836:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155841:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532147.155842:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155845:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532147.155846:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155850:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155865:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.155881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.155891:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468595456
00000100:00100000:0.0:1651532147.155893:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.155907:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4596
00000100:00100000:1.0:1651532147.155909:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468595456:12345-10.240.43.64@tcp:3:fio.
00010000:00010000:1.0:1651532147.155916:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.155921:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.155922:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.155926:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468595584
00010000:00010000:1.0:1651532147.155931:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532147.155932:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.155934:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4514
00000100:00100000:0.0:1651532147.155936:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468595584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.155937:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155939:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.155942:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411f4d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc69 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.155943:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.155949:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411f4d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc69 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.155953:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411f4d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc69 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.155957:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532147.155959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.155973:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468595584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.155976:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4514
00000100:00100000:0.0:1651532147.155981:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468595776
00000100:00100000:1.0:1651532147.155985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.156001:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468595712
00000100:00100000:0.0:1651532147.156004:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4515
00000100:00100000:0.0:1651532147.156006:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468595776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.156009:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.156012:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411f54 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc77 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.156017:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411f54 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc77 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.156021:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411f54 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc77 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.156024:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532147.156029:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4516
00000100:00100000:1.0:1651532147.156031:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468595712:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532147.156035:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468595776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.156037:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4515
00010000:00010000:1.0:1651532147.156040:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.156043:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411f5b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc70 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.156051:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411f5b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc70 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.156055:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411f5b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc70 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.156058:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532147.156079:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468595712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.156082:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4516
00000100:00100000:1.0:1651532147.156271:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.156278:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468596032
00000100:00100000:1.0:1651532147.156289:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4517
00000100:00100000:1.0:1651532147.156290:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468596032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.156294:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.156297:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411f62 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc7e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.156304:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411f62 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc7e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.156308:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411f62 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc7e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.156312:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532147.156323:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468596032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.156326:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4517
00000100:00100000:1.0:1651532147.156396:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.156403:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468596160
00000100:00100000:1.0:1651532147.156413:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4518
00000100:00100000:1.0:1651532147.156414:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468596160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.156418:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.156421:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f69 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc85 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.156428:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f69 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc85 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.156432:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f69 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc85 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.156435:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532147.156446:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468596160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.156449:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4518
00000100:00100000:1.0:1651532147.156556:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.156563:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468596352
00000100:00100000:1.0:1651532147.156572:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4519
00000100:00100000:1.0:1651532147.156574:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468596352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.156577:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.156580:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f70 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc8c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.156587:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f70 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc8c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.156590:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f70 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc8c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.156594:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532147.156604:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468596352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.156607:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4519
00000100:00100000:1.0:1651532147.156847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.156854:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468596544
00000100:00100000:1.0:1651532147.156865:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4520
00000100:00100000:1.0:1651532147.156867:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468596544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.156870:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.156873:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f77 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc93 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.156880:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f77 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc93 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.156884:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f77 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc93 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.156887:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532147.156898:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468596544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.156901:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4520
00000001:00080000:1.0:1651532147.263500:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793957 is committed
00010000:00010000:0.0:1651532147.263532:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.263540:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.263564:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468590656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507993us (508039us total) trans 158913793957 rc 0/0
00000100:00100000:0.0:1651532147.263567:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4587
00010000:00010000:0.0:1651532147.263575:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.263579:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.263580:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.263583:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.263587:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.263588:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.263589:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.263592:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.263601:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.263607:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411e51 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3207168->10199039] (req 3207168->10199039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.263623:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.263628:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.263863:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.263868:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.263891:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468590720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508302us (508346us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532147.263894:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4588
00010000:00010000:1.0:1651532147.263902:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.263906:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532147.263907:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.263909:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.263915:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.263924:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.263925:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.263928:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.263938:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.263941:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411e58 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->6324223] (req 1191936->6324223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.263941:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.263945:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.264145:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.264154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.264165:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468596928
00000100:00100000:1.0:1651532147.264177:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468596864
00000100:00100000:1.0:1651532147.264184:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4597
00000100:00100000:1.0:1651532147.264186:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468596928:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532147.264193:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.264197:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.264198:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532147.264199:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.264202:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.264209:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4598
00000100:00100000:1.0:1651532147.264210:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468596864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532147.264214:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.264218:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.264219:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.264221:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.264224:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532147.264225:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.264229:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.264235:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.264240:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532147.371884:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793958 is committed
00010000:00010000:0.0:1651532147.371919:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.371924:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.371943:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008949cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468591744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 533107us (533163us total) trans 158913793958 rc 0/0
00000100:00100000:0.0:1651532147.371946:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4589
00010000:00010000:0.0:1651532147.371953:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.371956:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.371957:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.371960:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.371968:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.371969:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.371970:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.371973:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.371986:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.371988:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411e7b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->10043391] (req 729088->10043391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.371998:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372003:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.372296:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.372328:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468597248
00000100:00100000:1.0:1651532147.372348:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4521
00000100:00100000:1.0:1651532147.372350:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468597248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.372355:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.372359:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411f8c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bc9a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.372363:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532147.372372:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532147.372373:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468597440
00010000:00010000:1.0:1651532147.372376:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411f8c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc9a expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532147.372381:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4522
00010000:00010000:1.0:1651532147.372383:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411f8c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bc9a expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532147.372383:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468597440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.372386:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.372387:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532147.372390:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411f93 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bca1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.372396:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532147.372398:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468597248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (103us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532147.372399:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411f93 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bca1 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532147.372401:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4521
00010000:00010000:0.0:1651532147.372406:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411f93 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bca1 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.372409:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532147.372414:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372418:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.372418:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468597440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.372420:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4522
00000100:00100000:1.0:1651532147.372435:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468591872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533587us (533646us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532147.372436:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.372438:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4590
00010000:00010000:0.0:1651532147.372440:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.372441:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.372444:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.372449:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.372449:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.372450:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.372453:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.372463:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.372469:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411e82 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3891200->9515007] (req 3891200->9515007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.372479:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.372482:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.372840:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.372853:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.372857:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468597632
00000100:00100000:0.0:1651532147.372860:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.372866:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.372871:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468597504
00000100:00100000:1.0:1651532147.372880:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4599
00000100:00100000:1.0:1651532147.372882:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000782e634b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468597632:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532147.372885:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532147.372890:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372894:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.372895:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372901:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532147.372901:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372906:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372909:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.372922:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4600
00000100:00100000:1.0:1651532147.372924:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468597504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532147.372929:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372932:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.372933:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372936:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532147.372936:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372940:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372943:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.372950:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468597696
00000100:00100000:0.0:1651532147.372960:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468597952
00000100:00100000:0.0:1651532147.372963:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468598016
00000100:00100000:0.0:1651532147.372967:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4523
00000100:00100000:0.0:1651532147.372969:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468597696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532147.372971:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4524
00010000:00010000:0.0:1651532147.372973:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532147.372974:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468597952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.372977:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fa8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bca8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.372980:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.372985:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411faf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bcaf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.372985:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fa8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bca8 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.372989:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fa8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bca8 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.372993:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532147.372997:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411faf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcaf expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.373002:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411faf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcaf expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532147.373006:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468597696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (146us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.373009:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4523
00000100:00100000:0.0:1651532147.373014:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4525
00010000:00010000:1.0:1651532147.373015:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532147.373016:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468598016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.373018:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.373021:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411fb6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bcb6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.373026:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468597952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (159us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532147.373027:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411fb6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcb6 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.373031:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411fb6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcb6 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.373034:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532147.373041:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4524
00000100:00100000:0.0:1651532147.373054:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468598016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (169us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.373056:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4525
00000001:00080000:1.0:1651532147.480195:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793959 is committed
00010000:00010000:0.0:1651532147.480229:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480234:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.480260:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468592832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541384us (541422us total) trans 158913793959 rc 0/0
00010000:00010000:1.0:1651532147.480261:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.480264:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4592
00010000:00010000:1.0:1651532147.480266:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532147.480267:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480271:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480277:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.480278:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.480279:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480282:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480285:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.480285:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.480286:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480289:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480311:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480314:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f411eac lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [974848->6901759] (req 974848->6901759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480321:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480324:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480324:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480328:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.480580:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.480601:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468598400
00010000:00010000:1.0:1651532147.480608:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.480610:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4526
00000100:00100000:0.0:1651532147.480612:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468598400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.480613:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480615:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.480619:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411fbd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bcbd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480632:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532147.480634:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468594176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 407843us (407886us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532147.480635:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411fbd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcbd expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532147.480637:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4593
00010000:00010000:0.0:1651532147.480639:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f411fbd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcbd expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.480643:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532147.480651:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468598400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.480654:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4526
00010000:00010000:0.0:1651532147.480662:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480665:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.480666:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480669:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480674:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480677:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f411ef2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9244671] (req 12288->9244671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480687:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480690:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.480703:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468592960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 541845us (541884us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532147.480706:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4591
00010000:00010000:0.0:1651532147.480711:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480725:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.480741:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480744:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480749:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.480750:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.480750:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480753:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480766:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.480770:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f411eb3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5447680->9334783] (req 5447680->9334783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480775:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.480779:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.481053:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.481065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.481065:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468598528
00000100:00100000:1.0:1651532147.481072:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.481081:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468598592
00000100:00100000:1.0:1651532147.481084:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.481094:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4601
00000100:00100000:0.0:1651532147.481095:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468598528:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532147.481098:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4602
00000100:00100000:1.0:1651532147.481101:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059bf1b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468598592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532147.481102:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.481109:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.481109:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532147.481110:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.481113:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532147.481114:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.481120:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.481121:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.481124:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532147.481125:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.481129:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.481129:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.481133:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.481133:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.481141:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468598720
00000100:00100000:0.0:1651532147.481147:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468598848
00000100:00100000:0.0:1651532147.481154:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4527
00000100:00100000:0.0:1651532147.481155:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468598720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.481158:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.481161:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411fd2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bcc4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.481168:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411fd2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcc4 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.481172:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f411fd2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcc4 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.481178:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532147.481189:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468598720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.481192:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4527
00000100:00100000:0.0:1651532147.481196:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4528
00000100:00100000:0.0:1651532147.481198:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468598848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.481200:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.481203:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411fd9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bccb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.481208:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411fd9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bccb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.481212:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f411fd9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bccb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.481215:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532147.481219:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468598848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.481222:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4528
00000100:00100000:1.0:1651532147.481496:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.481507:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468599040
00000100:00100000:1.0:1651532147.481509:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.481522:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468599104
00000100:00100000:1.0:1651532147.481531:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4529
00000100:00100000:1.0:1651532147.481534:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67c125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468599040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532147.481534:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4530
00000100:00100000:0.0:1651532147.481536:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009722cac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468599104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.481538:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.481541:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.481542:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411fe0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bcd2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.481544:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411fe7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bcd9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.481551:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411fe0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcd2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.481552:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411fe7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcd9 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.481555:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f411fe0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcd2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.481556:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f411fe7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcd9 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.481559:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532147.481559:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532147.481573:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67c125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468599040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.481576:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4529
00000100:00100000:0.0:1651532147.481578:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009722cac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468599104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.481581:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4530
00000100:00100000:1.0:1651532147.481875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.481886:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468599296
00000100:00100000:1.0:1651532147.481887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.481901:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468599424
00000100:00100000:1.0:1651532147.481909:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4531
00000100:00100000:1.0:1651532147.481911:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036ea9a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468599296:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532147.481911:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4532
00000100:00100000:0.0:1651532147.481913:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468599424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.481915:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.481917:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.481918:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f411fee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bce0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.481920:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411ff5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bce7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.481925:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f411fee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bce0 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.481927:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411ff5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bce7 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.481930:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f411fee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bce0 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.481931:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f411ff5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bce7 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.481933:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532147.481935:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532147.481946:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036ea9a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468599296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.481949:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4531
00000100:00100000:0.0:1651532147.481951:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468599424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.481953:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4532
00000100:00100000:1.0:1651532147.482188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.482198:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468599552
00000100:00100000:1.0:1651532147.482199:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.482212:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468599616
00000100:00100000:1.0:1651532147.482215:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4533
00000100:00100000:1.0:1651532147.482217:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468599552:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532147.482221:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4534
00000100:00100000:0.0:1651532147.482223:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468599616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.482225:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.482226:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.482229:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411ffc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bcee expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.482235:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411ffc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcee expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.482237:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f412003 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bcf5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.482239:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f411ffc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcee expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.482243:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:0.0:1651532147.482245:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f412003 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcf5 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.482249:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f412003 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcf5 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532147.482254:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468599552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.482257:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4533
00010000:00010000:0.0:1651532147.482258:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532147.482266:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468599616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.482269:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4534
00000100:00100000:1.0:1651532147.482497:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.482508:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468599872
00000100:00100000:0.0:1651532147.482516:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4535
00000100:00100000:0.0:1651532147.482517:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468599872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.482521:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.482524:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41200a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bcfc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.482531:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41200a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcfc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.482535:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41200a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bcfc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.482538:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532147.482547:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468599872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.482550:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4535
00000001:00080000:1.0:1651532147.580187:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793960 is committed
00002000:00010000:1.0:1651532147.580201:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532146 -> 1651532147
00002000:00010000:1.0:1651532147.580202:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532146 -> 1651532147
00010000:00010000:1.0:1651532147.580205:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.580209:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.580227:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000505165d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468594112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507393us (507457us total) trans 158913793960 rc 0/0
00000100:00100000:1.0:1651532147.580230:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4594
00010000:00010000:1.0:1651532147.580237:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.580241:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532147.580242:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.580245:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.580251:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.580251:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.580252:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.580255:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.580268:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.580271:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f411ef9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4767744->9072639] (req 4767744->9072639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.580284:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.580289:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.580600:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.580614:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.580627:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468600064
00000100:00100000:1.0:1651532147.580643:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468600000
00000100:00100000:1.0:1651532147.580651:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4603
00000100:00100000:1.0:1651532147.580653:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468600064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532147.580661:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.580677:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4604
00000100:00100000:0.0:1651532147.580679:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468600000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532147.580680:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.580682:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532147.580682:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.580688:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.580700:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.580708:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532147.580710:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.580713:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.580715:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532147.580716:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.580719:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532147.580720:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.580729:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.580733:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468600256
00010000:00010000:0.0:1651532147.580733:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.580744:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4536
00000100:00100000:1.0:1651532147.580745:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468600256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.580749:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.580753:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41201f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd03 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.580761:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41201f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd03 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.580766:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41201f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd03 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.580769:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532147.580789:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468600256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.580792:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4536
00000100:00100000:1.0:1651532147.581061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.581069:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468600384
00000100:00100000:1.0:1651532147.581080:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4537
00000100:00100000:1.0:1651532147.581082:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029ec6cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468600384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.581087:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.581091:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412026 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd0a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.581098:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412026 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd0a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.581103:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412026 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd0a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.581106:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532147.581118:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029ec6cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468600384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.581121:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4537
00000001:00080000:1.0:1651532147.688551:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793961 is committed
00010000:00010000:0.0:1651532147.688583:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688588:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.688612:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468595392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532781us (532893us total) trans 158913793961 rc 0/0
00000100:00100000:0.0:1651532147.688617:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4595
00010000:00010000:0.0:1651532147.688625:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688629:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.688630:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688633:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688638:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.688639:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.688639:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688642:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688645:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.688646:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.688647:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688650:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688660:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688665:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f411f3f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->10473471] (req 2453504->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.688675:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688675:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.688678:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.688680:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.689022:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.689030:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.689045:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468600512
00000100:00100000:0.0:1651532147.689057:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468600576
00010000:00010000:1.0:1651532147.689061:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.689065:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4538
00000100:00100000:0.0:1651532147.689067:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468600512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.689069:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689071:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.689074:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41202d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd11 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689080:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.689083:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41202d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd11 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532147.689088:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468596928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424902us (424943us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532147.689092:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4597
00010000:00010000:0.0:1651532147.689094:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41202d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd11 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.689098:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532147.689102:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4539
00000100:00100000:1.0:1651532147.689104:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468600576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.689107:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532147.689107:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468600512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.689110:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4538
00010000:00010000:1.0:1651532147.689111:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412034 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd18 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689117:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.689120:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412034 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd18 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.689122:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689126:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689129:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412034 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd18 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.689133:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532147.689137:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468595456:12345-10.240.43.64@tcp:3:fio. Request processed in 533227us (533256us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532147.689140:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468600576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.689140:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4596
00000100:00100000:1.0:1651532147.689143:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4539
00010000:00010000:0.0:1651532147.689145:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689149:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.689150:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689152:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689153:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689155:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532147.689158:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689158:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689161:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689161:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f411f7e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->10207231] (req 28672->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689166:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.689166:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.689167:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689170:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689178:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689181:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f411f46 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2084864->8654847] (req 2084864->8654847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689186:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689189:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.689666:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.689679:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.689685:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468600896
00000100:00100000:1.0:1651532147.689687:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.689696:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.689701:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.689701:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468600960
00000100:00100000:0.0:1651532147.689711:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4605
00000100:00100000:0.0:1651532147.689713:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000262e29b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468600896:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532147.689715:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532147.689725:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.689726:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4606
00000100:00100000:1.0:1651532147.689728:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468600960:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532147.689729:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532147.689730:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689733:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532147.689734:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689737:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689738:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689742:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.689743:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689746:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532147.689746:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689750:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689751:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689754:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.689758:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468601088
00000100:00100000:1.0:1651532147.689762:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468601216
00000100:00100000:0.0:1651532147.689763:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468601280
00000100:00100000:0.0:1651532147.689765:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468601408
00000100:00100000:0.0:1651532147.689768:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4540
00000100:00100000:1.0:1651532147.689770:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4541
00000100:00100000:0.0:1651532147.689770:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468601088:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532147.689772:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67c125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468601280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.689772:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.689775:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.689775:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f412049 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd1f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689777:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412050 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd2d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689785:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412050 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd2d expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.689786:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f412049 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd1f expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.689790:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412050 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd2d expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.689790:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f412049 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd1f expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.689793:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532147.689794:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532147.689821:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67c125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468601280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.689821:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468601088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.689823:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4541
00000100:00100000:0.0:1651532147.689825:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4540
00000100:00100000:1.0:1651532147.689829:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4542
00000100:00100000:1.0:1651532147.689831:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468601216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532147.689831:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4543
00000100:00100000:0.0:1651532147.689833:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468601408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.689834:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.689836:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412057 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd26 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.689836:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.689839:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41205e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd34 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.689843:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412057 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd26 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.689845:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41205e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd34 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.689847:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412057 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd26 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.689849:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41205e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd34 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.689850:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532147.689852:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532147.689857:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468601216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (161us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.689858:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468601408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (143us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.689859:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4542
00000100:00100000:0.0:1651532147.689861:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4543
00000100:00100000:1.0:1651532147.690212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.690232:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468601536
00000100:00100000:1.0:1651532147.690238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.690250:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468601600
00000100:00100000:0.0:1651532147.690257:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4544
00000100:00100000:0.0:1651532147.690259:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468601536:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532147.690260:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532147.690262:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.690266:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f412065 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd3b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.690267:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.690273:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468601792
00010000:00010000:0.0:1651532147.690273:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f412065 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd3b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.690276:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f412065 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd3b expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532147.690278:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468601856
00010000:00010000:0.0:1651532147.690280:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532147.690281:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4545
00000100:00100000:1.0:1651532147.690283:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468601600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.690286:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.690290:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41206c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd42 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.690290:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468601536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.690293:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4544
00010000:00010000:1.0:1651532147.690297:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41206c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd42 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532147.690297:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4546
00000100:00100000:0.0:1651532147.690299:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468601792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.690301:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41206c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd42 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.690302:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.690304:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532147.690304:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412073 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd49 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.690309:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412073 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd49 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532147.690311:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468601600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (80us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532147.690313:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412073 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd49 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532147.690314:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4545
00010000:00010000:0.0:1651532147.690316:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532147.690319:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4547
00000100:00100000:1.0:1651532147.690320:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468601856:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532147.690321:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468601792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (67us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532147.690322:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.690324:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41207a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd50 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.690324:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4546
00010000:00010000:1.0:1651532147.690332:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41207a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd50 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.690348:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41207a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd50 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.690352:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532147.690358:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468601856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.690361:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4547
00000100:00100000:1.0:1651532147.690676:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.690684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.690690:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468602048
00000100:00100000:1.0:1651532147.690703:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468602112
00000100:00100000:1.0:1651532147.690710:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4548
00000100:00100000:1.0:1651532147.690711:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468602048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.690715:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.690718:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412081 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd57 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.690718:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4549
00000100:00100000:0.0:1651532147.690720:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468602112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.690724:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.690726:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412081 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd57 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.690728:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f412088 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd5e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.690729:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412081 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd57 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.690735:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532147.690735:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f412088 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd5e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.690739:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f412088 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd5e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.690742:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532147.690747:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468602048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.690750:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4548
00000100:00100000:0.0:1651532147.690756:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468602112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.690759:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4549
00000001:00080000:1.0:1651532147.755291:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793962 is committed
00010000:00010000:1.0:1651532147.755307:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.755311:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.755335:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468596864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491123us (491180us total) trans 158913793962 rc 0/0
00010000:00010000:0.0:1651532147.755335:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.755348:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4598
00010000:00010000:0.0:1651532147.755348:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.755349:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755352:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755358:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.755359:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.755360:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755363:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755373:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755376:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f411f85 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1769472->7303167] (req 1769472->7303167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755386:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755389:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755404:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755408:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.755424:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000782e634b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468597632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 382542us (382585us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532147.755428:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4599
00010000:00010000:0.0:1651532147.755452:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755456:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.755458:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755460:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755465:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.755466:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.755466:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755470:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755482:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755485:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f411f9a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3649536->3653631] (req 3649536->3653631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.755495:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.755500:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.755724:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.755736:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468602688
00000100:00100000:1.0:1651532147.755743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.755754:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468602624
00000100:00100000:1.0:1651532147.755760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.755761:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4607
00000100:00100000:0.0:1651532147.755768:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468602688:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532147.755770:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.755779:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532147.755782:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755786:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532147.755787:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532147.755788:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755791:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.755798:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4608
00000100:00100000:0.0:1651532147.755799:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468602624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532147.755816:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755820:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532147.755821:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755824:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755829:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532147.755830:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755834:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755836:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755840:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.755848:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468602752
00000100:00100000:0.0:1651532147.755857:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468602816
00000100:00100000:0.0:1651532147.755859:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468602880
00000100:00100000:0.0:1651532147.755862:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4550
00000100:00100000:0.0:1651532147.755864:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468602752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.755867:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532147.755868:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4551
00000100:00100000:1.0:1651532147.755870:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468602816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.755870:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41209d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd65 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.755874:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.755877:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41209d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd65 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.755879:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4120a4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd6c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755881:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41209d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd65 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.755887:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4120a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd6c expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.755887:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532147.755891:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4120a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd6c expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.755895:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532147.755898:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468602752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.755901:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4550
00000100:00100000:1.0:1651532147.755904:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468602816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (134us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.755905:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4552
00000100:00100000:1.0:1651532147.755907:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4551
00000100:00100000:0.0:1651532147.755907:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468602880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.755910:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.755912:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120ab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd73 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.755918:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd73 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.755921:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd73 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.755924:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532147.755930:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468602880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (151us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.755932:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4552
00000100:00100000:1.0:1651532147.756221:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.756232:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468603072
00000100:00100000:0.0:1651532147.756244:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4553
00000100:00100000:0.0:1651532147.756246:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468603072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.756249:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.756253:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4120b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd7a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.756260:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4120b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd7a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.756264:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4120b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd7a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.756267:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532147.756277:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468603072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.756280:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4553
00000100:00100000:1.0:1651532147.756537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.756548:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468603264
00000100:00100000:0.0:1651532147.756560:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4554
00000100:00100000:0.0:1651532147.756562:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468603264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.756565:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.756568:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4120b9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd81 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.756575:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4120b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd81 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.756579:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4120b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd81 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.756582:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532147.756592:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468603264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.756595:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4554
00000001:00080000:1.0:1651532147.846994:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793963 is committed
00010000:00010000:1.0:1651532147.847008:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847012:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.847028:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468597504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474103us (474175us total) trans 158913793963 rc 0/0
00000100:00100000:1.0:1651532147.847032:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4600
00010000:00010000:1.0:1651532147.847047:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847050:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532147.847052:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847055:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847060:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.847060:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.847061:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847064:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847077:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847080:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f411fa1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3112960->6529023] (req 3112960->6529023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.847092:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.847097:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.847447:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.847458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.847466:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.847475:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.847490:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468603520
00000100:00100000:0.0:1651532147.847494:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.847505:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468603648
00000100:00100000:1.0:1651532147.847508:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468603712
00000100:00100000:1.0:1651532147.847513:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4555
00000100:00100000:1.0:1651532147.847515:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468603520:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532147.847517:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4556
00000100:00100000:0.0:1651532147.847518:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8c71a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468603648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.847520:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.847522:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.847526:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4120c0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd8f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847534:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4120c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd88 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.847534:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4120c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd8f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.847538:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4120c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd8f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.847541:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532147.847544:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4120c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd88 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.847549:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4120c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd88 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532147.847554:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8c71a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468603648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.847557:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4556
00010000:00010000:1.0:1651532147.847559:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532147.847562:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4557
00000100:00100000:0.0:1651532147.847564:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468603712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.847566:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.847569:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4120ce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd96 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.847570:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468603520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.847573:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4555
00010000:00010000:0.0:1651532147.847575:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4120ce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd96 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.847578:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4120ce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd96 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.847581:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532147.847582:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468603584
00000100:00100000:0.0:1651532147.847587:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468603712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.847589:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4557
00000100:00100000:1.0:1651532147.847590:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468603456
00000100:00100000:1.0:1651532147.847596:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4609
00000100:00100000:1.0:1651532147.847598:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468603584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532147.847604:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.847604:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4610
00000100:00100000:0.0:1651532147.847606:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468603456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532147.847608:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.847610:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.847612:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847613:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532147.847613:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.847617:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532147.847619:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.847622:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532147.847623:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847626:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.847627:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.847630:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.847631:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.847990:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.847997:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468604032
00000100:00100000:0.0:1651532147.848004:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4558
00000100:00100000:0.0:1651532147.848006:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468604032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.848009:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.848013:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4120e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bd9d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.848019:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4120e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd9d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.848023:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4120e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bd9d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.848027:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532147.848043:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468604032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.848054:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4558
00000001:00080000:1.0:1651532147.926335:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793964 is committed
00010000:00010000:0.0:1651532147.926373:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926378:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.926396:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468598528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 445299us (445343us total) trans 158913793964 rc 0/0
00000100:00100000:0.0:1651532147.926399:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4601
00010000:00010000:0.0:1651532147.926406:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926409:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.926410:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926413:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926418:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.926418:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.926419:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926422:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926438:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.926438:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.926439:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926442:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926454:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926457:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f411fc4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->5672959] (req 135168->5672959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.926466:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.926471:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926489:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926493:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.926762:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.926769:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.926792:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468604288
00000100:00100000:0.0:1651532147.926799:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468604224
00010000:00010000:1.0:1651532147.926801:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.926818:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4559
00010000:00010000:1.0:1651532147.926819:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.926820:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070f9d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468604288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.926824:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532147.926839:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059bf1b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468598592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 445738us (445774us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532147.926843:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4602
00000100:00100000:1.0:1651532147.926852:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4560
00000100:00100000:1.0:1651532147.926854:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006388808e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468604224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.926857:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.926858:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4120ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdab expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926865:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.926868:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4120ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdab expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.926870:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4120f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bda4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926873:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4120ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdab expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.926876:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.926876:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532147.926879:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4120f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bda4 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.926884:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4120f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bda4 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532147.926885:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070f9d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468604288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (124us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532147.926887:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532147.926888:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4559
00000100:00100000:1.0:1651532147.926895:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006388808e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468604224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (125us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532147.926896:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.926898:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4560
00010000:00010000:0.0:1651532147.926899:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532147.926900:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926903:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926908:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926911:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f411fcb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [888832->5558271] (req 888832->5558271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.926914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532147.926923:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926927:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.926942:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468600064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 346289us (346344us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532147.926946:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4603
00000100:00100000:0.0:1651532147.926953:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468604416
00000100:00100000:0.0:1651532147.926959:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4561
00000100:00100000:0.0:1651532147.926961:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468604416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.926964:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.926967:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4120f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdb2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.926971:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926972:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532147.926974:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4120f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdb2 expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.926975:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532147.926977:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926978:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4120f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdb2 expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.926980:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.926981:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532147.926985:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.926986:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532147.926986:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.926995:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.927008:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.927012:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412011 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->9113599] (req 0->9113599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.927013:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468604416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.927017:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4561
00010000:00010000:0.0:1651532147.927024:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.927028:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.927369:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.927376:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.927386:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.927399:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468604608
00000100:00100000:0.0:1651532147.927399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.927409:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.927416:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468604544
00000100:00100000:1.0:1651532147.927425:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4611
00000100:00100000:1.0:1651532147.927427:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468604608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532147.927434:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.927438:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532147.927439:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.927442:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532147.927443:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.927447:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.927450:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.927458:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468604736
00000100:00100000:1.0:1651532147.927463:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468604928
00000100:00100000:1.0:1651532147.927466:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468604992
00000100:00100000:1.0:1651532147.927469:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4562
00000100:00100000:1.0:1651532147.927470:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468604736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.927473:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.927482:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412106 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdb9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.927485:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4612
00000100:00100000:0.0:1651532147.927488:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468604544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532147.927490:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412106 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdb9 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.927494:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412106 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdb9 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.927495:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.927498:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532147.927500:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532147.927501:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.927504:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532147.927504:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.927509:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468604736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (122us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532147.927509:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.927511:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4562
00010000:00010000:0.0:1651532147.927515:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.927516:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4563
00000100:00100000:1.0:1651532147.927518:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468604928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.927521:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.927523:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412114 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdc0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532147.927524:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4564
00000100:00100000:0.0:1651532147.927526:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468604992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.927528:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.927529:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412114 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdc0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.927530:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41211b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdc7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.927536:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412114 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdc0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.927537:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41211b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdc7 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.927539:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532147.927542:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41211b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdc7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532147.927543:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468604928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (144us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532147.927545:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532147.927546:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4563
00000100:00100000:0.0:1651532147.927554:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468604992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.927556:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4564
00000100:00100000:0.0:1651532147.927815:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.927829:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468605312
00000100:00100000:0.0:1651532147.927837:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4565
00000100:00100000:0.0:1651532147.927838:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468605312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.927842:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.927845:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f412122 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdce expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.927856:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f412122 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdce expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.927860:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f412122 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdce expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532147.927863:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532147.927879:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468605312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532147.927892:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4565
00000100:00100000:1.0:1651532147.927921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.927929:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468605440
00000100:00100000:1.0:1651532147.927935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532147.927936:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4566
00000100:00100000:0.0:1651532147.927937:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468605440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.927941:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532147.927943:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468605568
00010000:00010000:0.0:1651532147.927944:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f412129 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdd5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532147.927950:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4567
00000100:00100000:1.0:1651532147.927951:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c954c1cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468605568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532147.927951:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f412129 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdd5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.927955:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532147.927955:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f412129 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdd5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.927958:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412130 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bddc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532147.927958:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532147.927966:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412130 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bddc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532147.927967:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468605440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (47us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532147.927970:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412130 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bddc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532147.927970:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4566
00010000:00010000:1.0:1651532147.927973:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532147.927981:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c954c1cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468605568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.927985:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4567
00000100:00100000:1.0:1651532147.928249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.928256:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468605888
00000100:00100000:1.0:1651532147.928263:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4568
00000100:00100000:1.0:1651532147.928264:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef1e5012 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468605888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.928267:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.928271:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412137 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bde3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.928278:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412137 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bde3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.928282:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412137 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bde3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.928285:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532147.928298:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef1e5012 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468605888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.928301:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4568
00000100:00100000:1.0:1651532147.928528:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532147.928535:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468606016
00000100:00100000:1.0:1651532147.928541:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4569
00000100:00100000:1.0:1651532147.928543:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c93ae433 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468606016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532147.928546:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532147.928549:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41213e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdea expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532147.928556:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41213e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdea expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.928560:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41213e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdea expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532147.928564:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532147.928577:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c93ae433 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468606016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532147.928579:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4569
00000001:00080000:1.0:1651532148.055389:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793965 is committed
00010000:00010000:0.0:1651532148.055419:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055424:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.055448:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468600000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474768us (474834us total) trans 158913793965 rc 0/0
00000100:00100000:0.0:1651532148.055452:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4604
00010000:00010000:0.0:1651532148.055459:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055463:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532148.055464:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055467:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055472:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.055473:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.055474:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055477:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055488:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055491:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412018 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->10141695] (req 225280->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055496:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055499:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.055837:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.055847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.055857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.055865:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468606272
00000100:00100000:1.0:1651532148.055873:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4570
00000100:00100000:1.0:1651532148.055875:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c5fef33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468606272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.055879:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.055883:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412145 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdf1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.055892:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412145 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdf1 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.055896:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412145 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdf1 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.055900:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532148.055903:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468606144
00000100:00100000:1.0:1651532148.055913:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c5fef33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468606272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.055916:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4570
00000100:00100000:0.0:1651532148.055919:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468606208
00000100:00100000:0.0:1651532148.055930:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4613
00000100:00100000:0.0:1651532148.055932:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099ca9cfd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468606144:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532148.055936:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4614
00000100:00100000:1.0:1651532148.055938:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6476f5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468606208:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532148.055939:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.055944:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055944:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532148.055945:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055948:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532148.055948:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.055953:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532148.055955:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.055958:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532148.055958:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055962:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.055963:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.055966:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.055966:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532148.164186:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793966 is committed
00010000:00010000:0.0:1651532148.164213:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164218:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.164244:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000262e29b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468600896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474530us (474578us total) trans 158913793966 rc 0/0
00000100:00100000:0.0:1651532148.164247:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4605
00010000:00010000:0.0:1651532148.164255:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164259:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532148.164260:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164263:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164268:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.164269:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.164269:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164275:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164278:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.164279:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.164279:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164282:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164293:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164296:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41203b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->10379263] (req 1069056->10379263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164298:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164301:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164304:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164305:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.164588:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.164596:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.164617:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.164626:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468606592
00010000:00010000:0.0:1651532148.164626:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164631:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.164635:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468606656
00000100:00100000:1.0:1651532148.164638:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468606720
00000100:00100000:1.0:1651532148.164641:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4571
00000100:00100000:1.0:1651532148.164643:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081aa37cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468606592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.164652:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.164656:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41215a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdff expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164661:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532148.164663:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e7d7bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468602688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408898us (408938us total) trans 0 rc 45056/45056
00010000:00010000:1.0:1651532148.164664:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41215a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdff expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.164668:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41215a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdff expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532148.164668:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4607
00010000:00010000:1.0:1651532148.164672:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532148.164680:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081aa37cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468606592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.164682:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4572
00000100:00100000:1.0:1651532148.164684:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4571
00000100:00100000:0.0:1651532148.164685:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afc7141e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468606656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.164689:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.164693:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412161 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bdf8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164698:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532148.164699:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4573
00000100:00100000:1.0:1651532148.164701:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008205689 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468606720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.164701:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412161 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdf8 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.164704:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.164706:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412168 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be06 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164706:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f412161 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bdf8 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.164709:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532148.164711:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.164713:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412168 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be06 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.164717:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412168 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be06 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532148.164717:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afc7141e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468606656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (121us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532148.164720:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532148.164720:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4572
00000100:00100000:1.0:1651532148.164727:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008205689 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468606720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.164729:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4573
00010000:00010000:1.0:1651532148.164736:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164739:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532148.164740:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164743:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164748:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164781:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41208f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1241088->10235903] (req 1241088->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164795:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164798:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164827:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.164831:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468600960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 475102us (475151us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532148.164831:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532148.164832:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.164834:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4606
00010000:00010000:0.0:1651532148.164836:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164841:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.164841:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.164842:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164845:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164853:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.164855:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412042 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1650688->2453503] (req 1650688->2453503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164871:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.164875:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.165147:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.165171:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.165181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.165189:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.165196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.165197:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468606912
00000100:00100000:1.0:1651532148.165206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.165215:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468606784
00000100:00100000:0.0:1651532148.165218:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4615
00000100:00100000:0.0:1651532148.165220:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002652088d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468606912:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532148.165226:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4616
00010000:00010000:0.0:1651532148.165227:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.165228:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000628378fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468606784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532148.165232:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532148.165232:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532148.165233:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.165235:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.165240:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532148.165241:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.165244:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.165247:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532148.165247:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.165250:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.165252:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.165254:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.165257:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.165258:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468606976
00000100:00100000:0.0:1651532148.165263:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468607104
00000100:00100000:0.0:1651532148.165265:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468607168
00000100:00100000:0.0:1651532148.165267:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468607296
00000100:00100000:0.0:1651532148.165270:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4574
00000100:00100000:0.0:1651532148.165272:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4122441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468606976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.165274:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.165277:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41217d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be0d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.165284:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41217d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be0d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.165288:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41217d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be0d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.165291:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532148.165302:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4122441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468606976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (121us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.165305:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4574
00000100:00100000:0.0:1651532148.165309:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4575
00000100:00100000:0.0:1651532148.165311:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000629d7e9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468607104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.165314:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.165316:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f412184 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be14 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.165322:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f412184 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be14 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.165325:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f412184 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be14 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.165328:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532148.165330:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4576
00000100:00100000:1.0:1651532148.165332:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f2aa9fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468607168:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532148.165333:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000629d7e9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468607104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (144us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532148.165336:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532148.165336:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4575
00010000:00010000:1.0:1651532148.165347:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41218b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be1b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.165348:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4577
00000100:00100000:0.0:1651532148.165350:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbc9cd00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468607296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.165353:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.165355:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f412192 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be22 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.165358:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41218b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be1b expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.165361:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f412192 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be22 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.165362:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41218b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be1b expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.165364:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f412192 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be22 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.165366:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532148.165370:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532148.165375:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f2aa9fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468607168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (178us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.165376:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbc9cd00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468607296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (170us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.165378:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4576
00000100:00100000:0.0:1651532148.165379:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4577
00000100:00100000:1.0:1651532148.165711:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.165723:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468607424
00000100:00100000:0.0:1651532148.165736:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4578
00000100:00100000:0.0:1651532148.165738:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c954c1cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468607424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.165741:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.165745:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f412199 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be29 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.165752:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f412199 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be29 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.165756:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f412199 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be29 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.165759:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532148.165770:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c954c1cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468607424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.165772:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4578
00000100:00100000:1.0:1651532148.165893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.165902:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468607744
00000100:00100000:0.0:1651532148.165913:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4579
00000100:00100000:0.0:1651532148.165915:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef1e5012 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468607744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.165919:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.165922:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4121a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be30 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.165929:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4121a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be30 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.165933:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4121a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be30 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.165936:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532148.165945:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef1e5012 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468607744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.165948:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4579
00000100:00100000:1.0:1651532148.166006:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.166016:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468607872
00000100:00100000:0.0:1651532148.166026:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4580
00000100:00100000:0.0:1651532148.166028:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c93ae433 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468607872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.166031:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.166034:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4121a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be37 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.166040:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4121a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be37 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.166044:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4121a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be37 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.166050:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532148.166060:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c93ae433 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468607872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.166062:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4580
00000100:00100000:1.0:1651532148.166287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.166297:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468608128
00000100:00100000:0.0:1651532148.166307:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4581
00000100:00100000:0.0:1651532148.166308:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c5fef33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468608128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.166311:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.166315:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121ae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be3e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.166321:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be3e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.166325:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be3e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.166328:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532148.166349:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c5fef33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468608128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.166351:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4581
00000001:00080000:1.0:1651532148.305372:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793967 is committed
00010000:00010000:1.0:1651532148.305387:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305391:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.305414:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df909e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468602624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549614us (549670us total) trans 158913793967 rc 0/0
00000100:00100000:1.0:1651532148.305417:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4608
00010000:00010000:0.0:1651532148.305419:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305425:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532148.305426:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305430:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305435:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.305436:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.305437:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305440:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305450:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305453:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f412096 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [151552->9371647] (req 151552->9371647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305463:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305470:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.305704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.305712:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.305718:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.305730:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468608384
00000100:00100000:1.0:1651532148.305734:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468608256
00000100:00100000:0.0:1651532148.305743:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4582
00000100:00100000:0.0:1651532148.305745:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008205689 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468608384:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532148.305749:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468608320
00010000:00010000:0.0:1651532148.305749:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.305752:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121b5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be45 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.305758:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4617
00000100:00100000:1.0:1651532148.305760:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081aa37cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468608256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532148.305768:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305775:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.305778:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532148.305779:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305782:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532148.305783:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305787:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305788:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be45 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.305791:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305793:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be45 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.305796:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532148.305814:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4618
00000100:00100000:1.0:1651532148.305816:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afc7141e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468608320:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532148.305822:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008205689 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468608384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 76us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.305825:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4582
00010000:00010000:1.0:1651532148.305827:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305830:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.305831:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305834:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532148.305835:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305838:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305841:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.305844:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532148.305852:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305855:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.305879:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468603584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458280us (458432us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532148.305880:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.305889:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4609
00010000:00010000:1.0:1651532148.305895:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305899:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532148.305900:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.305903:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468608448
00000100:00100000:0.0:1651532148.305912:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468608512
00010000:00010000:1.0:1651532148.305913:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.305918:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4583
00000100:00100000:0.0:1651532148.305920:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468608448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.305923:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.305923:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.305924:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.305924:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305926:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be4c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305928:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305934:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be4c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.305938:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.305941:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4120d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3928064->8613887] (req 3928064->8613887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.305949:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4584
00000100:00100000:1.0:1651532148.305951:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468608512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.305954:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.305957:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4121d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be53 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305959:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be4c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.305963:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:1.0:1651532148.305965:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4121d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be53 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.305969:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4121d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be53 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.305972:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532148.305973:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468608448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (129us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.305976:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4583
00000100:00100000:1.0:1651532148.305980:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468608512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.305983:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4584
00010000:00010000:0.0:1651532148.305983:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.305986:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.306141:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.306155:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468608640
00000100:00100000:1.0:1651532148.306163:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4585
00000100:00100000:1.0:1651532148.306165:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468608640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.306168:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.306172:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4121d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be5a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.306179:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4121d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be5a expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.306183:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4121d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be5a expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.306186:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532148.306200:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468608640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.306203:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4585
00000100:00100000:0.0:1651532148.306325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.306354:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468608896
00000100:00100000:1.0:1651532148.306362:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4586
00000100:00100000:1.0:1651532148.306364:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468608896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.306367:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.306370:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4121df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be61 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.306377:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4121df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be61 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.306381:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4121df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be61 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.306385:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532148.306394:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468608896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.306397:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4586
00000100:00100000:0.0:1651532148.306603:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.306621:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468609088
00000100:00100000:1.0:1651532148.306629:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4587
00000100:00100000:1.0:1651532148.306630:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468609088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.306633:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.306637:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4121e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be68 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.306646:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4121e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be68 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.306650:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4121e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be68 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.306653:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532148.306663:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468609088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.306665:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4587
00000001:00080000:1.0:1651532148.430352:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793968 is committed
00010000:00010000:0.0:1651532148.430383:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430388:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.430407:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468603456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582800us (582940us total) trans 158913793968 rc 0/0
00000100:00100000:0.0:1651532148.430410:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4610
00010000:00010000:0.0:1651532148.430417:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430421:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532148.430422:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430425:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430431:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.430432:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.430433:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430436:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430448:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430451:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4120dc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1675264->9297919] (req 1675264->9297919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.430460:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.430465:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.430644:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.430649:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430667:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.430670:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468604608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 503242us (503301us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532148.430672:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532148.430673:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4611
00010000:00010000:0.0:1651532148.430673:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430676:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430681:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.430682:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.430683:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430688:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430695:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430698:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4120ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1376256->10285055] (req 1376256->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.430712:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.430716:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.430915:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.430925:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.430933:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.430943:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468609280
00000100:00100000:1.0:1651532148.430952:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468609344
00000100:00100000:0.0:1651532148.430955:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468609216
00000100:00100000:0.0:1651532148.430963:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4619
00000100:00100000:0.0:1651532148.430965:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036ea9a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468609280:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532148.430970:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4588
00000100:00100000:1.0:1651532148.430971:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468609344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.430973:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.430975:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.430977:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532148.430978:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532148.430979:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4121f4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be6f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430979:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.430982:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.430987:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4121f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be6f expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.430991:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4121f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be6f expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.430994:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532148.430997:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4620
00000100:00100000:0.0:1651532148.430999:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468609216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532148.431004:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.431008:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468609344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.431011:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4588
00010000:00010000:0.0:1651532148.431014:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532148.431015:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.431018:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.431021:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532148.431021:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.431025:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.431028:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.431031:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.431079:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.431093:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468609600
00000100:00100000:1.0:1651532148.431104:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4589
00000100:00100000:1.0:1651532148.431106:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468609600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.431109:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.431130:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412202 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be76 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.431138:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412202 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be76 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.431143:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412202 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be76 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.431146:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532148.431157:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468609600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.431159:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4589
00000100:00100000:0.0:1651532148.431258:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.431277:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468609792
00000100:00100000:1.0:1651532148.431289:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4590
00000100:00100000:1.0:1651532148.431290:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468609792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.431294:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.431297:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412209 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be7d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.431305:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412209 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be7d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.431308:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412209 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be7d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.431312:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532148.431322:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468609792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.431324:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4590
00000001:00080000:1.0:1651532148.538705:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793969 is committed
00010000:00010000:1.0:1651532148.538721:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.538725:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.538747:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468604544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 611259us (611370us total) trans 158913793969 rc 0/0
00000100:00100000:1.0:1651532148.538751:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4612
00010000:00010000:1.0:1651532148.538758:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.538762:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532148.538763:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.538766:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.538771:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.538771:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.538772:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.538775:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.538796:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.538799:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41210d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->5038079] (req 1130496->5038079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.538809:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.538817:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.539106:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.539125:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.539136:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.539150:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468609984
00000100:00100000:1.0:1651532148.539164:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468610048
00000100:00100000:1.0:1651532148.539172:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4621
00000100:00100000:1.0:1651532148.539174:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468609984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532148.539181:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.539185:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532148.539186:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.539189:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532148.539190:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.539194:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.539198:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.539205:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4622
00000100:00100000:1.0:1651532148.539207:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029ec6cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468610048:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532148.539212:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.539215:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532148.539216:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.539218:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532148.539219:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.539222:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.539225:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.539232:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468610240
00000100:00100000:0.0:1651532148.539242:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4591
00000100:00100000:0.0:1651532148.539244:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468610240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.539247:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.539251:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41221e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be84 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.539260:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41221e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be84 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.539264:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41221e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be84 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.539268:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532148.539285:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468610240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (149us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.539288:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4591
00000001:00080000:1.0:1651532148.637759:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793970 is committed
00010000:00010000:0.0:1651532148.637790:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.637798:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.637831:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099ca9cfd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468606144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 581898us (581995us total) trans 158913793970 rc 0/0
00010000:00010000:1.0:1651532148.637834:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.637835:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4613
00010000:00010000:1.0:1651532148.637839:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532148.637840:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.637843:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.637851:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.637852:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.637853:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.637856:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.637859:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.637859:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.637860:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.637863:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.637886:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.637890:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41214c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8232959] (req 225280->8232959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.637892:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.637895:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.637896:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.637898:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.638164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.638185:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468610496
00010000:00010000:1.0:1651532148.638196:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638206:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.638210:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4592
00000100:00100000:0.0:1651532148.638212:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468610496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.638216:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.638220:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412225 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be8b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.638226:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6476f5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468606208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 582287us (582378us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532148.638229:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4614
00010000:00010000:0.0:1651532148.638232:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.638235:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412225 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be8b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.638237:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638239:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412225 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be8b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.638240:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532148.638241:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638244:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638245:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:1.0:1651532148.638249:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638252:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412153 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2834432->8581119] (req 2834432->8581119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.638254:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468610496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.638257:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4592
00010000:00010000:0.0:1651532148.638268:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638272:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.638278:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.638284:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002652088d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468606912:12345-10.240.43.64@tcp:3:fio.0 Request processed in 473063us (473137us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532148.638293:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4615
00010000:00010000:0.0:1651532148.638299:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638303:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532148.638304:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638307:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638311:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.638312:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.638313:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638318:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638329:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638332:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41216f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6479872->9908223] (req 6479872->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.638333:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468610624
00000100:00100000:1.0:1651532148.638355:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4593
00000100:00100000:1.0:1651532148.638356:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4122441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468610624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.638362:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.638365:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41222c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be92 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638373:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41222c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be92 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.638375:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638378:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41222c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be92 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.638379:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638381:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532148.638391:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4122441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468610624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.638394:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4593
00000100:00100000:0.0:1651532148.638745:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.638753:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.638765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.638771:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468610752
00000100:00100000:0.0:1651532148.638772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.638781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.638791:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468610688
00000100:00100000:1.0:1651532148.638801:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4623
00000100:00100000:1.0:1651532148.638816:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67c125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468610752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532148.638824:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638833:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532148.638835:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638838:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.638847:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468610880
00000100:00100000:1.0:1651532148.638857:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468611008
00000100:00100000:1.0:1651532148.638860:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468611072
00000100:00100000:1.0:1651532148.638862:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4594
00000100:00100000:1.0:1651532148.638864:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468610880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.638867:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.638869:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41223a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44be99 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638876:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41223a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be99 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.638880:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41223a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44be99 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.638883:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532148.638895:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468610880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.638898:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4594
00000100:00100000:0.0:1651532148.638902:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4624
00000100:00100000:1.0:1651532148.638903:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4595
00000100:00100000:1.0:1651532148.638904:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468611008:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532148.638905:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468610688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532148.638907:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.638909:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412241 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bea0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638913:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638917:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412241 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bea0 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.638918:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532148.638919:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638922:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638925:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532148.638926:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638930:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412241 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bea0 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.638930:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638933:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532148.638933:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.638936:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.638938:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468611008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (166us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.638941:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4595
00000100:00100000:1.0:1651532148.638945:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4596
00000100:00100000:1.0:1651532148.638946:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468611072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.638960:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.638962:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41224f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bea7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.638968:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41224f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bea7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.638972:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41224f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bea7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532148.638974:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532148.638975:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532148.638981:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468611072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (200us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.638984:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4596
00000100:00100000:1.0:1651532148.638988:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468611264
00000100:00100000:1.0:1651532148.638996:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4597
00000100:00100000:1.0:1651532148.638997:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468611264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.639000:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.639002:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412256 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44beae expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.639016:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412256 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44beae expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.639020:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412256 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44beae expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.639023:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532148.639036:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468611264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.639039:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4597
00000100:00100000:1.0:1651532148.639239:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.639260:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.639280:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468611456
00000100:00100000:0.0:1651532148.639280:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468611392
00000100:00100000:1.0:1651532148.639290:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4598
00000100:00100000:1.0:1651532148.639292:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f2aa9fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468611456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.639295:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532148.639297:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4599
00010000:00010000:1.0:1651532148.639299:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41225d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bebc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.639299:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000629d7e9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468611392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.639303:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.639305:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41225d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bebc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.639307:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412264 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44beb5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.639309:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41225d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bebc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.639313:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532148.639315:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412264 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44beb5 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532148.639325:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f2aa9fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468611456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.639327:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4598
00010000:00010000:0.0:1651532148.639328:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412264 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44beb5 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.639332:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532148.639365:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000629d7e9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468611392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.639369:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4599
00000100:00100000:1.0:1651532148.639372:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.639375:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468611648
00000100:00100000:0.0:1651532148.639380:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4600
00000100:00100000:0.0:1651532148.639382:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8c71a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468611648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.639384:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.639387:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41226b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bec3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.639394:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41226b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bec3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.639398:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41226b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bec3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.639401:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532148.639409:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8c71a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468611648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (38us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.639411:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4600
00000100:00100000:0.0:1651532148.639616:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.639623:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468611776
00000100:00100000:0.0:1651532148.639630:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4601
00000100:00100000:0.0:1651532148.639632:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468611776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.639635:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.639638:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412272 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44beca expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.639645:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412272 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44beca expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.639649:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412272 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44beca expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.639653:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532148.639668:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468611776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.639671:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4601
00000001:00080000:1.0:1651532148.762753:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793971 is committed
00010000:00010000:0.0:1651532148.762784:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.762789:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.762812:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.762817:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532148.762818:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.762821:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.762821:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000628378fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468606784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 597592us (597649us total) trans 158913793971 rc 0/0
00000100:00100000:0.0:1651532148.762824:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4616
00010000:00010000:1.0:1651532148.762827:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.762827:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.762828:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.762834:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.762841:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.762844:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412176 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1249280->9428991] (req 1249280->9428991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.762849:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.762852:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.763115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.763127:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.763136:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468612096
00000100:00100000:0.0:1651532148.763147:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468612032
00000100:00100000:0.0:1651532148.763153:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4625
00000100:00100000:0.0:1651532148.763155:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468612096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532148.763162:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.763167:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532148.763168:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.763170:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532148.763171:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.763176:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.763179:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.763186:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4626
00000100:00100000:0.0:1651532148.763188:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468612032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532148.763192:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.763222:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532148.763223:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.763228:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532148.763229:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.763233:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.763236:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.763253:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.763261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.763267:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468612224
00000100:00100000:0.0:1651532148.763273:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468612288
00000100:00100000:0.0:1651532148.763282:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4602
00000100:00100000:0.0:1651532148.763284:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468612224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.763287:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.763290:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412287 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bed1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.763292:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4603
00000100:00100000:1.0:1651532148.763294:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468612288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.763298:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.763298:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412287 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bed1 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.763302:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412287 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bed1 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.763303:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41228e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bed8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.763308:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:1.0:1651532148.763311:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41228e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bed8 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532148.763321:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468612224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.763324:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4602
00010000:00010000:1.0:1651532148.763325:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41228e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bed8 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.763329:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532148.763349:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f594ab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468612288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.763352:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4603
00000001:00080000:1.0:1651532148.871086:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793972 is committed
00010000:00010000:1.0:1651532148.871101:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871105:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.871127:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081aa37cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468608256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565365us (565423us total) trans 158913793972 rc 0/0
00000100:00100000:1.0:1651532148.871130:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4617
00010000:00010000:1.0:1651532148.871137:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871140:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532148.871141:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871144:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871150:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.871150:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.871151:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871155:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.871158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.871159:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871161:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871183:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871187:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4121bc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10022911] (req 499712->10022911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871192:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871195:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.871195:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.871200:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.871501:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.871511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.871512:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468612544
00000100:00100000:0.0:1651532148.871528:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.871538:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468612608
00000100:00100000:1.0:1651532148.871542:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468612736
00000100:00100000:0.0:1651532148.871544:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4604
00000100:00100000:0.0:1651532148.871546:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468612544:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532148.871547:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4605
00000100:00100000:1.0:1651532148.871549:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468612608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.871550:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.871553:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.871554:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412295 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bedf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871557:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41229c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bee6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.871560:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.871562:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532148.871563:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412295 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bedf expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.871565:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41229c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bee6 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.871567:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412295 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bedf expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.871569:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41229c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bee6 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.871573:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532148.871573:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532148.871583:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd97fa6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468612608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.871583:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c294a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468612544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.871586:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4605
00000100:00100000:0.0:1651532148.871588:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4604
00000100:00100000:1.0:1651532148.871591:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4606
00000100:00100000:1.0:1651532148.871592:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468612736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.871595:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.871597:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4122a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44beed expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.871600:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.871604:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871607:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.871609:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4122a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44beed expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532148.871616:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036ea9a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468609280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 440650us (440701us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532148.871618:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4619
00010000:00010000:1.0:1651532148.871620:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4122a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44beed expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.871624:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532148.871624:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.871627:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532148.871628:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.871630:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2aca7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468612736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (103us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532148.871631:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.871633:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4606
00010000:00010000:0.0:1651532148.871636:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.871642:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4121ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->10285055] (req 57344->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871645:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871649:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.871660:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afc7141e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468608320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 565843us (565948us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532148.871663:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4618
00010000:00010000:1.0:1651532148.871668:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871672:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532148.871673:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871676:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871683:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.871684:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.871685:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871688:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871697:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.871700:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4121c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1830912->9199615] (req 1830912->9199615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.871701:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.871704:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.872176:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.872213:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.872224:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.872224:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468612928
00000100:00100000:1.0:1651532148.872232:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.872245:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.872256:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468612864
00000100:00100000:0.0:1651532148.872259:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4627
00000100:00100000:0.0:1651532148.872261:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a51a0864 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468612928:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532148.872269:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4628
00000100:00100000:1.0:1651532148.872271:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468612864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532148.872274:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.872278:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.872279:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532148.872280:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.872283:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532148.872284:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.872288:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532148.872289:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.872294:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532148.872295:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.872299:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.872300:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.872303:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.872303:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.872311:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468612992
00000100:00100000:0.0:1651532148.872311:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468613056
00000100:00100000:1.0:1651532148.872320:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468613312
00000100:00100000:1.0:1651532148.872323:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4607
00000100:00100000:1.0:1651532148.872325:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006388808e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468612992:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532148.872326:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4608
00010000:00010000:1.0:1651532148.872328:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532148.872328:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070f9d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468613056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.872330:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4122b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bef4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.872331:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.872334:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4122bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44befb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.872345:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4122b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bef4 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.872350:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4122b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bef4 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.872351:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4122bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44befb expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.872354:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532148.872355:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4122bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44befb expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.872359:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532148.872365:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006388808e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468612992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (133us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.872368:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4607
00000100:00100000:0.0:1651532148.872368:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070f9d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468613056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (144us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.872371:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4608
00000100:00100000:1.0:1651532148.872373:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4609
00000100:00100000:1.0:1651532148.872375:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468613312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.872377:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.872380:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4122c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf02 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.872386:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4122c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf02 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.872389:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4122c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf02 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532148.872389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532148.872392:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532148.872398:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468613312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (158us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.872400:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4609
00000100:00100000:1.0:1651532148.872404:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468613376
00000100:00100000:1.0:1651532148.872412:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4610
00000100:00100000:1.0:1651532148.872414:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468613376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.872416:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.872419:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4122cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf09 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.872434:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4122cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf09 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.872438:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4122cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf09 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.872441:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532148.872452:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468613376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.872455:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4610
00000100:00100000:1.0:1651532148.872642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.872649:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468613568
00000100:00100000:1.0:1651532148.872659:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4611
00000100:00100000:1.0:1651532148.872661:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468613568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.872664:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.872668:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4122d4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf10 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.872674:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4122d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf10 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.872678:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4122d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf10 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.872681:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532148.872693:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468613568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.872703:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4611
00000100:00100000:0.0:1651532148.872731:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.872739:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468613632
00000100:00100000:0.0:1651532148.872739:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.872748:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468613696
00000100:00100000:1.0:1651532148.872752:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4612
00000100:00100000:1.0:1651532148.872754:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468613632:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532148.872755:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4613
00010000:00010000:1.0:1651532148.872757:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532148.872757:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468613696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532148.872760:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4122db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf17 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.872761:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.872764:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4122e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf1e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.872766:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4122db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf17 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.872770:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4122db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf17 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.872772:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4122e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf1e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.872773:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532148.872776:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4122e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf1e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.872779:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532148.872780:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468613632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.872783:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4612
00000100:00100000:0.0:1651532148.872787:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468613696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.872790:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4613
00000100:00100000:0.0:1651532148.872881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.872889:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468613888
00000100:00100000:0.0:1651532148.872896:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4614
00000100:00100000:0.0:1651532148.872898:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468613888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.872901:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.872904:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4122e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf25 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.872911:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4122e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf25 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.872915:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4122e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf25 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.872918:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532148.872931:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468613888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.872934:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4614
00000100:00100000:0.0:1651532148.873165:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.873172:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468614144
00000100:00100000:0.0:1651532148.873179:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4615
00000100:00100000:0.0:1651532148.873180:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468614144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.873183:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.873186:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4122f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf2c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.873193:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4122f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf2c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.873198:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4122f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf2c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.873201:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532148.873216:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468614144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.873219:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4615
00000100:00100000:0.0:1651532148.873416:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.873423:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468614336
00000100:00100000:0.0:1651532148.873429:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4616
00000100:00100000:0.0:1651532148.873431:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468614336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.873434:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.873437:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf33 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.873444:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf33 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.873448:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf33 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.873451:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532148.873467:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468614336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.873470:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4616
00000001:00080000:1.0:1651532148.929508:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793973 is committed
00010000:00010000:0.0:1651532148.929540:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.929546:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.929570:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.929573:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468609216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 498573us (498647us total) trans 158913793973 rc 0/0
00010000:00010000:1.0:1651532148.929575:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532148.929576:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.929577:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4620
00010000:00010000:1.0:1651532148.929583:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.929588:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.929589:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532148.929590:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.929593:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.929601:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.929604:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4121fb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->8908799] (req 630784->8908799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.929610:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.929613:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.929981:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.929993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.929993:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468614528
00000100:00100000:1.0:1651532148.930003:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532148.930011:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.930019:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468614464
00000100:00100000:1.0:1651532148.930025:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532148.930027:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4629
00000100:00100000:0.0:1651532148.930034:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468614528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532148.930042:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.930048:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532148.930049:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.930052:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532148.930053:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.930058:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.930061:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532148.930069:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4630
00000100:00100000:0.0:1651532148.930071:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468614464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532148.930085:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.930089:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532148.930089:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.930092:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532148.930093:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.930097:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468614592
00010000:00010000:0.0:1651532148.930097:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.930100:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532148.930105:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468614720
00000100:00100000:1.0:1651532148.930108:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468614848
00000100:00100000:0.0:1651532148.930109:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4617
00000100:00100000:0.0:1651532148.930111:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468614592:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532148.930112:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4618
00000100:00100000:1.0:1651532148.930114:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468614720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.930114:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.930117:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41230c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf3a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532148.930118:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532148.930121:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412313 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf41 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.930125:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41230c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf3a expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.930129:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41230c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf3a expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.930130:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412313 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf41 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.930133:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:1.0:1651532148.930134:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412313 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf41 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532148.930137:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532148.930144:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468614592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (141us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532148.930147:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468614720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.930147:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4617
00000100:00100000:1.0:1651532148.930149:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4618
00000100:00100000:0.0:1651532148.930153:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4619
00000100:00100000:0.0:1651532148.930155:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468614848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532148.930157:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532148.930159:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41231a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf48 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532148.930168:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41231a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf48 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.930172:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41231a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf48 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532148.930175:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532148.930181:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f147ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468614848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (157us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532148.930184:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4619
00000001:00080000:1.0:1651532149.079475:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793974 is committed
00010000:00010000:1.0:1651532149.079492:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.079498:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079518:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079523:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532149.079524:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468609984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 540349us (540418us total) trans 158913793974 rc 0/0
00010000:00010000:0.0:1651532149.079525:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079528:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.079530:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4621
00010000:00010000:0.0:1651532149.079534:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.079535:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.079536:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079539:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079542:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.079543:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.079544:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079546:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079557:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079560:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412210 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079576:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079579:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.079581:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.079586:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079595:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.079598:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.079623:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.079626:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67c125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468610752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 440822us (440882us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651532149.079627:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532149.079629:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.079632:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.079632:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4623
00010000:00010000:1.0:1651532149.079637:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.079640:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412233 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3125248->3129343] (req 3125248->3129343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.079879:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.079891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.079891:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468615104
00000100:00100000:0.0:1651532149.079903:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468615168
00000100:00100000:0.0:1651532149.079910:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4620
00000100:00100000:0.0:1651532149.079912:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468615104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.079915:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.079919:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f412321 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf4f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.079920:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4621
00000100:00100000:1.0:1651532149.079924:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468615168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.079931:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.079936:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412328 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf56 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.079942:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.079945:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412328 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf56 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.079950:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.079953:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f412321 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf4f expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.079957:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f412321 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf4f expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.079961:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:1.0:1651532149.079963:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412328 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf56 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.079967:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532149.079974:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007bf6af6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468615104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.079977:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4620
00000100:00100000:1.0:1651532149.079984:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003fc5037e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468615168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.079988:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4621
00000100:00100000:0.0:1651532149.079994:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532149.080002:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.080006:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.080010:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.080024:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029ec6cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468610048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 540817us (540899us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532149.080028:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4622
00000100:00100000:0.0:1651532149.080040:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468615296
00000100:00100000:0.0:1651532149.080050:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468615232
00000100:00100000:0.0:1651532149.080059:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4631
00000100:00100000:0.0:1651532149.080061:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468615296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532149.080069:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.080073:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4632
00010000:00010000:0.0:1651532149.080073:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.080074:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.080076:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468615232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532149.080076:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532149.080077:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080081:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080085:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.080086:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.080093:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532149.080095:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.080100:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532149.080101:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.080106:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.080110:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080117:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080120:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532149.080121:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080124:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080129:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.080130:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.080131:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080134:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080141:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080144:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412217 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1884160->7471103] (req 1884160->7471103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080149:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080152:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.080361:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.080378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.080386:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468615488
00000100:00100000:1.0:1651532149.080393:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468615424
00000100:00100000:1.0:1651532149.080403:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4622
00000100:00100000:1.0:1651532149.080405:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468615488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.080409:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.080413:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41233d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf64 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.080421:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41233d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf64 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.080425:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41233d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf64 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.080429:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532149.080431:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4623
00000100:00100000:0.0:1651532149.080433:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c414cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468615424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.080437:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532149.080441:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b90adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468615488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.080444:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4622
00010000:00010000:0.0:1651532149.080446:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f412344 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf5d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080455:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f412344 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf5d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.080460:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f412344 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf5d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.080463:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532149.080472:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c414cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468615424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (94us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.080475:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4623
00000100:00100000:1.0:1651532149.080729:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.080741:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468615808
00000100:00100000:0.0:1651532149.080752:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4624
00000100:00100000:0.0:1651532149.080754:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e66b2a7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468615808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.080757:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.080761:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41234b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf6b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.080768:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41234b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf6b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.080772:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41234b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf6b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.080775:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532149.080786:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e66b2a7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468615808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.080788:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4624
00000001:00080000:1.0:1651532149.221147:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793975 is committed
00010000:00010000:0.0:1651532149.221175:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221180:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.221205:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468610688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582299us (582451us total) trans 158913793975 rc 0/0
00000100:00100000:0.0:1651532149.221209:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4624
00010000:00010000:0.0:1651532149.221217:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221221:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532149.221222:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221225:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221230:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.221231:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.221232:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221235:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221242:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221245:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412248 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8065023] (req 196608->8065023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221250:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221253:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.221602:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.221615:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.221615:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468616000
00000100:00100000:1.0:1651532149.221624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.221631:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.221631:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468616128
00000100:00100000:0.0:1651532149.221638:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4633
00000100:00100000:0.0:1651532149.221645:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468616000:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532149.221646:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4634
00000100:00100000:1.0:1651532149.221649:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b65c3b5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468616128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532149.221652:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221657:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532149.221658:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221659:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221661:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532149.221661:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221665:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.221666:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221669:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532149.221670:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221677:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221678:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.221681:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221682:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.221689:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468616064
00010000:00010000:0.0:1651532149.221693:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.221696:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468616192
00010000:00010000:0.0:1651532149.221697:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.221700:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4625
00000100:00100000:1.0:1651532149.221702:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009059a7df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468616064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.221712:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.221715:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412360 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf72 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.221716:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468612096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458560us (458602us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532149.221719:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4625
00010000:00010000:1.0:1651532149.221720:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.221723:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412360 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf72 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532149.221727:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4626
00010000:00010000:1.0:1651532149.221728:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412360 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf72 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532149.221729:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468616192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.221731:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532149.221732:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.221735:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f412367 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf79 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.221740:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009059a7df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468616064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (125us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532149.221740:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532149.221743:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4625
00010000:00010000:0.0:1651532149.221743:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f412367 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf79 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.221747:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f412367 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf79 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.221751:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:1.0:1651532149.221752:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221756:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532149.221757:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.221757:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468616192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (126us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532149.221760:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.221760:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4626
00010000:00010000:1.0:1651532149.221764:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.221765:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.221766:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221769:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221780:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221783:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412279 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2342912->9940991] (req 2342912->9940991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221792:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.221795:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.222156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.222171:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.222176:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468616384
00000100:00100000:1.0:1651532149.222177:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.222183:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.222187:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468616448
00000100:00100000:0.0:1651532149.222190:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468616576
00000100:00100000:0.0:1651532149.222192:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468616640
00000100:00100000:0.0:1651532149.222195:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4627
00000100:00100000:0.0:1651532149.222197:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468616384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.222200:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.222204:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41236e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf80 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.222211:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41236e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf80 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.222215:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41236e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf80 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.222219:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532149.222229:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468616384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.222231:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4627
00000100:00100000:0.0:1651532149.222236:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4628
00000100:00100000:0.0:1651532149.222237:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468616448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.222240:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.222242:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412375 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf87 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.222247:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412375 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf87 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.222251:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412375 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf87 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.222257:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532149.222259:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4629
00000100:00100000:1.0:1651532149.222262:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468616576:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532149.222262:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468616448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.222264:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4628
00010000:00010000:1.0:1651532149.222266:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532149.222267:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4630
00000100:00100000:0.0:1651532149.222269:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468616640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.222270:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41237c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf8e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.222271:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.222273:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412383 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf95 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.222279:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41237c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf8e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.222279:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412383 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf95 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.222283:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41237c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf8e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.222283:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412383 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf95 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.222286:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:1.0:1651532149.222287:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532149.222290:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468616640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.222293:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4630
00000100:00100000:1.0:1651532149.222296:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468616576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.222299:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4629
00000100:00100000:1.0:1651532149.222644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.222652:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.222659:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.222665:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468616768
00000100:00100000:1.0:1651532149.222679:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468617024
00000100:00100000:1.0:1651532149.222682:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468617088
00000100:00100000:1.0:1651532149.222685:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4631
00000100:00100000:1.0:1651532149.222687:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2ac1480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468616768:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532149.222689:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4632
00000100:00100000:0.0:1651532149.222691:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028f69b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468617024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.222692:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.222694:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.222696:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41238a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bf9c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.222698:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412391 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfa3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.222704:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41238a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf9c expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.222706:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412391 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfa3 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.222708:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41238a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bf9c expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.222710:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412391 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfa3 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.222712:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532149.222713:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532149.222725:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2ac1480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468616768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.222728:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4631
00000100:00100000:0.0:1651532149.222730:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028f69b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468617024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.222733:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4632
00000100:00100000:1.0:1651532149.222735:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4633
00000100:00100000:1.0:1651532149.222736:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468617088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.222739:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.222741:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412398 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfaa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.222747:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412398 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfaa expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.222751:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412398 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfaa expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.222757:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532149.222779:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468617088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.222782:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4633
00000100:00100000:0.0:1651532149.222987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.223002:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.223014:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468617280
00000100:00100000:1.0:1651532149.223022:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468617408
00000100:00100000:1.0:1651532149.223029:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4634
00000100:00100000:1.0:1651532149.223031:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468617280:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532149.223033:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4635
00010000:00010000:1.0:1651532149.223035:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532149.223035:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468617408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.223038:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41239f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfb1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.223038:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.223042:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4123a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfb8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.223045:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41239f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfb1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.223049:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41239f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfb1 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.223050:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4123a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfb8 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.223053:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532149.223054:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4123a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfb8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.223057:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532149.223063:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468617280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.223065:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468617408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.223066:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4634
00000100:00100000:0.0:1651532149.223068:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4635
00000100:00100000:0.0:1651532149.223288:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.223295:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468617728
00000100:00100000:0.0:1651532149.223308:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4636
00000100:00100000:0.0:1651532149.223310:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468617728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.223313:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.223317:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4123ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfbf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.223324:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4123ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfbf expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.223328:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4123ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfbf expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.223332:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532149.223352:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468617728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.223355:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4636
00000001:00080000:1.0:1651532149.287844:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793976 is committed
00010000:00010000:1.0:1651532149.287861:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.287868:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.287894:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468612032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524704us (524766us total) trans 158913793976 rc 0/0
00010000:00010000:0.0:1651532149.287895:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.287897:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4626
00010000:00010000:0.0:1651532149.287900:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532149.287901:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.287907:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.287913:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.287913:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.287914:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.287917:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.287925:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.287927:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412280 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->9613311] (req 2170880->9613311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.287948:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.287953:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.288222:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.288233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.288242:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.288243:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468617920
00000100:00100000:0.0:1651532149.288260:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4637
00000100:00100000:1.0:1651532149.288271:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468617984
00000100:00100000:0.0:1651532149.288276:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468617920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.288280:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.288283:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4123b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfc6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.288291:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468617856
00010000:00010000:0.0:1651532149.288294:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532149.288299:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4635
00000100:00100000:1.0:1651532149.288301:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000282157fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468617984:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532149.288301:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4123b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfc6 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.288308:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4123b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfc6 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.288309:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288312:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:1.0:1651532149.288313:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.288314:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532149.288315:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.288321:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.288325:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468617920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.288328:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4637
00000100:00100000:0.0:1651532149.288336:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4636
00000100:00100000:0.0:1651532149.288348:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c414cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468617856:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532149.288349:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.288352:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288355:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288365:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532149.288366:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288369:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.288370:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a51a0864 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468612928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416108us (416195us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532149.288371:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532149.288372:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.288373:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4627
00010000:00010000:0.0:1651532149.288376:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288382:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288385:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288392:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288395:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532149.288396:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288399:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288404:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.288404:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.288405:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288408:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288417:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288420:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4122aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->5550079] (req 32768->5550079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288430:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288433:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.288757:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.288776:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468618048
00000100:00100000:0.0:1651532149.288785:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4638
00000100:00100000:0.0:1651532149.288787:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468618048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.288790:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.288794:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4123c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfcd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.288801:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4123c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfcd expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.288820:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4123c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfcd expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.288824:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532149.288833:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468618048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.288836:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4638
00000100:00100000:1.0:1651532149.289062:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.289073:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468618304
00000100:00100000:0.0:1651532149.289082:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4639
00000100:00100000:0.0:1651532149.289083:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468618304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.289087:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.289090:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4123d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfd4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.289098:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4123d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfd4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.289115:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4123d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfd4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.289118:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532149.289132:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468618304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.289135:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4639
00000100:00100000:1.0:1651532149.289185:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.289195:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468618432
00000100:00100000:0.0:1651532149.289202:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4640
00000100:00100000:0.0:1651532149.289204:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468618432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.289207:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.289210:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfdb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.289217:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfdb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.289221:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfdb expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.289227:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532149.289239:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468618432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.289242:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4640
00000001:00080000:1.0:1651532149.379538:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793977 is committed
00002000:00010000:0.0:1651532149.379565:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532147 -> 1651532148
00002000:00010000:0.0:1651532149.379567:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532147 -> 1651532148
00010000:00010000:0.0:1651532149.379570:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.379575:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.379599:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.379603:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468612864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507331us (507389us total) trans 158913793977 rc 0/0
00000100:00100000:0.0:1651532149.379606:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4628
00010000:00010000:1.0:1651532149.379609:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532149.379610:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.379614:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.379620:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.379621:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.379622:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.379625:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.379635:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.379638:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4122b1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3448832->9347071] (req 3448832->9347071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.379646:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.379650:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.379908:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.379917:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.379937:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468618688
00010000:00010000:0.0:1651532149.379941:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.379954:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468618752
00010000:00010000:0.0:1651532149.379956:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.379964:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4637
00000100:00100000:1.0:1651532149.379967:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468618688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532149.379978:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.379984:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532149.379985:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.379988:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532149.379989:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.379993:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.380005:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468614528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449970us (450031us total) trans 0 rc 49152/49152
00000100:00100000:0.0:1651532149.380009:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4629
00000100:00100000:0.0:1651532149.380017:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4638
00000100:00100000:0.0:1651532149.380019:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468618752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532149.380020:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380027:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380031:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.380032:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380036:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532149.380036:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.380037:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532149.380041:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380052:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380060:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380063:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532149.380064:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380067:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380072:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.380073:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.380073:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380076:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.380081:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532149.380082:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380085:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4122fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9478143] (req 532480->9478143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.380094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532149.380096:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380099:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.380103:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468618880
00000100:00100000:1.0:1651532149.380109:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468618816
00000100:00100000:1.0:1651532149.380112:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468618944
00000100:00100000:1.0:1651532149.380115:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4641
00000100:00100000:1.0:1651532149.380116:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468618880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.380120:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.380124:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4123ec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfe9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.380133:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4642
00000100:00100000:0.0:1651532149.380135:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468618816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.380138:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.380139:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4123ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfe9 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.380142:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4123f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bfe2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.380144:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4123ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfe9 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.380147:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532149.380150:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4123f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfe2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.380155:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4123f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bfe2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532149.380156:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468618880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (119us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532149.380158:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:1.0:1651532149.380159:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4641
00000100:00100000:1.0:1651532149.380164:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4643
00000100:00100000:1.0:1651532149.380166:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468618944:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532149.380166:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468618816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.380168:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4642
00010000:00010000:1.0:1651532149.380169:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.380171:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4123fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bff0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.380177:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4123fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bff0 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.380181:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4123fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bff0 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.380184:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532149.380189:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468618944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.380192:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4643
00000100:00100000:1.0:1651532149.380258:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.380267:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468619008
00000100:00100000:1.0:1651532149.380278:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4644
00000100:00100000:1.0:1651532149.380281:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468619008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.380286:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.380302:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412401 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bff7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.380311:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412401 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bff7 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.380318:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412401 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bff7 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.380321:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532149.380333:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468619008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.380336:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4644
00000100:00100000:1.0:1651532149.380619:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.380627:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.380633:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468619136
00000100:00100000:1.0:1651532149.380643:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468619200
00000100:00100000:1.0:1651532149.380650:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4645
00000100:00100000:1.0:1651532149.380651:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468619136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.380655:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532149.380658:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4646
00010000:00010000:1.0:1651532149.380659:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412408 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44bffe expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.380661:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468619200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.380666:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412408 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bffe expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.380666:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.380670:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412408 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44bffe expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.380671:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41240f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c005 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.380674:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532149.380680:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41240f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c005 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.380685:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41240f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c005 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532149.380692:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468619136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.380698:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4645
00010000:00010000:0.0:1651532149.380715:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532149.380726:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468619200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.380730:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4646
00000100:00100000:1.0:1651532149.380741:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.380776:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468619392
00000100:00100000:0.0:1651532149.380784:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4647
00000100:00100000:0.0:1651532149.380786:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468619392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.380790:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.380793:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412416 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c00c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.380800:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412416 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c00c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.380823:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412416 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c00c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.380827:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532149.380837:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468619392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.380840:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4647
00000100:00100000:1.0:1651532149.381012:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.381023:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468619584
00000100:00100000:0.0:1651532149.381032:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4648
00000100:00100000:0.0:1651532149.381033:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468619584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.381038:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.381041:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41241d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c013 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.381049:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41241d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c013 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.381052:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41241d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c013 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.381056:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532149.381066:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468619584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.381068:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4648
00000001:00080000:1.0:1651532149.521154:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793978 is committed
00010000:00010000:0.0:1651532149.521185:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521191:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.521214:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468614464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 591142us (591220us total) trans 158913793978 rc 0/0
00000100:00100000:0.0:1651532149.521218:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4630
00010000:00010000:0.0:1651532149.521225:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521229:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532149.521230:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521233:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521238:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.521239:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.521240:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521243:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521250:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521253:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412305 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->9678847] (req 262144->9678847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521258:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521261:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.521606:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.521622:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.521631:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.521638:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468619904
00000100:00100000:1.0:1651532149.521645:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.521654:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.521657:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468619968
00000100:00100000:1.0:1651532149.521662:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468620160
00000100:00100000:0.0:1651532149.521664:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4639
00000100:00100000:0.0:1651532149.521666:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468619904:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532149.521670:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468620032
00000100:00100000:1.0:1651532149.521673:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468620224
00010000:00010000:0.0:1651532149.521673:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.521676:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4649
00000100:00100000:1.0:1651532149.521678:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468620160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.521678:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532149.521679:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521682:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.521682:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532149.521682:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521686:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41242b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c021 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521687:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521690:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521692:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.521696:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41242b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c021 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.521700:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41242b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c021 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.521703:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521704:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532149.521706:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.521722:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468620160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.521726:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4649
00000100:00100000:0.0:1651532149.521729:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468615296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441668us (441735us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532149.521731:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4650
00000100:00100000:0.0:1651532149.521732:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4631
00000100:00100000:1.0:1651532149.521733:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468620032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.521735:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.521738:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412432 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c01a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.521738:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4640
00000100:00100000:0.0:1651532149.521740:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468619968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532149.521743:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.521745:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412432 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c01a expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.521746:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521749:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412432 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c01a expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.521749:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.521750:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521752:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532149.521753:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532149.521754:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.521757:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.521759:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468620032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.521761:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4650
00010000:00010000:0.0:1651532149.521761:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.521765:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4651
00000100:00100000:1.0:1651532149.521766:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468620224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.521769:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.521770:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412440 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c028 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521774:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.521776:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412440 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c028 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.521780:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412440 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c028 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.521783:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532149.521787:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468620224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (133us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.521790:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4651
00010000:00010000:1.0:1651532149.521796:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521851:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532149.521853:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521858:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521866:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.521867:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.521868:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521871:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521879:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521883:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41232f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1835008->7639039] (req 1835008->7639039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521889:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.521892:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.522166:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.522204:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.522217:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.522228:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468620544
00000100:00100000:1.0:1651532149.522229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.522240:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468620608
00000100:00100000:0.0:1651532149.522243:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468620480
00000100:00100000:0.0:1651532149.522245:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468620736
00000100:00100000:0.0:1651532149.522248:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4652
00000100:00100000:0.0:1651532149.522250:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468620544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.522254:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.522257:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412447 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c036 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.522265:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412447 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c036 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.522273:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412447 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c036 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.522276:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532149.522287:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468620544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.522289:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4652
00000100:00100000:0.0:1651532149.522294:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4653
00000100:00100000:0.0:1651532149.522296:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468620608:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532149.522298:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4654
00010000:00010000:0.0:1651532149.522298:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532149.522300:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468620480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.522300:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41244e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c03d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.522304:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.522306:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41244e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c03d expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.522308:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412455 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c02f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.522310:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41244e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c03d expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.522313:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00010000:00010000:1.0:1651532149.522316:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412455 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c02f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532149.522317:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468620608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (123us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532149.522320:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412455 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c02f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532149.522320:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4653
00000100:00100000:0.0:1651532149.522323:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4655
00010000:00010000:1.0:1651532149.522324:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532149.522325:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468620736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.522327:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.522329:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41245c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c044 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.522333:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468620480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (116us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532149.522334:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41245c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c044 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532149.522335:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4654
00010000:00010000:0.0:1651532149.522349:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41245c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c044 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.522352:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532149.522359:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468620736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.522361:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4655
00000001:00080000:1.0:1651532149.612894:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793979 is committed
00002000:00010000:1.0:1651532149.612909:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532148 -> 1651532149
00002000:00010000:1.0:1651532149.612910:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532148 -> 1651532149
00010000:00010000:1.0:1651532149.612913:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.612916:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.612939:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.612940:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468615232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532864us (532930us total) trans 158913793979 rc 0/0
00000100:00100000:1.0:1651532149.612944:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4632
00010000:00010000:0.0:1651532149.612944:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532149.612945:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.612948:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.612954:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.612955:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.612956:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.612959:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.612966:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.612969:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412336 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->9408511] (req 331776->9408511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.612977:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.612994:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.613372:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.613391:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.613405:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.613414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.613416:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468621056
00000100:00100000:1.0:1651532149.613423:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468621120
00000100:00100000:0.0:1651532149.613428:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4641
00000100:00100000:0.0:1651532149.613430:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468621056:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532149.613439:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4642
00000100:00100000:1.0:1651532149.613441:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468621120:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532149.613442:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.613447:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532149.613448:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.613449:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.613451:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532149.613451:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.613456:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532149.613457:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.613461:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532149.613461:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.613465:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.613466:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.613469:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.613470:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.613477:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468621184
00000100:00100000:0.0:1651532149.613478:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468621312
00000100:00100000:1.0:1651532149.613485:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4656
00000100:00100000:1.0:1651532149.613494:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468621184:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532149.613494:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4657
00000100:00100000:0.0:1651532149.613495:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468621312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.613497:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.613498:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.613500:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412471 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c04b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.613501:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412478 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c052 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.613509:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412471 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c04b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.613509:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412478 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c052 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.613513:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412471 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c04b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.613513:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412478 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c052 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.613517:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00010000:00010000:1.0:1651532149.613518:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532149.613527:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468621312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.613528:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468621184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.613530:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4657
00000100:00100000:1.0:1651532149.613531:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4656
00000001:00080000:1.0:1651532149.679589:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793980 is committed
00010000:00010000:1.0:1651532149.679604:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679608:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.679626:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468616000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457980us (458025us total) trans 158913793980 rc 0/0
00000100:00100000:1.0:1651532149.679629:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4633
00010000:00010000:1.0:1651532149.679636:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679640:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532149.679641:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679644:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679649:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.679650:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.679651:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679654:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679657:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.679658:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.679658:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679661:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679668:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679671:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412352 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8290304->9519103] (req 8290304->9519103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679676:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679679:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679707:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679711:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679987:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.679992:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680007:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.680011:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000282157fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468617984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391709us (391789us total) trans 0 rc 49152/49152
00010000:00010000:0.0:1651532149.680012:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532149.680013:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.680015:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4635
00010000:00010000:0.0:1651532149.680016:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680022:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.680025:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680025:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4123bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8261631] (req 651264->8261631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.680028:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680034:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680037:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532149.680038:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b65c3b5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468616128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458389us (458414us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532149.680038:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.680040:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4634
00010000:00010000:0.0:1651532149.680040:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680044:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.680045:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.680045:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680048:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680054:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680057:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412359 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1437696->10395647] (req 1437696->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680062:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680065:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.680642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.680655:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.680664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.680671:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468621824
00000100:00100000:0.0:1651532149.680672:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.680680:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.680689:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.680690:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468621696
00000100:00100000:1.0:1651532149.680700:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4643
00000100:00100000:1.0:1651532149.680702:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468621824:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532149.680702:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468621760
00000100:00100000:0.0:1651532149.680708:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468621952
00010000:00010000:1.0:1651532149.680709:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.680710:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468622144
00000100:00100000:0.0:1651532149.680712:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468622336
00010000:00010000:1.0:1651532149.680713:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532149.680715:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.680715:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4658
00000100:00100000:0.0:1651532149.680717:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468621760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.680718:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680721:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532149.680725:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4644
00010000:00010000:0.0:1651532149.680725:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412486 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c059 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.680727:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098606df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468621696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532149.680731:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680732:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412486 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c059 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.680734:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532149.680735:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.680738:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.680740:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532149.680741:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.680745:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680745:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412486 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c059 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.680748:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.680751:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.680751:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:1.0:1651532149.680758:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4659
00000100:00100000:1.0:1651532149.680760:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468621952:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532149.680764:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468621760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.680767:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4658
00010000:00010000:1.0:1651532149.680769:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.680772:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412494 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c060 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.680772:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4660
00000100:00100000:0.0:1651532149.680774:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073eec7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468622144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.680776:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.680779:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412494 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c060 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.680779:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41249b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c067 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.680784:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412494 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c060 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.680785:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41249b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c067 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.680787:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532149.680789:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41249b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c067 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.680792:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:1.0:1651532149.680796:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468621952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.680798:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073eec7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468622144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.680799:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4659
00000100:00100000:0.0:1651532149.680801:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4660
00000100:00100000:1.0:1651532149.680818:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4661
00000100:00100000:1.0:1651532149.680820:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468622336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.680823:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.680825:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4124a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c06e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.680831:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4124a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c06e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.680838:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4124a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c06e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.680841:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532149.680847:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468622336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (158us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.680850:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4661
00000100:00100000:0.0:1651532149.681134:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.681153:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468622656
00000100:00100000:1.0:1651532149.681164:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4662
00000100:00100000:1.0:1651532149.681166:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468622656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.681169:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.681172:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4124a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c075 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.681179:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4124a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c075 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.681183:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4124a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c075 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.681186:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532149.681200:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468622656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.681203:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4662
00000100:00100000:0.0:1651532149.681427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.681444:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468622848
00000100:00100000:1.0:1651532149.681454:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4663
00000100:00100000:1.0:1651532149.681456:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468622848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.681459:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.681462:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c07c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.681468:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c07c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.681472:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c07c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.681475:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532149.681487:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468622848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.681489:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4663
00000001:00080000:1.0:1651532149.787952:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793981 is committed
00010000:00010000:0.0:1651532149.787982:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.787989:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.788011:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.788011:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c414cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468617856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499672us (499768us total) trans 158913793981 rc 0/0
00000100:00100000:0.0:1651532149.788014:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4636
00010000:00010000:1.0:1651532149.788016:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003325411e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532149.788017:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.788021:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.788029:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.788030:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.788031:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.788034:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.788041:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.788044:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4123c2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->8564735] (req 1155072->8564735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.788045:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.788050:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.788392:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.788401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.788407:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468623104
00000100:00100000:0.0:1651532149.788417:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468623040
00000100:00100000:0.0:1651532149.788422:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4645
00000100:00100000:0.0:1651532149.788424:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468623104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532149.788431:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.788436:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532149.788437:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.788440:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532149.788441:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.788446:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.788449:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.788456:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4646
00000100:00100000:0.0:1651532149.788458:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000262e29b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468623040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532149.788462:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.788465:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532149.788466:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.788469:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532149.788469:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.788473:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.788475:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532149.879656:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793982 is committed
00010000:00010000:0.0:1651532149.879688:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879695:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.879711:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468618688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499744us (499804us total) trans 158913793982 rc 0/0
00000100:00100000:0.0:1651532149.879714:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4637
00010000:00010000:0.0:1651532149.879721:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879724:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532149.879725:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879728:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879733:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.879734:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.879734:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879737:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879744:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879747:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4123de lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->9502719] (req 458752->9502719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879752:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879755:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879939:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879944:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.879957:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468618752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499938us (500040us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532149.879960:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4638
00010000:00010000:0.0:1651532149.879966:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879970:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532149.879971:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879974:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879978:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.879979:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532149.879980:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879983:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879990:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879992:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4123e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2072576->9842687] (req 2072576->9842687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.879997:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.880000:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.880065:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.880079:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468623424
00000100:00100000:1.0:1651532149.880092:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4664
00000100:00100000:1.0:1651532149.880093:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468623424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.880097:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.880101:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c083 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.880110:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c083 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.880114:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c083 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.880120:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532149.880136:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468623424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.880139:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4664
00000100:00100000:0.0:1651532149.880349:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.880359:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.880371:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468623616
00000100:00100000:1.0:1651532149.880389:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468623744
00000100:00100000:1.0:1651532149.880400:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4665
00000100:00100000:0.0:1651532149.880401:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4647
00000100:00100000:1.0:1651532149.880402:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468623744:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532149.880404:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036ea9a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468623616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532149.880405:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.880409:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4124cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c08a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.880411:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.880416:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4124cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c08a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.880416:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532149.880417:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.880421:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532149.880421:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.880426:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4124cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c08a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.880426:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.880429:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.880430:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532149.880441:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468623744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.880444:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4665
00000100:00100000:0.0:1651532149.880501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.880511:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468623872
00000100:00100000:1.0:1651532149.880520:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4666
00000100:00100000:1.0:1651532149.880522:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468623872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.880526:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.880529:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4124da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c091 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.880535:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4124da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c091 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.880539:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4124da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c091 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.880542:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532149.880553:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468623872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.880555:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4666
00000001:00080000:1.0:1651532149.979677:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793983 is committed
00010000:00010000:0.0:1651532149.979707:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.979712:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.979733:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.979734:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468619904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 458067us (458128us total) trans 158913793983 rc 0/0
00000100:00100000:0.0:1651532149.979737:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4639
00010000:00010000:1.0:1651532149.979738:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532149.979739:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.979743:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.979748:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.979749:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.979749:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.979753:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.979762:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.979765:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412424 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192->9449471] (req 8192->9449471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.979769:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.979774:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.980137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.980155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.980163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.980174:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.980180:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468624384
00000100:00100000:0.0:1651532149.980180:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.980192:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468624512
00000100:00100000:1.0:1651532149.980195:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468624576
00000100:00100000:1.0:1651532149.980198:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4667
00000100:00100000:0.0:1651532149.980198:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468624192
00000100:00100000:1.0:1651532149.980200:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468624384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.980203:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.980207:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4124e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c098 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.980208:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468624320
00010000:00010000:1.0:1651532149.980212:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532149.980214:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4648
00010000:00010000:1.0:1651532149.980215:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4124e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c098 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532149.980215:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67c125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468624192:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532149.980219:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4124e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c098 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.980222:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532149.980222:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.980227:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532149.980228:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.980231:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532149.980231:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.980236:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468624384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.980239:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4667
00010000:00010000:0.0:1651532149.980242:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.980244:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4668
00000100:00100000:1.0:1651532149.980246:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468624512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.980246:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980248:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.980250:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4124ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c09f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.980253:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4669
00010000:00010000:1.0:1651532149.980255:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532149.980255:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468624576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.980257:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4124ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c09f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.980258:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.980260:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4124ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c09f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.980261:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4124f6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0a6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980264:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532149.980266:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532149.980269:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468624512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (95us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532149.980269:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4124f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0a6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532149.980272:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4668
00010000:00010000:0.0:1651532149.980273:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4124f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0a6 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.980277:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:1.0:1651532149.980285:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4649
00000100:00100000:0.0:1651532149.980285:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468624576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.980286:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029ec6cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468624320:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532149.980288:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4669
00010000:00010000:1.0:1651532149.980292:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980296:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.980297:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980303:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532149.980303:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.980307:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.980310:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980314:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980318:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.980323:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468619968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458582us (458701us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532149.980325:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4640
00010000:00010000:1.0:1651532149.980329:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980333:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532149.980334:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980337:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980352:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.980353:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532149.980354:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980357:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.980380:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.980385:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980388:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980397:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412439 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [118784->9854975] (req 118784->9854975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532149.980785:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.980797:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468624832
00000100:00100000:0.0:1651532149.980797:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.980819:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.980833:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468624768
00000100:00100000:1.0:1651532149.980836:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468624896
00000100:00100000:0.0:1651532149.980836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.980839:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468625088
00000100:00100000:1.0:1651532149.980842:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4670
00000100:00100000:1.0:1651532149.980844:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468624832:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532149.980844:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4671
00000100:00100000:0.0:1651532149.980846:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af0a247b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468624768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.980847:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.980850:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.980858:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412504 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0b4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.980859:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41250b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0ad expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980868:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412504 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0b4 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.980869:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41250b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0ad expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.980872:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412504 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0b4 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.980873:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41250b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0ad expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.980876:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532149.980877:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532149.980889:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468624832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.980892:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4670
00000100:00100000:0.0:1651532149.980894:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af0a247b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468624768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.980897:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4671
00000100:00100000:1.0:1651532149.980899:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4672
00000100:00100000:1.0:1651532149.980901:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468624896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.980903:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.980906:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412512 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0bb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.980912:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412512 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0bb expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.980915:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412512 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0bb expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.980919:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532149.980923:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4673
00000100:00100000:1.0:1651532149.980924:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468624896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.980925:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468625088:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532149.980927:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4672
00010000:00010000:0.0:1651532149.980928:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532149.980931:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412519 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0c2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.980938:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412519 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0c2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.980942:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412519 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0c2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.980945:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532149.980951:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468625088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.980954:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4673
00000100:00100000:0.0:1651532149.981274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.981281:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532149.981295:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468625280
00000100:00100000:1.0:1651532149.981300:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468625408
00000100:00100000:0.0:1651532149.981305:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4674
00000100:00100000:0.0:1651532149.981307:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468625280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532149.981310:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532149.981312:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4675
00010000:00010000:0.0:1651532149.981313:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412520 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0c9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532149.981314:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468625408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.981317:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.981320:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412527 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0d0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532149.981321:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412520 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0c9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.981325:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412520 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0c9 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.981327:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412527 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0d0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532149.981331:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00010000:00010000:1.0:1651532149.981334:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412527 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0d0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.981338:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532149.981350:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468625280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532149.981353:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4674
00000100:00100000:1.0:1651532149.981356:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468625408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.981359:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4675
00000100:00100000:0.0:1651532149.981568:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532149.981585:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468625536
00000100:00100000:1.0:1651532149.981592:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4676
00000100:00100000:1.0:1651532149.981593:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468625536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532149.981596:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532149.981600:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41252e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0d7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532149.981607:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41252e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0d7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.981610:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41252e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0d7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532149.981614:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532149.981627:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468625536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532149.981629:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4676
00000001:00080000:1.0:1651532150.112996:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793984 is committed
00010000:00010000:0.0:1651532150.113027:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113031:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.113049:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468621056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499618us (499678us total) trans 158913793984 rc 0/0
00000100:00100000:0.0:1651532150.113052:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4641
00010000:00010000:0.0:1651532150.113059:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113062:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532150.113063:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113066:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113071:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.113072:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.113073:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113076:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113079:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.113080:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.113080:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113083:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113096:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113099:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412463 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->10317823] (req 1589248->10317823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113107:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113111:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113129:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113133:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.113454:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.113481:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468625728
00000100:00100000:0.0:1651532150.113489:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.113496:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.113498:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4677
00000100:00100000:1.0:1651532150.113500:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468625728:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532150.113502:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532150.113503:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.113516:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412535 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0de expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113522:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532150.113522:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468625856
00010000:00010000:1.0:1651532150.113525:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412535 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0de expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.113529:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412535 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0de expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.113532:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532150.113532:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468625792
00000100:00100000:0.0:1651532150.113541:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4650
00000100:00100000:0.0:1651532150.113543:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468625856:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532150.113551:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468625728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.113553:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4677
00010000:00010000:0.0:1651532150.113555:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.113558:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468625984
00010000:00010000:0.0:1651532150.113560:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.113561:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532150.113562:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.113566:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4678
00000100:00100000:1.0:1651532150.113567:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468625984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.113570:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.113570:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113573:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412543 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0e5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113577:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532150.113577:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4651
00000100:00100000:0.0:1651532150.113578:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468625792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532150.113579:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412543 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0e5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.113583:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412543 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0e5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.113583:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113586:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532150.113587:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532150.113588:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113590:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.113592:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468625984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (91us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532150.113593:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532150.113593:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.113595:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4678
00010000:00010000:0.0:1651532150.113598:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113601:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113604:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113608:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113612:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113615:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.113618:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.113623:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468621120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 500182us (500232us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532150.113632:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4642
00000100:00100000:0.0:1651532150.113637:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468621824:12345-10.240.43.64@tcp:3:fio.0 Request processed in 432934us (432995us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532150.113638:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.113640:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4643
00010000:00010000:1.0:1651532150.113644:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532150.113645:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113648:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113654:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113656:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41246a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->10080255] (req 1191936->10080255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113659:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113662:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532150.113663:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113666:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113669:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.113669:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.113670:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113702:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113710:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113713:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41247f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->3104767] (req 1253376->3104767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113719:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.113722:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.114074:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.114081:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.114091:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.114097:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.114102:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.114109:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468626304
00000100:00100000:0.0:1651532150.114118:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468626496
00000100:00100000:0.0:1651532150.114120:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468626560
00000100:00100000:0.0:1651532150.114123:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4679
00000100:00100000:0.0:1651532150.114125:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468626304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.114129:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.114133:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412551 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0ec expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.114141:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412551 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0ec expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532150.114142:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468626240
00010000:00010000:0.0:1651532150.114145:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412551 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0ec expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.114148:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532150.114156:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468626176
00000100:00100000:1.0:1651532150.114162:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4652
00000100:00100000:1.0:1651532150.114165:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468626240:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532150.114165:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468626304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.114168:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4679
00010000:00010000:1.0:1651532150.114171:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.114173:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4680
00000100:00100000:0.0:1651532150.114174:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468626496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.114176:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532150.114177:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.114177:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.114180:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532150.114180:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41255f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0f3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.114181:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.114186:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.114186:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41255f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0f3 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.114189:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.114190:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41255f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0f3 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532150.114196:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4653
00010000:00010000:0.0:1651532150.114196:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:1.0:1651532150.114198:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009059a7df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468626176:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532150.114201:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468626496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (104us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532150.114202:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.114204:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4680
00010000:00010000:1.0:1651532150.114205:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532150.114206:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532150.114207:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.114207:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4681
00010000:00010000:1.0:1651532150.114209:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.114209:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468626560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.114211:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.114213:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41256d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c0fa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.114218:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41256d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0fa expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.114221:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41256d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c0fa expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.114224:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532150.114229:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468626560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 19us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.114231:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4681
00000100:00100000:0.0:1651532150.114575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.114589:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.114594:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468626688
00000100:00100000:0.0:1651532150.114596:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468626880
00000100:00100000:1.0:1651532150.114606:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4682
00000100:00100000:1.0:1651532150.114612:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468626688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.114615:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532150.114615:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4683
00000100:00100000:0.0:1651532150.114616:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468626880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.114618:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412574 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c101 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.114620:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.114624:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41257b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c108 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.114628:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412574 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c101 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.114631:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41257b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c108 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.114632:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412574 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c101 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.114635:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41257b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c108 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.114636:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532150.114638:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532150.114650:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468626688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.114652:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4682
00000100:00100000:0.0:1651532150.114655:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468626880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.114657:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4683
00000001:00080000:1.0:1651532150.238035:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793985 is committed
00010000:00010000:1.0:1651532150.238051:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.238055:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.238076:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098606df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468621696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557348us (557421us total) trans 158913793985 rc 0/0
00000100:00100000:1.0:1651532150.238079:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4644
00010000:00010000:0.0:1651532150.238079:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.238083:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532150.238085:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.238088:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.238093:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.238094:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.238095:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.238101:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.238108:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.238111:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41248d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->8081407] (req 565248->8081407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.238116:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.238128:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.238433:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.238445:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468627200
00010000:00010000:1.0:1651532150.238452:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.238454:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4684
00000100:00100000:0.0:1651532150.238455:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468627200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.238457:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.238459:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.238462:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412582 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c10f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.238475:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468623104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 450050us (450084us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532150.238478:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4645
00010000:00010000:0.0:1651532150.238478:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.238481:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412582 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c10f expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.238485:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412582 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c10f expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.238488:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532150.238489:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.238492:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532150.238494:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.238496:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.238497:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468627200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (64us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532150.238501:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532150.238501:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4684
00010000:00010000:1.0:1651532150.238502:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.238503:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.238506:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.238518:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.238521:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4124b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [577536->10092543] (req 577536->10092543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.238529:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.238532:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.238960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.238970:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.238979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.238987:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.238995:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468627456
00000100:00100000:0.0:1651532150.239004:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468627648
00000100:00100000:0.0:1651532150.239010:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4685
00000100:00100000:0.0:1651532150.239012:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468627456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.239015:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.239019:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412589 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c116 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.239026:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412589 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c116 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.239030:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412589 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c116 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.239033:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532150.239043:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468627456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.239046:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4685
00000100:00100000:0.0:1651532150.239050:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4686
00000100:00100000:0.0:1651532150.239051:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468627648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.239055:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.239057:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412590 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c11d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.239062:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412590 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c11d expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.239066:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412590 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c11d expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.239069:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532150.239074:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468627648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.239076:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4686
00000100:00100000:1.0:1651532150.239085:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468627328
00000100:00100000:1.0:1651532150.239095:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468627264
00000100:00100000:1.0:1651532150.239101:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4654
00000100:00100000:1.0:1651532150.239103:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2ac1480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468627328:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532150.239111:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4655
00000100:00100000:0.0:1651532150.239113:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028f69b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468627264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532150.239119:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.239120:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.239123:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532150.239124:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.239127:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532150.239128:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.239132:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532150.239133:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.239137:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.239139:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532150.239140:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.239144:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.239145:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.239148:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.239148:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.239151:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.239336:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.239355:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468627840
00000100:00100000:0.0:1651532150.239366:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4687
00000100:00100000:0.0:1651532150.239367:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468627840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.239371:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.239374:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4125a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c124 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.239381:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4125a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c124 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.239385:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4125a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c124 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.239388:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532150.239398:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468627840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.239403:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4687
00000001:00080000:1.0:1651532150.329686:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793986 is committed
00010000:00010000:1.0:1651532150.329702:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.329706:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.329723:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000262e29b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468623040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541264us (541321us total) trans 158913793986 rc 0/0
00000100:00100000:1.0:1651532150.329726:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4646
00010000:00010000:1.0:1651532150.329732:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.329736:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532150.329737:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.329740:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.329744:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.329745:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.329746:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.329749:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.329762:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.329765:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4124be lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2347008->10297343] (req 2347008->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.329774:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.329779:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.330180:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.330188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.330215:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468628096
00000100:00100000:0.0:1651532150.330220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.330228:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.330232:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468628224
00000100:00100000:1.0:1651532150.330235:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468628288
00000100:00100000:1.0:1651532150.330237:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468628416
00000100:00100000:1.0:1651532150.330241:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4688
00000100:00100000:1.0:1651532150.330242:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468628096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532150.330245:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4689
00010000:00010000:1.0:1651532150.330246:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532150.330247:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468628224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.330250:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c12b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.330252:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.330256:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4125b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c132 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.330258:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c12b expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.330263:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c12b expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.330264:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4125b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c132 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.330266:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532150.330268:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4125b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c132 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.330271:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:1.0:1651532150.330277:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468628096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.330280:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4688
00000100:00100000:0.0:1651532150.330280:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468628224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.330284:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4689
00000100:00100000:1.0:1651532150.330286:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4690
00000100:00100000:1.0:1651532150.330288:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468628288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.330290:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532150.330290:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4691
00010000:00010000:1.0:1651532150.330292:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125ba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c139 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.330292:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468628416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.330294:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.330296:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4125c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c140 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.330298:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c139 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.330302:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c139 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.330302:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4125c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c140 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.330305:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532150.330306:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4125c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c140 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.330309:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:1.0:1651532150.330311:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468628288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.330313:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4690
00000100:00100000:0.0:1651532150.330314:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468628416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.330316:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4691
00000100:00100000:0.0:1651532150.330684:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.330691:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468628736
00000100:00100000:0.0:1651532150.330698:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4692
00000100:00100000:0.0:1651532150.330700:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468628736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.330703:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.330706:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4125c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c147 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.330715:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4125c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c147 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.330719:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4125c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c147 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.330723:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532150.330753:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468628736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.330756:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4692
00000100:00100000:1.0:1651532150.330785:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.330831:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468628928
00000100:00100000:0.0:1651532150.330839:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4693
00000100:00100000:0.0:1651532150.330841:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468628928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.330844:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.330847:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4125cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c14e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.330854:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4125cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c14e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.330858:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4125cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c14e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.330861:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532150.330870:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468628928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.330873:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4693
00000001:00080000:1.0:1651532150.429725:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793987 is committed
00010000:00010000:0.0:1651532150.429755:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.429759:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.429781:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036ea9a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468623616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549377us (549443us total) trans 158913793987 rc 0/0
00000100:00100000:0.0:1651532150.429784:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4647
00010000:00010000:0.0:1651532150.429791:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.429795:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532150.429796:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.429799:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.429814:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.429815:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.429815:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.429818:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.429829:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.429832:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4124d3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->4734975] (req 94208->4734975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.429837:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.429840:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.430215:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.430224:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.430235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.430243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.430244:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468629184
00000100:00100000:1.0:1651532150.430256:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468629120
00000100:00100000:1.0:1651532150.430262:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4656
00000100:00100000:1.0:1651532150.430264:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468629184:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532150.430271:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.430278:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532150.430279:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.430282:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532150.430283:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.430287:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.430291:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.430298:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4657
00000100:00100000:1.0:1651532150.430300:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468629120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532150.430304:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.430304:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468629312
00010000:00010000:1.0:1651532150.430307:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532150.430308:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.430311:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532150.430311:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.430312:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468629504
00010000:00010000:1.0:1651532150.430315:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.430320:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4694
00000100:00100000:0.0:1651532150.430322:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468629312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.430325:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.430326:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.430330:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4125e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c155 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.430333:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4695
00000100:00100000:1.0:1651532150.430335:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468629504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.430337:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4125e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c155 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.430338:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.430354:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4125e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c155 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.430357:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532150.430367:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4125eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c15c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.430376:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4125eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c15c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532150.430383:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468629312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (148us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532150.430386:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4125eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c15c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532150.430386:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4694
00010000:00010000:1.0:1651532150.430390:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532150.430399:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468629504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (156us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.430402:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4695
00000100:00100000:0.0:1651532150.430630:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.430650:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468629696
00000100:00100000:1.0:1651532150.430661:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4696
00000100:00100000:1.0:1651532150.430663:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468629696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.430666:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.430669:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4125f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c163 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.430676:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4125f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c163 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.430681:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4125f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c163 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.430684:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532150.430694:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468629696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.430696:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4696
00000100:00100000:1.0:1651532150.460861:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b823d8ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4117a37c-db10-4766-b60a-8aa6e5558d6b:39028:1731745966863744:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532150.461127:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b823d8ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4117a37c-db10-4766-b60a-8aa6e5558d6b:39028:1731745966863744:10.240.43.61@tcp:400:kworker/u4:2.0
00000001:00080000:1.0:1651532150.546422:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793988 is committed
00010000:00010000:0.0:1651532150.546453:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546458:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.546480:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67c125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468624192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566264us (566343us total) trans 158913793988 rc 0/0
00010000:00010000:1.0:1651532150.546481:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.546483:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4648
00010000:00010000:1.0:1651532150.546486:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532150.546487:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546491:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546496:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.546497:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.546498:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546501:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546504:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.546505:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.546506:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546508:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546519:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546528:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546529:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4124e8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [503808->9093119] (req 503808->9093119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546533:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546536:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546538:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.546834:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.546845:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468629824
00000100:00100000:0.0:1651532150.546845:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.546857:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468629888
00000100:00100000:1.0:1651532150.546870:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4697
00000100:00100000:1.0:1651532150.546872:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468629824:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532150.546873:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4698
00000100:00100000:0.0:1651532150.546875:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468629888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.546876:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.546879:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.546880:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4125f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c16a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546885:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.546888:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4125f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c16a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.546892:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4125f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c16a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.546892:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412600 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c171 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546895:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532150.546898:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.546901:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412600 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c171 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532150.546906:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468629824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (73us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532150.546906:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412600 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c171 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532150.546909:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4697
00010000:00010000:0.0:1651532150.546909:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532150.546918:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468629888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (73us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532150.546920:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.546921:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4698
00010000:00010000:1.0:1651532150.546924:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.546935:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029ec6cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468624320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566648us (566780us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532150.546935:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.546938:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4649
00010000:00010000:0.0:1651532150.546938:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546945:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546951:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532150.546951:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468625856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433407us (433462us total) trans 0 rc 40960/40960
00010000:00010000:1.0:1651532150.546952:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.546953:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4650
00010000:00010000:1.0:1651532150.546955:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546959:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546959:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.546962:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4124fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3792896->5816319] (req 3792896->5816319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546965:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532150.546966:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546969:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546974:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.546975:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.546975:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546978:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546985:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546990:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41253c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->9342975] (req 737280->9342975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.546998:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.547003:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.547482:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.547496:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.547501:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468630144
00000100:00100000:0.0:1651532150.547503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.547512:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.547522:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468630272
00000100:00100000:0.0:1651532150.547527:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.547528:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4699
00000100:00100000:1.0:1651532150.547530:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468630144:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532150.547533:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532150.547534:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.547537:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412607 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c178 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.547540:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468630016
00010000:00010000:1.0:1651532150.547545:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412607 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c178 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.547549:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412607 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c178 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532150.547550:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468630080
00010000:00010000:1.0:1651532150.547555:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532150.547560:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4658
00000100:00100000:0.0:1651532150.547562:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468630016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532150.547570:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.547571:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468630144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.547574:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4699
00010000:00010000:0.0:1651532150.547575:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532150.547576:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.547579:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468630336
00010000:00010000:0.0:1651532150.547579:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532150.547579:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.547582:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468630400
00010000:00010000:0.0:1651532150.547584:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.547585:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4700
00000100:00100000:1.0:1651532150.547586:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468630272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.547587:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.547589:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.547592:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412615 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c17f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.547595:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4701
00000100:00100000:0.0:1651532150.547596:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468630336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.547598:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412615 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c17f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.547600:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.547601:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412615 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c17f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.547603:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41261c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c186 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.547605:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532150.547610:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468630272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (98us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532150.547610:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41261c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c186 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532150.547612:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4700
00010000:00010000:0.0:1651532150.547614:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41261c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c186 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532150.547616:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4702
00000100:00100000:1.0:1651532150.547618:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468630400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.547618:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532150.547626:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468630336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.547629:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4701
00010000:00010000:1.0:1651532150.547631:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.547634:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412623 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c18d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.547638:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4659
00000100:00100000:0.0:1651532150.547639:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468630080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532150.547640:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412623 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c18d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.547644:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412623 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c18d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.547644:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.547647:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532150.547648:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532150.547649:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.547652:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532150.547652:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.547653:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468630400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.547656:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4702
00010000:00010000:0.0:1651532150.547658:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.547662:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.547924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.547943:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468630592
00000100:00100000:1.0:1651532150.547951:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4703
00000100:00100000:1.0:1651532150.547953:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468630592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.547956:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.547959:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412631 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c194 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.547966:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412631 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c194 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.547970:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412631 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c194 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.547984:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532150.547995:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468630592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.547998:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4703
00000100:00100000:0.0:1651532150.548046:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.548056:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468630784
00000100:00100000:1.0:1651532150.548063:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4704
00000100:00100000:1.0:1651532150.548065:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468630784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.548068:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.548071:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412638 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c19b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.548078:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412638 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c19b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.548082:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412638 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c19b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.548086:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532150.548094:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468630784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.548097:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4704
00000100:00100000:0.0:1651532150.548246:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.548264:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468630976
00000100:00100000:1.0:1651532150.548271:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4705
00000100:00100000:1.0:1651532150.548273:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468630976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.548277:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.548280:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41263f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1a2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.548287:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41263f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1a2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.548291:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41263f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1a2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.548294:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532150.548303:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468630976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.548305:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4705
00000001:00080000:1.0:1651532150.604801:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793989 is committed
00010000:00010000:0.0:1651532150.604840:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.604845:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.604867:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468625792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491287us (491370us total) trans 158913793989 rc 0/0
00010000:00010000:1.0:1651532150.604868:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.604870:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4651
00010000:00010000:1.0:1651532150.604873:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532150.604874:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604877:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604883:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.604884:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.604885:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604888:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604891:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.604891:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.604892:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604895:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604902:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604905:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41254a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7147519] (req 1204224->7147519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.604909:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.604915:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604918:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604921:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604942:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604945:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.604965:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468626240:12345-10.240.43.64@tcp:3:fio.0 Request processed in 490800us (490892us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532150.604969:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4652
00010000:00010000:1.0:1651532150.604982:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604986:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532150.604987:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604990:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604995:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.604998:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412558 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6053888->6057983] (req 6053888->6057983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.605187:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.605198:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468631232
00000100:00100000:0.0:1651532150.605198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.605205:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468631296
00000100:00100000:1.0:1651532150.605209:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4660
00000100:00100000:1.0:1651532150.605211:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073eec7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468631232:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532150.605220:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4661
00000100:00100000:0.0:1651532150.605222:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468631296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532150.605223:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.605227:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532150.605228:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.605229:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.605231:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532150.605232:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.605237:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532150.605239:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.605242:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532150.605242:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.605246:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.605248:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.605250:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.605285:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.605366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.605381:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.605391:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468631424
00000100:00100000:0.0:1651532150.605393:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468631552
00000100:00100000:1.0:1651532150.605411:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4706
00000100:00100000:1.0:1651532150.605413:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468631552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.605416:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.605419:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412654 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1b0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.605419:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4707
00000100:00100000:0.0:1651532150.605421:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468631424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.605425:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.605427:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412654 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1b0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.605429:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41265b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1a9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.605431:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412654 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1b0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.605434:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:0.0:1651532150.605437:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41265b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1a9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.605442:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41265b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1a9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532150.605447:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468631552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.605450:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4706
00010000:00010000:0.0:1651532150.605452:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:0.0:1651532150.605462:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468631424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.605464:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4707
00000100:00100000:0.0:1651532150.605724:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.605731:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468631808
00000100:00100000:0.0:1651532150.605747:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4708
00000100:00100000:0.0:1651532150.605748:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468631808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.605752:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.605756:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412662 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1b7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.605763:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412662 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1b7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.605767:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412662 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1b7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.605771:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532150.605781:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468631808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.605785:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4708
00000100:00100000:0.0:1651532150.606016:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.606023:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468631936
00000100:00100000:0.0:1651532150.606038:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4709
00000100:00100000:0.0:1651532150.606040:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468631936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.606043:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.606047:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412669 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1be expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.606054:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412669 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1be expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.606058:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412669 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1be expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.606061:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532150.606071:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468631936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.606074:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4709
00000001:00080000:1.0:1651532150.696477:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793990 is committed
00010000:00010000:0.0:1651532150.696508:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.696512:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696534:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.696534:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009059a7df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468626176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582335us (582452us total) trans 158913793990 rc 0/0
00000100:00100000:0.0:1651532150.696538:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4653
00010000:00010000:1.0:1651532150.696539:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532150.696540:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696543:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696549:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.696549:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.696550:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696553:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696560:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696564:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412566 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->3850239] (req 2654208->3850239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696569:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696582:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.696840:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.696848:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.696859:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468632128
00000100:00100000:1.0:1651532150.696870:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468632064
00000100:00100000:1.0:1651532150.696880:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4662
00000100:00100000:1.0:1651532150.696881:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468632128:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532150.696886:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532150.696888:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696892:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.696893:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532150.696894:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696897:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.696910:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4663
00000100:00100000:1.0:1651532150.696912:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468632064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532150.696916:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.696918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532150.696920:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532150.696921:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.696936:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468632192
00010000:00010000:1.0:1651532150.696939:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.696942:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532150.696942:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.696946:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468632256
00000100:00100000:0.0:1651532150.696953:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4710
00010000:00010000:1.0:1651532150.696955:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.696955:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468632192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.696959:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.696959:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.696962:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.696962:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41267e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1c5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.696968:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532150.696969:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4711
00000100:00100000:1.0:1651532150.696971:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468632256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.696971:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41267e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1c5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.696973:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.696975:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41267e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1c5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.696976:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412685 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1cc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.696979:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00010000:00010000:1.0:1651532150.696981:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.696984:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412685 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1cc expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532150.696989:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468632192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (127us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532150.696990:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412685 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1cc expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532150.696992:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4710
00010000:00010000:1.0:1651532150.696994:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532150.697002:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468632256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.697005:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4711
00010000:00010000:1.0:1651532150.697018:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.697022:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697035:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697042:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532150.697043:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.697048:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2ac1480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468627328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 457944us (458088us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532150.697051:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4654
00010000:00010000:0.0:1651532150.697054:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697060:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.697060:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.697061:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697064:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697071:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697074:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412597 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->10223615] (req 1208320->10223615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697080:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697083:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.697378:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.697387:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468632512
00000100:00100000:0.0:1651532150.697399:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4712
00000100:00100000:0.0:1651532150.697401:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468632512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.697407:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.697427:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41268c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1d3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697437:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41268c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1d3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.697441:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41268c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1d3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.697445:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532150.697471:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468632512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 69us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.697475:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4712
00000100:00100000:0.0:1651532150.697505:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.697538:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468632640
00000100:00100000:0.0:1651532150.697551:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4713
00000100:00100000:0.0:1651532150.697553:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468632640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.697557:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.697560:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412693 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1da expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697568:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412693 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1da expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.697575:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412693 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1da expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.697578:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:0.0:1651532150.697588:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468632640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.697591:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4713
00000100:00100000:0.0:1651532150.697739:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.697746:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468632768
00000100:00100000:0.0:1651532150.697759:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4714
00000100:00100000:0.0:1651532150.697760:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468632768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.697764:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.697768:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41269a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1e1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697775:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41269a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1e1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.697779:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41269a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1e1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.697782:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532150.697792:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468632768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.697796:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4714
00000100:00100000:0.0:1651532150.697872:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.697879:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468632896
00000100:00100000:0.0:1651532150.697892:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4715
00000100:00100000:0.0:1651532150.697893:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468632896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.697897:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.697900:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1e8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.697907:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1e8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.697912:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1e8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.697915:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532150.697924:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468632896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.697927:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4715
00000001:00080000:1.0:1651532150.763256:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793991 is committed
00010000:00010000:0.0:1651532150.763286:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763291:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.763307:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028f69b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468627264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524193us (524336us total) trans 158913793991 rc 0/0
00000100:00100000:0.0:1651532150.763311:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4655
00010000:00010000:0.0:1651532150.763317:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763321:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532150.763322:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763325:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763330:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.763330:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.763331:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763334:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763363:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763366:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41259e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->10485759] (req 1523712->10485759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763375:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763380:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.763722:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.763732:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.763745:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.763752:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.763760:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468633152
00000100:00100000:0.0:1651532150.763769:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468633088
00000100:00100000:1.0:1651532150.763783:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4664
00000100:00100000:1.0:1651532150.763786:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468633152:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532150.763789:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4665
00000100:00100000:0.0:1651532150.763791:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468633088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532150.763798:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763816:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763816:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532150.763817:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763820:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532150.763821:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763825:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.763827:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763830:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532150.763831:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763835:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763836:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763839:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763840:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.763849:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468633216
00000100:00100000:0.0:1651532150.763849:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468633280
00000100:00100000:1.0:1651532150.763857:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4716
00000100:00100000:1.0:1651532150.763859:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468633216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532150.763860:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4717
00000100:00100000:0.0:1651532150.763861:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468633280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.763863:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.763864:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.763866:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4126b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1ef expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763867:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4126bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1f6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763871:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.763872:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.763876:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4126b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1ef expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.763876:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4126bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1f6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.763880:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4126bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1f6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.763884:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:1.0:1651532150.763892:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4126b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1ef expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532150.763893:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468633280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (141us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532150.763895:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532150.763896:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4717
00000100:00100000:1.0:1651532150.763906:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468633216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (161us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.763910:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4716
00010000:00010000:1.0:1651532150.763924:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763928:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763939:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763944:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532150.763945:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763949:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.763956:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468629184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 333691us (333742us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532150.763959:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4656
00010000:00010000:0.0:1651532150.763962:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.763963:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.763963:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763967:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763977:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763980:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.763980:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4125d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1077248->9486335] (req 1077248->9486335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.763984:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.764431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.764438:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.764450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.764457:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468633600
00000100:00100000:0.0:1651532150.764457:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468633664
00000100:00100000:0.0:1651532150.764464:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468633920
00000100:00100000:1.0:1651532150.764466:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4718
00000100:00100000:1.0:1651532150.764468:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468633664:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532150.764469:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4719
00000100:00100000:0.0:1651532150.764471:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800abcef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468633600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.764473:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.764474:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.764477:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4126c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c204 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.764478:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4126cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c1fd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.764487:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4126c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c204 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.764487:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4126cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1fd expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.764491:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4126c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c204 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.764491:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4126cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c1fd expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.764495:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532150.764495:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532150.764505:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468633664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.764505:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800abcef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468633600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.764507:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4719
00000100:00100000:1.0:1651532150.764509:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4718
00000100:00100000:1.0:1651532150.764515:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4720
00000100:00100000:1.0:1651532150.764516:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468633920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.764519:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.764521:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4126d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c20b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.764526:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4126d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c20b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.764530:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4126d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c20b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.764536:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532150.764541:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468633920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.764544:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4720
00000100:00100000:0.0:1651532150.764845:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.764860:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.764867:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468634048
00000100:00100000:0.0:1651532150.764868:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468634176
00000100:00100000:1.0:1651532150.764878:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4721
00000100:00100000:1.0:1651532150.764880:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468634048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.764883:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532150.764884:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4722
00010000:00010000:1.0:1651532150.764886:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c212 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.764886:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468634176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.764890:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.764893:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c212 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.764894:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4126e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c219 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.764897:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c212 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.764901:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532150.764901:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4126e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c219 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.764905:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4126e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c219 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.764909:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532150.764913:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468634048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.764915:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4721
00000100:00100000:0.0:1651532150.764923:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468634176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.764926:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4722
00000100:00100000:0.0:1651532150.765154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.765162:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468634368
00000100:00100000:0.0:1651532150.765169:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4723
00000100:00100000:0.0:1651532150.765170:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468634368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.765174:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.765177:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4126e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c220 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.765184:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4126e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c220 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.765192:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4126e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c220 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.765195:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532150.765204:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468634368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.765207:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4723
00000001:00080000:1.0:1651532150.821653:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793992 is committed
00010000:00010000:1.0:1651532150.821669:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.821684:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.821706:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468629120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 391405us (391482us total) trans 158913793992 rc 0/0
00000100:00100000:1.0:1651532150.821709:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4657
00010000:00010000:0.0:1651532150.821709:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.821713:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532150.821715:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.821718:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.821724:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.821724:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.821725:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.821728:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.821737:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.821746:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.821746:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4125dd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->8560639] (req 761856->8560639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.821758:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.822170:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.822185:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.822192:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.822204:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.822212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.822221:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.822221:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468634752
00000100:00100000:0.0:1651532150.822228:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468634816
00000100:00100000:0.0:1651532150.822231:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468634880
00000100:00100000:0.0:1651532150.822233:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468635008
00000100:00100000:0.0:1651532150.822236:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4724
00000100:00100000:0.0:1651532150.822238:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468634752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.822241:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.822245:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4126ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c227 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.822252:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4126ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c227 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.822256:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4126ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c227 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.822260:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532150.822270:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468634752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.822273:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4724
00000100:00100000:0.0:1651532150.822278:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4725
00000100:00100000:0.0:1651532150.822279:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468634816:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532150.822281:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468634624
00010000:00010000:0.0:1651532150.822283:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.822285:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4126f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c22e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.822291:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4126f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c22e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532150.822295:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468634560
00000100:00100000:1.0:1651532150.822303:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4666
00000100:00100000:1.0:1651532150.822305:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468634624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532150.822307:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4126f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c22e expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.822310:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532150.822312:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.822317:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532150.822317:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468634816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.822319:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4725
00000100:00100000:0.0:1651532150.822323:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4726
00000100:00100000:0.0:1651532150.822325:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468634880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.822326:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532150.822326:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.822327:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.822338:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412703 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c235 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.822355:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.822355:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412703 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c235 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.822360:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412703 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c235 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532150.822364:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4667
00010000:00010000:0.0:1651532150.822365:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532150.822366:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468634560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532150.822372:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.822372:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468634880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (160us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.822375:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4726
00010000:00010000:1.0:1651532150.822376:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532150.822377:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.822379:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.822380:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4727
00000100:00100000:0.0:1651532150.822381:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468635008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.822382:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532150.822382:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.822384:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.822386:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412711 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c23c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.822387:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.822390:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.822392:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412711 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c23c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.822393:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.822395:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412711 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c23c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.822398:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532150.822403:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468635008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (182us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532150.822405:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4727
00000001:00080000:1.0:1651532150.929977:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793993 is committed
00010000:00010000:1.0:1651532150.929991:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.929995:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.930018:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468630016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 382455us (382522us total) trans 158913793993 rc 0/0
00010000:00010000:0.0:1651532150.930018:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.930022:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4658
00010000:00010000:0.0:1651532150.930023:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532150.930025:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930028:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930033:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.930034:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532150.930035:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930038:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930047:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930052:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41260e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1589248->8777727] (req 1589248->8777727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930055:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930067:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.930316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.930327:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468635392
00010000:00010000:1.0:1651532150.930334:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.930349:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4728
00000100:00100000:0.0:1651532150.930351:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468635392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532150.930355:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930355:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.930359:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412718 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c243 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930371:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532150.930374:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468630080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 382734us (382871us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532150.930377:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4659
00010000:00010000:0.0:1651532150.930378:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412718 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c243 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.930383:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412718 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c243 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.930386:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:1.0:1651532150.930389:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930392:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532150.930394:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.930395:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468635392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (80us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532150.930396:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.930398:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4728
00010000:00010000:1.0:1651532150.930402:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.930402:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532150.930403:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930406:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930413:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930416:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41262a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->6094847] (req 188416->6094847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930421:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930424:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.930830:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.930844:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.930858:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468635712
00000100:00100000:1.0:1651532150.930860:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532150.930871:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532150.930879:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468635648
00000100:00100000:0.0:1651532150.930886:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4668
00000100:00100000:1.0:1651532150.930888:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4669
00000100:00100000:0.0:1651532150.930888:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468635712:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532150.930891:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468635648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532150.930895:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930899:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532150.930900:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930901:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930903:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532150.930904:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930908:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532150.930909:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930913:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532150.930914:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930917:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930919:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930921:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532150.930922:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532150.930929:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468635776
00000100:00100000:1.0:1651532150.930931:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468635904
00000100:00100000:0.0:1651532150.930938:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4729
00000100:00100000:0.0:1651532150.930940:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468635776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.930943:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532150.930945:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41272d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c24a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532150.930947:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4730
00000100:00100000:1.0:1651532150.930949:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468635904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532150.930952:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41272d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c24a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.930953:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532150.930956:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412734 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c251 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532150.930956:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41272d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c24a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532150.930959:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532150.930964:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412734 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c251 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532150.930969:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412734 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c251 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532150.930971:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468635776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (111us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532150.930972:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532150.930973:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4729
00000100:00100000:1.0:1651532150.930982:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468635904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532150.930985:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4730
00000100:00100000:1.0:1651532151.008111:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532151.008137:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232832
00000100:00100000:0.0:1651532151.008149:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 66
00000100:00100000:0.0:1651532151.008151:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232832:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532151.008157:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 630784 granted 351240768 pending 200704 free 81138851840 avail 76965560320
00000100:00100000:0.0:1651532151.008170:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232832:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 19us (60us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532151.008173:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 66
00000001:00080000:1.0:1651532151.096656:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793994 is committed
00010000:00010000:1.0:1651532151.096672:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.096677:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.096701:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073eec7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468631232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491489us (491514us total) trans 158913793994 rc 0/0
00010000:00010000:0.0:1651532151.096703:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.096705:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4660
00010000:00010000:0.0:1651532151.096708:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.096709:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.096712:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.096718:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.096719:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.096720:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.096723:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.096727:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.096728:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.096729:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.096734:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.096751:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.096754:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412646 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->9105407] (req 3248128->9105407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.096761:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.096761:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.096764:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.096768:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.097126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.097134:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.097140:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.097160:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468636224
00010000:00010000:0.0:1651532151.097166:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.097171:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468636288
00000100:00100000:1.0:1651532151.097173:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468636352
00010000:00010000:0.0:1651532151.097176:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.097177:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4731
00000100:00100000:1.0:1651532151.097178:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468636224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.097182:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.097186:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41273b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c258 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097192:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532151.097193:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468631296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491971us (491995us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532151.097195:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41273b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c258 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532151.097197:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4661
00010000:00010000:1.0:1651532151.097200:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41273b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c258 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.097203:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532151.097204:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.097207:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.097208:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.097211:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.097212:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468636224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.097214:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4731
00010000:00010000:0.0:1651532151.097217:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.097219:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4732
00000100:00100000:1.0:1651532151.097221:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468636288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.097223:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41264d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3211264->9568255] (req 3211264->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097224:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.097226:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412742 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c25f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097230:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532151.097230:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4733
00010000:00010000:1.0:1651532151.097232:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412742 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c25f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532151.097232:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468636352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.097235:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412742 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c25f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.097235:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.097238:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412749 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c266 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097239:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532151.097243:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468636288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (109us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532151.097244:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532151.097246:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4732
00010000:00010000:0.0:1651532151.097246:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412749 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c266 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.097250:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412749 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c266 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.097253:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532151.097257:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.097260:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468636352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (120us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532151.097261:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.097263:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4733
00000100:00100000:1.0:1651532151.097272:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468632128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 400390us (400433us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532151.097275:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4662
00010000:00010000:1.0:1651532151.097281:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097284:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532151.097285:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097288:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097293:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532151.097293:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532151.097294:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097297:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.097316:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.097320:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097327:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097330:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412670 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1175552->9215999] (req 1175552->9215999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.097686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.097719:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.097730:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.097738:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468636544
00000100:00100000:1.0:1651532151.097739:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.097748:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.097757:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468636480
00000100:00100000:1.0:1651532151.097767:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4670
00000100:00100000:1.0:1651532151.097770:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468636544:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532151.097770:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4671
00000100:00100000:0.0:1651532151.097772:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000782e634b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468636480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532151.097780:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097785:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.097785:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532151.097786:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.097789:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532151.097789:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097793:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.097794:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097797:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532151.097798:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.097802:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097816:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.097818:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097820:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.097825:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468636608
00000100:00100000:1.0:1651532151.097828:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468636672
00000100:00100000:0.0:1651532151.097834:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468636800
00000100:00100000:0.0:1651532151.097837:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4734
00000100:00100000:0.0:1651532151.097839:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468636608:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532151.097842:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4735
00010000:00010000:0.0:1651532151.097842:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532151.097844:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468636800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.097845:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41275e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c26d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.097847:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.097850:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412765 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c27b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.097853:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41275e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c26d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.097857:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412765 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c27b expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.097857:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41275e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c26d expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.097860:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00010000:00010000:1.0:1651532151.097861:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412765 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c27b expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532151.097872:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468636608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (141us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532151.097873:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532151.097874:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4734
00000100:00100000:0.0:1651532151.097879:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4736
00000100:00100000:0.0:1651532151.097881:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468636672:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532151.097883:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468636800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (135us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532151.097883:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.097885:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41276c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c274 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.097886:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4735
00010000:00010000:0.0:1651532151.097891:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41276c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c274 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.097895:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41276c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c274 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.097898:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532151.097904:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468636672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (165us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.097907:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4736
00000100:00100000:1.0:1651532151.098156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.098168:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468637120
00000100:00100000:0.0:1651532151.098177:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4737
00000100:00100000:0.0:1651532151.098179:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468637120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.098184:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.098205:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412773 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c282 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.098213:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412773 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c282 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.098217:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412773 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c282 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.098220:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532151.098234:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468637120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.098237:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4737
00000100:00100000:1.0:1651532151.098255:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.098300:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468637312
00000100:00100000:0.0:1651532151.098310:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4738
00000100:00100000:0.0:1651532151.098312:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468637312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.098315:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.098318:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41277a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c289 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.098325:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41277a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c289 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.098329:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41277a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c289 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.098333:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532151.098353:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468637312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.098356:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4738
00000100:00100000:0.0:1651532151.098510:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.098518:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468637440
00000100:00100000:0.0:1651532151.098525:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4739
00000100:00100000:0.0:1651532151.098527:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468637440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.098530:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.098534:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412781 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c290 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.098541:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412781 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c290 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.098545:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412781 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c290 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.098548:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532151.098564:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468637440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.098569:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4739
00000100:00100000:0.0:1651532151.098844:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.098852:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468637696
00000100:00100000:0.0:1651532151.098859:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4740
00000100:00100000:0.0:1651532151.098860:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468637696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.098864:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.098867:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412788 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c297 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.098875:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412788 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c297 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.098879:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412788 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c297 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.098882:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532151.098898:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468637696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.098900:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4740
00000100:00100000:0.0:1651532151.099097:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.099105:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468637888
00000100:00100000:0.0:1651532151.099112:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4741
00000100:00100000:0.0:1651532151.099113:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468637888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.099117:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.099120:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41278f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c29e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.099127:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41278f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c29e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.099131:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41278f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c29e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.099134:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532151.099150:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468637888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.099153:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4741
00000001:00080000:1.0:1651532151.229932:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793995 is committed
00010000:00010000:0.0:1651532151.229963:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.229968:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.229984:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468632064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 533072us (533135us total) trans 158913793995 rc 0/0
00000100:00100000:0.0:1651532151.229988:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4663
00010000:00010000:0.0:1651532151.229994:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.229997:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.229999:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.230004:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.230010:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.230010:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.230011:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.230014:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.230021:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.230024:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412677 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1282048->9662463] (req 1282048->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.230029:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.230032:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.230354:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.230363:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.230371:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.230406:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468638080
00000100:00100000:0.0:1651532151.230412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.230419:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468638016
00000100:00100000:0.0:1651532151.230422:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4672
00000100:00100000:0.0:1651532151.230424:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468638080:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532151.230427:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4673
00000100:00100000:1.0:1651532151.230429:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468638016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532151.230433:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.230437:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.230438:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532151.230439:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532151.230439:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.230444:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.230445:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.230448:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.230451:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532151.230451:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.230455:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.230456:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.230462:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.230462:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468638144
00010000:00010000:1.0:1651532151.230466:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.230472:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468638208
00000100:00100000:0.0:1651532151.230476:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4742
00000100:00100000:0.0:1651532151.230478:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468638144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.230481:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532151.230483:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4743
00010000:00010000:0.0:1651532151.230483:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4127a4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2a5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.230485:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468638208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.230488:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.230490:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4127a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2a5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.230491:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4127ab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2ac expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.230494:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4127a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2a5 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.230498:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:1.0:1651532151.230499:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4127ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2ac expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.230503:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4127ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2ac expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.230507:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532151.230511:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468638144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.230514:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4742
00000100:00100000:1.0:1651532151.230522:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468638208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (121us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.230525:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4743
00000001:00080000:1.0:1651532151.346661:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793996 is committed
00010000:00010000:0.0:1651532151.346691:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346696:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.346713:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468633088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582922us (582981us total) trans 158913793996 rc 0/0
00000100:00100000:0.0:1651532151.346716:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4665
00010000:00010000:0.0:1651532151.346722:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346726:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.346727:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346730:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346735:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.346735:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.346736:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346739:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346745:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.346745:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.346746:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346748:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346761:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346764:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4126a8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1933312->7692287] (req 1933312->7692287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.346774:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.346781:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346794:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.346798:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.347057:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532151.347083:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347087:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.347090:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.347100:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.347106:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468634624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 524800us (524936us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532151.347109:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4666
00010000:00010000:0.0:1651532151.347122:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.347123:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468633152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 583336us (583401us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532151.347126:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4664
00010000:00010000:0.0:1651532151.347126:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.347127:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347130:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347135:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.347136:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468638464
00010000:00010000:0.0:1651532151.347138:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4126fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [192512->8318975] (req 192512->8318975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347141:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.347146:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4744
00000100:00100000:1.0:1651532151.347147:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468638464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.347150:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532151.347151:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.347151:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347154:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.347155:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4127b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2b3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.347158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.347159:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347162:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.347168:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4127b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2b3 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.347172:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347175:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4126af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [745472->8540159] (req 745472->8540159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.347180:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4127b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2b3 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.347183:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:0.0:1651532151.347186:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347189:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.347191:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468638464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (135us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.347194:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4744
00000100:00100000:0.0:1651532151.347650:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.347665:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.347667:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468638592
00000100:00100000:0.0:1651532151.347674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.347687:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4674
00000100:00100000:1.0:1651532151.347689:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468638592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532151.347696:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.347700:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.347702:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.347704:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532151.347705:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.347710:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.347710:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468638720
00010000:00010000:1.0:1651532151.347713:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.347719:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468638848
00000100:00100000:0.0:1651532151.347724:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4745
00000100:00100000:0.0:1651532151.347726:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468638720:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532151.347729:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4746
00010000:00010000:0.0:1651532151.347730:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532151.347731:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468638848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.347733:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4127c0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2ba expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.347734:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.347737:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2c1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347744:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4127c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2ba expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.347747:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2c1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.347748:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4127c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2ba expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.347751:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2c1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.347752:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:1.0:1651532151.347754:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532151.347760:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468638720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.347763:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468638848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.347763:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4745
00000100:00100000:1.0:1651532151.347766:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4746
00000100:00100000:1.0:1651532151.347775:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.347790:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.347797:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468638528
00000100:00100000:0.0:1651532151.347819:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4675
00000100:00100000:0.0:1651532151.347821:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468638528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532151.347832:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347836:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532151.347837:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532151.347838:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347841:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.347848:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468639040
00000100:00100000:0.0:1651532151.347860:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4747
00000100:00100000:0.0:1651532151.347862:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468639040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.347864:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.347867:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4127d5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2c8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.347873:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4127d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2c8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.347877:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4127d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2c8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.347881:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532151.347894:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468639040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.347897:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4747
00000100:00100000:0.0:1651532151.348048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.348055:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468639296
00000100:00100000:0.0:1651532151.348068:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4748
00000100:00100000:0.0:1651532151.348069:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468639296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.348073:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.348076:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4127dc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2cf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.348083:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4127dc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2cf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.348090:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4127dc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2cf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.348093:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532151.348104:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468639296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.348107:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4748
00000100:00100000:0.0:1651532151.348153:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.348160:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468639488
00000100:00100000:0.0:1651532151.348170:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4749
00000100:00100000:0.0:1651532151.348171:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468639488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.348175:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.348178:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4127e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2d6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.348185:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4127e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2d6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.348189:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4127e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2d6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.348192:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532151.348203:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468639488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.348207:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4749
00000100:00100000:0.0:1651532151.348285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.348291:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468639616
00000100:00100000:0.0:1651532151.348303:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4750
00000100:00100000:0.0:1651532151.348305:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468639616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.348308:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.348311:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2dd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.348318:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2dd expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.348322:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2dd expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.348325:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532151.348337:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468639616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.348346:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4750
00000001:00080000:1.0:1651532151.413313:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793997 is committed
00002000:00010000:0.0:1651532151.413350:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532149 -> 1651532150
00010000:00010000:0.0:1651532151.413354:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413358:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.413377:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468634560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 591011us (591192us total) trans 158913793997 rc 0/0
00000100:00100000:0.0:1651532151.413381:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4667
00010000:00010000:0.0:1651532151.413388:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413391:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.413392:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413395:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413400:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.413401:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.413402:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413405:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413411:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413414:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41270a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->9351167] (req 401408->9351167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413419:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413423:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413606:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413610:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.413631:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468635712:12345-10.240.43.64@tcp:3:fio.0 Request processed in 482743us (482803us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532151.413634:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4668
00010000:00010000:0.0:1651532151.413641:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413645:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.413646:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413649:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413653:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.413654:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.413655:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413658:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413667:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.413677:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.413683:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413686:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41271f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->9805823] (req 557056->9805823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.413701:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.413710:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.413716:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468639872
00000100:00100000:0.0:1651532151.413735:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468639936
00000100:00100000:0.0:1651532151.413744:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4676
00000100:00100000:0.0:1651532151.413746:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468639872:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532151.413751:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4677
00010000:00010000:0.0:1651532151.413753:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.413754:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468639936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532151.413757:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532151.413758:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413761:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.413762:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413763:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532151.413764:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.413768:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.413769:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.413784:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532151.413785:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413789:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.413790:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.413793:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413795:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.413798:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.413927:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.413954:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468640064
00000100:00100000:1.0:1651532151.413961:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.413965:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4751
00000100:00100000:0.0:1651532151.413967:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468640064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.413975:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532151.413977:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532151.413978:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4127ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2e4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.413987:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532151.413992:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4127ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2e4 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.413996:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4127ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2e4 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.413999:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532151.414009:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468640064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.414011:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4751
00000100:00100000:0.0:1651532151.414016:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468640192
00000100:00100000:0.0:1651532151.414020:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468640256
00000100:00100000:0.0:1651532151.414022:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468640320
00000100:00100000:0.0:1651532151.414025:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4752
00000100:00100000:0.0:1651532151.414026:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468640192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.414029:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.414041:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412806 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2eb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.414048:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412806 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2eb expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.414052:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412806 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2eb expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.414055:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532151.414060:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4753
00000100:00100000:1.0:1651532151.414062:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468640256:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532151.414062:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468640192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.414064:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4752
00010000:00010000:1.0:1651532151.414066:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532151.414069:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4754
00010000:00010000:1.0:1651532151.414070:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41280d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2f2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.414070:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8c71a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468640320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.414073:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.414075:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412814 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c2f9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.414082:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412814 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2f9 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.414083:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41280d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2f2 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.414086:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412814 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2f9 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.414089:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00010000:00010000:1.0:1651532151.414091:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41280d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c2f2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532151.414094:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8c71a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468640320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.414096:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4754
00010000:00010000:1.0:1651532151.414113:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532151.414148:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468640256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 84us (170us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.414151:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4753
00000100:00100000:0.0:1651532151.414414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.414434:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468640448
00000100:00100000:1.0:1651532151.414446:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4755
00000100:00100000:1.0:1651532151.414448:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468640448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.414452:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.414456:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41281b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c300 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.414464:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41281b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c300 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.414468:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41281b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c300 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.414471:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532151.414482:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468640448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.414485:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4755
00000100:00100000:0.0:1651532151.414530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.414543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.414548:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468640640
00000100:00100000:0.0:1651532151.414549:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468640704
00000100:00100000:1.0:1651532151.414560:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4756
00000100:00100000:1.0:1651532151.414562:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468640640:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532151.414564:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4757
00000100:00100000:0.0:1651532151.414566:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468640704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.414569:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.414573:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412822 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c30e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.414574:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.414577:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412829 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c307 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.414580:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412822 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c30e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.414585:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412829 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c307 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.414585:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412822 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c30e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.414588:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:1.0:1651532151.414589:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412829 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c307 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.414592:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532151.414601:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468640704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.414604:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4757
00000100:00100000:1.0:1651532151.414608:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468640640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.414611:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4756
00000100:00100000:0.0:1651532151.414716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.414734:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468640896
00000100:00100000:1.0:1651532151.414745:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4758
00000100:00100000:1.0:1651532151.414747:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468640896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.414750:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.414754:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412830 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c315 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.414761:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412830 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c315 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.414764:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412830 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c315 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.414778:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532151.414789:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468640896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.414792:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4758
00000001:00080000:1.0:1651532151.593916:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793998 is committed
00010000:00010000:1.0:1651532151.593933:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.593938:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.593966:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468635648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 663074us (663121us total) trans 158913793998 rc 0/0
00010000:00010000:0.0:1651532151.593967:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.593970:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4669
00010000:00010000:0.0:1651532151.593972:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.593973:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.593976:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.593982:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.593983:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.593984:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.593987:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.593994:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.593997:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412726 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2232320->10391551] (req 2232320->10391551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.594002:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.594005:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.594404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.594422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.594433:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.594433:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468641216
00000100:00100000:1.0:1651532151.594441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.594451:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468641280
00000100:00100000:1.0:1651532151.594455:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4678
00000100:00100000:1.0:1651532151.594458:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006388808e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468641216:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532151.594464:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4679
00000100:00100000:0.0:1651532151.594466:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070f9d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468641280:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532151.594472:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.594474:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.594478:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.594479:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.594482:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532151.594483:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.594487:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532151.594488:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.594491:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532151.594492:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.594496:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.594497:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.594500:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.594500:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.594508:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468641472
00000100:00100000:1.0:1651532151.594509:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468641536
00000100:00100000:0.0:1651532151.594514:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4759
00000100:00100000:0.0:1651532151.594516:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468641472:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532151.594522:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4760
00000100:00100000:1.0:1651532151.594524:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468641536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.594525:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.594528:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.594528:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412845 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c31c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.594531:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41284c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c323 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.594539:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412845 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c31c expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.594540:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41284c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c323 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.594544:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412845 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c31c expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.594545:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41284c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c323 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.594547:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00010000:00010000:1.0:1651532151.594549:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532151.594562:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468641472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.594565:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4759
00000100:00100000:1.0:1651532151.594567:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468641536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (126us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.594572:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4760
00000100:00100000:1.0:1651532151.594848:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.594857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.594868:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468641664
00000100:00100000:0.0:1651532151.594874:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468641728
00000100:00100000:1.0:1651532151.594879:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4761
00000100:00100000:1.0:1651532151.594881:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468641664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.594884:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532151.594886:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4762
00010000:00010000:1.0:1651532151.594888:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412853 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c32a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.594888:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468641728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.594892:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.594895:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41285a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c331 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.594896:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412853 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c32a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.594900:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412853 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c32a expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.594903:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532151.594903:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41285a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c331 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.594907:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41285a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c331 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.594910:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532151.594914:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468641664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.594916:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4761
00000100:00100000:0.0:1651532151.594918:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468641728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.594921:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4762
00000100:00100000:1.0:1651532151.595154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.595165:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468641920
00000100:00100000:0.0:1651532151.595173:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4763
00000100:00100000:0.0:1651532151.595174:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468641920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.595178:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.595181:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412861 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c338 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.595187:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412861 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c338 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.595191:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412861 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c338 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.595195:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532151.595208:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468641920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.595211:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4763
00000001:00080000:1.0:1651532151.660660:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913793999 is committed
00010000:00010000:0.0:1651532151.660691:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660696:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.660718:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000782e634b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468636480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 562944us (562999us total) trans 158913793999 rc 0/0
00000100:00100000:0.0:1651532151.660723:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4671
00010000:00010000:0.0:1651532151.660731:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660734:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.660735:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660738:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660743:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.660744:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.660744:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660747:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660752:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.660753:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.660753:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660758:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660773:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.660779:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660779:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412750 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2129920->9170943] (req 2129920->9170943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.660784:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660786:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.660789:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.661079:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.661091:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468642240
00010000:00010000:1.0:1651532151.661105:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.661105:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4764
00000100:00100000:0.0:1651532151.661107:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468642240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.661110:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661111:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.661115:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412868 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c33f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661126:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532151.661128:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468636544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 563357us (563442us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532151.661129:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412868 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c33f expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532151.661131:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4670
00010000:00010000:0.0:1651532151.661133:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412868 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c33f expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.661137:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532151.661145:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468642240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.661150:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4764
00010000:00010000:0.0:1651532151.661158:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661163:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.661164:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661169:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661177:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661182:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412757 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4788224->9244671] (req 4788224->9244671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661195:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661198:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.661234:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb99b0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468638080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 430809us (430881us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532151.661238:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4672
00010000:00010000:0.0:1651532151.661247:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661253:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.661255:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661258:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661263:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.661264:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.661265:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661268:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661279:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661282:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412796 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [229376->10465279] (req 229376->10465279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.661285:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.661289:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.661567:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.661579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.661580:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468642432
00000100:00100000:1.0:1651532151.661586:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.661591:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468642304
00000100:00100000:1.0:1651532151.661593:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.661604:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4680
00000100:00100000:0.0:1651532151.661605:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468642432:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532151.661609:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4681
00000100:00100000:1.0:1651532151.661611:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468642304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532151.661612:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661619:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.661620:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661620:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532151.661621:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.661625:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.661627:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.661630:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.661632:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532151.661633:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661637:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.661638:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.661641:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.661644:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.661645:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468642368
00000100:00100000:0.0:1651532151.661650:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468642560
00000100:00100000:0.0:1651532151.661658:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4765
00000100:00100000:0.0:1651532151.661660:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000066243b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468642368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.661664:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.661668:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41287d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c346 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.661699:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41287d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c346 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.661704:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41287d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c346 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.661707:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532151.661716:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000066243b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468642368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.661719:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4765
00000100:00100000:1.0:1651532151.661728:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4766
00000100:00100000:1.0:1651532151.661731:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468642560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.661734:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.661738:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412884 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c34d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.661746:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412884 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c34d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.661751:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412884 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c34d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.661754:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532151.661763:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468642560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (170us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.661766:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4766
00000100:00100000:1.0:1651532151.661782:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.661846:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468642688
00000100:00100000:1.0:1651532151.661859:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4767
00000100:00100000:1.0:1651532151.661861:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468642688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.661865:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.661868:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41288b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c354 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.661876:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41288b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c354 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.661880:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41288b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c354 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.661883:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532151.661893:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468642688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.661896:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4767
00000100:00100000:1.0:1651532151.662109:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.662116:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468643008
00000100:00100000:1.0:1651532151.662127:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4768
00000100:00100000:1.0:1651532151.662129:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468643008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.662133:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.662136:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412892 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c35b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.662143:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412892 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c35b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.662147:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412892 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c35b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.662151:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532151.662160:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468643008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.662162:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4768
00000100:00100000:1.0:1651532151.662387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.662394:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468643200
00000100:00100000:1.0:1651532151.662407:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4769
00000100:00100000:1.0:1651532151.662409:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468643200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.662413:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.662416:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412899 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c362 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.662423:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412899 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c362 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.662430:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412899 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c362 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.662433:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532151.662443:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468643200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.662445:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4769
00000100:00100000:1.0:1651532151.662686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.662693:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468643328
00000100:00100000:1.0:1651532151.662706:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4770
00000100:00100000:1.0:1651532151.662707:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468643328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.662711:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.662714:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c369 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.662721:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c369 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.662724:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c369 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.662728:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532151.662737:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468643328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.662741:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4770
00000001:00080000:1.0:1651532151.777323:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794000 is committed
00010000:00010000:1.0:1651532151.777337:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.777353:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.777375:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004247063d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468638016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 546945us (547004us total) trans 158913794000 rc 0/0
00010000:00010000:0.0:1651532151.777377:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.777378:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4673
00010000:00010000:0.0:1651532151.777381:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.777383:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777386:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777391:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.777392:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.777393:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777396:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777399:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.777400:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.777400:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777403:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777411:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777413:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41279d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1712128->8347647] (req 1712128->8347647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777419:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777422:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.777427:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.777431:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.777871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.777879:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.777891:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.777897:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.777897:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468643520
00000100:00100000:1.0:1651532151.777906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.777921:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468643584
00000100:00100000:0.0:1651532151.777929:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4682
00010000:00010000:1.0:1651532151.777931:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.777931:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468643520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532151.777935:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777938:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777943:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532151.777944:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777953:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532151.777953:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.777956:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468638592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 430266us (430306us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532151.777958:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.777959:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4674
00010000:00010000:0.0:1651532151.777961:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.777965:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4683
00000100:00100000:1.0:1651532151.777966:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468643584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532151.777970:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.777973:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777973:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.777974:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777977:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.777978:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.777979:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.777982:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532151.777983:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.777989:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777989:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.777992:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.777992:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4127b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->4612095] (req 770048->4612095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.777998:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468643712
00000100:00100000:1.0:1651532151.778002:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468643776
00000100:00100000:0.0:1651532151.778004:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468643904
00000100:00100000:0.0:1651532151.778008:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4771
00000100:00100000:0.0:1651532151.778009:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468643712:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532151.778010:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4772
00000100:00100000:1.0:1651532151.778011:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468643776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.778012:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.778014:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.778014:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4128b5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c370 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.778016:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4128bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c377 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.778021:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4128b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c370 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.778023:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4128bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c377 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.778028:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4128bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c377 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.778029:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4128b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c370 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.778031:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532151.778032:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:1.0:1651532151.778038:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468643776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (140us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.778040:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4772
00000100:00100000:0.0:1651532151.778042:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468643712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (151us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.778044:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4773
00000100:00100000:1.0:1651532151.778046:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468643904:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532151.778046:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4771
00010000:00010000:1.0:1651532151.778048:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.778050:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c37e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.778055:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c37e expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.778059:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c37e expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.778061:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532151.778066:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468643904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (160us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.778069:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4773
00000100:00100000:1.0:1651532151.778365:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.778383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.778394:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468644096
00000100:00100000:1.0:1651532151.778399:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468644352
00000100:00100000:0.0:1651532151.778403:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4774
00000100:00100000:0.0:1651532151.778405:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e94a2d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468644096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532151.778411:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4775
00000100:00100000:1.0:1651532151.778412:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006ef6773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468644352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.778413:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.778416:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.778417:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4128ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c385 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.778419:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c38c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.778424:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4128ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c385 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.778427:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c38c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.778429:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4128ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c385 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.778430:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c38c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.778432:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00010000:00010000:1.0:1651532151.778434:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532151.778442:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006ef6773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468644352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.778442:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e94a2d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468644096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.778445:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4774
00000100:00100000:1.0:1651532151.778449:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4775
00000001:00080000:1.0:1651532151.844284:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794001 is committed
00002000:00010000:0.0:1651532151.844313:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532150 -> 1651532151
00010000:00010000:0.0:1651532151.844316:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.844320:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.844349:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468638528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 496518us (496564us total) trans 158913794001 rc 0/0
00000100:00100000:0.0:1651532151.844352:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4675
00010000:00010000:0.0:1651532151.844359:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.844363:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.844364:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.844367:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.844372:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.844372:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.844373:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.844376:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.844383:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.844386:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4127ce lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7860224->7864319] (req 7860224->7864319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.844391:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.844394:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.844633:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.844640:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.844651:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.844664:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468644544
00000100:00100000:1.0:1651532151.844675:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468644608
00000100:00100000:1.0:1651532151.844680:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4684
00000100:00100000:1.0:1651532151.844682:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468644544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532151.844689:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.844694:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.844695:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.844698:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532151.844698:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.844703:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.844706:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.844713:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4685
00000100:00100000:1.0:1651532151.844715:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468644608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532151.844719:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.844723:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.844723:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.844726:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532151.844727:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.844730:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.844733:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.844736:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468644672
00000100:00100000:0.0:1651532151.844745:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4776
00000100:00100000:0.0:1651532151.844747:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468644672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.844750:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.844754:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4128e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c393 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.844761:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4128e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c393 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.844766:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4128e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c393 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.844769:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532151.844783:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468644672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (132us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.844785:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4776
00000001:00080000:1.0:1651532151.927409:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794002 is committed
00010000:00010000:0.0:1651532151.927440:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927445:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.927461:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468639872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 513714us (513760us total) trans 158913794002 rc 0/0
00000100:00100000:0.0:1651532151.927464:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4676
00010000:00010000:0.0:1651532151.927470:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927474:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532151.927475:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927478:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927482:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.927483:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.927484:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927487:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927502:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927505:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4127f1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9154559] (req 385024->9154559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.927513:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.927517:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.927855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.927863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.927868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.927886:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468644864
00000100:00100000:0.0:1651532151.927893:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468644928
00000100:00100000:0.0:1651532151.927895:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468644992
00010000:00010000:1.0:1651532151.927898:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532151.927898:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4777
00000100:00100000:0.0:1651532151.927900:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468644864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.927902:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927904:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.927907:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4128ed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c39a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927919:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532151.927922:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468639936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 514167us (514211us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532151.927922:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4128ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c39a expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532151.927925:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4677
00010000:00010000:0.0:1651532151.927926:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4128ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c39a expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.927930:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532151.927938:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468644864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.927941:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4777
00000100:00100000:0.0:1651532151.927945:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4778
00000100:00100000:0.0:1651532151.927947:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468644928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.927949:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.927952:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4128f4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3a1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927956:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.927958:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4128f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3a1 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.927961:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4128f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3a1 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.927964:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532151.927969:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468644928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.927971:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4778
00000100:00100000:0.0:1651532151.927974:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4779
00000100:00100000:0.0:1651532151.927976:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468644992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.927978:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.927979:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4128fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3a8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.927983:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532151.927985:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4128fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3a8 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.927989:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4128fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3a8 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.927992:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532151.927999:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468644992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.928001:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4779
00010000:00010000:1.0:1651532151.928005:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928009:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532151.928010:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928013:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928019:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532151.928020:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532151.928021:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928024:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928038:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928041:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4127f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2289664->8687615] (req 2289664->8687615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.928047:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.928051:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.928336:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.928359:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.928367:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.928378:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532151.928387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.928392:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468645184
00000100:00100000:1.0:1651532151.928395:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468645120
00000100:00100000:0.0:1651532151.928407:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4686
00000100:00100000:0.0:1651532151.928414:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468645184:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532151.928415:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4687
00000100:00100000:1.0:1651532151.928417:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468645120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532151.928428:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928430:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.928433:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532151.928434:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532151.928435:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928442:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532151.928443:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928449:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532151.928449:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.928453:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928454:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928457:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532151.928466:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468645248
00000100:00100000:1.0:1651532151.928472:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468645312
00000100:00100000:1.0:1651532151.928475:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468645440
00000100:00100000:1.0:1651532151.928477:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4780
00000100:00100000:1.0:1651532151.928479:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468645248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.928482:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.928485:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412910 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3af expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928491:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412910 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3af expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.928495:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412910 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3af expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.928499:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532151.928509:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468645248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (142us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532151.928512:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4780
00000100:00100000:1.0:1651532151.928516:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4781
00000100:00100000:1.0:1651532151.928518:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468645312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532151.928520:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.928522:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412917 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3b6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.928528:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412917 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3b6 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.928532:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412917 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3b6 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.928535:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532151.928538:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4782
00000100:00100000:1.0:1651532151.928540:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468645312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (162us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.928540:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468645440:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532151.928542:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4781
00010000:00010000:0.0:1651532151.928543:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.928547:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41291e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3bd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.928555:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41291e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3bd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532151.928556:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532151.928559:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41291e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3bd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.928562:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:0.0:1651532151.928571:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468645440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (184us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.928573:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4782
00000100:00100000:0.0:1651532151.928579:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468645568
00000100:00100000:0.0:1651532151.928589:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4783
00000100:00100000:0.0:1651532151.928591:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468645568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.928594:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.928596:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412925 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3c4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.928605:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412925 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3c4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.928608:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412925 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3c4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.928611:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532151.928622:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468645568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.928624:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4783
00000100:00100000:0.0:1651532151.928989:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.928997:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.929010:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.929020:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468645760
00000100:00100000:1.0:1651532151.929021:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468645824
00000100:00100000:0.0:1651532151.929029:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468646016
00000100:00100000:0.0:1651532151.929032:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4784
00000100:00100000:0.0:1651532151.929034:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468645760:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532151.929035:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4785
00000100:00100000:1.0:1651532151.929037:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468645824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.929037:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532151.929040:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.929041:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41292c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3cb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532151.929043:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412933 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3d2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.929048:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41292c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3cb expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.929053:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41292c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3cb expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.929054:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412933 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3d2 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.929057:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532151.929058:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412933 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3d2 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532151.929061:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532151.929069:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468645760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.929072:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4784
00000100:00100000:1.0:1651532151.929076:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468645824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.929077:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4786
00000100:00100000:0.0:1651532151.929078:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468646016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532151.929079:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4785
00010000:00010000:0.0:1651532151.929081:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.929083:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41293a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3d9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.929089:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41293a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3d9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.929092:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41293a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3d9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.929095:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532151.929101:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468646016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.929103:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4786
00000100:00100000:0.0:1651532151.929329:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532151.929336:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468646336
00000100:00100000:0.0:1651532151.929357:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4787
00000100:00100000:0.0:1651532151.929359:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468646336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532151.929363:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532151.929367:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412941 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3e0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532151.929374:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412941 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3e0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.929378:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412941 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3e0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532151.929381:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:0.0:1651532151.929395:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468646336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532151.929397:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4787
00000001:00080000:1.0:1651532152.085767:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794003 is committed
00002000:00010000:0.0:1651532152.085795:0:330054:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532149 -> 1651532151
00010000:00010000:0.0:1651532152.085799:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085812:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.085829:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006388808e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468641216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491371us (491426us total) trans 158913794003 rc 0/0
00000100:00100000:0.0:1651532152.085832:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4678
00010000:00010000:0.0:1651532152.085839:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085845:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532152.085847:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085850:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085855:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.085855:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.085856:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085859:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085862:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.085863:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.085863:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085866:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085873:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085876:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412837 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [946176->10014719] (req 946176->10014719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085883:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085886:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085912:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.085915:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086116:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086125:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086136:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086141:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532152.086141:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468642432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424535us (424575us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532152.086143:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.086145:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4680
00010000:00010000:1.0:1651532152.086146:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086152:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086154:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086155:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41286f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->9986047] (req 532480->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086158:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086166:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086169:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532152.086170:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.086170:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070f9d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468641280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491703us (491748us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532152.086173:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.086173:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4679
00010000:00010000:1.0:1651532152.086177:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.086177:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.086178:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086181:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086188:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086190:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41283e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->9027583] (req 4096->9027583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086195:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086198:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.086292:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.086299:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468646464
00000100:00100000:1.0:1651532152.086328:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4788
00000100:00100000:1.0:1651532152.086331:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468646464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.086335:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.086356:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412948 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3e7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086364:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412948 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3e7 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.086374:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412948 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3e7 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.086378:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532152.086384:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.086392:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468646656
00000100:00100000:1.0:1651532152.086398:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468646464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 67us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.086401:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4788
00000100:00100000:0.0:1651532152.086409:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4789
00000100:00100000:0.0:1651532152.086411:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468646656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.086414:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.086418:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41294f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3ee expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086426:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41294f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3ee expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.086430:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41294f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3ee expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.086433:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:0.0:1651532152.086441:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468646656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.086444:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4789
00000100:00100000:0.0:1651532152.086711:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.086720:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.086727:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.086734:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468646784
00000100:00100000:0.0:1651532152.086742:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468646720
00000100:00100000:0.0:1651532152.086747:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4688
00000100:00100000:0.0:1651532152.086749:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468646784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532152.086756:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086760:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532152.086761:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532152.086762:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086765:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.086772:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4689
00000100:00100000:0.0:1651532152.086773:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468646720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532152.086777:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086781:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532152.086781:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086784:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086787:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086790:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532152.086791:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086795:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086797:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086800:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086823:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.086830:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468646848
00000100:00100000:0.0:1651532152.086838:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4790
00000100:00100000:0.0:1651532152.086840:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468646848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.086859:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.086862:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412964 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3f5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.086870:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412964 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3f5 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532152.086871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532152.086877:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412964 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3f5 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532152.086879:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468647104
00010000:00010000:0.0:1651532152.086880:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532152.086887:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4791
00000100:00100000:1.0:1651532152.086889:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468647104:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532152.086891:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468646848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (164us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532152.086893:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532152.086893:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4790
00010000:00010000:1.0:1651532152.086896:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41296b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c3fc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.086904:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41296b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3fc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.086908:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41296b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c3fc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.086912:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532152.086933:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468647104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.086936:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4791
00000100:00100000:0.0:1651532152.087016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.087027:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468647296
00000100:00100000:1.0:1651532152.087034:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4792
00000100:00100000:1.0:1651532152.087036:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468647296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.087039:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.087043:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412972 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c403 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.087049:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412972 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c403 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.087053:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412972 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c403 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.087057:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532152.087066:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468647296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.087068:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4792
00000100:00100000:0.0:1651532152.087218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.087228:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468647488
00000100:00100000:1.0:1651532152.087235:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4793
00000100:00100000:1.0:1651532152.087236:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468647488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.087239:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.087242:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412979 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c40a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.087249:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412979 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c40a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.087253:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412979 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c40a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.087256:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532152.087265:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468647488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.087267:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4793
00000100:00100000:0.0:1651532152.087312:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.087321:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468647680
00000100:00100000:1.0:1651532152.087328:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4794
00000100:00100000:1.0:1651532152.087330:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468647680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.087333:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.087336:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412980 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c411 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.087352:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412980 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c411 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.087359:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412980 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c411 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.087363:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532152.087372:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468647680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.087375:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4794
00000100:00100000:0.0:1651532152.087580:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.087598:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468647936
00000100:00100000:1.0:1651532152.087606:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4795
00000100:00100000:1.0:1651532152.087607:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468647936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.087611:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.087614:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412987 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c418 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.087620:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412987 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c418 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.087624:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412987 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c418 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.087627:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532152.087636:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468647936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.087639:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4795
00000001:00080000:1.0:1651532152.152434:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794004 is committed
00010000:00010000:1.0:1651532152.152449:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.152453:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.152475:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468642304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490863us (490889us total) trans 158913794004 rc 0/0
00000100:00100000:1.0:1651532152.152478:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4681
00010000:00010000:0.0:1651532152.152478:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152483:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532152.152484:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152487:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152493:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.152494:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.152495:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152498:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152506:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152508:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412876 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1507328->9048063] (req 1507328->9048063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152514:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152517:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.152868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.152875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.152882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.152888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.152896:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468648064
00000100:00100000:1.0:1651532152.152906:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468648128
00000100:00100000:1.0:1651532152.152911:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4690
00000100:00100000:1.0:1651532152.152913:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468648064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532152.152920:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.152925:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532152.152926:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.152929:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532152.152929:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.152933:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4691
00000100:00100000:0.0:1651532152.152936:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059bf1b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468648128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532152.152937:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.152940:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152944:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152948:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532152.152949:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152952:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00000100:00100000:1.0:1651532152.152953:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468648192
00010000:00010000:0.0:1651532152.152953:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.152957:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.152963:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468648256
00000100:00100000:1.0:1651532152.152968:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4796
00000100:00100000:1.0:1651532152.152969:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468648192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.152971:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.152972:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.152975:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41299c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c41f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.152979:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4797
00000100:00100000:0.0:1651532152.152980:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468648256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.152981:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41299c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c41f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.152983:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.152985:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4129a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c426 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.152986:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41299c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c41f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.152989:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532152.152992:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4129a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c426 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.152996:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4129a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c426 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532152.152999:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468648192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (117us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532152.153000:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:1.0:1651532152.153002:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4796
00000100:00100000:0.0:1651532152.153009:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468648256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (121us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.153012:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4797
00000001:00080000:1.0:1651532152.310767:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794005 is committed
00010000:00010000:0.0:1651532152.310798:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.310811:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.310834:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468643520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532902us (532963us total) trans 158913794005 rc 0/0
00000100:00100000:0.0:1651532152.310837:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4682
00010000:00010000:1.0:1651532152.310839:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.310844:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532152.310845:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.310848:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.310854:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.310854:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.310855:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.310858:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.310866:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.310869:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4128a7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1310720->9764863] (req 1310720->9764863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.310873:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.310877:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.311192:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.311199:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532152.311213:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311217:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.311236:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.311245:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532152.311246:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.311252:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.311252:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468643584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533285us (533373us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532152.311255:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4683
00010000:00010000:1.0:1651532152.311257:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.311258:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.311258:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.311262:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.311264:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468648640
00010000:00010000:1.0:1651532152.311268:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.311273:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468648768
00010000:00010000:1.0:1651532152.311276:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4128ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1302528->9961471] (req 1302528->9961471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.311279:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4798
00000100:00100000:0.0:1651532152.311281:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468648640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.311284:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.311286:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311288:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4129aa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c42d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.311289:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311296:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4129aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c42d expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.311300:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4129aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c42d expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.311303:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:0.0:1651532152.311310:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468648640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (120us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.311313:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4798
00000100:00100000:1.0:1651532152.311316:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4799
00000100:00100000:1.0:1651532152.311318:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468648768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.311321:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.311324:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c434 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.311332:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c434 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.311336:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c434 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.311339:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532152.311351:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.311366:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468648768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (166us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.311369:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4799
00000100:00100000:1.0:1651532152.311375:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468648832
00000100:00100000:0.0:1651532152.311395:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4800
00000100:00100000:0.0:1651532152.311397:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468648832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.311401:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.311404:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4129b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c43b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311411:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4129b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c43b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.311415:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4129b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c43b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.311418:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:0.0:1651532152.311428:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468648832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.311431:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4800
00000100:00100000:0.0:1651532152.311881:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.311897:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.311905:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.311912:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468648960
00000100:00100000:0.0:1651532152.311924:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468648896
00000100:00100000:1.0:1651532152.311934:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4692
00000100:00100000:1.0:1651532152.311937:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468648960:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532152.311937:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4693
00000100:00100000:0.0:1651532152.311939:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468648896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532152.311946:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311946:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.311950:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532152.311951:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532152.311952:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311956:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532152.311957:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311960:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311963:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532152.311963:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.311966:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311967:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311970:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.311976:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.311983:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468649152
00000100:00100000:0.0:1651532152.311989:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4801
00000100:00100000:0.0:1651532152.311991:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468649152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.311993:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.311996:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4129cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c442 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.312002:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4129cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c442 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.312006:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4129cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c442 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.312010:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532152.312023:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468649152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.312025:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4801
00000100:00100000:0.0:1651532152.312225:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.312232:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468649600
00000100:00100000:0.0:1651532152.312239:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4802
00000100:00100000:0.0:1651532152.312240:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468649600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.312243:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.312247:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129d4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c449 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.312254:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c449 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.312258:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c449 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.312261:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532152.312277:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468649600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.312280:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4802
00000001:00080000:1.0:1651532152.369183:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794006 is committed
00010000:00010000:1.0:1651532152.369198:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369202:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.369224:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468644544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524540us (524591us total) trans 158913794006 rc 0/0
00000100:00100000:1.0:1651532152.369227:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4684
00010000:00010000:0.0:1651532152.369227:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369231:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532152.369232:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369236:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369241:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.369242:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.369243:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369246:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369249:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.369250:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.369251:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369253:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369261:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369264:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4128d8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [516096->10121215] (req 516096->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369269:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369272:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369272:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369276:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369598:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369602:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.369623:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468645184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441208us (441287us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532152.369628:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4686
00010000:00010000:1.0:1651532152.369633:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369638:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369638:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369642:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532152.369643:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369646:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369651:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.369651:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532152.369652:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468644608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 524936us (525011us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532152.369652:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.369655:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4685
00010000:00010000:0.0:1651532152.369655:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369658:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.369659:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.369659:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369662:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369662:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369665:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532152.369666:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369672:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369676:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369678:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412902 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6045696->10301439] (req 6045696->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369683:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369683:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369686:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4128df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4661248->9056255] (req 4661248->9056255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369686:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369691:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.369694:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369941:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369945:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.369966:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468646784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 283216us (283255us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532152.369969:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4688
00010000:00010000:0.0:1651532152.369976:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369979:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532152.369981:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369983:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369991:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.369994:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412956 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [159744->7049215] (req 159744->7049215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.370208:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.370219:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.370219:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468650048
00000100:00100000:1.0:1651532152.370227:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.370235:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468650112
00000100:00100000:1.0:1651532152.370236:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.370250:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4694
00000100:00100000:1.0:1651532152.370252:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4695
00000100:00100000:0.0:1651532152.370252:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468650048:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532152.370255:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468650112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532152.370258:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.370263:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.370263:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532152.370264:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.370266:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532152.370267:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.370271:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532152.370272:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.370277:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532152.370278:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.370282:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.370283:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.370286:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.370286:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.370294:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468650176
00000100:00100000:1.0:1651532152.370298:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468650368
00000100:00100000:0.0:1651532152.370304:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4803
00000100:00100000:0.0:1651532152.370305:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468650176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532152.370313:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4804
00000100:00100000:1.0:1651532152.370315:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468650368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.370318:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.370323:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.370325:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4129e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c457 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.370326:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4129f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c450 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.370333:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4129e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c457 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.370335:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4129f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c450 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.370337:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4129e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c457 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.370339:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4129f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c450 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.370351:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532152.370351:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532152.370364:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468650176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.370367:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4803
00000100:00100000:1.0:1651532152.370369:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468650368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (132us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.370373:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4804
00000100:00100000:1.0:1651532152.370388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.370403:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.370413:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468650560
00000100:00100000:0.0:1651532152.370420:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4805
00000100:00100000:0.0:1651532152.370422:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468650560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.370425:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.370427:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4129f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c45e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.370434:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4129f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c45e expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532152.370437:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468650432
00010000:00010000:0.0:1651532152.370438:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4129f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c45e expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.370442:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532152.370450:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4696
00000100:00100000:1.0:1651532152.370452:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468650432:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532152.370460:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468650560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (57us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532152.370463:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.370463:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4805
00010000:00010000:1.0:1651532152.370468:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.370469:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.370472:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532152.370473:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.370477:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.370480:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.370658:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.370669:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468650688
00000100:00100000:1.0:1651532152.370670:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.370683:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468650816
00000100:00100000:1.0:1651532152.370687:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4806
00000100:00100000:1.0:1651532152.370689:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468650688:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532152.370689:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4807
00000100:00100000:0.0:1651532152.370690:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468650816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.370694:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.370694:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.370705:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412a05 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c465 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.370706:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a0c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c46c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.370714:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412a05 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c465 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.370715:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a0c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c46c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.370719:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412a05 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c465 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.370719:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a0c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c46c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.370722:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532152.370722:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:1.0:1651532152.370740:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468650688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.370743:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4806
00000100:00100000:0.0:1651532152.370750:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468650816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.370753:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4807
00000100:00100000:1.0:1651532152.370775:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.370788:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468650944
00000100:00100000:0.0:1651532152.370794:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4808
00000100:00100000:0.0:1651532152.370796:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468650944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.370799:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.370813:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a13 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c473 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.370820:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a13 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c473 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.370824:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a13 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c473 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.370827:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532152.370839:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468650944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.370841:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4808
00000100:00100000:1.0:1651532152.371027:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.371036:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468651072
00000100:00100000:1.0:1651532152.371038:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.371050:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468651200
00000100:00100000:0.0:1651532152.371057:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4809
00000100:00100000:0.0:1651532152.371059:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468651072:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532152.371060:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4810
00000100:00100000:1.0:1651532152.371062:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468651200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.371062:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.371065:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a1a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c47a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.371066:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.371070:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412a21 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c481 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.371072:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a1a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c47a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.371076:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a1a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c47a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.371077:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412a21 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c481 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.371080:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00010000:00010000:1.0:1651532152.371084:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412a21 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c481 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.371088:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532152.371093:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468651072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.371095:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4809
00000100:00100000:1.0:1651532152.371102:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468651200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.371105:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4810
00000100:00100000:1.0:1651532152.371148:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.371155:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468651328
00000100:00100000:1.0:1651532152.371166:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4811
00000100:00100000:1.0:1651532152.371168:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468651328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.371171:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.371174:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412a28 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c488 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.371181:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412a28 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c488 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.371185:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412a28 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c488 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.371188:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532152.371197:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468651328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.371201:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4811
00000100:00100000:1.0:1651532152.371338:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.371355:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468651456
00000100:00100000:1.0:1651532152.371364:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4812
00000100:00100000:1.0:1651532152.371366:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f16ebf6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468651456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.371369:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.371372:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a2f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c48f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.371379:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a2f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c48f expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.371383:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a2f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c48f expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.371387:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532152.371396:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f16ebf6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468651456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.371398:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4812
00000100:00100000:1.0:1651532152.371652:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.371659:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468651776
00000100:00100000:1.0:1651532152.371672:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4813
00000100:00100000:1.0:1651532152.371674:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468651776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.371677:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.371681:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a36 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c496 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.371688:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a36 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c496 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.371692:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a36 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c496 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.371695:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532152.371704:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468651776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.371707:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4813
00000001:00080000:1.0:1651532152.460864:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794007 is committed
00010000:00010000:1.0:1651532152.460880:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.460884:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.460906:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468645120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532488us (532548us total) trans 158913794007 rc 0/0
00000100:00100000:1.0:1651532152.460909:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4687
00010000:00010000:0.0:1651532152.460912:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.460916:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532152.460917:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.460921:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.460926:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.460927:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.460928:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.460931:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.460939:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.460942:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412909 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9437184->9441279] (req 9437184->9441279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.460950:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.460953:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.461225:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.461233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.461243:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468651904
00000100:00100000:1.0:1651532152.461253:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468651968
00000100:00100000:1.0:1651532152.461258:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4697
00000100:00100000:1.0:1651532152.461260:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468651904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532152.461267:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.461271:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532152.461273:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.461275:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532152.461276:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.461281:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.461284:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.461291:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4698
00000100:00100000:0.0:1651532152.461293:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468651968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532152.461301:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.461306:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532152.461307:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.461310:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532152.461311:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.461315:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.461318:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532152.527598:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794008 is committed
00002000:00010000:0.0:1651532152.527626:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532151 -> 1651532152
00002000:00010000:0.0:1651532152.527628:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532151 -> 1651532152
00010000:00010000:0.0:1651532152.527631:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.527634:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.527655:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468646720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 440880us (440935us total) trans 158913794008 rc 0/0
00010000:00010000:1.0:1651532152.527658:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.527658:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4689
00010000:00010000:1.0:1651532152.527663:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532152.527664:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.527667:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.527673:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.527674:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.527675:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.527678:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.527685:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.527688:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41295d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [565248->10350591] (req 565248->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.527694:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.527698:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.528034:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.528063:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468652096
00000100:00100000:1.0:1651532152.528083:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4814
00000100:00100000:1.0:1651532152.528085:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f9bc190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468652096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.528089:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.528092:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a4b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c49d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.528100:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a4b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c49d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.528104:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a4b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c49d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.528107:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532152.528122:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f9bc190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468652096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.528125:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4814
00000001:00080000:1.0:1651532152.644241:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794009 is committed
00010000:00010000:0.0:1651532152.644271:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644276:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.644298:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468648064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491383us (491430us total) trans 158913794009 rc 0/0
00000100:00100000:0.0:1651532152.644301:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4690
00010000:00010000:0.0:1651532152.644308:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644314:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532152.644315:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644318:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644323:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.644324:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.644325:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644328:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644331:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.644331:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.644332:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644335:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644353:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644356:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41298e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1294336->8011775] (req 1294336->8011775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644359:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644364:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644364:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644367:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.644744:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.644763:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468652544
00000100:00100000:1.0:1651532152.644765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.644782:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468652608
00000100:00100000:1.0:1651532152.644786:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.644791:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4699
00000100:00100000:0.0:1651532152.644792:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468652544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532152.644799:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644824:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532152.644825:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644828:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532152.644829:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644833:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644837:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644841:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644849:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.644856:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fad28c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468648960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 332919us (332976us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532152.644859:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4692
00000100:00100000:1.0:1651532152.644866:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4700
00000100:00100000:1.0:1651532152.644867:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468652608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532152.644867:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644870:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644875:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644886:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.644887:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.644887:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059bf1b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468648128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491951us (492012us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532152.644890:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00000100:00100000:0.0:1651532152.644890:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4691
00010000:00010000:1.0:1651532152.644891:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644896:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644898:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644899:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644901:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532152.644902:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644905:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644909:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644910:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644912:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532152.644913:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644913:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4129bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [884736->8069119] (req 884736->8069119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644916:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644921:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.644921:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.644922:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644925:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644936:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644939:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412995 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1806336->9490431] (req 1806336->9490431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.644947:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.644954:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468652864
00010000:00010000:0.0:1651532152.644954:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.644962:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4815
00000100:00100000:1.0:1651532152.644963:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468652864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.644966:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.644969:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412a60 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4a4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.644983:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412a60 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4a4 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.644987:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412a60 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4a4 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.644990:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532152.644999:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468652864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (213us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.645002:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4815
00000100:00100000:1.0:1651532152.645241:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.645252:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.645260:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.645269:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468653056
00000100:00100000:1.0:1651532152.645278:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468653120
00000100:00100000:1.0:1651532152.645284:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4816
00000100:00100000:1.0:1651532152.645286:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468653056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.645289:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.645293:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412a67 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4ab expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.645300:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412a67 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4ab expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.645304:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412a67 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4ab expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.645307:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532152.645317:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468653056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.645319:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4816
00000100:00100000:1.0:1651532152.645324:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4817
00000100:00100000:1.0:1651532152.645325:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468653120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.645332:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.645334:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412a6e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4b2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.645338:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468652928
00010000:00010000:1.0:1651532152.645348:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412a6e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4b2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.645355:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412a6e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4b2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532152.645361:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4701
00000100:00100000:0.0:1651532152.645363:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468652928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532152.645365:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532152.645370:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.645372:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468653120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (112us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532152.645374:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532152.645375:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4817
00010000:00010000:0.0:1651532152.645375:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.645391:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532152.645391:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532152.645391:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.645396:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.645399:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.645407:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468653248
00000100:00100000:0.0:1651532152.645414:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4818
00000100:00100000:0.0:1651532152.645416:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468653248:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532152.645417:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532152.645420:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.645429:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a7c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4b9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.645449:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a7c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4b9 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.645453:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a7c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4b9 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.645456:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532152.645461:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468653376
00000100:00100000:1.0:1651532152.645467:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4819
00000100:00100000:0.0:1651532152.645471:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468653248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.645474:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468653376:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532152.645474:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4818
00010000:00010000:1.0:1651532152.645478:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.645481:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412a83 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4c0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.645488:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412a83 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4c0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.645492:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412a83 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4c0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.645495:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532152.645513:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468653376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.645518:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4819
00000100:00100000:0.0:1651532152.645762:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.645781:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468653632
00000100:00100000:1.0:1651532152.645791:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4820
00000100:00100000:1.0:1651532152.645793:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468653632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.645796:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.645799:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412a8a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4c7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.645818:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412a8a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4c7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.645822:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412a8a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4c7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.645825:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532152.645835:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468653632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.645837:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4820
00000100:00100000:0.0:1651532152.645939:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.645960:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468653760
00000100:00100000:1.0:1651532152.645970:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4821
00000100:00100000:1.0:1651532152.645972:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468653760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.645975:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.645978:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a91 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4ce expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.645985:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a91 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4ce expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.645989:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a91 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4ce expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.645992:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532152.646002:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468653760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.646005:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4821
00000001:00080000:1.0:1651532152.735970:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794010 is committed
00010000:00010000:0.0:1651532152.736001:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736005:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.736022:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615c694e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468648896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 424083us (424125us total) trans 158913794010 rc 0/0
00000100:00100000:0.0:1651532152.736025:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4693
00010000:00010000:0.0:1651532152.736032:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736038:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532152.736039:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736042:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736047:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.736047:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.736048:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736051:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736057:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736060:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4129c6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10321919] (req 114688->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736065:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736068:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.736442:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.736450:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.736463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.736470:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468654016
00000100:00100000:1.0:1651532152.736473:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468654080
00000100:00100000:1.0:1651532152.736493:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4702
00000100:00100000:1.0:1651532152.736495:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468654016:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532152.736504:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4703
00010000:00010000:1.0:1651532152.736507:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.736507:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008949cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468654080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532152.736511:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532152.736513:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736514:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.736515:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532152.736516:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736520:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532152.736521:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736524:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532152.736525:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.736528:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736529:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.736532:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.736532:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.736540:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468654144
00000100:00100000:1.0:1651532152.736549:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4822
00000100:00100000:1.0:1651532152.736551:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468654144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.736553:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.736556:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412aa6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4d5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.736563:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412aa6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4d5 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.736567:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412aa6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4d5 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.736571:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532152.736583:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468654144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.736586:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4822
00000100:00100000:0.0:1651532152.736594:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.736640:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468654208
00000100:00100000:1.0:1651532152.736650:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4823
00000100:00100000:1.0:1651532152.736652:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468654208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.736655:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.736658:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412aad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4dc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.736665:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412aad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4dc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.736669:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412aad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4dc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.736672:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532152.736682:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468654208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.736684:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4823
00000100:00100000:0.0:1651532152.736890:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.736899:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468654336
00000100:00100000:1.0:1651532152.736910:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4824
00000100:00100000:1.0:1651532152.736911:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468654336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.736915:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.736918:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412ab4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4e3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.736925:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412ab4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4e3 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.736929:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412ab4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4e3 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.736932:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532152.736942:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468654336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.736945:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4824
00000100:00100000:0.0:1651532152.737190:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.737208:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468654528
00000100:00100000:1.0:1651532152.737221:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4825
00000100:00100000:1.0:1651532152.737223:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468654528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.737226:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.737229:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412abb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4ea expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.737236:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412abb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4ea expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.737240:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412abb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4ea expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.737243:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532152.737253:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468654528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.737256:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4825
00000001:00080000:1.0:1651532152.827653:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794011 is committed
00010000:00010000:0.0:1651532152.827684:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.827688:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.827709:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468650048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457457us (457502us total) trans 158913794011 rc 0/0
00010000:00010000:1.0:1651532152.827710:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.827713:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4694
00010000:00010000:1.0:1651532152.827714:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532152.827716:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.827719:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.827727:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.827728:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.827728:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.827732:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.827739:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.827745:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.827749:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4129db lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [282624->10215423] (req 282624->10215423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.827749:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.828053:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.828066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.828072:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468654720
00000100:00100000:1.0:1651532152.828084:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468654848
00000100:00100000:1.0:1651532152.828088:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4826
00000100:00100000:1.0:1651532152.828090:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468654720:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532152.828091:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.828098:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468654976
00010000:00010000:1.0:1651532152.828101:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.828104:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412ac2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4f1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.828105:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4827
00000100:00100000:0.0:1651532152.828107:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468654848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532152.828110:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.828110:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.828112:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412ac2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4f1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.828115:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412ac9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4f8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.828116:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412ac2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4f1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.828120:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532152.828120:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.828123:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412ac9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4f8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.828128:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412ac9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4f8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532152.828131:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468654720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.828133:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4826
00010000:00010000:0.0:1651532152.828134:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:1.0:1651532152.828139:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4828
00000100:00100000:1.0:1651532152.828140:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468654976:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532152.828142:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468654848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (75us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532152.828143:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.828145:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412ad0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c4ff expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.828145:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4827
00010000:00010000:1.0:1651532152.828150:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532152.828151:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412ad0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4ff expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.828155:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412ad0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c4ff expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.828156:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.828158:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532152.828159:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.828164:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468654976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.828166:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4828
00000100:00100000:0.0:1651532152.828170:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468650112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 457916us (457952us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532152.828173:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4695
00010000:00010000:0.0:1651532152.828179:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828183:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532152.828184:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828187:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828191:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.828192:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532152.828192:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828198:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828209:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828213:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4129e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->9969663] (req 49152->9969663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.828220:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.828230:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.828555:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.828565:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468655232
00000100:00100000:1.0:1651532152.828566:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.828575:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.828585:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.828600:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468655168
00000100:00100000:0.0:1651532152.828612:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4704
00000100:00100000:0.0:1651532152.828614:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468655232:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532152.828620:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828635:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532152.828637:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828640:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.828648:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4705
00000100:00100000:0.0:1651532152.828650:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468655168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532152.828655:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828658:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532152.828659:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828661:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828664:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532152.828665:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828669:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828672:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828675:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.828681:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468655296
00000100:00100000:0.0:1651532152.828693:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468655424
00000100:00100000:0.0:1651532152.828698:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4829
00000100:00100000:0.0:1651532152.828700:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468655296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.828703:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.828706:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412ae5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c506 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.828716:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412ae5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c506 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532152.828717:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4830
00000100:00100000:1.0:1651532152.828719:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468655424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.828720:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412ae5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c506 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.828723:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.828723:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:1.0:1651532152.828727:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412aec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c50d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532152.828736:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468655296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (160us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.828739:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4829
00010000:00010000:1.0:1651532152.828742:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412aec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c50d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.828746:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412aec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c50d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532152.828749:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532152.828755:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532152.828758:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468655424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (173us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.828761:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4830
00000100:00100000:1.0:1651532152.828766:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468655552
00000100:00100000:1.0:1651532152.828777:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4831
00000100:00100000:1.0:1651532152.828779:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468655552:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532152.828784:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532152.828788:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532152.828792:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412af3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c514 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532152.828798:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412af3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c514 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532152.828817:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468655680
00010000:00010000:1.0:1651532152.828822:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412af3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c514 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532152.828823:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4832
00010000:00010000:1.0:1651532152.828825:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532152.828825:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468655680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.828828:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.828832:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412afa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c51b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532152.828837:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468655552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532152.828840:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4831
00010000:00010000:0.0:1651532152.828846:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412afa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c51b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.828850:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412afa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c51b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.828856:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532152.828864:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468655680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.828866:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4832
00000100:00100000:0.0:1651532152.829068:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.829075:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468655872
00000100:00100000:0.0:1651532152.829081:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4833
00000100:00100000:0.0:1651532152.829083:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468655872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.829086:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.829100:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412b01 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c522 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.829108:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412b01 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c522 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.829112:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412b01 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c522 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.829115:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532152.829130:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468655872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.829133:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4833
00000100:00100000:0.0:1651532152.829200:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.829207:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468656064
00000100:00100000:0.0:1651532152.829213:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4834
00000100:00100000:0.0:1651532152.829215:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468656064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.829218:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.829221:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412b08 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c529 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.829228:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412b08 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c529 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.829232:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412b08 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c529 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.829235:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532152.829251:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468656064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.829254:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4834
00000100:00100000:0.0:1651532152.829364:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532152.829371:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468656256
00000100:00100000:0.0:1651532152.829377:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4835
00000100:00100000:0.0:1651532152.829379:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468656256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532152.829382:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532152.829385:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b0f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c530 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532152.829392:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b0f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c530 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.829399:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b0f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c530 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532152.829402:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532152.829418:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468656256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532152.829420:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4835
00000001:00080000:1.0:1651532153.052563:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794012 is committed
00010000:00010000:1.0:1651532153.052578:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.052583:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.052608:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468650432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 682154us (682219us total) trans 158913794012 rc 0/0
00010000:00010000:0.0:1651532153.052609:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.052611:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4696
00010000:00010000:0.0:1651532153.052614:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.052615:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.052619:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.052624:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.052625:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.052626:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.052629:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.052638:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.052644:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4129fe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1515520->6512639] (req 1515520->6512639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.052654:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.052657:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532153.185864:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794013 is committed
00010000:00010000:0.0:1651532153.185896:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.185907:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.185929:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000afb69a45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468651904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 724668us (724704us total) trans 158913794013 rc 0/0
00010000:00010000:1.0:1651532153.185932:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.185933:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4697
00010000:00010000:1.0:1651532153.185937:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532153.185938:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.185942:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.185947:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.185948:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.185949:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.185952:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.185961:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.185964:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412a3d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [196608->8376319] (req 196608->8376319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.185971:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.185975:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.186256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.186273:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.186284:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468656576
00010000:00010000:0.0:1651532153.186292:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.186296:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468656704
00010000:00010000:0.0:1651532153.186297:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.186302:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4706
00000100:00100000:1.0:1651532153.186304:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468656576:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532153.186314:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0235a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468651968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 725021us (725080us total) trans 0 rc 45056/45056
00010000:00010000:1.0:1651532153.186317:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.186318:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4698
00010000:00010000:1.0:1651532153.186322:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532153.186323:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.186324:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4707
00000100:00100000:0.0:1651532153.186325:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468656704:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532153.186328:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532153.186329:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.186333:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186333:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186337:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.186338:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186351:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532153.186352:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.186357:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186357:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186361:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186367:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186373:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.186374:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186377:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186382:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.186382:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.186383:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186386:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186392:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186395:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412a44 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [73728->9428991] (req 73728->9428991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186400:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.186403:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.186648:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.186664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.186668:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468656960
00000100:00100000:1.0:1651532153.186679:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468657024
00000100:00100000:1.0:1651532153.186684:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4836
00000100:00100000:1.0:1651532153.186686:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468656960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.186690:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.186693:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412b24 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c537 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.186702:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412b24 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c537 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.186706:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412b24 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c537 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.186709:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532153.186730:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468656960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.186741:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4836
00000100:00100000:1.0:1651532153.186746:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4837
00000100:00100000:1.0:1651532153.186748:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468657024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.186751:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.186753:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412b2b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c53e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.186760:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412b2b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c53e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.186764:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412b2b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c53e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.186767:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532153.186774:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468657024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.186776:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4837
00000100:00100000:0.0:1651532153.186783:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.186842:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468657088
00000100:00100000:1.0:1651532153.186869:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4838
00000100:00100000:1.0:1651532153.186871:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468657088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.186874:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.186877:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b32 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c545 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.186884:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b32 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c545 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.186896:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b32 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c545 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.186900:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532153.186911:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468657088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.186914:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4838
00000100:00100000:1.0:1651532153.187111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.187119:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.187125:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468657216
00000100:00100000:1.0:1651532153.187134:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468657280
00000100:00100000:0.0:1651532153.187143:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4839
00000100:00100000:1.0:1651532153.187146:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4840
00000100:00100000:0.0:1651532153.187146:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468657216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532153.187148:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468657280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.187150:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.187151:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.187155:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b39 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c553 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.187156:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412b40 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c54c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.187162:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b39 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c553 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.187164:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412b40 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c54c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.187166:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b39 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c553 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.187168:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412b40 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c54c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.187169:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532153.187172:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:1.0:1651532153.187181:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468657280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.187183:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4840
00000100:00100000:0.0:1651532153.187188:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468657216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.187191:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4839
00000100:00100000:1.0:1651532153.187248:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.187272:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468657472
00000100:00100000:0.0:1651532153.187281:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4841
00000100:00100000:0.0:1651532153.187282:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468657472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.187286:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.187289:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412b47 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c55a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.187296:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412b47 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c55a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.187304:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412b47 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c55a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.187307:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532153.187316:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468657472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.187319:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4841
00000100:00100000:1.0:1651532153.187539:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.187550:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468657792
00000100:00100000:0.0:1651532153.187558:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4842
00000100:00100000:0.0:1651532153.187560:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468657792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.187563:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.187566:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b4e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c561 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.187574:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b4e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c561 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.187577:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b4e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c561 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.187581:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532153.187591:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468657792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.187593:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4842
00000001:00080000:1.0:1651532153.310877:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794014 is committed
00010000:00010000:0.0:1651532153.310908:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.310913:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.310935:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd4972a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468652544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 666142us (666191us total) trans 158913794014 rc 0/0
00000100:00100000:0.0:1651532153.310938:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4699
00010000:00010000:0.0:1651532153.310946:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.310949:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.310950:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.310953:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.310958:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.310959:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.310959:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.310962:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.310972:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.310978:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412a52 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1392640->8212479] (req 1392640->8212479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.310986:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.310992:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311010:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311014:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.311036:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f75db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468652608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 666167us (666270us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532153.311040:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4700
00010000:00010000:1.0:1651532153.311048:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311052:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532153.311053:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311056:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311062:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.311062:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.311064:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311067:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311076:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311079:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412a59 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4530176->4534271] (req 4530176->4534271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.311084:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.311088:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.311294:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.311306:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.311314:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.311323:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.311332:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468657984
00000100:00100000:1.0:1651532153.311350:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468658112
00000100:00100000:1.0:1651532153.311358:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4708
00000100:00100000:1.0:1651532153.311360:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468657984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532153.311367:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311372:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532153.311373:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311379:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532153.311379:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311384:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311387:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.311387:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468658048
00000100:00100000:1.0:1651532153.311395:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4709
00000100:00100000:0.0:1651532153.311398:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468658176
00000100:00100000:1.0:1651532153.311408:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468658112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532153.311413:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311417:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532153.311418:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.311419:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4843
00010000:00010000:1.0:1651532153.311420:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532153.311421:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.311421:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468658048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.311424:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.311425:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.311427:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.311429:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b63 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c568 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.311435:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4844
00000100:00100000:1.0:1651532153.311437:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468658176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.311437:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b63 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c568 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.311439:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.311441:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b63 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c568 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.311442:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412b6a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c56f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.311445:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:1.0:1651532153.311449:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412b6a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c56f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.311454:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412b6a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c56f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532153.311459:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468658048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (166us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532153.311464:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532153.311464:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4843
00000100:00100000:1.0:1651532153.311474:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468658176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (151us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.311477:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4844
00000100:00100000:0.0:1651532153.311484:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.311540:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468658304
00000100:00100000:1.0:1651532153.311548:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4845
00000100:00100000:1.0:1651532153.311549:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468658304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.311553:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.311556:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412b71 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c576 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311564:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412b71 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c576 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.311571:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412b71 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c576 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.311574:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532153.311584:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468658304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.311586:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4845
00000100:00100000:0.0:1651532153.311856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.311865:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468658496
00000100:00100000:1.0:1651532153.311873:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4846
00000100:00100000:1.0:1651532153.311875:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468658496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.311878:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.311882:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412b78 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c57d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311889:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412b78 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c57d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.311893:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412b78 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c57d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.311896:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532153.311906:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468658496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.311909:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4846
00000100:00100000:0.0:1651532153.311955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.311965:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468658688
00000100:00100000:1.0:1651532153.311972:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4847
00000100:00100000:1.0:1651532153.311974:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468658688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.311977:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.311980:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412b7f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c584 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.311987:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412b7f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c584 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.311991:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412b7f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c584 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.311994:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532153.312003:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468658688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.312006:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4847
00000001:00080000:1.0:1651532153.457698:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794015 is committed
00010000:00010000:0.0:1651532153.457733:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.457738:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.457756:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051be4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468652928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 812392us (812515us total) trans 158913794015 rc 0/0
00000100:00100000:0.0:1651532153.457759:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4701
00010000:00010000:0.0:1651532153.457766:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.457769:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003325411e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.457770:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.457773:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.457778:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.457779:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.457780:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.457786:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.457798:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.457801:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412a75 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9547775] (req 106496->9547775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.457811:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.457816:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.458186:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.458193:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.458200:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.458210:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468658944
00000100:00100000:1.0:1651532153.458215:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468659008
00000100:00100000:0.0:1651532153.458220:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468658880
00000100:00100000:0.0:1651532153.458229:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4710
00000100:00100000:0.0:1651532153.458230:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468658944:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532153.458231:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4848
00000100:00100000:1.0:1651532153.458233:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468659008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.458238:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.458238:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.458242:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412b8d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c58b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.458242:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532153.458243:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532153.458244:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.458247:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.458250:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412b8d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c58b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.458254:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412b8d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c58b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532153.458254:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4711
00000100:00100000:0.0:1651532153.458256:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468658880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532153.458258:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532153.458261:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.458264:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532153.458265:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.458267:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.458273:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468659008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.458275:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4848
00010000:00010000:0.0:1651532153.458276:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532153.458277:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.458281:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.458284:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.458288:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.458561:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.458580:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468659264
00000100:00100000:1.0:1651532153.458587:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4849
00000100:00100000:1.0:1651532153.458589:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468659264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.458592:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.458596:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412b9b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c592 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.458603:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412b9b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c592 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.458607:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412b9b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c592 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.458613:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532153.458630:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468659264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.458632:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4849
00000001:00080000:1.0:1651532153.569205:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794016 is committed
00010000:00010000:1.0:1651532153.569220:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569224:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.569246:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468654016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 832750us (832804us total) trans 158913794016 rc 0/0
00000100:00100000:1.0:1651532153.569249:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4702
00010000:00010000:0.0:1651532153.569249:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569253:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.569254:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569258:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569263:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.569263:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.569264:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569267:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569271:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.569271:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.569272:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569274:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569282:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569285:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412a98 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [311296->9125887] (req 311296->9125887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569286:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569291:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569296:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569297:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569549:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569553:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569568:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.569574:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008949cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468654080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 833067us (833123us total) trans 0 rc 28672/28672
00010000:00010000:1.0:1651532153.569577:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532153.569577:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4703
00010000:00010000:1.0:1651532153.569578:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569584:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569590:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569593:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f412a9f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [851968->10428415] (req 851968->10428415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.569593:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.569607:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468659456
00000100:00100000:1.0:1651532153.569623:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4850
00000100:00100000:1.0:1651532153.569625:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468659456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.569629:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.569637:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412ba2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c599 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.569641:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532153.569643:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.569645:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412ba2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c599 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532153.569649:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468659520
00010000:00010000:1.0:1651532153.569650:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412ba2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c599 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.569653:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532153.569657:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4851
00000100:00100000:0.0:1651532153.569659:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468659520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.569662:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532153.569667:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468659456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.569671:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4850
00010000:00010000:0.0:1651532153.569672:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412ba9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5a0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569678:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.569681:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412ba9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5a0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.569683:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569687:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569691:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f412ba9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5a0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.569699:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:1.0:1651532153.569701:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12776ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468655232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 741087us (741147us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532153.569704:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4704
00000100:00100000:0.0:1651532153.569708:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468659520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.569711:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4851
00010000:00010000:0.0:1651532153.569718:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569722:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.569723:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569726:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569730:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.569730:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.569731:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569734:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569741:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569744:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f412ad7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5890048->9936895] (req 5890048->9936895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569751:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569754:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.569892:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.569906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.569912:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468659648
00000100:00100000:1.0:1651532153.569922:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468659584
00000100:00100000:1.0:1651532153.569943:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4712
00000100:00100000:1.0:1651532153.569945:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468659648:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532153.569952:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.569955:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4713
00010000:00010000:1.0:1651532153.569957:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532153.569957:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468659584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532153.569958:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569961:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532153.569962:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569965:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569966:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569969:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532153.569971:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569974:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532153.569974:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.569979:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569980:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.569983:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.570084:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.570092:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468659904
00000100:00100000:0.0:1651532153.570099:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4852
00000100:00100000:0.0:1651532153.570101:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468659904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.570104:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.570108:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412bbe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5a7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.570116:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412bbe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5a7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.570120:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f412bbe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5a7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.570123:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532153.570155:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468659904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.570158:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4852
00000100:00100000:1.0:1651532153.570178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.570211:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468660032
00000100:00100000:0.0:1651532153.570219:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4853
00000100:00100000:0.0:1651532153.570220:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468660032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.570224:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.570227:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412bc5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5ae expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.570237:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412bc5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5ae expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.570241:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f412bc5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5ae expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.570244:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532153.570253:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468660032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.570256:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4853
00000100:00100000:1.0:1651532153.570447:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.570458:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468660224
00000100:00100000:0.0:1651532153.570466:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4854
00000100:00100000:0.0:1651532153.570468:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468660224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.570471:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.570475:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412bcc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5b5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.570482:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412bcc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5b5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.570485:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f412bcc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5b5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.570489:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532153.570498:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468660224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.570501:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4854
00000100:00100000:1.0:1651532153.570546:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.570556:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468660352
00000100:00100000:0.0:1651532153.570563:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4855
00000100:00100000:0.0:1651532153.570565:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468660352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.570568:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.570571:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412bd3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5bc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.570578:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412bd3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5bc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.570581:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f412bd3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5bc expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.570585:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532153.570594:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468660352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.570597:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4855
00000100:00100000:1.0:1651532153.570690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.570700:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468660544
00000100:00100000:0.0:1651532153.570708:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4856
00000100:00100000:0.0:1651532153.570709:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468660544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.570712:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.570715:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412bda lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5c3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.570722:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412bda lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5c3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.570726:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412bda lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5c3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.570729:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532153.570739:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468660544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.570742:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4856
00000100:00100000:1.0:1651532153.570976:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.570987:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468660736
00000100:00100000:0.0:1651532153.570995:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4857
00000100:00100000:0.0:1651532153.570996:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468660736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.571000:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.571003:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412be1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5ca expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.571010:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412be1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5ca expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.571014:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412be1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5ca expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.571017:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532153.571027:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468660736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.571029:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4857
00000100:00100000:1.0:1651532153.571261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.571272:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468660928
00000100:00100000:0.0:1651532153.571280:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4858
00000100:00100000:0.0:1651532153.571281:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468660928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.571284:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.571288:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412be8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5d1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.571295:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412be8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5d1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.571299:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412be8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5d1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.571302:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532153.571312:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468660928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.571314:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4858
00000001:00080000:1.0:1651532153.694183:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794017 is committed
00010000:00010000:0.0:1651532153.694214:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694218:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.694239:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b47a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468655168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 865589us (865673us total) trans 158913794017 rc 0/0
00000100:00100000:0.0:1651532153.694243:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4705
00010000:00010000:0.0:1651532153.694249:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694253:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.694254:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694257:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694262:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.694263:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.694264:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694266:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694275:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694279:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412ade lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2179072->10051583] (req 2179072->10051583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.694288:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.694294:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.694654:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.694665:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468661184
00000100:00100000:1.0:1651532153.694674:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.694684:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468661120
00000100:00100000:1.0:1651532153.694695:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4714
00000100:00100000:1.0:1651532153.694698:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468661184:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532153.694698:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4715
00000100:00100000:0.0:1651532153.694700:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468661120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532153.694706:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694707:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.694711:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532153.694712:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.694718:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532153.694719:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694723:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532153.694724:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694727:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532153.694727:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.694731:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694732:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.694735:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.694735:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532153.802541:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794018 is committed
00002000:00010000:1.0:1651532153.802555:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532152 -> 1651532153
00010000:00010000:1.0:1651532153.802558:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.802561:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.802583:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468656576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616278us (616328us total) trans 158913794018 rc 0/0
00010000:00010000:0.0:1651532153.802585:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.802587:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4706
00010000:00010000:0.0:1651532153.802590:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.802591:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.802594:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.802599:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.802600:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.802601:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.802606:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.802614:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.802616:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412b16 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9048063] (req 1716224->9048063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.802631:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.802636:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.802943:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.802954:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468661632
00000100:00100000:0.0:1651532153.802963:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4859
00000100:00100000:0.0:1651532153.802964:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3b03404 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468661632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.802968:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.802971:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412bfd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5d8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.802976:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.802979:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.802979:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412bfd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5d8 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.802983:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.802989:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412bfd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5d8 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.802998:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532153.803003:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468656704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 616676us (616729us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532153.803006:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4707
00000100:00100000:0.0:1651532153.803007:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3b03404 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468661632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.803012:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4859
00010000:00010000:0.0:1651532153.803040:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803044:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.803045:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803048:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803052:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.803053:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.803053:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803057:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803068:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803071:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412b1d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [352256->8949759] (req 352256->8949759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.803073:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.803078:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.803443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.803450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.803456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.803462:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.803475:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468661952
00000100:00100000:0.0:1651532153.803480:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468662080
00000100:00100000:1.0:1651532153.803485:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468661888
00000100:00100000:0.0:1651532153.803491:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468662208
00000100:00100000:0.0:1651532153.803498:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4860
00000100:00100000:0.0:1651532153.803500:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468662080:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532153.803501:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4716
00000100:00100000:1.0:1651532153.803503:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e94a2d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468661952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532153.803503:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.803507:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412c04 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5df expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.803511:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803514:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412c04 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5df expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.803518:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532153.803520:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.803523:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532153.803523:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803527:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412c04 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5df expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.803528:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.803531:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803531:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532153.803538:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4717
00000100:00100000:1.0:1651532153.803540:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006ef6773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468661888:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532153.803543:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468662080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.803546:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4860
00010000:00010000:1.0:1651532153.803551:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.803551:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4861
00000100:00100000:0.0:1651532153.803552:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468662208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.803554:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532153.803555:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803555:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.803557:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c19 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5e6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.803558:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532153.803558:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.803562:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803562:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c19 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5e6 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.803566:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803566:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c19 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5e6 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.803572:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532153.803577:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468662208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (115us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.803579:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4861
00000100:00100000:0.0:1651532153.803906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.803914:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.803920:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468662400
00000100:00100000:0.0:1651532153.803933:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468662592
00000100:00100000:0.0:1651532153.803940:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4862
00000100:00100000:0.0:1651532153.803941:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468662400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.803945:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.803949:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412c20 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5ed expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.803953:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4863
00000100:00100000:1.0:1651532153.803955:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468662592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.803956:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412c20 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5ed expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.803959:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.803960:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412c20 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5ed expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.803963:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412c27 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5f4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.803963:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:1.0:1651532153.803972:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412c27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5f4 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532153.803975:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468662400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.803978:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4862
00010000:00010000:1.0:1651532153.803982:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412c27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5f4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.803986:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532153.803996:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468662592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.803999:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4863
00000001:00080000:1.0:1651532153.910921:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794019 is committed
00010000:00010000:1.0:1651532153.910937:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.910941:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.910967:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468657984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599607us (599660us total) trans 158913794019 rc 0/0
00000100:00100000:1.0:1651532153.910971:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4708
00010000:00010000:1.0:1651532153.910978:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.910982:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532153.910983:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.910986:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.910991:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.910991:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.910992:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.910996:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.910999:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.910999:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.911009:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911012:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911028:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911031:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412b55 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3805184->9469951] (req 3805184->9469951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911037:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911039:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911040:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911044:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.911285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.911301:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532153.911310:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911315:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911318:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911328:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.911334:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468658112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 599926us (600019us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532153.911337:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4709
00000100:00100000:0.0:1651532153.911352:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468658944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 453121us (453167us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532153.911356:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468662784
00000100:00100000:0.0:1651532153.911356:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4710
00000100:00100000:1.0:1651532153.911365:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468662912
00000100:00100000:1.0:1651532153.911372:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4864
00000100:00100000:1.0:1651532153.911374:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468662784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.911374:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911377:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.911381:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412c2e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c5fb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911387:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.911390:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412c2e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5fb expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.911394:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412c2e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c5fb expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.911398:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532153.911401:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.911402:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911406:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911411:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.911414:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468662784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.911417:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4864
00010000:00010000:0.0:1651532153.911417:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412b5c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [327680->4481023] (req 327680->4481023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911420:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.911421:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4865
00000100:00100000:1.0:1651532153.911423:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468662912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.911423:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.911424:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911425:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.911427:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911428:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412c35 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c602 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911430:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.911431:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.911431:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911434:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911440:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412c35 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c602 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.911441:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911443:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412c35 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c602 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.911444:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412b86 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [40960->9179135] (req 40960->9179135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911447:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532153.911450:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.911453:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468662912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (152us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532153.911453:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.911455:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4865
00000100:00100000:1.0:1651532153.911472:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.911477:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468663040
00000100:00100000:0.0:1651532153.911488:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4866
00000100:00100000:0.0:1651532153.911490:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468663040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.911493:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.911497:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412c3c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c609 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911504:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412c3c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c609 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.911508:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412c3c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c609 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.911511:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532153.911518:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468663040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (47us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.911521:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4866
00000100:00100000:1.0:1651532153.911857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.911875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.911889:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468663232
00000100:00100000:1.0:1651532153.911893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.911903:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468663168
00000100:00100000:1.0:1651532153.911905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.911910:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4718
00000100:00100000:0.0:1651532153.911912:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468663232:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532153.911913:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.911923:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4719
00010000:00010000:0.0:1651532153.911924:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.911925:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468663168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532153.911929:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532153.911930:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911933:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532153.911934:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911934:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911951:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532153.911952:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911955:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532153.911956:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911960:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911960:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.911964:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911964:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532153.911972:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468663296
00000100:00100000:0.0:1651532153.911973:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468663424
00000100:00100000:1.0:1651532153.911982:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468663488
00000100:00100000:1.0:1651532153.911986:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4867
00000100:00100000:1.0:1651532153.911987:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468663296:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532153.911988:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4868
00010000:00010000:1.0:1651532153.911990:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532153.911990:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468663424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.911993:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412c51 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c610 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.911993:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.911996:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412c58 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c617 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.912000:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412c51 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c610 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.912003:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412c58 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c617 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.912004:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412c51 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c610 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.912007:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532153.912007:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412c58 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c617 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532153.912018:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468663296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (161us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.912021:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4867
00010000:00010000:0.0:1651532153.912023:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532153.912025:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4869
00000100:00100000:1.0:1651532153.912027:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468663488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.912029:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.912031:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412c5f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c61e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.912033:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468663424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (132us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.912036:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4868
00010000:00010000:1.0:1651532153.912037:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412c5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c61e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.912041:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412c5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c61e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.912044:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532153.912050:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468663488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.912052:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4869
00000100:00100000:0.0:1651532153.912054:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.912057:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468663616
00000100:00100000:1.0:1651532153.912065:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4870
00000100:00100000:1.0:1651532153.912067:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468663616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.912069:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.912072:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412c66 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c625 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.912077:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412c66 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c625 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.912081:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412c66 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c625 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.912084:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532153.912112:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468663616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.912120:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4870
00000100:00100000:0.0:1651532153.912317:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.912336:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468663744
00000100:00100000:0.0:1651532153.912348:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532153.912358:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468663872
00000100:00100000:0.0:1651532153.912362:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4871
00000100:00100000:1.0:1651532153.912366:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4872
00000100:00100000:1.0:1651532153.912368:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468663872:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532153.912369:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468663744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532153.912371:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.912373:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532153.912375:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c6d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c633 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.912377:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412c74 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c62c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.912382:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c6d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c633 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.912384:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412c74 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c62c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.912386:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c6d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c633 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.912388:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412c74 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c62c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532153.912389:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532153.912392:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532153.912399:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468663872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.912399:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468663744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532153.912402:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4872
00000100:00100000:0.0:1651532153.912403:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4871
00000100:00100000:0.0:1651532153.912503:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.912520:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468664000
00000100:00100000:0.0:1651532153.912527:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4873
00000100:00100000:0.0:1651532153.912529:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468664000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.912532:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.912535:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412c7b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c63a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.912542:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412c7b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c63a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.912546:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412c7b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c63a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.912549:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532153.912562:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468664000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.912565:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4873
00000100:00100000:0.0:1651532153.912658:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.912665:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468664192
00000100:00100000:0.0:1651532153.912671:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4874
00000100:00100000:0.0:1651532153.912673:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468664192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.912676:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.912679:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412c82 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c641 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.912686:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412c82 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c641 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.912693:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412c82 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c641 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.912696:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532153.912710:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468664192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.912712:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4874
00000100:00100000:0.0:1651532153.912749:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.912755:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468664384
00000100:00100000:0.0:1651532153.912762:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4875
00000100:00100000:0.0:1651532153.912763:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468664384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532153.912766:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532153.912769:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c89 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c648 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.912775:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c648 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.912779:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c648 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532153.912783:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532153.912795:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468664384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (47us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532153.912800:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4875
00000001:00080000:1.0:1651532153.961202:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794020 is committed
00010000:00010000:0.0:1651532153.961231:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961236:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.961256:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468658880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 502999us (503062us total) trans 158913794020 rc 0/0
00010000:00010000:1.0:1651532153.961258:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.961259:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4711
00010000:00010000:1.0:1651532153.961263:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532153.961264:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.961268:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.961273:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.961274:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532153.961275:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.961278:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.961286:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.961289:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412b94 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3813376->7778303] (req 3813376->7778303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961290:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961294:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.961575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.961582:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532153.961593:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468664704
00000100:00100000:0.0:1651532153.961607:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468664640
00000100:00100000:0.0:1651532153.961616:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4720
00000100:00100000:0.0:1651532153.961617:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468664704:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532153.961623:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4721
00000100:00100000:1.0:1651532153.961625:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468664640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532153.961625:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961628:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.961630:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961633:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532153.961633:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.961634:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.961639:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532153.961640:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.961643:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532153.961643:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961647:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.961648:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961650:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532153.961651:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961661:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961665:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532153.961685:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468659648:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391738us (391793us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532153.961688:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4712
00010000:00010000:0.0:1651532153.961694:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961698:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532153.961699:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961702:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961707:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.961707:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532153.961708:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961711:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961718:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961721:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412bb0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->5206015] (req 28672->5206015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961726:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532153.961729:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532154.102627:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794021 is committed
00010000:00010000:0.0:1651532154.102660:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.102664:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.102682:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468659584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532724us (532776us total) trans 158913794021 rc 0/0
00000100:00100000:0.0:1651532154.102687:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4713
00010000:00010000:0.0:1651532154.102694:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.102697:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.102698:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.102701:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.102706:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.102707:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.102708:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.102711:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.102723:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.102726:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412bb7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2158592->4698111] (req 2158592->4698111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.102735:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.102740:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.103074:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.103083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.103100:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468665216
00000100:00100000:0.0:1651532154.103109:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4876
00000100:00100000:0.0:1651532154.103110:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468665216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.103114:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103114:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.103118:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103118:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412c9e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c64f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103124:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.103126:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412c9e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c64f expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.103131:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412c9e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c64f expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.103134:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532154.103135:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468661184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408436us (408481us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532154.103139:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4714
00000100:00100000:0.0:1651532154.103142:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468665216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.103145:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468665024
00000100:00100000:0.0:1651532154.103145:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4876
00000100:00100000:1.0:1651532154.103158:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4722
00000100:00100000:1.0:1651532154.103160:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468665024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532154.103166:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103167:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.103170:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532154.103171:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.103174:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532154.103175:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103179:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532154.103180:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103180:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.103183:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103183:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103188:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.103189:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.103190:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103193:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103200:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103202:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412bef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [892928->9838591] (req 892928->9838591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103207:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103210:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.103602:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.103625:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.103647:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.103655:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.103662:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468665472
00000100:00100000:0.0:1651532154.103672:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468665536
00000100:00100000:0.0:1651532154.103684:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4723
00000100:00100000:0.0:1651532154.103686:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f9bc190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468665472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532154.103694:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.103698:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4724
00000100:00100000:1.0:1651532154.103700:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468665536:12345-10.240.43.64@tcp:3:fio.
00010000:00010000:0.0:1651532154.103701:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532154.103702:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103705:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532154.103706:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.103709:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103710:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.103714:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532154.103715:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.103718:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532154.103719:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103722:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.103723:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.103727:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.103730:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468665600
00000100:00100000:0.0:1651532154.103736:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468665664
00000100:00100000:1.0:1651532154.103738:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4877
00000100:00100000:1.0:1651532154.103740:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468665600:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532154.103745:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4878
00000100:00100000:0.0:1651532154.103747:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468665664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.103749:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.103750:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.103752:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412cba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c656 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.103753:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412cc1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c65d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.103761:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412cba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c656 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.103761:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412cc1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c65d expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.103765:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412cba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c656 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.103766:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412cc1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c65d expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.103769:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532154.103772:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532154.103780:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468665600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (132us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.103781:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468665664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (126us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.103783:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4877
00000100:00100000:0.0:1651532154.103784:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4878
00000100:00100000:0.0:1651532154.104018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.104025:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468665792
00000100:00100000:0.0:1651532154.104039:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4879
00000100:00100000:0.0:1651532154.104041:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468665792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.104044:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.104048:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412cc8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c664 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.104055:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412cc8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c664 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.104059:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412cc8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c664 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.104082:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532154.104094:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468665792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.104096:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4879
00000100:00100000:1.0:1651532154.104116:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.104137:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468665920
00000100:00100000:0.0:1651532154.104146:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4880
00000100:00100000:0.0:1651532154.104147:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468665920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.104151:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.104154:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412ccf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c66b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.104161:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412ccf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c66b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.104165:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412ccf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c66b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.104168:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532154.104177:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468665920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.104180:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4880
00000100:00100000:1.0:1651532154.104273:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.104284:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468666048
00000100:00100000:0.0:1651532154.104294:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4881
00000100:00100000:0.0:1651532154.104295:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468666048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.104299:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.104302:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412cd6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c672 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.104309:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412cd6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c672 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.104313:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412cd6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c672 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.104319:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532154.104328:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468666048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.104331:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4881
00000100:00100000:1.0:1651532154.104393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.104403:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468666176
00000100:00100000:0.0:1651532154.104414:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4882
00000100:00100000:0.0:1651532154.104415:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468666176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.104419:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.104422:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412cdd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c679 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.104429:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412cdd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c679 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.104433:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412cdd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c679 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.104436:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532154.104445:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468666176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.104448:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4882
00000100:00100000:1.0:1651532154.104536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.104546:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468666304
00000100:00100000:0.0:1651532154.104556:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4883
00000100:00100000:0.0:1651532154.104557:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468666304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.104562:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.104565:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412ce4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c680 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.104572:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412ce4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c680 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.104575:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412ce4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c680 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.104579:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532154.104588:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468666304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.104591:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4883
00000001:00080000:1.0:1651532154.269238:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794022 is committed
00010000:00010000:0.0:1651532154.269269:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269273:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.269294:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468661120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574593us (574620us total) trans 158913794022 rc 0/0
00000100:00100000:0.0:1651532154.269298:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4715
00010000:00010000:0.0:1651532154.269305:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269308:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.269309:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269313:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269317:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.269318:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.269319:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269322:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269332:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269335:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412bf6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4804608->10305535] (req 4804608->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269364:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269369:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269385:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269389:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.269412:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e94a2d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468661952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 465908us (465969us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532154.269416:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4716
00010000:00010000:0.0:1651532154.269427:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269431:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.269432:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269435:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269443:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.269443:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.269444:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269447:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269453:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269456:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412c0b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6725632->6729727] (req 6725632->6729727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269469:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269473:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.269648:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.269659:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.269667:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468666560
00000100:00100000:1.0:1651532154.269691:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468666688
00000100:00100000:0.0:1651532154.269694:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4884
00000100:00100000:0.0:1651532154.269696:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468666560:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532154.269698:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4885
00000100:00100000:1.0:1651532154.269700:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468666688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.269700:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.269703:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412ceb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c687 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269704:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.269708:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412cf2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c68e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269711:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412ceb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c687 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.269716:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412cf2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c68e expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.269716:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412ceb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c687 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.269719:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:1.0:1651532154.269721:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412cf2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c68e expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.269724:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532154.269734:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468666560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.269737:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4884
00000100:00100000:1.0:1651532154.269740:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468666688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.269743:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4885
00000100:00100000:0.0:1651532154.269878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.269891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.269898:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468666944
00000100:00100000:0.0:1651532154.269899:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.269906:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468667008
00000100:00100000:1.0:1651532154.269911:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468666816
00000100:00100000:1.0:1651532154.269920:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4725
00000100:00100000:1.0:1651532154.269927:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468666944:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532154.269928:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4886
00000100:00100000:0.0:1651532154.269929:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468667008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.269933:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.269934:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269937:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412d00 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c695 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269939:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532154.269940:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532154.269940:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269948:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.269949:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412d00 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c695 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.269953:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412d00 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c695 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.269956:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532154.269961:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4726
00000100:00100000:1.0:1651532154.269963:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468666816:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532154.269968:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468667008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.269971:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4886
00010000:00010000:1.0:1651532154.269972:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269976:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532154.269977:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269980:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269982:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532154.269983:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269987:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.269990:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.270008:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532154.377595:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794023 is committed
00002000:00010000:1.0:1651532154.377609:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532152 -> 1651532153
00010000:00010000:1.0:1651532154.377612:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.377616:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.377638:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006ef6773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468661888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574097us (574188us total) trans 158913794023 rc 0/0
00010000:00010000:0.0:1651532154.377640:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.377641:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4717
00010000:00010000:0.0:1651532154.377644:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.377646:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377649:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377654:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.377655:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.377656:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377659:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377667:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377670:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412c12 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [446464->9953279] (req 446464->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.377676:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.377687:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.377860:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.377864:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377882:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.377884:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468663232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 465971us (466008us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532154.377886:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532154.377887:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4718
00010000:00010000:0.0:1651532154.377887:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377890:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377898:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.377898:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.377899:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377902:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377912:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.377915:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412c43 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [442368->7012351] (req 442368->7012351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.377927:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.377931:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.378074:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.378085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.378092:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468667584
00000100:00100000:0.0:1651532154.378103:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468667648
00000100:00100000:0.0:1651532154.378112:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4887
00000100:00100000:0.0:1651532154.378114:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468667648:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532154.378121:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4888
00000100:00100000:1.0:1651532154.378123:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468667584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.378123:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.378126:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.378126:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412d0e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6a3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.378130:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d15 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c69c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.378134:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412d0e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6a3 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.378138:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412d0e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6a3 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.378144:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:1.0:1651532154.378147:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d15 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c69c expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.378151:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d15 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c69c expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532154.378158:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468667648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.378161:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4887
00010000:00010000:1.0:1651532154.378162:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532154.378171:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468667584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.378174:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4888
00000100:00100000:1.0:1651532154.378237:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.378267:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.378274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.378281:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.378291:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468667712
00000100:00100000:0.0:1651532154.378297:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468667904
00000100:00100000:0.0:1651532154.378316:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4889
00000100:00100000:0.0:1651532154.378317:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468667712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.378321:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.378324:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412d1c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6aa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.378331:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412d1c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6aa expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.378335:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412d1c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6aa expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.378338:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532154.378362:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468667712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (125us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.378365:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4889
00000100:00100000:0.0:1651532154.378370:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4890
00000100:00100000:0.0:1651532154.378372:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468667904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.378376:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532154.378377:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468667776
00010000:00010000:0.0:1651532154.378378:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412d23 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6b1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.378385:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412d23 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6b1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532154.378391:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468667840
00000100:00100000:1.0:1651532154.378399:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4727
00010000:00010000:0.0:1651532154.378400:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412d23 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6b1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532154.378401:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468667776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532154.378404:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:1.0:1651532154.378408:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.378410:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468667904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (129us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532154.378412:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532154.378413:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.378413:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4890
00010000:00010000:1.0:1651532154.378416:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:0.0:1651532154.378420:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4728
00000100:00100000:0.0:1651532154.378422:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468667840:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532154.378424:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.378428:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.378429:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.378432:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532154.378433:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.378436:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532154.378436:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.378442:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.378443:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.378447:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.378513:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.378523:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468668032
00000100:00100000:1.0:1651532154.378524:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.378538:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468668096
00000100:00100000:0.0:1651532154.378543:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4891
00000100:00100000:0.0:1651532154.378544:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468668032:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532154.378545:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4892
00000100:00100000:1.0:1651532154.378547:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468668096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.378547:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.378550:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412d38 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6b8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.378551:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.378555:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412d3f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6bf expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.378557:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412d38 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6b8 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.378562:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412d38 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6b8 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.378563:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412d3f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6bf expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.378565:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:1.0:1651532154.378567:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412d3f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6bf expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.378570:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532154.378577:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468668032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.378580:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4891
00000100:00100000:1.0:1651532154.378585:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468668096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.378588:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4892
00000100:00100000:1.0:1651532154.378837:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.378844:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468668480
00000100:00100000:1.0:1651532154.378856:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4893
00000100:00100000:1.0:1651532154.378857:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468668480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.378861:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.378864:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412d46 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6c6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.378871:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412d46 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6c6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.378875:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412d46 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6c6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.378879:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532154.378888:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468668480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.378891:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4893
00000001:00080000:1.0:1651532154.477647:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794024 is committed
00010000:00010000:1.0:1651532154.477662:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.477666:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.477688:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468663168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565762us (565794us total) trans 158913794024 rc 0/0
00010000:00010000:0.0:1651532154.477691:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.477693:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4719
00010000:00010000:0.0:1651532154.477699:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.477700:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.477703:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.477709:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.477709:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.477710:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.477714:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.477721:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.477724:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412c4a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->7311359] (req 479232->7311359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.477725:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.477742:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.477998:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.478011:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468668672
00000100:00100000:1.0:1651532154.478025:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4894
00000100:00100000:1.0:1651532154.478027:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468668672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.478031:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.478034:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412d4d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6cd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.478040:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532154.478043:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412d4d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6cd expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.478047:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412d4d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6cd expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.478051:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532154.478061:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468668672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.478064:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4894
00010000:00010000:1.0:1651532154.478079:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.478085:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478105:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478109:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532154.478110:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dffc2f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468664704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 516492us (516536us total) trans 0 rc 45056/45056
00010000:00010000:0.0:1651532154.478110:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.478114:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4720
00010000:00010000:0.0:1651532154.478115:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478120:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.478120:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.478121:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478124:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478133:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478136:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412c90 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1060864->10067967] (req 1060864->10067967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478145:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478148:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.478155:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.478200:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468668864
00000100:00100000:1.0:1651532154.478212:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4895
00000100:00100000:1.0:1651532154.478214:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468668864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.478217:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.478221:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412d54 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6d4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.478228:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412d54 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6d4 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.478232:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412d54 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6d4 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.478235:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532154.478245:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468668864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.478248:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4895
00000100:00100000:1.0:1651532154.478563:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.478573:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.478579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.478586:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.478597:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468669056
00000100:00100000:0.0:1651532154.478598:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468668992
00000100:00100000:1.0:1651532154.478610:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468669120
00000100:00100000:0.0:1651532154.478614:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468669184
00000100:00100000:1.0:1651532154.478616:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4729
00000100:00100000:1.0:1651532154.478618:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468669056:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532154.478619:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4896
00000100:00100000:0.0:1651532154.478621:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468668992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.478625:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478626:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.478629:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532154.478629:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412d62 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6db expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.478630:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.478633:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532154.478634:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.478639:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478639:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412d62 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6db expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.478642:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478643:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412d62 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6db expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.478647:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532154.478649:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4730
00000100:00100000:1.0:1651532154.478651:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468669120:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532154.478656:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.478662:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468668992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.478665:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4896
00000100:00100000:0.0:1651532154.478670:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4897
00010000:00010000:1.0:1651532154.478671:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532154.478671:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468669184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.478672:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.478677:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532154.478678:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.478683:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478690:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.478693:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478693:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412d70 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6e2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478700:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412d70 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6e2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.478704:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412d70 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6e2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532154.478710:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532154.478710:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532154.478717:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468669184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (131us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.478720:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4897
00000100:00100000:1.0:1651532154.478725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.478725:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468669312
00000100:00100000:0.0:1651532154.478728:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468669376
00000100:00100000:0.0:1651532154.478731:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4898
00000100:00100000:0.0:1651532154.478733:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468669312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.478735:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.478737:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412d77 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6e9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.478742:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412d77 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6e9 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.478746:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412d77 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6e9 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.478749:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532154.478759:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468669312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.478761:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4898
00000100:00100000:1.0:1651532154.478765:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4899
00000100:00100000:1.0:1651532154.478768:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468669376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.478772:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.478775:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412d7e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6f0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.478782:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412d7e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6f0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.478787:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412d7e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6f0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.478793:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532154.478801:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468669376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.478819:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4899
00000100:00100000:1.0:1651532154.479121:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.479143:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.479162:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468669696
00000100:00100000:1.0:1651532154.479166:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468669824
00000100:00100000:0.0:1651532154.479170:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4900
00000100:00100000:0.0:1651532154.479172:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468669696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532154.479178:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4901
00000100:00100000:1.0:1651532154.479180:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468669824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.479181:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.479183:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.479184:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412d85 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6f7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.479187:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412d8c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c6fe expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.479192:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412d85 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6f7 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.479194:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412d8c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6fe expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.479196:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412d85 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6f7 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.479198:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412d8c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c6fe expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.479199:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:1.0:1651532154.479202:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532154.479213:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468669696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.479216:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4900
00000100:00100000:1.0:1651532154.479218:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468669824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.479221:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4901
00000100:00100000:1.0:1651532154.479476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.479484:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468669952
00000100:00100000:1.0:1651532154.479497:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4902
00000100:00100000:1.0:1651532154.479499:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468669952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.479502:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.479506:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412d93 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c705 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.479513:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412d93 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c705 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.479517:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412d93 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c705 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.479520:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532154.479530:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468669952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.479533:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4902
00000001:00080000:1.0:1651532154.544398:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794025 is committed
00010000:00010000:0.0:1651532154.544436:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.544442:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.544468:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025ea45a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468664640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582842us (582885us total) trans 158913794025 rc 0/0
00000100:00100000:0.0:1651532154.544472:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4721
00010000:00010000:0.0:1651532154.544480:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.544484:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.544486:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.544489:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.544494:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.544495:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.544496:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.544499:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.544506:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.544509:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412c97 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10227711] (req 897024->10227711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.544526:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.544531:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.544896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.544905:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468670336
00000100:00100000:1.0:1651532154.544919:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4903
00000100:00100000:1.0:1651532154.544920:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468670336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.544925:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.544929:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412d9a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c70c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.544937:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412d9a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c70c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.544941:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412d9a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c70c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.544944:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532154.544955:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468670336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.544957:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4903
00000001:00080000:1.0:1651532154.670946:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794026 is committed
00010000:00010000:1.0:1651532154.670961:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.670965:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.670988:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000069987eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468665024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 567828us (567915us total) trans 158913794026 rc 0/0
00010000:00010000:0.0:1651532154.670989:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.670992:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4722
00010000:00010000:0.0:1651532154.670996:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.670997:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671001:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671010:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.671011:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.671012:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671015:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671023:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671026:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412ca5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->9097215] (req 4423680->9097215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671032:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671035:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.671423:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.671431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.671442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.671450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.671459:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468670528
00000100:00100000:1.0:1651532154.671471:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468670464
00000100:00100000:1.0:1651532154.671478:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4731
00000100:00100000:1.0:1651532154.671479:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468670528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532154.671487:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.671491:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532154.671492:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532154.671493:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.671496:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.671497:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4732
00000100:00100000:0.0:1651532154.671499:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468670464:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532154.671503:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468670656
00000100:00100000:1.0:1651532154.671512:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468670720
00000100:00100000:1.0:1651532154.671518:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4904
00000100:00100000:1.0:1651532154.671519:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468670656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.671519:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.671522:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.671524:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412daf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c713 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671525:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532154.671527:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671530:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671533:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532154.671534:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.671539:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412daf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c713 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.671539:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.671542:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.671544:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412daf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c713 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.671546:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.671547:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532154.671554:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4905
00000100:00100000:0.0:1651532154.671556:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468670720:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532154.671558:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468670656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (116us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532154.671559:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.671562:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412db6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c71a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.671572:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4904
00010000:00010000:0.0:1651532154.671582:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412db6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c71a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.671587:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412db6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c71a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.671591:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532154.671607:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468670720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (157us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.671611:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4905
00000001:00080000:1.0:1651532154.744381:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794027 is committed
00002000:00010000:0.0:1651532154.744409:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532153 -> 1651532154
00002000:00010000:0.0:1651532154.744411:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532153 -> 1651532154
00010000:00010000:0.0:1651532154.744413:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744417:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.744439:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f9bc190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468665472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 640752us (640838us total) trans 158913794027 rc 0/0
00000100:00100000:0.0:1651532154.744442:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4723
00010000:00010000:0.0:1651532154.744450:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744454:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.744455:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744458:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744463:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.744464:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.744465:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744468:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744471:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.744471:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.744472:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744474:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744481:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744484:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412cac lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2686976->10289151] (req 2686976->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.744493:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.744497:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.744514:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.744517:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744538:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.744539:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468665536:12345-10.240.43.64@tcp:3:fio. Request processed in 640838us (640913us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651532154.744541:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532154.744542:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4724
00010000:00010000:0.0:1651532154.744542:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744545:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.744549:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.744552:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744552:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744555:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412cb3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6164480->6168575] (req 6164480->6168575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.744826:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.744835:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.744845:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468671040
00010000:00010000:1.0:1651532154.744852:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.744853:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468671104
00010000:00010000:1.0:1651532154.744856:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.744880:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468666944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474953us (475022us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532154.744883:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4725
00000100:00100000:0.0:1651532154.744891:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4906
00000100:00100000:0.0:1651532154.744893:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000815fffb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468671040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.744897:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.744901:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412dbd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c721 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.744903:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4907
00000100:00100000:1.0:1651532154.744905:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468671104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.744907:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532154.744908:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.744910:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412dbd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c721 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.744912:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412dc4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c728 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744914:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412dbd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c721 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.744918:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.744918:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:1.0:1651532154.744920:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412dc4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c728 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.744925:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412dc4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c728 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532154.744927:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000815fffb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468671040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (101us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532154.744928:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532154.744929:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4906
00000100:00100000:1.0:1651532154.744935:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468671104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.744938:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4907
00000100:00100000:1.0:1651532154.744952:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532154.744961:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744965:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532154.744966:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532154.744966:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744969:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744973:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.744974:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.744975:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744978:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744988:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.744991:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412cf9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [466944->7585791] (req 466944->7585791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.745002:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.745005:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468671296
00010000:00010000:0.0:1651532154.745005:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.745018:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468671232
00000100:00100000:1.0:1651532154.745024:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4733
00000100:00100000:1.0:1651532154.745026:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468671296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532154.745032:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.745036:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532154.745037:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.745040:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532154.745041:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.745045:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.745049:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.745051:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4734
00000100:00100000:0.0:1651532154.745054:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468671232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532154.745061:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.745066:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532154.745067:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.745069:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532154.745070:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.745074:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.745077:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.745441:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.745451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.745457:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468671552
00000100:00100000:0.0:1651532154.745469:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468671680
00000100:00100000:1.0:1651532154.745477:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4908
00000100:00100000:1.0:1651532154.745480:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468671552:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532154.745480:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4909
00000100:00100000:0.0:1651532154.745482:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468671680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.745485:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.745486:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.745489:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dd9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c72f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.745489:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412de0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c736 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.745496:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dd9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c72f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.745498:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412de0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c736 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.745500:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dd9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c72f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.745503:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412de0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c736 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.745504:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532154.745506:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532154.745514:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468671552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.745515:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468671680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.745516:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4908
00000100:00100000:0.0:1651532154.745518:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4909
00000100:00100000:0.0:1651532154.745749:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.745757:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468671808
00000100:00100000:0.0:1651532154.745770:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4910
00000100:00100000:0.0:1651532154.745772:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468671808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.745776:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.745779:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412de7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c73d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.745787:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412de7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c73d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.745790:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412de7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c73d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.745794:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532154.745819:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468671808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.745824:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4910
00000001:00080000:1.0:1651532154.844407:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794028 is committed
00010000:00010000:0.0:1651532154.844438:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.844443:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.844462:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468666816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574498us (574570us total) trans 158913794028 rc 0/0
00000100:00100000:0.0:1651532154.844465:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4726
00010000:00010000:0.0:1651532154.844472:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.844476:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.844477:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.844480:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.844485:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.844485:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.844486:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.844489:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.844504:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.844507:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412d07 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1347584->9146367] (req 1347584->9146367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.844515:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.844520:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.844919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.844931:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468672000
00000100:00100000:0.0:1651532154.844947:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4735
00000100:00100000:0.0:1651532154.844949:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468672000:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532154.844955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532154.844956:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.844960:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532154.844961:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.844963:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532154.844964:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532154.844965:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.844974:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532154.844976:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.844979:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.844982:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468672064
00000100:00100000:0.0:1651532154.844986:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468672192
00000100:00100000:0.0:1651532154.844992:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468672256
00000100:00100000:1.0:1651532154.844995:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4736
00000100:00100000:0.0:1651532154.845000:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4911
00000100:00100000:0.0:1651532154.845002:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468672192:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532154.845004:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468672064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532154.845005:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.845008:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412df5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c744 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.845013:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.845016:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412df5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c744 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.845018:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532154.845020:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.845023:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532154.845024:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.845028:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.845028:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412df5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c744 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.845031:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:1.0:1651532154.845032:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.845041:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4912
00000100:00100000:0.0:1651532154.845042:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468672192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.845043:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468672256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532154.845045:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532154.845045:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4911
00010000:00010000:1.0:1651532154.845058:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e03 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c74b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.845067:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e03 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c74b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.845071:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e03 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c74b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.845084:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532154.845097:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468672256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.845100:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4912
00000001:00080000:1.0:1651532154.952786:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794029 is committed
00010000:00010000:1.0:1651532154.952814:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.952818:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.952841:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468667776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574439us (574574us total) trans 158913794029 rc 0/0
00010000:00010000:0.0:1651532154.952843:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.952844:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4727
00010000:00010000:0.0:1651532154.952847:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.952849:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.952852:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.952857:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.952858:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.952859:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.952862:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.952870:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.952872:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f412d2a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->7151615] (req 53248->7151615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.952878:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.952881:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.953178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.953196:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468672512
00000100:00100000:1.0:1651532154.953207:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4913
00000100:00100000:1.0:1651532154.953209:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468672512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.953210:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.953213:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.953214:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.953217:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e0a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c752 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.953223:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532154.953227:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e0a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c752 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532154.953247:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468667840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 574824us (574971us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532154.953250:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4728
00010000:00010000:1.0:1651532154.953251:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e0a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c752 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.953255:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532154.953258:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.953262:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532154.953263:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.953264:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468672512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (87us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532154.953266:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.953267:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4913
00010000:00010000:0.0:1651532154.953271:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.953271:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532154.953272:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.953275:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.953284:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.953287:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412d31 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->8474623] (req 2441216->8474623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.953298:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532154.953301:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532154.953301:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.953329:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468672832
00000100:00100000:0.0:1651532154.953341:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4914
00000100:00100000:0.0:1651532154.953353:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468672832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.953357:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.953360:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e11 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c759 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.953368:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e11 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c759 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.953372:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e11 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c759 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.953376:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532154.953390:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468672832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.953393:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4914
00000100:00100000:1.0:1651532154.953737:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.953749:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468673024
00000100:00100000:1.0:1651532154.953750:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532154.953758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.953766:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468672960
00000100:00100000:1.0:1651532154.953767:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532154.953776:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4737
00000100:00100000:0.0:1651532154.953778:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468673024:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532154.953781:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4738
00000100:00100000:1.0:1651532154.953783:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468672960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532154.953785:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.953790:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532154.953791:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.953792:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.953794:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.953797:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532154.953798:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.953801:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.953818:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532154.953818:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.953831:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.953834:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.953835:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468673088
00010000:00010000:1.0:1651532154.953837:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532154.953841:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468673216
00000100:00100000:0.0:1651532154.953845:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4915
00000100:00100000:0.0:1651532154.953847:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468673088:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532154.953848:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4916
00000100:00100000:1.0:1651532154.953849:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468673216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532154.953850:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532154.953852:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532154.953853:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412e26 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c760 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532154.953855:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412e2d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c767 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532154.953860:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412e26 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c760 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.953863:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412e2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c767 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.953864:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412e26 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c760 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532154.953868:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412e2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c767 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532154.953868:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:1.0:1651532154.953871:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532154.953882:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468673088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532154.953885:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4915
00000100:00100000:1.0:1651532154.953888:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468673216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532154.953891:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4916
00000001:00080000:1.0:1651532155.084294:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794030 is committed
00010000:00010000:0.0:1651532155.084325:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084330:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.084364:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b89d421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468669056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 605745us (605801us total) trans 158913794030 rc 0/0
00000100:00100000:0.0:1651532155.084369:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4729
00010000:00010000:0.0:1651532155.084377:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084381:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.084382:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084385:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084390:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.084391:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.084392:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084395:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084398:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.084398:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.084399:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084402:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084408:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084414:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f412d5b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->3891199] (req 573440->3891199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.084418:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.084423:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084423:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084426:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.084784:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.084816:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468673536
00010000:00010000:0.0:1651532155.084821:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.084828:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4917
00000100:00100000:1.0:1651532155.084830:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468673536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.084831:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.084834:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.084838:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412e34 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c76e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.084844:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532155.084850:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468670528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 413370us (413427us total) trans 0 rc 36864/36864
00010000:00010000:1.0:1651532155.084854:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412e34 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c76e expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532155.084854:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4731
00010000:00010000:1.0:1651532155.084858:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412e34 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c76e expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.084862:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532155.084867:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.084870:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468673536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (88us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532155.084870:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.084871:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.084873:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4917
00010000:00010000:0.0:1651532155.084874:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084883:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084886:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f412da1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->8769535] (req 1585152->8769535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.084889:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.084896:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084908:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084911:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532155.084912:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003ae0fec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468669120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 606260us (606332us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532155.084912:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.084915:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4730
00010000:00010000:0.0:1651532155.084915:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084919:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.084919:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.084920:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084923:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084930:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084933:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412d69 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->8253439] (req 122880->8253439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084938:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.084941:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.085417:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.085429:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.085430:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468673984
00000100:00100000:1.0:1651532155.085437:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.085447:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4918
00000100:00100000:1.0:1651532155.085449:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.085449:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468673984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.085457:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532155.085461:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532155.085462:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412e3b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c775 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.085471:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468673856
00010000:00010000:0.0:1651532155.085475:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412e3b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c775 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.085480:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412e3b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c775 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532155.085484:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468673920
00000100:00100000:1.0:1651532155.085491:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4739
00000100:00100000:1.0:1651532155.085493:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468673856:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532155.085494:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:1.0:1651532155.085501:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.085508:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468673984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.085511:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4918
00010000:00010000:1.0:1651532155.085512:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532155.085514:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.085517:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532155.085517:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.085517:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468674112
00000100:00100000:0.0:1651532155.085520:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468674368
00010000:00010000:1.0:1651532155.085522:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.085523:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4919
00000100:00100000:0.0:1651532155.085525:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468674112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.085526:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.085528:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.085531:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e49 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c77c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.085533:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4920
00000100:00100000:1.0:1651532155.085535:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468674368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.085537:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.085537:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e49 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c77c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.085540:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412e50 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c783 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.085541:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e49 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c77c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.085544:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:1.0:1651532155.085547:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412e50 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c783 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532155.085550:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468674112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (101us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532155.085552:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412e50 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c783 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532155.085553:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4919
00010000:00010000:1.0:1651532155.085555:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532155.085560:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4740
00000100:00100000:0.0:1651532155.085562:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468673920:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532155.085564:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468674368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.085567:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4920
00010000:00010000:0.0:1651532155.085567:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.085571:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532155.085572:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.085575:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532155.085576:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.085583:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.085586:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.085952:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.085962:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468674688
00000100:00100000:0.0:1651532155.085984:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4921
00000100:00100000:0.0:1651532155.085986:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468674688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.085990:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.085993:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e5e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c78a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.086000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532155.086001:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e5e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c78a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.086005:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e5e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c78a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.086008:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532155.086017:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468674752
00000100:00100000:0.0:1651532155.086021:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468674688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.086024:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4921
00000100:00100000:1.0:1651532155.086032:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4922
00000100:00100000:1.0:1651532155.086034:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468674752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.086039:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.086042:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412e65 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c791 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.086049:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412e65 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c791 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.086053:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412e65 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c791 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.086057:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532155.086064:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468674752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.086067:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4922
00000001:00080000:1.0:1651532155.184313:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794031 is committed
00010000:00010000:0.0:1651532155.184354:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184361:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.184384:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468670464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 512884us (512952us total) trans 158913794031 rc 0/0
00000100:00100000:0.0:1651532155.184388:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4732
00010000:00010000:0.0:1651532155.184395:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184399:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.184400:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184403:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184408:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.184409:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.184409:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184412:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184422:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184425:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412da8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [876544->10072063] (req 876544->10072063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.184443:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.184448:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.184776:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.184788:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.184788:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468675136
00000100:00100000:1.0:1651532155.184797:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.184817:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.184834:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468675072
00010000:00010000:1.0:1651532155.184841:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.184843:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4741
00000100:00100000:0.0:1651532155.184845:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468675136:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532155.184848:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184852:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184862:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.184863:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532155.184864:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.184867:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468671296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 439840us (439914us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532155.184867:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.184870:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4733
00000100:00100000:0.0:1651532155.184874:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4742
00000100:00100000:0.0:1651532155.184875:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468675072:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532155.184878:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468675200
00010000:00010000:0.0:1651532155.184880:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184884:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532155.184884:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.184887:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468675328
00000100:00100000:1.0:1651532155.184893:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4923
00000100:00100000:1.0:1651532155.184895:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468675200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.184897:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.184899:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.184902:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412e7a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c798 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184902:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532155.184903:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.184907:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.184909:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.184910:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412e7a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c798 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.184912:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.184914:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412e7a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c798 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.184915:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.184918:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532155.184922:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4924
00000100:00100000:1.0:1651532155.184924:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468675200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.184924:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468675328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.184926:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532155.184927:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4923
00010000:00010000:0.0:1651532155.184929:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412e81 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c79f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184934:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.184937:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412e81 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c79f expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532155.184941:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532155.184941:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412e81 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c79f expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.184947:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532155.184956:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468675328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (139us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.184959:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4924
00000100:00100000:0.0:1651532155.184964:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468675456
00000100:00100000:0.0:1651532155.184968:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4925
00000100:00100000:0.0:1651532155.184969:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468675456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.184972:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.184974:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412e88 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7a6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.184978:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.184980:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412e88 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7a6 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.184984:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412e88 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7a6 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.184987:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532155.184999:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468675456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.185002:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4925
00010000:00010000:0.0:1651532155.185008:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.185014:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.185015:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.185018:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.185023:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.185023:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.185024:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.185042:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.185050:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.185053:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412dcb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [811008->2908159] (req 811008->2908159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.185058:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.185061:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.185301:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.185309:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.185315:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468675584
00000100:00100000:1.0:1651532155.185325:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468675648
00000100:00100000:1.0:1651532155.185329:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4926
00000100:00100000:1.0:1651532155.185331:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468675584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.185334:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.185338:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412e8f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7ad expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.185354:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412e8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7ad expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.185358:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412e8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7ad expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.185362:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532155.185372:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468675584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.185375:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4927
00000100:00100000:1.0:1651532155.185378:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4926
00000100:00100000:0.0:1651532155.185378:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468675648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.185381:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.185385:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412e96 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7b4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.185393:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412e96 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7b4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.185397:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412e96 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7b4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.185400:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532155.185414:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468675648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.185417:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4927
00000100:00100000:1.0:1651532155.185681:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.185692:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468676032
00000100:00100000:0.0:1651532155.185705:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4928
00000100:00100000:0.0:1651532155.185707:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468676032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.185710:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.185713:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412e9d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7bb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.185721:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412e9d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7bb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.185725:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412e9d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7bb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.185728:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532155.185742:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468676032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.185745:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4928
00000001:00080000:1.0:1651532155.325960:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794032 is committed
00010000:00010000:0.0:1651532155.325988:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.325992:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.326014:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468671232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 580959us (581047us total) trans 158913794032 rc 0/0
00000100:00100000:0.0:1651532155.326017:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4734
00010000:00010000:0.0:1651532155.326024:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326028:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.326029:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326032:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326036:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.326037:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.326038:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326041:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326048:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326051:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412dd2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1748992->8855551] (req 1748992->8855551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326056:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326059:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.326397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.326413:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.326422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.326431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.326438:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468676160
00000100:00100000:1.0:1651532155.326460:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468676224
00000100:00100000:1.0:1651532155.326466:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4743
00000100:00100000:1.0:1651532155.326468:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468676160:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532155.326475:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.326480:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532155.326481:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.326483:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4744
00010000:00010000:1.0:1651532155.326484:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532155.326485:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.326485:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468676224:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532155.326489:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.326493:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326493:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326498:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532155.326499:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.326501:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468676352
00010000:00010000:0.0:1651532155.326502:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532155.326502:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.326506:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468676416
00000100:00100000:1.0:1651532155.326510:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4929
00010000:00010000:0.0:1651532155.326510:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.326512:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468676352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.326513:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.326514:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.326517:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412eb2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7c2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.326521:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4930
00000100:00100000:0.0:1651532155.326522:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468676416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.326524:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412eb2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7c2 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.326525:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.326527:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412eb9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7c9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.326528:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412eb2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7c2 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.326532:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532155.326534:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412eb9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7c9 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.326538:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412eb9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7c9 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532155.326540:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468676352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (118us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532155.326542:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532155.326543:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4929
00000100:00100000:0.0:1651532155.326550:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468676416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.326553:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4930
00000100:00100000:1.0:1651532155.326574:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.326587:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468676480
00000100:00100000:0.0:1651532155.326598:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4931
00000100:00100000:0.0:1651532155.326599:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468676480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.326603:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.326605:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412ec0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7d0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.326612:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412ec0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7d0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.326616:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412ec0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7d0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.326619:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532155.326633:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468676480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.326636:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4931
00000001:00080000:1.0:1651532155.459301:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794033 is committed
00010000:00010000:0.0:1651532155.459333:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459338:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.459370:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468672000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 614420us (614452us total) trans 158913794033 rc 0/0
00000100:00100000:0.0:1651532155.459373:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4735
00010000:00010000:0.0:1651532155.459381:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459384:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.459386:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459389:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459394:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.459395:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.459396:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459399:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459402:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.459403:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.459403:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459406:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459417:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459420:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f412dee lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [69632->9691135] (req 69632->9691135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459425:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.459430:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459431:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.459435:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.459698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.459715:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468676736
00000100:00100000:0.0:1651532155.459727:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4932
00000100:00100000:0.0:1651532155.459729:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468676736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.459733:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.459736:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412ec7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7d7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.459739:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532155.459742:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.459745:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412ec7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7d7 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.459749:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f412ec7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7d7 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.459752:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459752:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:1.0:1651532155.459756:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.459772:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468676736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.459775:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4932
00000100:00100000:1.0:1651532155.459778:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468672064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 614779us (614823us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532155.459780:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468676864
00000100:00100000:1.0:1651532155.459781:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4736
00000100:00100000:0.0:1651532155.459788:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4933
00000100:00100000:0.0:1651532155.459790:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468676864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.459792:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.459795:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412ece lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7de expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459800:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.459818:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412ece lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7de expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.459823:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f412ece lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7de expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.459826:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532155.459833:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468676864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.459836:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4933
00010000:00010000:0.0:1651532155.459843:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459846:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.459847:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459850:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459855:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459858:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412dfc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9814015] (req 94208->9814015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459870:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459873:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.459908:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468673024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 506129us (506177us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532155.459912:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4737
00010000:00010000:0.0:1651532155.459919:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459922:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.459923:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459926:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459931:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.459931:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.459932:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459935:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459945:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.459948:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f412e18 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->8916991] (req 2007040->8916991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.459951:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.459955:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.460196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.460207:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.460208:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468676928
00000100:00100000:1.0:1651532155.460214:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.460223:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.460225:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468676992
00000100:00100000:0.0:1651532155.460235:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4745
00000100:00100000:0.0:1651532155.460236:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468676928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532155.460243:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460262:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.460263:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460266:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532155.460267:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460271:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460274:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.460282:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4746
00000100:00100000:0.0:1651532155.460284:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468676992:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532155.460290:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460293:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532155.460294:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460297:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532155.460297:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460301:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460304:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.460305:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468677120
00000100:00100000:0.0:1651532155.460310:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468677312
00000100:00100000:1.0:1651532155.460315:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4934
00000100:00100000:0.0:1651532155.460319:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4935
00000100:00100000:0.0:1651532155.460321:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468677312:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532155.460322:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468677120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.460324:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.460326:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.460326:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412ee3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7ec expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.460330:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412eea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7e5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460333:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412ee3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7ec expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.460338:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f412ee3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7ec expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.460339:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412eea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7e5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.460353:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:1.0:1651532155.460354:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412eea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7e5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.460358:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532155.460362:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468677312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (139us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.460365:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4935
00000100:00100000:1.0:1651532155.460368:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468677120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (154us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.460371:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4934
00000100:00100000:1.0:1651532155.460387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.460398:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468677376
00000100:00100000:0.0:1651532155.460405:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4936
00000100:00100000:0.0:1651532155.460406:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468677376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.460409:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.460412:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f412ef1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7f3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460419:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f412ef1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7f3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.460423:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f412ef1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7f3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.460426:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532155.460433:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468677376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.460435:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4936
00000100:00100000:1.0:1651532155.460692:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.460703:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468677568
00000100:00100000:0.0:1651532155.460711:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4937
00000100:00100000:0.0:1651532155.460712:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468677568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.460717:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.460720:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f412ef8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c7fa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460727:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f412ef8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7fa expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.460731:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f412ef8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c7fa expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.460734:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532155.460763:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468677568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.460766:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4937
00000100:00100000:1.0:1651532155.460791:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.460801:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468677696
00000100:00100000:0.0:1651532155.460818:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4938
00000100:00100000:0.0:1651532155.460819:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468677696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.460822:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.460825:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412eff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c801 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.460832:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412eff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c801 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.460836:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f412eff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c801 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.460842:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532155.460856:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468677696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.460859:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4938
00000100:00100000:1.0:1651532155.460960:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.460969:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468677824
00000100:00100000:0.0:1651532155.460976:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4939
00000100:00100000:0.0:1651532155.460978:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468677824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.460981:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.460993:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f06 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c808 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.461000:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f06 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c808 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.461004:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f06 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c808 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.461007:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532155.461022:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468677824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.461024:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4939
00000100:00100000:1.0:1651532155.461298:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.461316:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468678016
00000100:00100000:0.0:1651532155.461323:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4940
00000100:00100000:0.0:1651532155.461325:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468678016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.461329:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.461332:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f0d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c80f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.461339:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f0d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c80f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.461353:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f0d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c80f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.461357:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532155.461371:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468678016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.461374:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4940
00000001:00080000:1.0:1651532155.584284:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794034 is committed
00010000:00010000:1.0:1651532155.584300:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.584304:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.584328:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468672960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 630544us (630578us total) trans 158913794034 rc 0/0
00010000:00010000:0.0:1651532155.584330:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.584331:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4738
00010000:00010000:0.0:1651532155.584334:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.584335:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.584339:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.584354:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.584355:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.584356:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.584361:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.584371:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.584374:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412e1f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3731456->10301439] (req 3731456->10301439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.584386:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.584390:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.584719:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.584725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.584732:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.584745:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468678208
00000100:00100000:0.0:1651532155.584751:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468678400
00000100:00100000:1.0:1651532155.584755:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468678272
00000100:00100000:1.0:1651532155.584761:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4747
00000100:00100000:0.0:1651532155.584761:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4941
00000100:00100000:1.0:1651532155.584763:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468678208:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532155.584763:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468678400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.584766:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.584770:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f14 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c816 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.584771:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.584775:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532155.584777:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.584779:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532155.584780:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.584786:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.584786:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f14 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c816 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.584789:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.584791:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f14 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c816 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.584794:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:1.0:1651532155.584796:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4748
00000100:00100000:1.0:1651532155.584798:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468678272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532155.584816:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.584820:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532155.584821:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.584824:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532155.584824:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.584837:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468678400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 73us (104us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532155.584840:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.584840:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4941
00010000:00010000:1.0:1651532155.584844:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.584922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.584940:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468678656
00000100:00100000:0.0:1651532155.584947:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4942
00000100:00100000:0.0:1651532155.584949:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468678656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.584953:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.584956:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f29 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c81d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.584963:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f29 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c81d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.584967:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f29 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c81d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.584970:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532155.584985:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468678656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.584988:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4942
00000001:00080000:1.0:1651532155.725929:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794035 is committed
00010000:00010000:1.0:1651532155.725944:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.725947:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.725970:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468673856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 640476us (640541us total) trans 158913794035 rc 0/0
00010000:00010000:0.0:1651532155.725970:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.725973:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4739
00010000:00010000:0.0:1651532155.725975:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.725976:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.725979:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.725984:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.725985:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.725986:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.725989:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.725992:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.725993:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.725993:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.725996:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726004:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726007:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f412e42 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3186688->9654271] (req 3186688->9654271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726012:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726015:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726042:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726046:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.726388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.726398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.726400:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468679040
00000100:00100000:0.0:1651532155.726423:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468679168
00000100:00100000:0.0:1651532155.726429:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4943
00000100:00100000:0.0:1651532155.726431:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468679040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532155.726432:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4944
00000100:00100000:1.0:1651532155.726434:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468679168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.726434:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.726438:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.726438:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f30 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c824 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.726443:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412f37 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c82b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726443:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.726446:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f30 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c824 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.726449:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.726451:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f30 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c824 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.726452:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412f37 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c82b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.726455:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00010000:00010000:1.0:1651532155.726457:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412f37 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c82b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.726460:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532155.726468:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468679040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.726470:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4943
00000100:00100000:1.0:1651532155.726475:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468679168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.726478:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4944
00010000:00010000:0.0:1651532155.726482:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726485:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.726497:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468673920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 640935us (641060us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532155.726500:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4740
00010000:00010000:0.0:1651532155.726506:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726509:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.726510:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726513:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726518:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726520:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f412e57 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->9191423] (req 2035712->9191423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726528:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726531:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.726540:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.726546:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468675136:12345-10.240.43.64@tcp:3:fio.0 Request processed in 541700us (541778us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532155.726549:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532155.726549:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4741
00010000:00010000:1.0:1651532155.726550:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.726553:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.726559:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532155.726559:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532155.726560:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.726563:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.726573:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.726577:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f412e6c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1527808->8708095] (req 1527808->8708095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726580:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.726585:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.726965:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.726975:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.726984:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.726992:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468679488
00000100:00100000:1.0:1651532155.726999:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4945
00000100:00100000:1.0:1651532155.727001:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468679488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.727005:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.727008:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412f3e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c832 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.727016:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412f3e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c832 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.727020:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412f3e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c832 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.727023:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532155.727033:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468679488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.727035:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4945
00000100:00100000:0.0:1651532155.727058:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468679424
00000100:00100000:0.0:1651532155.727073:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468679360
00000100:00100000:0.0:1651532155.727081:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4749
00000100:00100000:0.0:1651532155.727083:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468679424:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532155.727085:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532155.727090:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.727093:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532155.727094:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532155.727095:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532155.727096:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.727099:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.727101:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4750
00000100:00100000:1.0:1651532155.727103:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468679360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532155.727110:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.727114:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532155.727115:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.727118:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.727121:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532155.727122:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.727126:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.727129:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.727132:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.727139:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468679872
00000100:00100000:1.0:1651532155.727145:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468679808
00000100:00100000:1.0:1651532155.727154:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4946
00000100:00100000:1.0:1651532155.727156:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468679872:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532155.727157:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4947
00000100:00100000:0.0:1651532155.727158:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468679808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.727159:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.727161:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f53 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c840 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.727161:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.727164:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412f5a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c839 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.727168:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f53 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c840 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.727171:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412f5a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c839 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.727172:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f53 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c840 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.727175:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532155.727178:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412f5a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c839 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.727181:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:1.0:1651532155.727185:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468679872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.727187:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4946
00000100:00100000:0.0:1651532155.727190:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468679808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.727193:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4947
00000100:00100000:1.0:1651532155.727284:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.727294:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468680000
00000100:00100000:0.0:1651532155.727304:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4948
00000100:00100000:0.0:1651532155.727306:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468680000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.727309:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.727313:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412f61 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c847 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.727320:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412f61 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c847 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.727323:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412f61 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c847 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.727327:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532155.727339:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468680000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.727341:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4948
00000100:00100000:1.0:1651532155.727568:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.727579:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468680320
00000100:00100000:0.0:1651532155.727589:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4949
00000100:00100000:0.0:1651532155.727591:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468680320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.727594:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.727597:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f68 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c84e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.727604:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f68 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c84e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.727608:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f68 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c84e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.727611:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532155.727624:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468680320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.727626:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4949
00000001:00080000:1.0:1651532155.825959:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794036 is committed
00002000:00010000:0.0:1651532155.825988:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532154 -> 1651532155
00002000:00010000:0.0:1651532155.825990:0:330280:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532154 -> 1651532155
00010000:00010000:0.0:1651532155.825992:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.825996:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.826017:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468675072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 641141us (641229us total) trans 158913794036 rc 0/0
00000100:00100000:0.0:1651532155.826022:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4742
00010000:00010000:0.0:1651532155.826030:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826033:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.826034:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826037:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826042:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.826043:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.826043:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826047:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826053:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826056:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f412e73 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [73728->10260479] (req 73728->10260479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.826065:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.826070:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.826467:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.826480:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.826489:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.826496:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468680448
00000100:00100000:1.0:1651532155.826497:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.826504:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.826506:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468680512
00000100:00100000:0.0:1651532155.826515:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4751
00000100:00100000:1.0:1651532155.826516:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.826517:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468680448:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532155.826524:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4752
00010000:00010000:0.0:1651532155.826524:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.826527:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468680512:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532155.826528:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532155.826529:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826532:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532155.826532:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.826536:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826537:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.826540:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532155.826542:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.826545:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532155.826545:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826549:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.826550:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.826553:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.826558:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468680576
00000100:00100000:1.0:1651532155.826560:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468680640
00000100:00100000:0.0:1651532155.826562:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468680704
00000100:00100000:0.0:1651532155.826565:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468680768
00000100:00100000:1.0:1651532155.826567:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4950
00000100:00100000:1.0:1651532155.826568:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468680576:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532155.826569:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4951
00010000:00010000:1.0:1651532155.826571:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532155.826571:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468680640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.826574:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412f7d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c855 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826574:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.826577:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412f84 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c85c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826584:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412f84 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c85c expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.826585:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412f7d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c855 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.826589:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412f7d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c855 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.826592:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f412f84 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c85c expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.826593:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532155.826595:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532155.826603:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468680576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (114us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.826604:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468680640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.826606:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4950
00000100:00100000:0.0:1651532155.826608:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4951
00000100:00100000:1.0:1651532155.826611:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4952
00000100:00100000:1.0:1651532155.826613:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468680704:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532155.826613:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4953
00000100:00100000:0.0:1651532155.826615:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000577063a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468680768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.826616:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.826617:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.826618:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412f8b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c863 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.826619:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412f92 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c86a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.826626:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412f8b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c863 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.826626:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412f92 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c86a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.826630:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412f8b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c863 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.826630:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412f92 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c86a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.826633:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:0.0:1651532155.826633:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:1.0:1651532155.826639:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468680704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.826640:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000577063a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468680768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.826642:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4952
00000100:00100000:0.0:1651532155.826644:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4953
00000100:00100000:0.0:1651532155.827069:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.827077:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.827084:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.827090:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468680896
00000100:00100000:0.0:1651532155.827104:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468681024
00000100:00100000:0.0:1651532155.827107:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468681152
00000100:00100000:0.0:1651532155.827110:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4954
00000100:00100000:0.0:1651532155.827112:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468680896:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532155.827114:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4955
00000100:00100000:1.0:1651532155.827116:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468681024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.827116:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.827119:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f99 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c871 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.827120:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.827124:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412fa0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c878 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.827126:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f99 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c871 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.827131:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412f99 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c871 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.827132:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412fa0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c878 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.827134:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00010000:00010000:1.0:1651532155.827136:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412fa0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c878 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.827139:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532155.827147:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468680896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.827150:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4954
00000100:00100000:1.0:1651532155.827155:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468681024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.827155:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4956
00000100:00100000:0.0:1651532155.827156:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468681152:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532155.827158:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4955
00010000:00010000:0.0:1651532155.827159:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.827161:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412fa7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c87f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.827169:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412fa7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c87f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.827173:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412fa7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c87f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.827176:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532155.827182:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468681152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.827184:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4956
00000100:00100000:0.0:1651532155.827503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.827511:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.827517:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468681344
00000100:00100000:0.0:1651532155.827522:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468681472
00000100:00100000:0.0:1651532155.827533:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4957
00000100:00100000:0.0:1651532155.827535:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468681344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.827538:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.827542:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c886 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.827543:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4958
00000100:00100000:1.0:1651532155.827545:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468681472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.827549:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.827549:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c886 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.827553:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412fb5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c88d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.827553:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c886 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.827559:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532155.827560:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412fb5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c88d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.827567:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412fb5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c88d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532155.827571:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468681344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.827574:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4957
00010000:00010000:1.0:1651532155.827577:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532155.827585:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468681472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.827588:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4958
00000001:00080000:1.0:1651532155.992839:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794037 is committed
00010000:00010000:1.0:1651532155.992855:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.992859:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.992882:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468676160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 666413us (666486us total) trans 158913794037 rc 0/0
00000100:00100000:1.0:1651532155.992886:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4743
00010000:00010000:1.0:1651532155.992893:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.992896:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532155.992897:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.992900:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.992908:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532155.992909:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532155.992910:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.992913:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.992934:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.992937:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f412ea4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6655999] (req 98304->6655999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.992943:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.992948:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.993261:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.993275:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.993281:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468681728
00000100:00100000:1.0:1651532155.993293:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468681792
00010000:00010000:0.0:1651532155.993295:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.993300:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4959
00000100:00100000:1.0:1651532155.993301:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468681728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.993303:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993305:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.993308:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412fbc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c894 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993314:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532155.993317:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412fbc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c894 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532155.993322:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468676224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 666836us (666908us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532155.993325:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4744
00010000:00010000:1.0:1651532155.993327:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f412fbc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c894 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.993331:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532155.993332:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.993336:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532155.993337:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.993340:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468681728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (80us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532155.993340:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.993356:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4959
00010000:00010000:0.0:1651532155.993357:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.993358:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532155.993358:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.993361:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4960
00010000:00010000:0.0:1651532155.993362:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532155.993363:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468681792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.993366:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.993368:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412fc3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c89b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.993369:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.993372:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f412eab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->7962623] (req 2007040->7962623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993376:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412fc3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c89b expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.993377:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993380:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f412fc3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c89b expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.993381:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993383:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532155.993389:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468681792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.993391:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4960
00000100:00100000:1.0:1651532155.993875:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.993898:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.993900:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468682176
00000100:00100000:0.0:1651532155.993911:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468682112
00000100:00100000:1.0:1651532155.993914:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.993923:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4753
00000100:00100000:1.0:1651532155.993925:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532155.993925:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468682176:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532155.993935:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4754
00000100:00100000:1.0:1651532155.993937:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468682112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532155.993937:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.993941:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532155.993943:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993945:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.993946:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993950:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532155.993951:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993954:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993956:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532155.993957:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993962:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993964:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.993967:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468682240
00010000:00010000:1.0:1651532155.993968:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532155.993973:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468682368
00000100:00100000:0.0:1651532155.993977:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4961
00000100:00100000:0.0:1651532155.993978:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468682240:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532155.993979:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4962
00000100:00100000:1.0:1651532155.993981:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468682368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532155.993981:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.993984:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532155.993984:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412fd8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8a2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.993986:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412fdf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8a9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532155.993991:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412fd8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8a2 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.993993:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412fdf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8a9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.993995:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412fd8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8a2 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.993997:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f412fdf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8a9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532155.993999:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00010000:00010000:1.0:1651532155.994001:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532155.994010:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468682368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532155.994010:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468682240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.994012:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4962
00000100:00100000:0.0:1651532155.994014:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4961
00000100:00100000:1.0:1651532155.994285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532155.994293:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468682752
00000100:00100000:1.0:1651532155.994304:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4963
00000100:00100000:1.0:1651532155.994306:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468682752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532155.994309:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532155.994313:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412fe6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8b0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532155.994320:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412fe6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8b0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.994324:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f412fe6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8b0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532155.994330:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532155.994341:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468682752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532155.994351:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4963
00000001:00080000:1.0:1651532156.059324:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794038 is committed
00010000:00010000:0.0:1651532156.059359:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.059364:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.059386:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468676928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599149us (599190us total) trans 158913794038 rc 0/0
00000100:00100000:0.0:1651532156.059389:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4745
00010000:00010000:0.0:1651532156.059397:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.059400:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.059401:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.059404:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.059409:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.059410:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.059411:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.059414:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.059421:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.059424:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f412ed5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->2424831] (req 233472->2424831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.059434:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.059439:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.059676:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532156.059693:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.059697:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.059717:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468676992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 599432us (599509us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532156.059720:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4746
00010000:00010000:1.0:1651532156.059727:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.059731:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532156.059732:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.059735:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.059740:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532156.059741:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532156.059748:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468682880
00010000:00010000:1.0:1651532156.059750:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.059753:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.059756:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4964
00000100:00100000:0.0:1651532156.059758:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468682880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.059761:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.059762:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.059764:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f412edc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->6905855] (req 1314816->6905855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.059765:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412fed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8b7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.059769:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.059772:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.059773:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412fed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8b7 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.059778:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f412fed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8b7 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.059781:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532156.059794:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468682880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.059797:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4964
00000100:00100000:1.0:1651532156.060041:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.060049:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.060059:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.060059:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468683008
00000100:00100000:0.0:1651532156.060074:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468683072
00000100:00100000:0.0:1651532156.060080:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4755
00000100:00100000:0.0:1651532156.060081:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468683008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532156.060088:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.060093:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532156.060094:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.060097:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532156.060098:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.060102:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.060106:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.060113:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4756
00000100:00100000:0.0:1651532156.060114:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468683072:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532156.060119:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.060122:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532156.060123:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.060125:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532156.060126:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.060129:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.060132:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.060139:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468683264
00000100:00100000:0.0:1651532156.060144:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4965
00000100:00100000:0.0:1651532156.060146:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468683264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.060148:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.060160:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413002 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8be expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.060168:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413002 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8be expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.060172:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413002 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8be expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.060175:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532156.060186:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468683264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.060189:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4965
00000100:00100000:1.0:1651532156.128115:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532156.128140:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232960
00000100:00100000:0.0:1651532156.128151:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 67
00000100:00100000:0.0:1651532156.128153:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232960:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532156.128159:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 745472 granted 353010240 pending 86016 free 81138851840 avail 76967165952
00000100:00100000:0.0:1651532156.128172:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232960:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 19us (57us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532156.128175:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 67
00000001:00080000:1.0:1651532156.192634:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794039 is committed
00010000:00010000:1.0:1651532156.192648:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.192652:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.192674:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468678208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 607911us (607956us total) trans 158913794039 rc 0/0
00010000:00010000:0.0:1651532156.192676:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.192677:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4747
00010000:00010000:0.0:1651532156.192680:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.192681:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.192685:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.192690:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.192691:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.192692:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.192695:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.192698:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.192698:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.192699:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.192702:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.192710:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.192712:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f412f1b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->9183231] (req 2465792->9183231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.192718:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.192721:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.192728:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.192733:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.193007:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532156.193029:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.193033:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193037:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193041:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.193049:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468679424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 465966us (466084us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532156.193053:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4749
00000100:00100000:1.0:1651532156.193054:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468678272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 608255us (608328us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532156.193057:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4748
00010000:00010000:0.0:1651532156.193059:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.193063:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532156.193064:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.193064:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193067:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.193067:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193069:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193072:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.193072:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193077:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532156.193078:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.193078:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f412f45 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3280896->9416703] (req 3280896->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193079:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193082:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.193085:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468683520
00010000:00010000:1.0:1651532156.193089:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.193091:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4966
00010000:00010000:1.0:1651532156.193092:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f412f22 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3665920->10018815] (req 3665920->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.193093:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468683520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.193096:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.193097:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.193099:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413009 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8c5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193100:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.193107:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413009 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8c5 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.193111:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413009 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8c5 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.193114:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532156.193121:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468683520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (114us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.193124:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4966
00000100:00100000:0.0:1651532156.193494:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.193505:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.193513:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468683584
00000100:00100000:0.0:1651532156.193513:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.193520:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468683648
00000100:00100000:0.0:1651532156.193533:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4757
00000100:00100000:0.0:1651532156.193534:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468683648:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532156.193541:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.193546:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4758
00010000:00010000:0.0:1651532156.193546:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532156.193547:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532156.193547:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.193548:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468683584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532156.193551:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193556:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.193557:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468683776
00010000:00010000:1.0:1651532156.193561:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532156.193562:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.193565:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4967
00000100:00100000:0.0:1651532156.193567:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468683776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.193569:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.193571:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.193572:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41301e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8cc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193574:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532156.193575:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193580:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.193580:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41301e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8cc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.193583:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.193584:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41301e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8cc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.193586:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.193588:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532156.193613:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468683776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.193623:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4967
00000100:00100000:0.0:1651532156.193654:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.193662:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.193671:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468683968
00000100:00100000:1.0:1651532156.193672:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468684096
00000100:00100000:0.0:1651532156.193678:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4968
00000100:00100000:0.0:1651532156.193680:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468683968:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532156.193683:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4969
00010000:00010000:0.0:1651532156.193683:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532156.193684:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468684096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.193686:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413025 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8d3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193688:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.193691:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41302c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8da expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.193699:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41302c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8da expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.193704:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41302c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8da expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.193707:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532156.193707:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413025 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8d3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.193712:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413025 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8d3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.193715:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:1.0:1651532156.193717:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468684096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.193720:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4969
00000100:00100000:0.0:1651532156.193723:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468683968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.193726:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4968
00000100:00100000:0.0:1651532156.193959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.193967:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.193973:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.193987:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468684224
00000100:00100000:1.0:1651532156.193991:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468684352
00000100:00100000:0.0:1651532156.193996:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468684416
00000100:00100000:0.0:1651532156.193999:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4970
00000100:00100000:0.0:1651532156.194001:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468684224:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532156.194004:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4971
00010000:00010000:0.0:1651532156.194004:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532156.194005:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468684416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.194008:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413033 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8e1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.194009:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.194012:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41303a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8ef expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.194015:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413033 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8e1 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.194019:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413033 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8e1 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.194020:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41303a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8ef expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.194023:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00010000:00010000:1.0:1651532156.194024:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41303a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8ef expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.194027:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532156.194035:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468684224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.194037:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4970
00000100:00100000:1.0:1651532156.194041:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468684416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.194042:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4972
00000100:00100000:0.0:1651532156.194044:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468684352:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532156.194045:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4971
00010000:00010000:0.0:1651532156.194046:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.194048:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413041 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8e8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.194054:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413041 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8e8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.194058:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413041 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8e8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.194064:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532156.194069:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468684352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.194072:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4972
00000100:00100000:0.0:1651532156.194270:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.194277:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468684672
00000100:00100000:0.0:1651532156.194283:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4973
00000100:00100000:0.0:1651532156.194285:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468684672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.194288:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.194291:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413048 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8f6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.194297:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413048 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8f6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.194301:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413048 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8f6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.194305:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:0.0:1651532156.194320:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468684672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.194323:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4973
00000100:00100000:0.0:1651532156.194533:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.194540:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468684864
00000100:00100000:0.0:1651532156.194546:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4974
00000100:00100000:0.0:1651532156.194548:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468684864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.194551:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.194555:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41304f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c8fd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.194562:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41304f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8fd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.194565:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41304f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c8fd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.194569:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532156.194584:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468684864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.194587:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4974
00000100:00100000:0.0:1651532156.194769:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.194775:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468684992
00000100:00100000:0.0:1651532156.194781:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4975
00000100:00100000:0.0:1651532156.194783:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468684992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.194786:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.194789:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413056 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c904 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.194796:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413056 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c904 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.194818:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413056 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c904 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.194822:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:0.0:1651532156.194839:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468684992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.194842:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4975
00000100:00100000:0.0:1651532156.195018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.195024:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468685120
00000100:00100000:0.0:1651532156.195031:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4976
00000100:00100000:0.0:1651532156.195032:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468685120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.195036:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.195039:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41305d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c90b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.195046:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41305d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c90b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.195050:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41305d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c90b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.195053:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532156.195068:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468685120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.195073:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4976
00000001:00080000:1.0:1651532156.300975:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794040 is committed
00010000:00010000:1.0:1651532156.300990:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.300994:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.301015:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468679360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 573911us (574040us total) trans 158913794040 rc 0/0
00010000:00010000:0.0:1651532156.301017:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.301018:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4750
00010000:00010000:0.0:1651532156.301022:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.301023:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.301026:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.301032:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.301032:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.301033:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.301036:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.301044:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.301047:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f412f4c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->9039871] (req 557056->9039871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.301052:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.301064:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.301473:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.301483:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.301496:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.301503:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.301513:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468685248
00000100:00100000:0.0:1651532156.301519:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468685312
00000100:00100000:0.0:1651532156.301529:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468685504
00000100:00100000:0.0:1651532156.301533:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4977
00000100:00100000:1.0:1651532156.301534:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468685376
00000100:00100000:0.0:1651532156.301535:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468685312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.301538:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532156.301541:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4759
00010000:00010000:0.0:1651532156.301541:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f413064 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c912 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.301543:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468685248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532156.301549:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f413064 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c912 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.301550:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.301553:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f413064 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c912 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.301556:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:1.0:1651532156.301557:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532156.301558:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.301561:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532156.301562:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.301568:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468685312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.301571:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4977
00010000:00010000:1.0:1651532156.301572:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.301576:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.301576:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4978
00000100:00100000:0.0:1651532156.301578:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468685504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.301580:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.301582:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f413072 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c919 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.301583:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4760
00000100:00100000:1.0:1651532156.301585:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468685376:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532156.301588:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f413072 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c919 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.301590:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.301592:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f413072 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c919 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.301593:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532156.301594:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.301597:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532156.301598:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.301598:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:1.0:1651532156.301601:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.301603:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468685504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (100us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532156.301604:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.301605:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4978
00000100:00100000:1.0:1651532156.301622:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.301659:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468685696
00000100:00100000:1.0:1651532156.301672:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4979
00000100:00100000:1.0:1651532156.301673:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468685696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.301677:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.301680:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413080 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c920 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.301688:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413080 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c920 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.301692:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413080 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c920 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.301695:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532156.301706:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468685696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.301708:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4979
00000100:00100000:1.0:1651532156.302032:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.302039:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468686080
00000100:00100000:1.0:1651532156.302050:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4980
00000100:00100000:1.0:1651532156.302052:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468686080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.302056:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.302059:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413087 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c927 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.302066:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413087 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c927 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.302070:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413087 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c927 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.302073:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532156.302083:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468686080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.302085:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4980
00000001:00080000:1.0:1651532156.417628:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794041 is committed
00010000:00010000:1.0:1651532156.417643:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.417647:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.417668:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056b3c860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468680448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 591151us (591202us total) trans 158913794041 rc 0/0
00010000:00010000:0.0:1651532156.417669:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.417672:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4751
00010000:00010000:0.0:1651532156.417674:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.417675:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.417678:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.417684:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.417684:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.417685:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.417688:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.417691:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.417692:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.417693:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.417695:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.417703:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.417706:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f412f6f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->7258111] (req 2936832->7258111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.417711:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.417714:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.417719:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.417727:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418025:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418030:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.418049:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4acdd69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468682176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424124us (424174us total) trans 0 rc 40960/40960
00010000:00010000:1.0:1651532156.418051:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.418053:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4753
00010000:00010000:1.0:1651532156.418055:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.418072:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003504775b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468680512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 591545us (591592us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532156.418075:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4752
00010000:00010000:1.0:1651532156.418083:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418089:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418093:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.418094:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418100:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418106:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418108:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f412f76 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [868352->10194943] (req 868352->10194943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.418110:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532156.418111:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.418115:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.418120:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532156.418121:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532156.418122:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.418127:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.418135:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.418137:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f412fca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1064960->7524351] (req 1064960->7524351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.418143:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.418146:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.418431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.418442:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.418451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.418458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.418465:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.418475:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468686464
00000100:00100000:0.0:1651532156.418475:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468686528
00000100:00100000:1.0:1651532156.418492:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468686656
00000100:00100000:0.0:1651532156.418492:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468686400
00000100:00100000:1.0:1651532156.418495:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468686720
00000100:00100000:0.0:1651532156.418502:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4761
00000100:00100000:0.0:1651532156.418504:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468686528:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532156.418505:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4981
00000100:00100000:1.0:1651532156.418507:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468686464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.418511:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.418511:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.418514:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413095 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c92e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418516:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532156.418517:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532156.418517:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418522:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.418523:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413095 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c92e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532156.418529:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4982
00010000:00010000:1.0:1651532156.418530:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413095 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c92e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532156.418531:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468686656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.418534:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532156.418534:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.418537:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41309c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c935 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.418544:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468686464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (114us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532156.418544:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41309c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c935 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532156.418546:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4981
00010000:00010000:0.0:1651532156.418548:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41309c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c935 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532156.418551:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4983
00010000:00010000:0.0:1651532156.418551:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532156.418553:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468686720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.418555:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.418557:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c93c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.418560:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468686656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.418562:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4982
00010000:00010000:1.0:1651532156.418563:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c93c expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.418566:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c93c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.418569:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532156.418574:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468686720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.418577:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4983
00000100:00100000:0.0:1651532156.418577:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4762
00000100:00100000:0.0:1651532156.418578:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468686400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532156.418584:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418588:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532156.418589:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418594:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418597:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532156.418597:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418601:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418604:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418607:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.418938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.418947:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468686976
00000100:00100000:0.0:1651532156.418961:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4984
00000100:00100000:0.0:1651532156.418963:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468686976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.418967:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.418971:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4130b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c943 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.418979:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4130b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c943 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.418986:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4130b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c943 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.418989:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532156.419001:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468686976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.419003:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4984
00000100:00100000:0.0:1651532156.419039:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.419046:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468687168
00000100:00100000:0.0:1651532156.419056:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4985
00000100:00100000:0.0:1651532156.419058:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468687168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.419061:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.419064:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c94a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.419071:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c94a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.419075:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c94a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.419078:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532156.419089:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468687168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.419094:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4985
00000100:00100000:0.0:1651532156.419372:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.419379:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468687552
00000100:00100000:0.0:1651532156.419392:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4986
00000100:00100000:0.0:1651532156.419394:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468687552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.419397:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.419400:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c951 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.419408:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c951 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.419412:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c951 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.419415:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532156.419428:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468687552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.419431:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4986
00000001:00080000:1.0:1651532156.517679:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794042 is committed
00010000:00010000:1.0:1651532156.517697:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.517702:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.517730:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83a9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468682112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 523792us (523831us total) trans 158913794042 rc 0/0
00010000:00010000:0.0:1651532156.517732:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.517734:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4754
00010000:00010000:0.0:1651532156.517737:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.517738:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.517744:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.517749:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.517750:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.517751:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.517754:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.517762:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.517765:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f412fd1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10469375] (req 1085440->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.517781:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.517790:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.518203:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.518210:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.518224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.518234:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468687744
00000100:00100000:1.0:1651532156.518235:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468687680
00000100:00100000:0.0:1651532156.518246:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4763
00000100:00100000:1.0:1651532156.518248:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4764
00000100:00100000:0.0:1651532156.518248:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468687744:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532156.518250:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468687680:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532156.518254:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.518258:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.518259:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532156.518260:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.518263:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532156.518264:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.518269:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532156.518271:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.518274:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532156.518275:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.518279:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.518279:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.518283:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.518283:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.518291:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468688000
00000100:00100000:0.0:1651532156.518300:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4987
00000100:00100000:0.0:1651532156.518302:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468688000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.518304:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.518307:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130d4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c958 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.518314:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c958 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.518317:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c958 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.518321:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532156.518334:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468688000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.518336:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4987
00000100:00100000:1.0:1651532156.518582:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.518593:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468688128
00000100:00100000:0.0:1651532156.518601:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4988
00000100:00100000:0.0:1651532156.518603:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468688128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.518606:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.518610:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4130db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c95f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.518617:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4130db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c95f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.518621:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4130db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c95f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.518624:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532156.518634:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468688128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.518636:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4988
00000001:00080000:1.0:1651532156.609386:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794043 is committed
00002000:00010000:1.0:1651532156.609400:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532155 -> 1651532156
00002000:00010000:1.0:1651532156.609401:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532155 -> 1651532156
00010000:00010000:1.0:1651532156.609404:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.609408:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.609432:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029bc3606 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468683008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549349us (549391us total) trans 158913794043 rc 0/0
00010000:00010000:0.0:1651532156.609432:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.609436:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4755
00010000:00010000:0.0:1651532156.609437:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.609438:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609441:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609446:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.609447:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.609448:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609451:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609454:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.609455:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.609455:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609458:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609466:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609469:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f412ff4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3645440->9474047] (req 3645440->9474047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609474:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609477:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.609479:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.609483:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.609782:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.609799:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468688448
00000100:00100000:0.0:1651532156.609819:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4989
00010000:00010000:1.0:1651532156.609820:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.609821:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468688448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.609824:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609824:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.609828:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4130e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c966 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609834:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.609836:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4130e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c966 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532156.609843:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468683648:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416307us (416337us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532156.609846:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4757
00010000:00010000:0.0:1651532156.609846:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4130e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c966 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.609850:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:1.0:1651532156.609854:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.609857:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532156.609858:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.609859:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468688448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (77us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532156.609861:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.609861:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4989
00010000:00010000:1.0:1651532156.609867:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.609869:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413010 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1089536->6447103] (req 1089536->6447103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609873:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609876:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.609888:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093e444eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468683072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 549773us (549839us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532156.609890:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4756
00010000:00010000:0.0:1651532156.609896:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609899:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.609901:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609904:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609908:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.609909:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.609910:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609913:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609926:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.609929:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f412ffb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->5529599] (req 790528->5529599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.609935:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.609939:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.610285:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.610297:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468688704
00000100:00100000:1.0:1651532156.610304:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.610316:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468688640
00000100:00100000:0.0:1651532156.610324:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4765
00000100:00100000:0.0:1651532156.610326:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468688704:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532156.610327:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532156.610333:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.610335:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4766
00010000:00010000:0.0:1651532156.610337:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532156.610338:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468688640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532156.610358:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.610364:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.610370:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532156.610371:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.610375:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532156.610376:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.610379:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532156.610380:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.610384:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.610385:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.610387:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.610388:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.610398:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468688832
00000100:00100000:0.0:1651532156.610404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.610415:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468688896
00000100:00100000:1.0:1651532156.610422:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4990
00000100:00100000:1.0:1651532156.610423:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468688832:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532156.610427:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4991
00010000:00010000:1.0:1651532156.610428:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532156.610429:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468688896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.610431:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4130f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c96d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.610432:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.610436:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4130fe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c974 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.610439:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4130f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c96d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.610443:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4130f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c96d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.610443:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4130fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c974 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.610447:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532156.610447:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4130fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c974 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.610451:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532156.610458:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468688832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (131us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.610459:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468688896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.610461:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4990
00000100:00100000:0.0:1651532156.610463:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4991
00000100:00100000:0.0:1651532156.610698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.610707:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.610713:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468689152
00000100:00100000:0.0:1651532156.610719:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468689088
00000100:00100000:0.0:1651532156.610730:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4992
00000100:00100000:0.0:1651532156.610732:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468689152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.610735:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532156.610741:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4993
00000100:00100000:1.0:1651532156.610743:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468689088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.610746:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f413105 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c97b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.610747:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.610750:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41310c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c982 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.610754:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f413105 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c97b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.610758:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41310c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c982 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.610758:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f413105 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c97b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.610762:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41310c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c982 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.610762:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532156.610768:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532156.610774:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468689152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.610777:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4992
00000100:00100000:1.0:1651532156.610783:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468689088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.610786:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4993
00000001:00080000:1.0:1651532156.726059:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794044 is committed
00010000:00010000:1.0:1651532156.726075:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.726079:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.726105:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468683584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532557us (532611us total) trans 158913794044 rc 0/0
00010000:00010000:0.0:1651532156.726107:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.726109:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4758
00010000:00010000:0.0:1651532156.726112:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.726113:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.726116:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.726122:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.726122:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.726123:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.726126:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.726136:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.726139:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413017 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4513792->8544255] (req 4513792->8544255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.726152:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.726157:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.726493:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.726500:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.726507:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.726513:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468689408
00000100:00100000:1.0:1651532156.726523:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468689472
00000100:00100000:1.0:1651532156.726534:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4767
00000100:00100000:1.0:1651532156.726537:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468689408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532156.726544:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.726545:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4768
00000100:00100000:0.0:1651532156.726547:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468689472:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532156.726548:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532156.726550:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532156.726550:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.726554:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.726555:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.726559:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532156.726561:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468689664
00010000:00010000:0.0:1651532156.726561:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.726563:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532156.726564:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.726570:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4994
00000100:00100000:1.0:1651532156.726572:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468689664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.726574:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.726576:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.726577:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413121 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c989 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.726579:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.726585:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413121 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c989 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.726589:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413121 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c989 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.726593:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532156.726603:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468689664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.726608:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4994
00000001:00080000:1.0:1651532156.809398:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794045 is committed
00010000:00010000:1.0:1651532156.809413:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.809417:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.809441:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468685248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507897us (507968us total) trans 158913794045 rc 0/0
00010000:00010000:0.0:1651532156.809441:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.809444:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4759
00010000:00010000:0.0:1651532156.809445:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.809446:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809450:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809455:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.809456:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.809457:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809460:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809463:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.809464:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.809464:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809467:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809475:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809478:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41306b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3870720->10473471] (req 3870720->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809484:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809487:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.809494:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.809498:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.809773:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532156.809798:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809816:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.809831:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.809833:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468686528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391328us (391390us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532156.809842:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4761
00010000:00010000:0.0:1651532156.809850:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809856:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.809857:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809860:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809865:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809868:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41308e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2711552->10113023] (req 2711552->10113023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.809869:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.809874:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.809875:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468689856
00000100:00100000:0.0:1651532156.809881:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468689920
00000100:00100000:0.0:1651532156.809885:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4995
00000100:00100000:0.0:1651532156.809887:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468689856:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532156.809889:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468685376:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508303us (508393us total) trans 0 rc 45056/45056
00010000:00010000:0.0:1651532156.809890:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.809893:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f413128 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c990 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.809894:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4760
00010000:00010000:0.0:1651532156.809898:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532156.809901:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809901:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f413128 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c990 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.809904:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.809905:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f413128 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c990 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.809906:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.809909:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809911:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:1.0:1651532156.809914:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532156.809914:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532156.809915:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.809918:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.809918:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468689856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.809921:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4995
00000100:00100000:0.0:1651532156.809925:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4996
00010000:00010000:1.0:1651532156.809930:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.809933:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413079 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->9695231] (req 28672->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.809934:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468689920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.809937:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.809939:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41312f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c997 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809945:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41312f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c997 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.809949:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41312f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c997 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.809952:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532156.809958:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468689920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.809961:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4996
00010000:00010000:0.0:1651532156.809967:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.809970:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.810006:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.810014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.810037:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468689984
00000100:00100000:0.0:1651532156.810055:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468690048
00000100:00100000:1.0:1651532156.810058:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4769
00000100:00100000:1.0:1651532156.810061:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468689984:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532156.810066:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4770
00000100:00100000:0.0:1651532156.810067:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468690048:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532156.810073:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.810075:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.810078:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532156.810079:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.810082:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532156.810083:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.810087:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532156.810088:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.810092:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.810093:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.810096:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.810137:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.810167:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468690112
00000100:00100000:1.0:1651532156.810176:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4997
00000100:00100000:1.0:1651532156.810178:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468690112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.810181:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.810185:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f413144 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c99e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.810192:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f413144 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c99e expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.810200:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f413144 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c99e expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.810203:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532156.810216:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468690112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.810219:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4997
00000100:00100000:1.0:1651532156.810242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.810272:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.810273:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468690176
00000100:00100000:1.0:1651532156.810288:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468690304
00000100:00100000:1.0:1651532156.810294:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4998
00000100:00100000:1.0:1651532156.810295:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468690176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532156.810296:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4999
00000100:00100000:0.0:1651532156.810298:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468690304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.810299:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.810302:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41314b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9a5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.810302:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.810306:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f413152 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9ac expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.810309:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41314b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9a5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.810313:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41314b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9a5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.810313:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f413152 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9ac expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.810317:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532156.810318:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f413152 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9ac expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.810321:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532156.810326:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468690176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.810330:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468690304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.810331:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4998
00000100:00100000:0.0:1651532156.810333:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4999
00000100:00100000:0.0:1651532156.810513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.810520:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468690496
00000100:00100000:0.0:1651532156.810535:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5000
00000100:00100000:0.0:1651532156.810537:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b29f8e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468690496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.810540:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.810543:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f413159 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9b3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.810551:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f413159 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9b3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.810555:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f413159 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9b3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.810558:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532156.810570:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b29f8e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468690496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.810573:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5000
00000100:00100000:0.0:1651532156.810635:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.810642:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468690688
00000100:00100000:0.0:1651532156.810652:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5001
00000100:00100000:0.0:1651532156.810654:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468690688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.810658:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.810661:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f413160 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9ba expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.810668:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f413160 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9ba expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.810672:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f413160 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9ba expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.810675:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532156.810686:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468690688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.810688:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5001
00000100:00100000:0.0:1651532156.810739:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.810745:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468690816
00000100:00100000:0.0:1651532156.810755:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5002
00000100:00100000:0.0:1651532156.810757:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468690816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.810760:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.810763:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413167 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9c1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.810770:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413167 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9c1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.810777:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413167 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9c1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.810780:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532156.810792:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468690816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.810794:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5002
00000100:00100000:0.0:1651532156.810875:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.810881:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468691008
00000100:00100000:0.0:1651532156.810891:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5003
00000100:00100000:0.0:1651532156.810893:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468691008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.810896:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.810900:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41316e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9c8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.810906:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41316e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9c8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.810910:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41316e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9c8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.810913:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532156.810925:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468691008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.810929:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5003
00000100:00100000:0.0:1651532156.811012:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.811019:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468691200
00000100:00100000:0.0:1651532156.811029:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5004
00000100:00100000:0.0:1651532156.811031:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468691200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.811034:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.811037:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413175 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9cf expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.811044:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413175 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9cf expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.811048:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413175 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9cf expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.811051:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532156.811062:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468691200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.811064:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5004
00000100:00100000:0.0:1651532156.811178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.811185:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468691456
00000100:00100000:0.0:1651532156.811197:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5005
00000100:00100000:0.0:1651532156.811199:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468691456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.811202:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.811206:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41317c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9d6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.811212:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41317c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9d6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.811216:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41317c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9d6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.811219:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532156.811231:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468691456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.811233:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5005
00000100:00100000:0.0:1651532156.811424:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.811431:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468691712
00000100:00100000:0.0:1651532156.811443:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5006
00000100:00100000:0.0:1651532156.811445:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468691712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.811448:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.811452:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413183 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9dd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.811458:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413183 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9dd expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.811462:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413183 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9dd expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.811465:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532156.811477:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468691712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.811480:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5006
00000001:00080000:1.0:1651532156.909431:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794046 is committed
00010000:00010000:0.0:1651532156.909462:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909466:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.909483:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468686400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490904us (491032us total) trans 158913794046 rc 0/0
00000100:00100000:0.0:1651532156.909486:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4762
00010000:00010000:0.0:1651532156.909492:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909495:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.909496:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909499:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909504:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.909505:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.909505:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909508:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909517:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909520:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4130aa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [450560->9887743] (req 450560->9887743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909525:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909528:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909696:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909701:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.909721:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468687744:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391473us (391519us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532156.909724:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4763
00010000:00010000:0.0:1651532156.909731:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909735:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532156.909736:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909741:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909746:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.909746:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532156.909747:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909750:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909760:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.909763:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4130c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2392064->9347071] (req 2392064->9347071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.909764:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.909770:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.909978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.909986:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.909993:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.909999:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.910009:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.910017:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.910026:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468691840
00000100:00100000:0.0:1651532156.910038:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468691904
00000100:00100000:0.0:1651532156.910045:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4771
00000100:00100000:0.0:1651532156.910047:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468691840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532156.910055:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.910060:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532156.910061:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.910063:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.910066:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.910069:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532156.910069:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.910073:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.910076:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.910079:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.910082:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.910090:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468691968
00000100:00100000:0.0:1651532156.910092:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4772
00000100:00100000:0.0:1651532156.910094:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468691904:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532156.910097:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468692032
00010000:00010000:0.0:1651532156.910098:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.910099:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468692096
00000100:00100000:1.0:1651532156.910101:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468692224
00010000:00010000:0.0:1651532156.910101:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532156.910102:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.910105:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5007
00010000:00010000:0.0:1651532156.910105:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532156.910105:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532156.910107:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468691968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.910109:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.910111:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.910112:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.910115:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413198 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9e4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532156.910118:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5008
00000100:00100000:0.0:1651532156.910119:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468692032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.910122:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.910123:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413198 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9e4 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.910124:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41319f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9eb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.910128:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413198 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9e4 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.910130:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41319f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9eb expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.910132:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532156.910135:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41319f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9eb expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.910138:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532156.910143:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468691968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (157us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.910146:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468692032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (147us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.910148:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5007
00000100:00100000:0.0:1651532156.910150:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5008
00000100:00100000:1.0:1651532156.910153:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5009
00000100:00100000:1.0:1651532156.910155:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468692096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532156.910155:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5010
00000100:00100000:0.0:1651532156.910156:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468692224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.910158:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.910159:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.910160:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4131a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9f2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.910161:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4131ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44c9f9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.910166:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4131a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9f2 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.910167:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4131ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9f9 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.910170:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4131a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9f2 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.910170:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4131ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44c9f9 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.910173:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532156.910174:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532156.910179:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468692096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (171us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.910180:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468692224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (163us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.910182:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5009
00000100:00100000:0.0:1651532156.910183:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5010
00000100:00100000:0.0:1651532156.910483:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.910502:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468692352
00000100:00100000:0.0:1651532156.910507:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.910516:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468692480
00000100:00100000:1.0:1651532156.910518:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5011
00000100:00100000:1.0:1651532156.910520:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468692352:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532156.910526:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5012
00010000:00010000:1.0:1651532156.910528:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532156.910528:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468692480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.910531:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.910532:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4131b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca00 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532156.910535:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4131bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca07 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.910539:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4131b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca00 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.910542:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4131bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca07 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.910543:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4131b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca00 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.910546:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4131bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca07 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.910547:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532156.910550:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:1.0:1651532156.910557:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468692352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.910557:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468692480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.910560:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5011
00000100:00100000:0.0:1651532156.910561:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5012
00000100:00100000:0.0:1651532156.910673:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.910692:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468692672
00000100:00100000:1.0:1651532156.910700:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5013
00000100:00100000:1.0:1651532156.910701:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468692672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.910705:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.910708:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4131c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca0e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.910715:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4131c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca0e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.910719:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4131c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca0e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.910722:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532156.910732:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468692672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.910734:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5013
00000100:00100000:0.0:1651532156.910851:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532156.910864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.910875:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468692864
00000100:00100000:1.0:1651532156.910886:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468692928
00000100:00100000:0.0:1651532156.910890:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5014
00000100:00100000:1.0:1651532156.910892:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5015
00000100:00100000:0.0:1651532156.910892:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468692864:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532156.910893:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468692928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532156.910895:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.910897:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532156.910899:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca15 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.910900:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4131d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca1c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.910907:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4131d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca1c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.910909:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca15 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.910911:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4131d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca1c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532156.910913:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca15 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.910915:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532156.910916:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:1.0:1651532156.910925:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468692928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532156.910925:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468692864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.910927:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5015
00000100:00100000:0.0:1651532156.910929:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5014
00000100:00100000:0.0:1651532156.911167:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532156.911185:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468693184
00000100:00100000:1.0:1651532156.911196:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5016
00000100:00100000:1.0:1651532156.911198:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468693184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532156.911201:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532156.911204:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca23 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532156.911211:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca23 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.911218:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca23 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532156.911221:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532156.911231:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468693184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532156.911233:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5016
00000001:00080000:1.0:1651532157.017781:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794047 is committed
00010000:00010000:1.0:1651532157.017797:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.017801:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.017836:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468687680:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499584us (499625us total) trans 158913794047 rc 0/0
00000100:00100000:1.0:1651532157.017839:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4764
00010000:00010000:1.0:1651532157.017847:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.017850:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.017851:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.017854:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.017860:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.017861:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.017862:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.017865:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.017880:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.017881:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.017885:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4130cd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1949696->9957375] (req 1949696->9957375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.017885:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.018253:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.018266:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.018275:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.018282:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468693440
00000100:00100000:0.0:1651532157.018283:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.018290:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.018298:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468693504
00000100:00100000:1.0:1651532157.018304:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4773
00000100:00100000:1.0:1651532157.018306:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468693440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532157.018308:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.018312:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018313:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018317:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.018318:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018321:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532157.018322:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.018330:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468688704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408003us (408045us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532157.018333:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4765
00010000:00010000:1.0:1651532157.018335:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018339:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.018339:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4774
00000100:00100000:0.0:1651532157.018341:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468693504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532157.018357:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.018359:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468693696
00010000:00010000:0.0:1651532157.018361:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.018363:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.018365:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00000100:00100000:1.0:1651532157.018366:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468693760
00010000:00010000:0.0:1651532157.018366:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.018368:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468693824
00000100:00100000:1.0:1651532157.018371:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5017
00010000:00010000:0.0:1651532157.018371:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.018373:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468693696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.018374:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018376:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.018378:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4131ec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca2a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.018381:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018383:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.018385:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532157.018386:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018387:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4131ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca2a expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.018389:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018391:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4131ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca2a expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.018393:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.018394:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532157.018394:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.018395:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.018397:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.018401:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.018401:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532157.018402:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468693696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (127us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532157.018402:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.018405:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5017
00010000:00010000:0.0:1651532157.018405:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.018409:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5018
00010000:00010000:0.0:1651532157.018414:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.018416:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4130e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [765952->4313087] (req 765952->4313087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.018418:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468693760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.018421:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.018423:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4131f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca31 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.018424:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5019
00000100:00100000:0.0:1651532157.018425:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468693824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.018428:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.018429:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4131f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca31 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.018431:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4131fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca38 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018433:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4131f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca31 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.018436:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532157.018438:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4131fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca38 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532157.018442:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468693760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (158us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532157.018442:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4131fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca38 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532157.018444:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5018
00010000:00010000:0.0:1651532157.018445:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00010000:00010000:1.0:1651532157.018451:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.018452:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468693824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (162us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532157.018454:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.018455:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5019
00010000:00010000:1.0:1651532157.018474:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018478:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.018906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.018920:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.018927:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468694016
00000100:00100000:1.0:1651532157.018928:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468694208
00000100:00100000:0.0:1651532157.018935:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5020
00000100:00100000:0.0:1651532157.018937:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468694016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532157.018938:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5021
00000100:00100000:1.0:1651532157.018940:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468694208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.018940:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.018943:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.018952:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413201 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca3f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.018954:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413208 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca46 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.018960:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413201 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca3f expref: 23 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.018963:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413208 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca46 expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.018967:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413208 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca46 expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.018967:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413201 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca3f expref: 23 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.018970:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532157.018971:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532157.018985:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468694208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.018987:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5021
00000100:00100000:0.0:1651532157.018990:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468694016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.018993:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5020
00000100:00100000:0.0:1651532157.019242:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.019249:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468694464
00000100:00100000:0.0:1651532157.019256:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5022
00000100:00100000:0.0:1651532157.019258:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468694464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.019261:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.019265:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41320f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca4d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.019272:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41320f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca4d expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.019276:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41320f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca4d expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.019279:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532157.019288:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468694464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.019292:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5022
00000001:00080000:1.0:1651532157.084533:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794049 is committed
00010000:00010000:1.0:1651532157.084550:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084555:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.084580:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468689408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 358043us (358087us total) trans 158913794049 rc 0/0
00010000:00010000:0.0:1651532157.084582:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.084584:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4767
00010000:00010000:0.0:1651532157.084587:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532157.084588:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.084591:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084597:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.084597:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.084600:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413113 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [729088->1753087] (req 729088->1753087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084601:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.084612:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468688640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474274us (474308us total) trans 158913794048 rc 0/0
00000100:00100000:1.0:1651532157.084615:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4766
00010000:00010000:1.0:1651532157.084621:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084624:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.084625:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084635:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084647:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.084648:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.084649:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084653:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084659:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.084659:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.084660:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084663:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084665:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.084666:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.084666:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084669:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084683:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084686:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4130f0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2273280->7389183] (req 2273280->7389183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.084690:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084692:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084695:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.084708:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084723:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084727:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084738:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084741:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.084764:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468690048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 274696us (274750us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532157.084768:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4770
00010000:00010000:1.0:1651532157.084777:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084781:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.084782:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084785:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084829:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.084832:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41313d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4358144->4362239] (req 4358144->4362239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085041:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.085051:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.085059:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.085066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.085077:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468694848
00000100:00100000:0.0:1651532157.085101:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468694912
00000100:00100000:0.0:1651532157.085109:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5023
00000100:00100000:0.0:1651532157.085111:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468694848:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532157.085114:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468694656
00010000:00010000:0.0:1651532157.085114:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.085118:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413216 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca54 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.085125:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468694592
00010000:00010000:0.0:1651532157.085126:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413216 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca54 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.085130:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413216 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca54 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532157.085131:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4775
00000100:00100000:1.0:1651532157.085133:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468694656:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532157.085134:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00010000:00010000:1.0:1651532157.085140:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085141:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468694848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.085144:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5023
00010000:00010000:1.0:1651532157.085145:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.085146:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.085149:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085149:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5024
00000100:00100000:0.0:1651532157.085150:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468694912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.085153:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.085154:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413224 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca5b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.085156:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4776
00000100:00100000:1.0:1651532157.085157:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468694592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532157.085160:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413224 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca5b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.085161:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085164:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413224 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca5b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.085165:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532157.085166:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085167:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532157.085169:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.085171:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532157.085172:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085172:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468694912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.085174:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5024
00010000:00010000:0.0:1651532157.085190:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085193:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.085197:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.085201:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.085204:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085206:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468689472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358658us (358706us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532157.085209:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4768
00010000:00010000:0.0:1651532157.085215:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085219:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532157.085220:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085223:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085228:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085233:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41311a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9117695] (req 4136960->9117695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085247:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.085266:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468694976
00000100:00100000:0.0:1651532157.085286:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4777
00000100:00100000:0.0:1651532157.085288:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468694976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532157.085296:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085301:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532157.085302:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085305:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532157.085305:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085310:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085313:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085683:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.085695:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.085704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.085712:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.085714:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468695296
00000100:00100000:0.0:1651532157.085721:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.085730:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468695232
00000100:00100000:0.0:1651532157.085735:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468695104
00000100:00100000:1.0:1651532157.085736:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4778
00000100:00100000:1.0:1651532157.085738:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468695296:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532157.085742:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468695360
00010000:00010000:1.0:1651532157.085744:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085744:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468695424
00000100:00100000:0.0:1651532157.085747:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5025
00010000:00010000:1.0:1651532157.085748:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.085749:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085749:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468695104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.085752:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532157.085752:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085752:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.085756:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085756:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413240 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca62 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.085763:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085763:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413240 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca62 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.085767:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413240 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca62 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532157.085769:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4779
00000100:00100000:1.0:1651532157.085771:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468695232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532157.085771:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00010000:00010000:1.0:1651532157.085775:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.085778:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.085779:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085780:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468695104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (117us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532157.085781:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532157.085782:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085782:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5025
00010000:00010000:1.0:1651532157.085785:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085787:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5026
00010000:00010000:1.0:1651532157.085788:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.085789:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468695360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.085791:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.085793:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41324e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca69 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.085796:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5027
00000100:00100000:1.0:1651532157.085797:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468695424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.085798:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41324e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca69 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.085800:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.085815:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f413255 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca70 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.085815:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41324e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca69 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.085819:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00010000:00010000:1.0:1651532157.085823:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f413255 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca70 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532157.085825:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468695360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (113us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532157.085828:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f413255 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca70 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532157.085828:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5026
00010000:00010000:1.0:1651532157.085831:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532157.085841:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468695424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.085844:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5027
00000100:00100000:0.0:1651532157.086061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.086079:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468695552
00000100:00100000:1.0:1651532157.086090:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5028
00000100:00100000:1.0:1651532157.086092:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468695552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.086095:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.086098:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41325c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca77 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.086105:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41325c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca77 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.086110:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41325c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca77 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.086113:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532157.086127:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468695552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.086130:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5028
00000100:00100000:0.0:1651532157.086359:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.086377:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468695872
00000100:00100000:1.0:1651532157.086386:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5029
00000100:00100000:1.0:1651532157.086388:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468695872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.086391:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.086394:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413263 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca7e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.086401:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413263 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca7e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.086405:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413263 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca7e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.086408:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532157.086420:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468695872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.086422:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5029
00000001:00080000:1.0:1651532157.176198:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794050 is committed
00010000:00010000:1.0:1651532157.176213:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.176217:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.176239:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468689984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 366178us (366233us total) trans 158913794050 rc 0/0
00000100:00100000:1.0:1651532157.176243:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4769
00010000:00010000:1.0:1651532157.176250:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.176254:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.176255:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.176258:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.176262:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.176263:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.176264:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.176267:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.176287:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.176291:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413136 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->3805183] (req 36864->3805183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.176301:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.176305:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.176611:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.176629:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468696192
00000100:00100000:1.0:1651532157.176640:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5030
00000100:00100000:1.0:1651532157.176642:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468696192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.176646:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.176650:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41326a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca85 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.176657:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41326a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca85 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.176661:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41326a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca85 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.176664:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532157.176689:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468696192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.176692:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5030
00000001:00080000:1.0:1651532157.284582:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794051 is committed
00010000:00010000:0.0:1651532157.284612:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.284617:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.284639:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.284639:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3638242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468691840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 374591us (374661us total) trans 158913794051 rc 0/0
00000100:00100000:0.0:1651532157.284642:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4771
00010000:00010000:1.0:1651532157.284644:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.284645:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.284648:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.284654:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.284654:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.284655:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.284659:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.284668:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.284671:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41318a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1257472->9134079] (req 1257472->9134079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.284679:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.284683:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.284946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.284955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.284966:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468696320
00000100:00100000:0.0:1651532157.284970:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.284982:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468696384
00010000:00010000:0.0:1651532157.284983:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.284987:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.284989:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4780
00000100:00100000:1.0:1651532157.284991:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468696320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532157.284998:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.285001:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000049bd2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468691904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 374907us (375008us total) trans 0 rc 49152/49152
00010000:00010000:1.0:1651532157.285002:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.285003:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.285004:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4772
00010000:00010000:1.0:1651532157.285006:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532157.285007:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.285010:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4781
00010000:00010000:1.0:1651532157.285011:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.285012:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468696384:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532157.285017:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.285019:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.285023:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.285024:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.285025:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468696512
00010000:00010000:0.0:1651532157.285027:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532157.285028:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.285036:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5031
00000100:00100000:1.0:1651532157.285038:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468696512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.285040:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.285041:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.285043:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41327f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca8c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.285044:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.285048:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.285050:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.285051:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41327f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca8c expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285053:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532157.285054:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.285055:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41327f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca8c expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285057:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.285059:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532157.285062:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.285063:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.285063:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.285066:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.285068:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468696512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.285070:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5031
00010000:00010000:0.0:1651532157.285076:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.285079:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413191 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1044480->10313727] (req 1044480->10313727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.285085:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.285089:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.285375:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.285382:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468696768
00000100:00100000:0.0:1651532157.285393:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5032
00000100:00100000:0.0:1651532157.285395:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468696768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.285399:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.285402:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413286 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca93 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.285410:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413286 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca93 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285414:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413286 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca93 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285418:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532157.285428:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468696768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.285430:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5032
00000100:00100000:0.0:1651532157.285472:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.285479:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468696896
00000100:00100000:0.0:1651532157.285489:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5033
00000100:00100000:0.0:1651532157.285491:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468696896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.285495:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.285498:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41328d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ca9a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.285508:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41328d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca9a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285529:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41328d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ca9a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285533:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532157.285541:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468696896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.285544:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5033
00000100:00100000:0.0:1651532157.285569:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.285590:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468696960
00000100:00100000:0.0:1651532157.285599:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5034
00000100:00100000:0.0:1651532157.285601:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468696960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.285604:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.285607:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413294 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44caa1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.285614:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413294 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44caa1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285618:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413294 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44caa1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285621:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532157.285631:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468696960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.285633:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5034
00000100:00100000:0.0:1651532157.285662:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.285686:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468697088
00000100:00100000:0.0:1651532157.285696:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5035
00000100:00100000:0.0:1651532157.285697:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468697088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.285701:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.285704:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41329b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44caa8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.285711:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41329b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44caa8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285715:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41329b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44caa8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285718:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532157.285726:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468697088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.285729:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5035
00000100:00100000:0.0:1651532157.285876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.285883:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468697344
00000100:00100000:0.0:1651532157.285894:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5036
00000100:00100000:0.0:1651532157.285896:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468697344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.285899:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.285902:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4132a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44caaf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.285910:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4132a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44caaf expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285913:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4132a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44caaf expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.285917:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532157.285926:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468697344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.285928:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5036
00000100:00100000:0.0:1651532157.286033:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.286039:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468697472
00000100:00100000:0.0:1651532157.286050:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5037
00000100:00100000:0.0:1651532157.286052:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468697472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.286055:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.286058:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cab6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.286065:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cab6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.286069:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cab6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.286075:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532157.286084:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468697472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.286087:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5037
00000100:00100000:0.0:1651532157.286145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.286152:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468697664
00000100:00100000:1.0:1651532157.286164:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5038
00000100:00100000:1.0:1651532157.286166:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468697664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.286170:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.286174:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4132b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cabd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.286182:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4132b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cabd expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.286186:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4132b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cabd expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.286190:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532157.286204:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468697664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.286207:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5038
00000001:00080000:1.0:1651532157.384576:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794052 is committed
00002000:00010000:1.0:1651532157.384590:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532156 -> 1651532157
00002000:00010000:1.0:1651532157.384592:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532156 -> 1651532157
00010000:00010000:1.0:1651532157.384594:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384598:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.384624:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468693440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 366317us (366370us total) trans 158913794052 rc 0/0
00000100:00100000:1.0:1651532157.384627:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4773
00010000:00010000:1.0:1651532157.384634:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384638:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.384639:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384642:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384648:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.384648:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.384649:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384652:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384655:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.384655:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.384656:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384668:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384684:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384688:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4131de lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->10035199] (req 897024->10035199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384694:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.384696:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.384697:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.384701:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.384954:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.384965:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.384973:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468697920
00000100:00100000:0.0:1651532157.384974:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.384989:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5039
00000100:00100000:1.0:1651532157.384991:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468697920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.384994:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.384998:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4132b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cac4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.384999:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532157.385003:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.385006:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4132b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cac4 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532157.385007:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468697856
00010000:00010000:1.0:1651532157.385011:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4132b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cac4 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.385016:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532157.385021:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468697984
00000100:00100000:0.0:1651532157.385029:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4782
00000100:00100000:0.0:1651532157.385031:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468697856:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532157.385040:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468697920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.385043:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5039
00010000:00010000:0.0:1651532157.385043:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.385048:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468698048
00010000:00010000:0.0:1651532157.385048:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532157.385049:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.385055:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5040
00000100:00100000:1.0:1651532157.385057:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468698048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.385060:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.385060:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532157.385061:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385062:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4132c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cacb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385065:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385067:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.385069:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4132c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cacb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.385069:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385073:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4132c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cacb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.385076:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532157.385080:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.385082:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468698048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (83us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532157.385083:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.385084:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5040
00000100:00100000:1.0:1651532157.385100:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4783
00000100:00100000:0.0:1651532157.385101:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cee4ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468693504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366759us (366834us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532157.385102:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468697984:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532157.385104:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4774
00010000:00010000:1.0:1651532157.385109:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385112:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.385113:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385116:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532157.385117:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385121:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385124:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385130:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385133:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003325411e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.385134:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385137:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385151:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385156:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4131e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->10231807] (req 696320->10231807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385166:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385169:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.385189:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468694656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 300055us (300148us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532157.385192:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4775
00010000:00010000:0.0:1651532157.385203:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385207:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532157.385209:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385212:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385217:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.385218:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.385219:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385222:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385232:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385235:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385235:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41321d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2260992->9699327] (req 2260992->9699327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385239:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.385474:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.385482:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.385529:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468698304
00000100:00100000:0.0:1651532157.385536:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468698368
00000100:00100000:0.0:1651532157.385543:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5041
00000100:00100000:0.0:1651532157.385545:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468698304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.385549:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.385552:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4132d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cad2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385559:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4132d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cad2 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.385566:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4132d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cad2 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.385570:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532157.385579:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468698304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.385582:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5041
00000100:00100000:0.0:1651532157.385586:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5042
00000100:00100000:0.0:1651532157.385588:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468698368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.385590:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.385592:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4132da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cad9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385598:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4132da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cad9 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.385601:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4132da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cad9 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.385604:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532157.385609:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468698368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.385611:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5042
00000100:00100000:0.0:1651532157.385672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.385680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.385711:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468698752
00000100:00100000:0.0:1651532157.385716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.385727:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.385738:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468698688
00000100:00100000:0.0:1651532157.385740:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468698816
00000100:00100000:1.0:1651532157.385747:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4784
00000100:00100000:1.0:1651532157.385749:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468698752:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532157.385750:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468698880
00000100:00100000:0.0:1651532157.385758:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5043
00000100:00100000:0.0:1651532157.385760:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468698816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.385761:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385763:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.385765:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532157.385766:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4132e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cae0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385774:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532157.385775:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385780:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385781:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4132e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cae0 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.385786:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4132e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cae0 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532157.385788:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4785
00010000:00010000:0.0:1651532157.385789:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532157.385790:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468698688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532157.385795:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385799:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.385799:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.385799:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468698816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.385801:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5043
00010000:00010000:1.0:1651532157.385802:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532157.385814:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.385818:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5044
00010000:00010000:1.0:1651532157.385819:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.385820:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468698880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.385822:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.385823:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385825:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4132f6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cae7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.385834:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4132f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cae7 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.385838:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4132f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cae7 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.385841:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532157.385847:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468698880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (120us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.385849:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5044
00000100:00100000:0.0:1651532157.385899:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.385921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.385928:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468699008
00000100:00100000:0.0:1651532157.385934:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468699072
00000100:00100000:0.0:1651532157.385941:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5045
00000100:00100000:0.0:1651532157.385943:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468699008:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532157.385945:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5046
00010000:00010000:0.0:1651532157.385946:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532157.385947:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468699072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.385949:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4132fd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44caee expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385950:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.385956:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4132fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44caee expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.385961:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413304 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44caf5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.385969:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413304 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44caf5 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.385973:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413304 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44caf5 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.385974:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4132fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44caee expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.385976:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532157.385981:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:1.0:1651532157.385990:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468699072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.385993:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5046
00000100:00100000:0.0:1651532157.385996:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468699008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.385999:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5045
00000100:00100000:0.0:1651532157.386110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.386117:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468699264
00000100:00100000:0.0:1651532157.386123:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5047
00000100:00100000:0.0:1651532157.386125:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001b5fb34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468699264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.386128:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.386131:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41330b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cafc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.386138:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41330b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cafc expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.386142:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41330b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cafc expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.386146:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532157.386154:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001b5fb34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468699264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (45us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.386157:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5047
00000100:00100000:0.0:1651532157.386236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.386243:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468699520
00000100:00100000:0.0:1651532157.386250:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5048
00000100:00100000:0.0:1651532157.386252:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468699520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.386255:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.386258:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413312 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb03 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.386265:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413312 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb03 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.386269:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413312 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb03 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.386272:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532157.386281:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468699520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (45us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.386283:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5048
00000001:00080000:1.0:1651532157.517919:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794053 is committed
00010000:00010000:1.0:1651532157.517935:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.517939:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.517964:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468694592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432806us (432913us total) trans 158913794053 rc 0/0
00000100:00100000:1.0:1651532157.517968:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4776
00010000:00010000:1.0:1651532157.517975:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.517979:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.517980:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.517983:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.517988:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.517989:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.517990:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.517995:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.518005:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.518014:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.518021:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41322b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [536576->9932799] (req 536576->9932799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.518021:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.518364:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.518370:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.518377:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.518383:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468699776
00000100:00100000:0.0:1651532157.518397:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468699904
00000100:00100000:0.0:1651532157.518399:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468699968
00000100:00100000:0.0:1651532157.518402:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5049
00000100:00100000:0.0:1651532157.518404:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468699776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.518408:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532157.518409:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5050
00000100:00100000:1.0:1651532157.518412:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468699904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.518412:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413319 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb0a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.518416:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.518420:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413319 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb0a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.518421:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413320 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb11 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.518424:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413319 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb0a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.518428:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00010000:00010000:1.0:1651532157.518430:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413320 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb11 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.518434:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413320 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb11 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.518438:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532157.518438:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468699776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.518441:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5049
00000100:00100000:0.0:1651532157.518445:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5051
00000100:00100000:0.0:1651532157.518447:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468699968:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532157.518448:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468699904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (77us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532157.518449:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532157.518451:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5050
00010000:00010000:0.0:1651532157.518452:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413327 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb18 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.518457:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413327 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb18 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.518461:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413327 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb18 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.518467:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532157.518472:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468699968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.518475:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5051
00000100:00100000:0.0:1651532157.518863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.518871:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468700160
00000100:00100000:0.0:1651532157.518886:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5052
00000100:00100000:0.0:1651532157.518888:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468700160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.518892:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.518896:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41332e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb1f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.518903:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41332e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb1f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.518907:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41332e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb1f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.518911:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532157.518921:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468700160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.518924:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5052
00000001:00080000:1.0:1651532157.617937:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794054 is committed
00010000:00010000:0.0:1651532157.617968:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.617975:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.617997:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468694976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532708us (532750us total) trans 158913794054 rc 0/0
00010000:00010000:1.0:1651532157.617999:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.618000:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4777
00010000:00010000:1.0:1651532157.618004:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.618005:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.618008:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.618014:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.618014:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.618015:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.618018:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.618030:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618034:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.618035:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413232 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1228800->7401471] (req 1228800->7401471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618038:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618182:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618186:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.618200:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468695296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 532461us (532504us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532157.618203:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4778
00010000:00010000:0.0:1651532157.618209:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618212:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532157.618213:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618217:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618222:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.618223:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.618223:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618227:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618239:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618242:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413239 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2695168->6516735] (req 2695168->6516735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.618248:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.618252:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.618421:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.618478:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.618487:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468700416
00000100:00100000:0.0:1651532157.618501:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468700352
00000100:00100000:0.0:1651532157.618508:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4786
00000100:00100000:0.0:1651532157.618510:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468700416:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532157.618518:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618522:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532157.618523:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618526:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532157.618527:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618531:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618534:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.618542:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4787
00000100:00100000:0.0:1651532157.618543:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468700352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532157.618548:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618551:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532157.618552:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618555:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618557:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532157.618558:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618561:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618591:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618594:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.618610:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.618616:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468700672
00000100:00100000:0.0:1651532157.618626:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5053
00000100:00100000:0.0:1651532157.618628:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468700672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.618631:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.618634:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413343 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb26 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.618642:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413343 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb26 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.618646:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413343 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb26 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.618649:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532157.618659:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468700672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.618661:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5053
00000001:00080000:1.0:1651532157.697888:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794055 is committed
00010000:00010000:1.0:1651532157.697904:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.697908:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.697931:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468695232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 612159us (612227us total) trans 158913794055 rc 0/0
00000100:00100000:1.0:1651532157.697935:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4779
00010000:00010000:1.0:1651532157.697942:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.697946:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.697947:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.697950:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.697956:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.697957:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.697958:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.697963:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.697985:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.697989:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413247 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [401408->2744319] (req 401408->2744319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.697995:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.697998:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.698225:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.698235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.698243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.698251:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468700928
00000100:00100000:0.0:1651532157.698261:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5054
00000100:00100000:0.0:1651532157.698263:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468700928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.698266:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.698270:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41334a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb2d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.698277:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41334a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb2d expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.698281:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41334a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb2d expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.698284:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532157.698294:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468700928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.698296:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5054
00000100:00100000:1.0:1651532157.698300:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468700864
00000100:00100000:1.0:1651532157.698311:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468700800
00000100:00100000:1.0:1651532157.698320:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4788
00000100:00100000:1.0:1651532157.698323:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468700864:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532157.698328:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4789
00000100:00100000:0.0:1651532157.698330:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468700800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532157.698338:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.698342:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532157.698343:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.698354:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.698359:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532157.698360:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.698364:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.698366:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.698371:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532157.698372:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.698376:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.698377:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.698379:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.698380:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.698575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.698582:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468701056
00000100:00100000:0.0:1651532157.698596:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5055
00000100:00100000:0.0:1651532157.698598:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468701056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.698601:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.698605:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41335f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb34 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.698612:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41335f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb34 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.698616:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41335f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb34 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.698619:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532157.698629:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468701056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.698632:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5055
00000100:00100000:0.0:1651532157.698864:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.698871:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468701184
00000100:00100000:0.0:1651532157.698883:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5056
00000100:00100000:0.0:1651532157.698885:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468701184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.698888:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.698891:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413366 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb3b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.698898:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413366 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb3b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.698902:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413366 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb3b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.698906:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532157.698915:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468701184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.698918:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5056
00000001:00080000:1.0:1651532157.786012:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794056 is committed
00010000:00010000:1.0:1651532157.786027:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786031:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.786054:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468696320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 501062us (501108us total) trans 158913794056 rc 0/0
00000100:00100000:1.0:1651532157.786057:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4780
00010000:00010000:1.0:1651532157.786064:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786068:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.786069:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786075:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786081:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.786082:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.786083:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786088:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786114:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786118:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413271 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->8712191] (req 77824->8712191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786126:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786131:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.786355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532157.786372:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786376:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.786390:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468696384:12345-10.240.43.64@tcp:3:fio.0 Request processed in 501378us (501435us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532157.786393:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4781
00010000:00010000:0.0:1651532157.786400:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786403:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532157.786404:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786407:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786412:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.786413:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.786414:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786417:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786438:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786445:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413278 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->8749055] (req 2756608->8749055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786451:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786454:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.786476:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468701376
00000100:00100000:0.0:1651532157.786491:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5057
00000100:00100000:0.0:1651532157.786493:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468701376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.786496:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.786500:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41336d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb42 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786507:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41336d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb42 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.786511:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41336d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb42 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.786514:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532157.786521:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468701376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (167us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.786523:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5057
00000100:00100000:0.0:1651532157.786538:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.786562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.786586:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468701504
00000100:00100000:0.0:1651532157.786596:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5058
00000100:00100000:0.0:1651532157.786598:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468701504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.786601:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.786604:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413374 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb49 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.786605:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468701568
00010000:00010000:0.0:1651532157.786611:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413374 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb49 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.786615:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413374 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb49 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532157.786616:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5059
00000100:00100000:1.0:1651532157.786618:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468701568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.786618:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00010000:00010000:1.0:1651532157.786621:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.786625:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41337b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb50 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.786627:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468701504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.786629:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5058
00010000:00010000:1.0:1651532157.786634:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41337b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb50 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.786641:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41337b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb50 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.786644:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532157.786673:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468701568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.786678:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5059
00000100:00100000:0.0:1651532157.786859:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.786867:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.786880:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468701760
00000100:00100000:1.0:1651532157.786885:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468701696
00000100:00100000:0.0:1651532157.786891:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4790
00000100:00100000:0.0:1651532157.786893:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468701760:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532157.786901:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4791
00000100:00100000:1.0:1651532157.786903:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468701696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532157.786905:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786910:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786913:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532157.786914:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532157.786914:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.786918:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786926:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.786927:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786930:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532157.786931:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786935:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.786939:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.786989:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.787000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.787001:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468701952
00000100:00100000:1.0:1651532157.787013:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468702016
00000100:00100000:1.0:1651532157.787021:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5060
00000100:00100000:1.0:1651532157.787023:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468701952:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532157.787025:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5061
00010000:00010000:1.0:1651532157.787026:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532157.787027:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468702016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.787030:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413390 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb57 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.787030:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.787034:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413397 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb5e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.787037:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413390 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb57 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.787041:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413390 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb57 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.787041:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413397 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb5e expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.787045:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532157.787045:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413397 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb5e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.787049:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:1.0:1651532157.787058:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468701952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.787061:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5060
00000100:00100000:0.0:1651532157.787064:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468702016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.787067:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5061
00000100:00100000:0.0:1651532157.787291:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.787298:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468702208
00000100:00100000:0.0:1651532157.787313:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5062
00000100:00100000:0.0:1651532157.787315:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468702208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.787318:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.787321:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41339e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb65 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.787328:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41339e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb65 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.787332:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41339e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb65 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.787336:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532157.787355:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468702208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.787358:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5062
00000001:00080000:1.0:1651532157.852712:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794057 is committed
00010000:00010000:0.0:1651532157.852742:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.852747:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.852768:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468697856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 467736us (467802us total) trans 158913794057 rc 0/0
00010000:00010000:1.0:1651532157.852769:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.852771:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4782
00010000:00010000:1.0:1651532157.852774:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.852775:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852781:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852786:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.852787:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.852787:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852791:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852797:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.852798:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.852799:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852825:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852835:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852838:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4132be lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [884736->9986047] (req 884736->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852844:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852847:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852881:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.852885:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.853085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.853106:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468702528
00000100:00100000:0.0:1651532157.853117:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5063
00000100:00100000:0.0:1651532157.853118:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468702528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.853119:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853122:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.853124:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853126:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4133a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb6c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853138:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.853141:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4133a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb6c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532157.853149:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468697984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 468046us (468174us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532157.853153:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4783
00010000:00010000:0.0:1651532157.853164:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4133a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb6c expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.853166:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853167:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00010000:00010000:1.0:1651532157.853169:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.853176:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468702528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.853179:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5063
00000100:00100000:1.0:1651532157.853182:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468698752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 467433us (467502us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532157.853185:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4784
00010000:00010000:0.0:1651532157.853186:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853189:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.853190:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853190:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853193:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.853196:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.853199:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853199:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.853200:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.853201:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853204:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.853208:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853215:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853218:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4132cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->7966719] (req 1429504->7966719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.853219:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.853223:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4132e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7913472->7974911] (req 7913472->7974911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.853229:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.853232:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.853243:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.853272:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468702720
00000100:00100000:0.0:1651532157.853283:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5064
00000100:00100000:0.0:1651532157.853285:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468702720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.853288:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.853291:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4133ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb73 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853298:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4133ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb73 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.853302:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4133ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb73 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.853308:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532157.853334:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468702720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.853337:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5064
00000100:00100000:0.0:1651532157.853644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.853667:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468702784
00000100:00100000:0.0:1651532157.853676:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.853688:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.853696:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.853705:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468702976
00000100:00100000:0.0:1651532157.853714:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468703104
00000100:00100000:0.0:1651532157.853720:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5065
00000100:00100000:0.0:1651532157.853722:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468702976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.853726:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532157.853731:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468702848
00010000:00010000:0.0:1651532157.853736:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4133b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb7a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.853741:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4792
00000100:00100000:1.0:1651532157.853743:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468702784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532157.853749:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4133b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb7a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.853750:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853753:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4133b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb7a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.853755:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.853756:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853756:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00010000:00010000:1.0:1651532157.853759:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.853762:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532157.853762:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.853766:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468702976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (78us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532157.853767:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.853770:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.853770:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5065
00010000:00010000:1.0:1651532157.853773:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.853775:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5066
00000100:00100000:0.0:1651532157.853776:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468703104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.853779:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532157.853781:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4793
00010000:00010000:0.0:1651532157.853781:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4133c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb81 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.853783:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8c71a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468702848:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532157.853786:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4133c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb81 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.853788:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853790:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4133c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb81 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.853791:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.853792:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.853793:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00010000:00010000:1.0:1651532157.853795:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532157.853795:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.853798:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468703104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (102us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532157.853799:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.853800:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5066
00010000:00010000:1.0:1651532157.853817:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.853847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.853857:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468703232
00000100:00100000:1.0:1651532157.853865:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5067
00000100:00100000:1.0:1651532157.853867:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468703232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.853871:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.853876:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4133cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb88 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.853897:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4133cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb88 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.853902:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4133cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb88 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.853906:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532157.853921:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468703232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.853924:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5067
00000100:00100000:0.0:1651532157.854104:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.854116:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468703488
00000100:00100000:1.0:1651532157.854124:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5068
00000100:00100000:1.0:1651532157.854126:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468703488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.854129:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.854133:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4133d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb8f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.854140:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4133d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb8f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.854144:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4133d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb8f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.854147:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532157.854161:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468703488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.854164:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5068
00000100:00100000:0.0:1651532157.854238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.854250:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468703616
00000100:00100000:1.0:1651532157.854257:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5069
00000100:00100000:1.0:1651532157.854259:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468703616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.854262:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.854265:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4133dd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb96 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.854273:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4133dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb96 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.854277:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4133dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb96 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.854280:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532157.854294:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468703616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.854296:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5069
00000100:00100000:0.0:1651532157.854374:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.854386:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468703808
00000100:00100000:1.0:1651532157.854394:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5070
00000100:00100000:1.0:1651532157.854396:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468703808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.854399:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.854402:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4133e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cb9d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.854409:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4133e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb9d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.854413:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4133e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cb9d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.854416:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532157.854429:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468703808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.854432:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5070
00000100:00100000:0.0:1651532157.854650:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.854668:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468704000
00000100:00100000:1.0:1651532157.854676:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5071
00000100:00100000:1.0:1651532157.854678:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468704000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.854682:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.854685:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4133eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cba4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.854693:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4133eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cba4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.854697:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4133eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cba4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.854700:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532157.854713:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468704000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.854716:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5071
00000100:00100000:0.0:1651532157.854928:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.854940:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468704192
00000100:00100000:1.0:1651532157.854948:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5072
00000100:00100000:1.0:1651532157.854949:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468704192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.854953:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.854956:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbab expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.854963:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbab expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.854966:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbab expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.854972:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532157.854986:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468704192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.854989:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5072
00000001:00080000:1.0:1651532157.969392:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794058 is committed
00010000:00010000:1.0:1651532157.969407:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969411:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.969433:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468698688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 583642us (583717us total) trans 158913794058 rc 0/0
00000100:00100000:1.0:1651532157.969436:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4785
00010000:00010000:1.0:1651532157.969444:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969447:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532157.969448:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969451:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969456:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.969457:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.969458:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969461:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969471:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969475:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4132ef lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->7434239] (req 1306624->7434239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.969481:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.969489:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.969880:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.969893:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468704384
00000100:00100000:0.0:1651532157.969899:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.969909:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468704512
00000100:00100000:1.0:1651532157.969917:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4794
00000100:00100000:1.0:1651532157.969919:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468704384:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532157.969919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.969929:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532157.969936:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.969937:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532157.969940:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532157.969942:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969944:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532157.969945:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969949:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.969950:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4795
00000100:00100000:0.0:1651532157.969952:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468704512:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532157.969955:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.969962:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468704640
00010000:00010000:0.0:1651532157.969967:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.969968:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468704576
00000100:00100000:1.0:1651532157.969970:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468704704
00010000:00010000:0.0:1651532157.969972:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532157.969973:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5073
00010000:00010000:0.0:1651532157.969973:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.969975:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468704640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.969976:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532157.969977:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.969977:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969980:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413407 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbb9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.969981:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969985:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.969985:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.969988:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413407 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbb9 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.969992:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413407 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbb9 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.969995:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532157.970000:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.970004:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.970010:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468704640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.970013:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5073
00000100:00100000:1.0:1651532157.970017:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5074
00000100:00100000:1.0:1651532157.970019:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468704576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.970022:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532157.970024:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468700416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 351513us (351603us total) trans 0 rc 49152/49152
00010000:00010000:1.0:1651532157.970025:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41340e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbb2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.970027:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4786
00010000:00010000:1.0:1651532157.970029:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532157.970031:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41340e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbb2 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.970034:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.970035:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41340e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbb2 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.970038:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532157.970038:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532157.970039:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.970042:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.970044:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468704576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (115us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532157.970046:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532157.970047:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5074
00010000:00010000:0.0:1651532157.970047:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532157.970048:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.970050:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5075
00010000:00010000:0.0:1651532157.970050:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532157.970052:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468704704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.970054:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.970056:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f413415 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbc0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.970057:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.970060:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413335 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [77824->9433087] (req 77824->9433087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.970061:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f413415 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbc0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.970064:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f413415 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbc0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.970065:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.970068:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.970070:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532157.970074:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468704704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.970077:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5075
00000100:00100000:0.0:1651532157.970555:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.970570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.970579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532157.970587:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468704960
00000100:00100000:1.0:1651532157.970595:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468705088
00000100:00100000:1.0:1651532157.970597:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468705408
00000100:00100000:1.0:1651532157.970600:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5076
00000100:00100000:1.0:1651532157.970602:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468704960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.970605:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.970608:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41341c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbc7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.970615:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41341c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbc7 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.970619:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41341c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbc7 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.970622:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532157.970636:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468704960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.970639:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5076
00000100:00100000:1.0:1651532157.970644:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5077
00000100:00100000:1.0:1651532157.970645:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468705088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532157.970658:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532157.970662:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413423 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbce expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532157.970665:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5078
00000100:00100000:0.0:1651532157.970667:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468705408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.970671:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.970675:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41342a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbd5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532157.970682:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413423 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbce expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.970684:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41342a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbd5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.970686:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413423 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbce expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.970689:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41342a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbd5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532157.970690:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532157.970692:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532157.970704:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468705088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532157.970707:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5077
00000100:00100000:0.0:1651532157.970709:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468705408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.970713:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5078
00000100:00100000:0.0:1651532157.971009:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532157.971017:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468705536
00000100:00100000:0.0:1651532157.971024:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5079
00000100:00100000:0.0:1651532157.971026:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468705536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532157.971029:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532157.971033:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413431 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbdc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532157.971040:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413431 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbdc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.971044:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413431 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbdc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532157.971048:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532157.971057:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468705536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532157.971060:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5079
00000001:00080000:1.0:1651532158.099553:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794059 is committed
00010000:00010000:0.0:1651532158.099589:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.099595:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.099619:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.099621:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aaca1153 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468700352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 481076us (481142us total) trans 158913794059 rc 0/0
00010000:00010000:1.0:1651532158.099624:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.099625:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.099625:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4787
00010000:00010000:1.0:1651532158.099628:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.099634:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.099634:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.099642:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.099645:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.099660:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.099668:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.099675:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41333c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->10141695] (req 81920->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.099675:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.100046:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.100054:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.100061:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.100068:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.100075:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468705920
00000100:00100000:0.0:1651532158.100086:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468705984
00000100:00100000:0.0:1651532158.100092:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4796
00000100:00100000:0.0:1651532158.100094:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468705920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532158.100102:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.100107:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.100108:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.100111:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532158.100112:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.100116:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.100123:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.100130:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4797
00000100:00100000:0.0:1651532158.100132:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468705984:12345-10.240.43.64@tcp:3:fio.
00010000:00010000:0.0:1651532158.100137:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.100140:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.100141:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.100144:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532158.100144:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.100148:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.100151:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.100215:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468706048
00000100:00100000:0.0:1651532158.100228:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468706176
00000100:00100000:0.0:1651532158.100233:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5080
00000100:00100000:0.0:1651532158.100234:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468706048:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532158.100239:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5081
00010000:00010000:0.0:1651532158.100239:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532158.100242:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468706176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.100243:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413446 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbe3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.100246:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.100250:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41344d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbea expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.100252:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413446 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbe3 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.100257:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413446 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbe3 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.100258:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41344d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbea expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.100261:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00010000:00010000:1.0:1651532158.100262:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41344d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbea expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.100266:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532158.100273:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468706048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (211us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.100275:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468706176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (207us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.100276:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5080
00000100:00100000:1.0:1651532158.100277:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5081
00000100:00100000:0.0:1651532158.100610:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.100631:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468706368
00000100:00100000:1.0:1651532158.100639:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5082
00000100:00100000:1.0:1651532158.100641:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468706368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.100645:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.100648:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413454 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbf1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.100655:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413454 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbf1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.100659:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413454 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbf1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.100662:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532158.100679:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468706368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.100682:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5082
00000001:00080000:1.0:1651532158.166268:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794060 is committed
00010000:00010000:0.0:1651532158.166299:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166304:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166326:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.166327:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052b7406c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468700800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 467995us (468091us total) trans 158913794060 rc 0/0
00000100:00100000:0.0:1651532158.166330:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4789
00010000:00010000:1.0:1651532158.166331:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.166332:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166335:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166343:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.166353:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.166354:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166357:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166361:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.166362:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.166363:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166367:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166396:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166400:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413351 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4026368->10067967] (req 4026368->10067967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166403:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166406:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166409:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166411:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166426:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166429:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.166451:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d0497e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468700864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 468128us (468226us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532158.166455:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4788
00010000:00010000:1.0:1651532158.166467:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166471:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.166472:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166475:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166481:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166486:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413358 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5894144->5898239] (req 5894144->5898239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166641:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166646:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166667:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.166668:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039dff19b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468701760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 379774us (379809us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532158.166671:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532158.166671:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4790
00010000:00010000:1.0:1651532158.166672:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166676:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166681:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.166681:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.166682:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166685:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166694:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166698:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413382 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2617344->8028159] (req 2617344->8028159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166702:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166707:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.166866:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.166885:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.166897:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468706752
00000100:00100000:0.0:1651532158.166897:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.166909:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468706688
00000100:00100000:1.0:1651532158.166918:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4798
00000100:00100000:1.0:1651532158.166920:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468706752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532158.166926:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.166927:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4799
00000100:00100000:0.0:1651532158.166930:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468706688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532158.166931:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532158.166932:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532158.166933:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166939:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166941:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.166950:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468706816
00000100:00100000:1.0:1651532158.166958:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5083
00000100:00100000:1.0:1651532158.166960:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468706816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.166963:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.166966:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413469 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbf8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166968:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.166969:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166972:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166975:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532158.166976:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166981:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413469 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbf8 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.166981:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.166984:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166985:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413469 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbf8 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.166987:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.166989:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532158.166998:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468706816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.167001:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5083
00000100:00100000:0.0:1651532158.167060:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.167080:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468706880
00000100:00100000:1.0:1651532158.167091:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5084
00000100:00100000:1.0:1651532158.167094:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468706880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.167118:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.167121:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f413470 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cbff expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.167129:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f413470 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbff expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.167132:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f413470 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cbff expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.167136:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532158.167148:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468706880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.167151:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5084
00000100:00100000:0.0:1651532158.167435:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.167453:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468707072
00000100:00100000:1.0:1651532158.167461:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5085
00000100:00100000:1.0:1651532158.167463:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468707072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.167466:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.167470:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f413477 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc06 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.167477:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f413477 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc06 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.167481:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f413477 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc06 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.167484:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532158.167498:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468707072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.167501:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5085
00000001:00080000:1.0:1651532158.250962:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794061 is committed
00010000:00010000:0.0:1651532158.251005:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251010:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.251037:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.251037:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468701696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 464133us (464170us total) trans 158913794061 rc 0/0
00010000:00010000:1.0:1651532158.251041:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532158.251041:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4791
00010000:00010000:1.0:1651532158.251043:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.251046:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.251051:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.251052:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.251053:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.251056:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.251064:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.251070:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413389 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5910528->8462335] (req 5910528->8462335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251074:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251080:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.251411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.251420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.251427:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468707392
00000100:00100000:0.0:1651532158.251437:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468707328
00000100:00100000:0.0:1651532158.251443:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4800
00000100:00100000:0.0:1651532158.251445:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468707392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532158.251452:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251457:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.251458:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251461:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532158.251462:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251482:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251486:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.251494:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4801
00000100:00100000:0.0:1651532158.251496:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468707328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532158.251501:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251505:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.251505:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251508:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532158.251509:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251512:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.251515:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532158.342684:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794062 is committed
00010000:00010000:0.0:1651532158.342725:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.342729:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.342755:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468702784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 489011us (489111us total) trans 158913794062 rc 0/0
00010000:00010000:1.0:1651532158.342756:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.342759:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4792
00010000:00010000:1.0:1651532158.342760:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.342761:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.342765:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.342770:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.342771:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.342771:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.342774:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.342784:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.342788:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4133ba lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8572927] (req 651264->8572927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.342791:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.342797:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.343088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.343109:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468707648
00000100:00100000:1.0:1651532158.343135:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5086
00000100:00100000:1.0:1651532158.343137:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468707648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.343141:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.343145:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41348c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc0d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.343149:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532158.343164:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343169:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.343174:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.343184:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41348c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc0d expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.343189:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41348c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc0d expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532158.343189:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8c71a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468702848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 489405us (489513us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532158.343192:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532158.343193:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4793
00000100:00100000:0.0:1651532158.343201:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468707776
00000100:00100000:1.0:1651532158.343202:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468707648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.343205:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5086
00000100:00100000:0.0:1651532158.343209:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5087
00000100:00100000:0.0:1651532158.343211:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468707776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.343214:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343215:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.343217:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.343218:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343218:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413493 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc14 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.343221:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.343226:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.343226:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.343227:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.343230:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343237:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413493 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc14 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.343238:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.343241:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4133c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5623808->9469951] (req 5623808->9469951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343242:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413493 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc14 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.343246:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343246:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00010000:00010000:1.0:1651532158.343249:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.343253:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468707776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (104us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.343256:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5087
00000100:00100000:0.0:1651532158.343670:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.343686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.343696:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.343706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.343708:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468708032
00000100:00100000:0.0:1651532158.343714:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468708160
00000100:00100000:1.0:1651532158.343722:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5088
00000100:00100000:1.0:1651532158.343724:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468708032:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532158.343731:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5089
00010000:00010000:1.0:1651532158.343732:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532158.343733:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468708160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.343736:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41349a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc1b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343737:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.343741:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc22 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.343745:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41349a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc1b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.343750:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41349a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc1b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.343750:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc22 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.343753:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532158.343754:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc22 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.343758:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:1.0:1651532158.343768:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468708032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.343771:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5088
00000100:00100000:0.0:1651532158.343774:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468708160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.343777:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5089
00000100:00100000:1.0:1651532158.343785:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468707968
00000100:00100000:1.0:1651532158.343796:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468707904
00000100:00100000:1.0:1651532158.343815:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4802
00000100:00100000:1.0:1651532158.343817:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468707968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532158.343825:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.343831:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4803
00010000:00010000:1.0:1651532158.343832:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532158.343833:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468707904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532158.343834:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532158.343835:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343843:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343850:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.343852:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343855:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532158.343856:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.343860:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343861:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.343865:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.344066:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.344073:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468708352
00000100:00100000:0.0:1651532158.344081:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5090
00000100:00100000:0.0:1651532158.344083:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468708352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.344086:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.344090:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4134b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc29 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.344097:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4134b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc29 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.344101:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4134b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc29 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.344105:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532158.344114:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468708352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.344117:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5090
00000001:00080000:1.0:1651532158.476025:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794063 is committed
00010000:00010000:1.0:1651532158.476041:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476045:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.476068:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468704384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 506148us (506189us total) trans 158913794063 rc 0/0
00000100:00100000:1.0:1651532158.476072:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4794
00010000:00010000:1.0:1651532158.476079:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476083:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.476084:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476087:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476092:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.476093:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.476093:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476097:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476116:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476119:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4133f9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9940991] (req 360448->9940991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476126:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476131:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.476396:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.476409:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468708672
00000100:00100000:0.0:1651532158.476418:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5091
00000100:00100000:0.0:1651532158.476419:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468708672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.476423:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.476427:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4134bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc30 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476433:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532158.476436:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4134bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc30 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.476440:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4134bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc30 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.476444:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532158.476453:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468708672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.476456:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5091
00010000:00010000:0.0:1651532158.476466:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476469:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476489:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.476490:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468704512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 506537us (506590us total) trans 0 rc 40960/40960
00010000:00010000:1.0:1651532158.476493:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532158.476493:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4795
00010000:00010000:1.0:1651532158.476494:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476500:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476505:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.476505:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.476506:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476509:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476518:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476521:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413400 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->10403839] (req 86016->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476528:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476535:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.476884:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.476891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.476904:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.476908:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468708992
00000100:00100000:0.0:1651532158.476912:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468709056
00000100:00100000:1.0:1651532158.476923:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4804
00000100:00100000:1.0:1651532158.476925:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468708992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532158.476937:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.476939:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4805
00010000:00010000:1.0:1651532158.476942:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532158.476943:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476945:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476948:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532158.476949:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476953:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.476956:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.476957:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468709056:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532158.476959:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476965:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476970:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.476971:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476974:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532158.476975:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476979:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.476983:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.477072:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468709120
00000100:00100000:0.0:1651532158.477081:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5092
00000100:00100000:0.0:1651532158.477083:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468709120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.477087:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.477091:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4134d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc37 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.477099:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4134d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc37 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.477103:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4134d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc37 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.477106:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532158.477115:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468709120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (212us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.477118:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5092
00000100:00100000:0.0:1651532158.477133:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.477164:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.477176:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468709248
00000100:00100000:0.0:1651532158.477187:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468709312
00000100:00100000:0.0:1651532158.477191:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5093
00000100:00100000:0.0:1651532158.477193:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468709248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.477196:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.477200:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4134d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc3e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.477205:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5094
00010000:00010000:0.0:1651532158.477207:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4134d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc3e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532158.477208:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045103c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468709312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.477214:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4134d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc3e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.477217:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:1.0:1651532158.477219:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.477227:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4134e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc45 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.477227:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468709248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (94us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.477230:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5093
00010000:00010000:1.0:1651532158.477241:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4134e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc45 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.477246:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4134e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc45 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.477250:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532158.477285:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045103c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468709312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 77us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.477289:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5094
00000100:00100000:0.0:1651532158.477438:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.477458:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468709440
00000100:00100000:1.0:1651532158.477471:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5095
00000100:00100000:1.0:1651532158.477473:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468709440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.477477:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.477480:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4134e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc4c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.477488:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4134e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc4c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.477493:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4134e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc4c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.477496:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532158.477510:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468709440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.477513:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5095
00000100:00100000:0.0:1651532158.477559:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.477569:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468709568
00000100:00100000:1.0:1651532158.477578:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5096
00000100:00100000:1.0:1651532158.477580:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468709568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.477583:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.477586:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4134ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc53 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.477595:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4134ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc53 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.477600:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4134ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc53 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.477603:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532158.477614:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468709568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.477617:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5096
00000100:00100000:0.0:1651532158.477746:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.477765:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468709760
00000100:00100000:1.0:1651532158.477775:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5097
00000100:00100000:1.0:1651532158.477777:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468709760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.477780:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.477783:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4134f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc5a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.477790:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4134f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc5a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.477794:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4134f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc5a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.477797:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532158.477820:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468709760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.477823:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5097
00000100:00100000:0.0:1651532158.478071:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.478090:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468709952
00000100:00100000:1.0:1651532158.478102:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5098
00000100:00100000:1.0:1651532158.478104:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468709952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.478107:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.478110:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4134fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc61 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.478117:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4134fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc61 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.478121:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4134fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc61 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.478124:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532158.478137:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468709952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.478140:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5098
00000001:00080000:1.0:1651532158.592686:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794064 is committed
00010000:00010000:0.0:1651532158.592719:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.592723:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.592746:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468705920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 492651us (492700us total) trans 158913794064 rc 0/0
00010000:00010000:1.0:1651532158.592747:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.592749:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4796
00010000:00010000:1.0:1651532158.592752:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.592753:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.592759:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.592765:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.592766:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.592766:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.592770:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.592773:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.592774:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.592774:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.592777:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.592798:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.592801:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413438 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->10117119] (req 90112->10117119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.592813:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.592818:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.592818:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.592821:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.593199:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.593215:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.593219:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468710208
00000100:00100000:0.0:1651532158.593222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.593232:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468710272
00000100:00100000:0.0:1651532158.593234:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.593235:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468710400
00000100:00100000:1.0:1651532158.593237:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468710464
00000100:00100000:1.0:1651532158.593241:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5099
00000100:00100000:1.0:1651532158.593247:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468710208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.593251:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532158.593254:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5100
00000100:00100000:0.0:1651532158.593256:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468710272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.593261:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.593263:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413503 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc68 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.593265:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41350a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc6f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593269:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532158.593271:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.593274:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413503 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc68 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.593275:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41350a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc6f expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.593278:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413503 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc68 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.593279:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41350a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc6f expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.593282:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532158.593283:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:1.0:1651532158.593296:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468710208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.593299:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5099
00000100:00100000:0.0:1651532158.593302:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468710272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.593305:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5101
00000100:00100000:1.0:1651532158.593306:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468710400:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532158.593306:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5100
00010000:00010000:1.0:1651532158.593309:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.593312:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413511 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc76 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.593312:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5102
00000100:00100000:0.0:1651532158.593314:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468710464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.593316:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532158.593317:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.593318:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413511 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc76 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.593319:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413518 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc7d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593322:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413511 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc76 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.593324:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.593325:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532158.593326:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413518 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc7d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532158.593330:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468710400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (108us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532158.593330:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413518 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc7d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532158.593333:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5101
00010000:00010000:0.0:1651532158.593333:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532158.593340:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468710464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.593342:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5102
00010000:00010000:1.0:1651532158.593356:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593360:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.593367:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.593372:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.593373:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468706752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 426453us (426509us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532158.593376:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4798
00000100:00100000:0.0:1651532158.593387:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468705984:12345-10.240.43.64@tcp:3:fio. Request processed in 493254us (493333us total) trans 0 rc 28672/28672
00010000:00010000:1.0:1651532158.593389:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.593390:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4797
00010000:00010000:1.0:1651532158.593393:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.593394:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593400:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593405:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593408:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41345b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3272704->10395647] (req 3272704->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593411:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593414:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.593414:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593417:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593420:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.593421:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.593422:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593424:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593440:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.593449:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41343f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2236416->8671231] (req 2236416->8671231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.593451:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.593456:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.593907:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.593923:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.593936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.593958:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468710784
00000100:00100000:0.0:1651532158.593965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.593972:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468710720
00000100:00100000:1.0:1651532158.593979:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4806
00000100:00100000:0.0:1651532158.593979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.593981:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468710784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532158.593988:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.593988:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532158.593998:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532158.593999:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532158.594000:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.594000:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4807
00000100:00100000:0.0:1651532158.594002:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468710720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532158.594003:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.594011:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468710592
00010000:00010000:0.0:1651532158.594011:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.594015:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468710848
00010000:00010000:0.0:1651532158.594015:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.594016:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.594017:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468711040
00000100:00100000:1.0:1651532158.594019:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468711104
00010000:00010000:0.0:1651532158.594019:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.594022:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5103
00010000:00010000:0.0:1651532158.594022:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00000100:00100000:1.0:1651532158.594023:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468710592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.594023:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.594026:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.594027:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.594028:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41352d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc84 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.594030:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.594037:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.594038:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41352d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc84 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.594042:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41352d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc84 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.594045:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532158.594045:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5104
00000100:00100000:0.0:1651532158.594046:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468710848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.594049:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.594051:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413534 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc8b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.594060:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468710592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (154us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.594063:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5103
00010000:00010000:0.0:1651532158.594065:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413534 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc8b expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532158.594068:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5105
00010000:00010000:0.0:1651532158.594069:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413534 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc8b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532158.594070:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468711040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.594072:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.594073:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00010000:00010000:1.0:1651532158.594075:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41353b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc92 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.594081:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41353b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc92 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532158.594082:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468710848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.594084:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5104
00010000:00010000:1.0:1651532158.594085:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41353b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc92 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.594088:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532158.594090:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5106
00000100:00100000:0.0:1651532158.594092:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468711104:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532158.594094:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468711040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (114us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532158.594094:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532158.594096:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5105
00010000:00010000:0.0:1651532158.594096:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413542 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cc99 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.594105:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413542 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc99 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.594108:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413542 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cc99 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.594111:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:0.0:1651532158.594116:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468711104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (129us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.594119:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5106
00000100:00100000:0.0:1651532158.594436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.594456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.594472:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468711296
00000100:00100000:0.0:1651532158.594485:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468711424
00000100:00100000:1.0:1651532158.594493:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5107
00000100:00100000:1.0:1651532158.594496:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468711296:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532158.594496:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5108
00000100:00100000:0.0:1651532158.594498:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468711424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.594499:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.594501:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.594503:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413549 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cca0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.594505:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413550 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cca7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.594510:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413549 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cca0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.594513:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413550 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cca7 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.594514:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413549 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cca0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.594517:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413550 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cca7 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.594518:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532158.594523:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:1.0:1651532158.594531:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468711296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.594534:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5107
00000100:00100000:0.0:1651532158.594539:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468711424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.594542:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5108
00000100:00100000:0.0:1651532158.594626:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.594634:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468711680
00000100:00100000:0.0:1651532158.594648:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5109
00000100:00100000:0.0:1651532158.594650:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468711680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.594653:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.594657:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413557 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ccae expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.594664:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413557 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccae expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.594669:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413557 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccae expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.594672:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532158.594681:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468711680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.594684:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5109
00000001:00080000:1.0:1651532158.651053:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794065 is committed
00002000:00010000:0.0:1651532158.651083:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532157 -> 1651532158
00002000:00010000:0.0:1651532158.651085:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532157 -> 1651532158
00010000:00010000:0.0:1651532158.651087:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651091:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.651113:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468706688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 484183us (484228us total) trans 158913794065 rc 0/0
00010000:00010000:1.0:1651532158.651115:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.651117:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4799
00010000:00010000:1.0:1651532158.651120:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.651121:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651124:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651130:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.651131:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.651132:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651135:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651144:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651147:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413462 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1417216->6672383] (req 1417216->6672383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651158:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651164:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.651506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.651518:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.651535:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.651543:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.651560:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468712256
00000100:00100000:0.0:1651532158.651560:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468712320
00000100:00100000:1.0:1651532158.651568:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468712448
00000100:00100000:0.0:1651532158.651574:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468712192
00000100:00100000:0.0:1651532158.651582:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4808
00000100:00100000:0.0:1651532158.651583:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468712320:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532158.651586:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5110
00000100:00100000:1.0:1651532158.651588:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468712256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.651591:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.651591:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651595:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413565 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ccb5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651595:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532158.651596:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651602:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532158.651602:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651606:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.651609:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413565 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccb5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.651609:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651612:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651613:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413565 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccb5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.651617:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532158.651623:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651626:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.651631:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468712256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (127us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.651634:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5110
00000100:00100000:1.0:1651532158.651645:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5111
00000100:00100000:1.0:1651532158.651647:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468712448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.651650:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532158.651651:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468707392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 400205us (400240us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532158.651653:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41356c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ccbc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.651654:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4800
00010000:00010000:1.0:1651532158.651657:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.651659:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41356c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccbc expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532158.651659:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4809
00000100:00100000:0.0:1651532158.651660:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468712192:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532158.651663:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41356c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccbc expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.651666:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651667:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532158.651670:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.651671:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.651673:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468712448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.651676:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5111
00010000:00010000:0.0:1651532158.651676:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532158.651677:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651681:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651682:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651684:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651685:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.651686:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651689:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651694:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.651694:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.651695:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651698:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651701:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.651702:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.651702:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651705:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651717:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651720:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41347e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5734400->9965567] (req 5734400->9965567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651726:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.651732:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651735:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651741:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651755:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651758:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.651777:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074df73d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468707968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 307960us (308108us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532158.651787:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4802
00010000:00010000:1.0:1651532158.651795:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651798:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.651799:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651802:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651822:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.651825:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4134a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.652152:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.652165:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.652176:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468712704
00000100:00100000:1.0:1651532158.652188:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5112
00000100:00100000:1.0:1651532158.652190:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468712704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.652193:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.652197:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41357a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ccc3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.652204:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41357a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccc3 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.652208:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41357a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccc3 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.652211:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532158.652227:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468712768
00000100:00100000:1.0:1651532158.652229:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468712704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.652232:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5112
00000100:00100000:1.0:1651532158.652237:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5113
00000100:00100000:1.0:1651532158.652245:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468712768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.652248:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.652250:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413581 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ccca expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.652256:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413581 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccca expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532158.652257:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532158.652269:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413581 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccca expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.652272:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532158.652279:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468712768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.652281:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5113
00000100:00100000:0.0:1651532158.652287:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.652300:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468712896
00000100:00100000:1.0:1651532158.652308:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468712832
00000100:00100000:1.0:1651532158.652317:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4810
00000100:00100000:1.0:1651532158.652325:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468712896:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532158.652329:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4811
00010000:00010000:1.0:1651532158.652332:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.652332:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468712832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532158.652336:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532158.652337:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.652340:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532158.652340:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.652341:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.652353:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.652355:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.652356:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.652359:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532158.652360:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.652365:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.652367:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.652373:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.652605:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.652623:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468713024
00000100:00100000:1.0:1651532158.652631:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5114
00000100:00100000:1.0:1651532158.652633:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468713024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.652636:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.652638:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413596 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ccd1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.652645:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413596 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccd1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.652649:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413596 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccd1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.652653:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532158.652667:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468713024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.652669:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5114
00000001:00080000:1.0:1651532158.693071:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794066 is committed
00010000:00010000:0.0:1651532158.693102:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.693107:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.693129:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034974c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468707328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 441632us (441708us total) trans 158913794066 rc 0/0
00010000:00010000:1.0:1651532158.693130:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.693132:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4801
00010000:00010000:1.0:1651532158.693135:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.693136:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.693142:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.693147:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.693148:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.693149:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.693152:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.693168:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.693170:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.693172:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413485 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8036352->9338879] (req 8036352->9338879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.693177:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.693443:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.693461:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468713280
00000100:00100000:1.0:1651532158.693478:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5115
00000100:00100000:1.0:1651532158.693480:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468713280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.693484:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.693487:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41359d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ccd8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.693494:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41359d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccd8 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.693501:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41359d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccd8 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.693505:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532158.693520:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468713280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.693523:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5115
00000001:00080000:1.0:1651532158.792843:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794067 is committed
00010000:00010000:0.0:1651532158.792886:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.792891:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.792915:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.792915:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061602adf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468707904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449081us (449230us total) trans 158913794067 rc 0/0
00000100:00100000:0.0:1651532158.792918:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4803
00010000:00010000:1.0:1651532158.792920:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.792921:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.792924:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.792930:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.792931:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.792932:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.792935:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.792942:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.792946:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4134af lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3338240->10244095] (req 3338240->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.792952:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.792959:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.793337:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.793355:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.793364:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.793376:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.793385:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468713536
00000100:00100000:1.0:1651532158.793387:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468713664
00000100:00100000:0.0:1651532158.793398:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468713472
00000100:00100000:1.0:1651532158.793401:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468713792
00000100:00100000:0.0:1651532158.793406:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4812
00000100:00100000:0.0:1651532158.793408:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468713536:12345-10.240.43.64@tcp:3:fio.
00000100:00100000:1.0:1651532158.793414:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5116
00000100:00100000:1.0:1651532158.793416:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468713664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.793420:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.793422:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.793423:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4135ab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ccdf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.793431:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532158.793432:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.793435:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532158.793435:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.793440:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4135ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccdf expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.793440:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.793443:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.793444:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4135ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccdf expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.793448:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532158.793451:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5117
00000100:00100000:0.0:1651532158.793453:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468713792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.793456:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532158.793461:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468713664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.793464:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5116
00010000:00010000:0.0:1651532158.793465:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4135b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cce6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.793472:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4813
00010000:00010000:0.0:1651532158.793473:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4135b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cce6 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532158.793474:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468713472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532158.793477:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4135b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cce6 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.793481:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.793481:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00010000:00010000:1.0:1651532158.793487:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532158.793488:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.793490:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468713792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (114us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532158.793491:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532158.793492:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.793493:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5117
00010000:00010000:1.0:1651532158.793496:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.793499:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532158.934492:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794068 is committed
00010000:00010000:0.0:1651532158.934524:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.934528:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.934550:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468708992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457624us (457666us total) trans 158913794068 rc 0/0
00010000:00010000:1.0:1651532158.934551:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.934553:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4804
00010000:00010000:1.0:1651532158.934556:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.934557:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.934561:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.934566:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.934567:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.934568:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.934571:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.934574:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.934575:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.934575:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.934578:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.934589:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.934598:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.934600:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4134c4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [380928->8519679] (req 380928->8519679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.934605:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.934609:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.934612:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.934994:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.935007:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.935019:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468714048
00010000:00010000:0.0:1651532158.935031:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.935035:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468714112
00000100:00100000:1.0:1651532158.935041:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5118
00010000:00010000:0.0:1651532158.935041:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.935043:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468714048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.935047:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.935055:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4135c0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cced expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.935060:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e82aa3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468710784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341078us (341138us total) trans 0 rc 36864/36864
00010000:00010000:1.0:1651532158.935062:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.935065:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4135c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cced expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532158.935065:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4806
00010000:00010000:1.0:1651532158.935069:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4135c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cced expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.935073:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532158.935073:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5119
00000100:00100000:0.0:1651532158.935075:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468714112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.935078:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532158.935081:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468714048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (88us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532158.935082:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4135c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ccf4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.935084:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5118
00010000:00010000:0.0:1651532158.935088:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532158.935091:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4135c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccf4 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.935095:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4135c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccf4 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.935097:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.935098:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00010000:00010000:1.0:1651532158.935101:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.935104:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468714112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.935107:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5119
00000100:00100000:1.0:1651532158.935113:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468709056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458156us (458222us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532158.935116:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4805
00010000:00010000:1.0:1651532158.935121:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935125:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.935126:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935129:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935134:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935137:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41351f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [32768->6803455] (req 32768->6803455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935140:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935166:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532158.935167:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935170:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935180:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.935181:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532158.935181:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935185:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935194:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935197:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4134cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4354048->10477567] (req 4354048->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.935200:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.935205:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.935563:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.935577:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.935583:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468714304
00000100:00100000:0.0:1651532158.935586:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.935597:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468714368
00000100:00100000:1.0:1651532158.935604:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4814
00000100:00100000:1.0:1651532158.935605:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468714304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532158.935612:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935616:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532158.935617:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935620:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532158.935621:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935625:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935628:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532158.935635:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4815
00000100:00100000:1.0:1651532158.935637:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468714368:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532158.935641:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935645:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532158.935645:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532158.935646:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935649:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532158.935660:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468714496
00000100:00100000:0.0:1651532158.935670:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5120
00000100:00100000:0.0:1651532158.935672:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468714496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532158.935675:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.935679:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4135dc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ccfb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.935688:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4135dc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccfb expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.935692:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4135dc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ccfb expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.935695:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532158.935705:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468714496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.935708:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5120
00000100:00100000:0.0:1651532158.935821:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.935829:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.935835:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532158.935842:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468714560
00000100:00100000:0.0:1651532158.935852:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468714752
00000100:00100000:0.0:1651532158.935855:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468714816
00000100:00100000:1.0:1651532158.935858:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5121
00000100:00100000:1.0:1651532158.935860:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468714560:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532158.935862:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5122
00000100:00100000:0.0:1651532158.935863:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468714752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.935864:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532158.935867:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.935868:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4135e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd02 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532158.935871:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4135ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd09 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935876:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4135e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd02 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.935880:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4135e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd02 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.935880:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4135ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd09 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.935883:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532158.935884:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4135ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd09 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532158.935887:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532158.935899:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468714560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.935902:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5121
00000100:00100000:0.0:1651532158.935904:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468714752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532158.935907:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5122
00000100:00100000:1.0:1651532158.935909:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5123
00000100:00100000:1.0:1651532158.935911:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468714816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.935913:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.935916:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4135f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd10 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.935922:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4135f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd10 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.935926:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4135f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd10 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.935929:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532158.935935:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468714816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.935937:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5123
00000100:00100000:0.0:1651532158.936196:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532158.936215:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468715072
00000100:00100000:1.0:1651532158.936227:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5124
00000100:00100000:1.0:1651532158.936229:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468715072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532158.936232:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532158.936235:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4135f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd17 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532158.936242:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4135f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd17 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.936246:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4135f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd17 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532158.936252:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532158.936264:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468715072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532158.936267:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5124
00000001:00080000:1.0:1651532159.059514:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794069 is committed
00010000:00010000:0.0:1651532159.059545:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.059550:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.059572:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.059572:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070bc959b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468710720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 465570us (465636us total) trans 158913794069 rc 0/0
00000100:00100000:0.0:1651532159.059576:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4807
00010000:00010000:1.0:1651532159.059577:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.059578:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.059582:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.059587:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.059588:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.059589:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.059592:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.059602:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.059605:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413526 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->9895935] (req 1576960->9895935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.059610:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.059616:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.059922:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.059934:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468715392
00000100:00100000:0.0:1651532159.059936:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.059947:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5125
00000100:00100000:1.0:1651532159.059949:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468715392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.059953:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.059956:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4135ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd1e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.059957:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532159.059968:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.059971:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4135ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd1e expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.059976:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4135ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd1e expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.059978:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.059979:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532159.059983:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.059994:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468715392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.059997:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5125
00000100:00100000:0.0:1651532159.060002:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468712320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408418us (408484us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532159.060005:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468715456
00000100:00100000:0.0:1651532159.060006:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4808
00000100:00100000:0.0:1651532159.060012:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468715328
00000100:00100000:1.0:1651532159.060016:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4816
00000100:00100000:1.0:1651532159.060018:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468715456:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532159.060027:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4817
00000100:00100000:0.0:1651532159.060029:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468715328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532159.060031:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060035:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.060036:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060037:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060040:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532159.060040:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.060046:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532159.060048:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.060051:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.060053:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532159.060054:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060058:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.060059:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060062:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.060062:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.060066:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060074:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060077:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.060078:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060081:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060085:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.060086:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.060087:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060089:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060101:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060112:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41355e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8429567] (req 81920->8429567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.060115:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.060120:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.060457:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.060471:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.060480:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468715712
00000100:00100000:1.0:1651532159.060491:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468715776
00000100:00100000:1.0:1651532159.060497:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5126
00000100:00100000:1.0:1651532159.060499:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468715712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.060502:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.060505:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413614 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd25 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060513:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413614 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd25 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.060517:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413614 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd25 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.060520:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532159.060533:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468715712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.060535:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5126
00000100:00100000:1.0:1651532159.060540:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5127
00000100:00100000:1.0:1651532159.060541:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468715776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.060544:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.060546:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41361b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd2c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.060552:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41361b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd2c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.060556:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41361b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd2c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.060559:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532159.060564:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468715776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.060566:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5127
00000100:00100000:0.0:1651532159.060850:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.060862:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468716096
00000100:00100000:1.0:1651532159.060871:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5128
00000100:00100000:1.0:1651532159.060873:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468716096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532159.060873:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532159.060876:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.060880:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413622 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd33 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.060883:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468716160
00010000:00010000:1.0:1651532159.060896:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413622 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd33 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532159.060896:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5129
00000100:00100000:0.0:1651532159.060898:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468716160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.060900:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413622 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd33 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.060902:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.060906:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532159.060906:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413629 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd3a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.060920:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468716096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.060923:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5128
00010000:00010000:0.0:1651532159.060925:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413629 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd3a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.060930:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413629 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd3a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.060934:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532159.060942:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468716160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.060945:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5129
00000100:00100000:0.0:1651532159.061210:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.061217:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468716416
00000100:00100000:0.0:1651532159.061225:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5130
00000100:00100000:0.0:1651532159.061226:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468716416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.061230:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.061233:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413630 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd41 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.061241:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413630 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd41 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.061245:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413630 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd41 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.061248:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532159.061258:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468716416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.061260:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5130
00000001:00080000:1.0:1651532159.201920:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794070 is committed
00010000:00010000:0.0:1651532159.201958:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.201963:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.201986:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.201987:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468712192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 550325us (550452us total) trans 158913794070 rc 0/0
00000100:00100000:0.0:1651532159.201990:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4809
00010000:00010000:1.0:1651532159.201991:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.201992:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.201996:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202001:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.202002:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.202003:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202006:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202014:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202017:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413573 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1306624->10366975] (req 1306624->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202023:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202030:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.202403:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.202415:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.202422:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.202435:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.202468:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.202482:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468716672
00000100:00100000:1.0:1651532159.202486:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468716736
00000100:00100000:0.0:1651532159.202492:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468716864
00000100:00100000:0.0:1651532159.202496:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5131
00000100:00100000:0.0:1651532159.202498:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468716672:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532159.202501:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5132
00010000:00010000:0.0:1651532159.202502:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532159.202503:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468716864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.202506:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413637 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd48 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202507:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.202511:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41363e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd56 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202513:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.202516:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.202516:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413637 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd48 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.202519:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41363e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd56 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.202520:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413637 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd48 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.202523:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41363e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd56 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.202524:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00010000:00010000:1.0:1651532159.202527:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532159.202534:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468716672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.202536:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468716864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.202537:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5131
00000100:00100000:1.0:1651532159.202539:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5132
00000100:00100000:0.0:1651532159.202541:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5133
00000100:00100000:0.0:1651532159.202543:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468716736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.202546:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.202548:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413645 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd4f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.202552:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468716608
00010000:00010000:0.0:1651532159.202552:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.202554:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413645 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd4f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.202558:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413645 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd4f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532159.202566:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468716544
00000100:00100000:1.0:1651532159.202574:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4818
00000100:00100000:1.0:1651532159.202575:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468716608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532159.202576:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:1.0:1651532159.202581:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.202582:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468716736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (148us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532159.202585:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532159.202585:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5133
00010000:00010000:1.0:1651532159.202586:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202589:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532159.202590:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.202593:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4819
00010000:00010000:1.0:1651532159.202594:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.202595:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468716544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532159.202598:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202601:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202605:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532159.202606:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202609:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532159.202610:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202614:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202617:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202628:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202634:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.202653:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468712896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 550328us (550396us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532159.202655:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.202656:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4810
00010000:00010000:1.0:1651532159.202659:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.202660:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202663:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202668:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.202668:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.202669:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202672:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202685:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.202688:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413588 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2605056->8294399] (req 2605056->8294399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202699:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.202706:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.203103:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.203115:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468716992
00000100:00100000:0.0:1651532159.203115:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.203124:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468717120
00000100:00100000:0.0:1651532159.203124:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.203134:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468717184
00000100:00100000:1.0:1651532159.203137:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5134
00000100:00100000:1.0:1651532159.203138:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468716992:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532159.203141:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5135
00010000:00010000:1.0:1651532159.203142:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532159.203143:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468717120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.203146:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41365a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd5d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.203146:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.203151:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413661 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd64 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.203153:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41365a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd5d expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.203158:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41365a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd5d expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.203158:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413661 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd64 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.203161:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532159.203163:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413661 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd64 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.203166:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532159.203176:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468716992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.203179:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5134
00000100:00100000:0.0:1651532159.203183:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468717120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.203184:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5136
00000100:00100000:1.0:1651532159.203186:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468717184:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532159.203186:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5135
00010000:00010000:1.0:1651532159.203189:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.203191:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413668 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd6b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.203197:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413668 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd6b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.203201:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413668 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd6b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.203204:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532159.203210:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468717184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.203212:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5136
00000100:00100000:0.0:1651532159.203504:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.203523:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468717568
00000100:00100000:1.0:1651532159.203531:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5137
00000100:00100000:1.0:1651532159.203533:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468717568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.203536:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.203539:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41366f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd72 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.203546:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41366f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd72 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.203550:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41366f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd72 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.203556:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532159.203570:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468717568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.203573:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5137
00000100:00100000:0.0:1651532159.203847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.203855:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468717696
00000100:00100000:1.0:1651532159.203863:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5138
00000100:00100000:1.0:1651532159.203864:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468717696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.203867:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.203870:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413676 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd79 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.203878:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413676 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd79 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.203882:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413676 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd79 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.203885:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532159.203901:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468717696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.203903:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5138
00000001:00080000:1.0:1651532159.263487:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794071 is committed
00010000:00010000:0.0:1651532159.263520:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.263525:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.263547:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.263548:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468712832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 611215us (611262us total) trans 158913794071 rc 0/0
00000100:00100000:0.0:1651532159.263551:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4811
00010000:00010000:1.0:1651532159.263562:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003325411e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.263563:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.263567:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.263572:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.263573:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.263574:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.263577:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.263599:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.263602:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41358f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6209536->10227711] (req 6209536->10227711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.263614:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.263618:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.263889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.263901:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468718016
00000100:00100000:0.0:1651532159.263903:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.263911:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5139
00000100:00100000:0.0:1651532159.263911:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.263913:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468718016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.263916:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.263920:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41367d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd80 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.263926:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.263933:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.263937:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.263939:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41367d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd80 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.263949:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41367d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd80 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532159.263952:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468713536:12345-10.240.43.64@tcp:3:fio. Request processed in 470543us (470615us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532159.263953:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532159.263955:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4812
00000100:00100000:0.0:1651532159.263960:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468717952
00000100:00100000:1.0:1651532159.263963:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468718016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.263965:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5139
00000100:00100000:0.0:1651532159.263971:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468717888
00000100:00100000:0.0:1651532159.263980:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4820
00000100:00100000:0.0:1651532159.263981:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468717952:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532159.263985:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4821
00000100:00100000:1.0:1651532159.263987:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468717888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532159.263988:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.263992:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.263994:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.263994:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.263997:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532159.263997:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264003:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532159.264004:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264007:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532159.264008:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.264011:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264012:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.264015:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264018:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264025:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264028:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.264029:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264032:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264036:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.264037:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.264037:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264040:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264046:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264049:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4135a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->6336511] (req 937984->6336511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.264058:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.264064:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.264341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.264361:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.264371:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468718208
00000100:00100000:1.0:1651532159.264379:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468718272
00000100:00100000:1.0:1651532159.264387:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5140
00000100:00100000:1.0:1651532159.264389:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468718208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.264392:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.264396:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413692 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd87 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264403:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413692 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd87 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.264407:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413692 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd87 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.264410:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532159.264423:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468718208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.264425:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5140
00000100:00100000:1.0:1651532159.264430:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5141
00000100:00100000:1.0:1651532159.264432:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007e79f8b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468718272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.264435:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.264438:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413699 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd8e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264448:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413699 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd8e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.264455:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413699 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd8e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.264472:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532159.264494:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007e79f8b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468718272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (133us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.264497:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5141
00000100:00100000:0.0:1651532159.264734:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.264752:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468718400
00000100:00100000:1.0:1651532159.264763:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5142
00000100:00100000:1.0:1651532159.264764:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468718400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.264768:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.264771:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd95 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.264778:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd95 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.264782:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd95 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.264785:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532159.264797:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468718400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.264799:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5142
00000001:00080000:1.0:1651532159.355213:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794072 is committed
00010000:00010000:0.0:1651532159.355245:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.355249:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355269:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.355272:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468713472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 561797us (561927us total) trans 158913794072 rc 0/0
00000100:00100000:0.0:1651532159.355275:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4813
00010000:00010000:1.0:1651532159.355276:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.355277:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355280:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355286:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.355286:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.355287:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355290:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355294:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.355294:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.355295:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355297:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355305:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355317:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4135b9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2367488->2920447] (req 2367488->2920447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355325:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355328:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355372:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355375:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.355741:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.355750:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.355759:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.355765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.355780:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468718656
00000100:00100000:0.0:1651532159.355790:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468718720
00000100:00100000:0.0:1651532159.355798:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4822
00000100:00100000:0.0:1651532159.355800:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468718656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532159.355821:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.355826:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532159.355827:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.355830:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532159.355831:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.355835:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.355836:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4823
00010000:00010000:0.0:1651532159.355839:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.355840:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468718720:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532159.355848:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468718784
00010000:00010000:1.0:1651532159.355852:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.355854:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468718848
00000100:00100000:0.0:1651532159.355858:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5143
00000100:00100000:0.0:1651532159.355860:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468718784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.355861:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532159.355862:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.355863:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.355866:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136b5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cd9c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355868:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532159.355869:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355875:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.355875:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd9c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.355881:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.355882:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cd9c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.355886:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00010000:00010000:1.0:1651532159.355896:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.355896:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468718784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (146us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.355899:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5143
00000100:00100000:0.0:1651532159.355903:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5144
00000100:00100000:0.0:1651532159.355905:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468718848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.355907:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.355909:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4136bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cda3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355915:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.355921:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4136bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cda3 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.355925:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4136bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cda3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.355928:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:1.0:1651532159.355932:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468714368:12345-10.240.43.64@tcp:3:fio.0 Request processed in 420294us (420354us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532159.355934:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468718848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (169us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.355935:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4815
00000100:00100000:0.0:1651532159.355936:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5144
00010000:00010000:1.0:1651532159.355942:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355946:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.355947:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355950:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355955:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.355958:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4135d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8740864->9302015] (req 8740864->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532159.421908:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794073 is committed
00010000:00010000:1.0:1651532159.421924:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.421928:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.421952:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468714304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 486345us (486389us total) trans 158913794073 rc 0/0
00000100:00100000:1.0:1651532159.421955:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4814
00010000:00010000:1.0:1651532159.421963:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.421966:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.421967:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.421970:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.421975:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.421976:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.421977:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.421980:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422000:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422004:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4135ce lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2007040->7892991] (req 2007040->7892991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422010:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422013:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.422341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.422366:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468719296
00000100:00100000:0.0:1651532159.422374:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.422379:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5145
00000100:00100000:1.0:1651532159.422381:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468719296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.422389:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532159.422392:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532159.422393:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4136c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cdaa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.422401:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532159.422404:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.422407:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4136c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdaa expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532159.422408:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532159.422412:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4136c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdaa expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532159.422422:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468719360
00010000:00010000:1.0:1651532159.422423:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532159.422429:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468719424
00000100:00100000:0.0:1651532159.422432:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5146
00000100:00100000:1.0:1651532159.422436:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468719296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.422439:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5145
00000100:00100000:0.0:1651532159.422439:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468719360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.422443:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532159.422445:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5147
00000100:00100000:1.0:1651532159.422446:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468719424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.422447:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4136ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cdb1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422449:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.422452:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4136d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cdb8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.422453:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.422456:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4136ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdb1 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.422457:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.422459:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4136d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdb8 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.422460:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4136ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdb1 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.422462:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4136d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdb8 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.422464:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00010000:00010000:1.0:1651532159.422466:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532159.422472:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468719360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.422473:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468719424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.422475:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5146
00000100:00100000:1.0:1651532159.422476:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5147
00000100:00100000:1.0:1651532159.422484:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468719232
00000100:00100000:1.0:1651532159.422495:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468719168
00000100:00100000:1.0:1651532159.422502:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4824
00000100:00100000:1.0:1651532159.422504:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468719232:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532159.422510:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422513:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.422515:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422518:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.422522:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4825
00000100:00100000:0.0:1651532159.422525:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468719168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532159.422536:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422540:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422543:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.422549:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.422550:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532159.422551:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.422554:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.422561:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468715456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 362542us (362625us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532159.422564:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4816
00010000:00010000:1.0:1651532159.422571:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422574:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.422575:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422578:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422585:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.422585:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.422586:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422590:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422606:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.422609:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413606 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->9330687] (req 1646592->9330687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.422615:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.422620:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.423041:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.423048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.423054:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.423064:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468719616
00000100:00100000:0.0:1651532159.423065:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.423071:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468719744
00000100:00100000:0.0:1651532159.423072:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468719808
00000100:00100000:1.0:1651532159.423073:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468719872
00000100:00100000:1.0:1651532159.423076:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5148
00000100:00100000:1.0:1651532159.423078:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468719616:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532159.423080:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5149
00010000:00010000:1.0:1651532159.423081:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532159.423082:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468719744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.423085:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4136e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cdbf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.423086:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.423089:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4136ed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cdc6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.423092:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4136e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdbf expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.423097:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4136e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdbf expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.423098:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4136ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdc6 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.423100:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532159.423105:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4136ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdc6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.423108:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532159.423115:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468719616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.423118:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5148
00000100:00100000:1.0:1651532159.423123:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5150
00000100:00100000:1.0:1651532159.423124:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468719872:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532159.423124:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468719744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (75us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532159.423127:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532159.423127:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5149
00010000:00010000:1.0:1651532159.423129:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4136f4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cdd4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.423133:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5151
00000100:00100000:0.0:1651532159.423134:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468719808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.423135:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4136f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdd4 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.423137:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.423139:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4136f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdd4 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.423139:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4136fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cdcd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.423142:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532159.423146:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4136fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdcd expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532159.423148:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468719872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (83us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532159.423149:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4136fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdcd expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532159.423150:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5150
00010000:00010000:0.0:1651532159.423152:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532159.423158:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468719808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (104us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.423160:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5151
00000100:00100000:1.0:1651532159.423516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.423528:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.423529:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468720064
00000100:00100000:1.0:1651532159.423536:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468720192
00000100:00100000:0.0:1651532159.423542:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5152
00000100:00100000:0.0:1651532159.423544:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468720064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.423547:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532159.423549:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5153
00000100:00100000:1.0:1651532159.423551:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468720192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.423555:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.423558:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413709 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cde2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.423559:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413702 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cddb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.423567:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413709 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cde2 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.423568:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413702 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cddb expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.423571:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413709 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cde2 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.423572:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413702 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cddb expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.423575:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532159.423576:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:1.0:1651532159.423589:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468720192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.423591:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5153
00000100:00100000:0.0:1651532159.423594:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468720064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.423596:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5152
00000100:00100000:1.0:1651532159.423868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.423880:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.423880:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468720384
00000100:00100000:1.0:1651532159.423887:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468720448
00000100:00100000:0.0:1651532159.423892:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5154
00000100:00100000:0.0:1651532159.423894:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468720384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.423898:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532159.423899:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5155
00000100:00100000:1.0:1651532159.423900:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468720448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.423901:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413710 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cde9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.423904:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.423907:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413717 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cdf0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.423909:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413710 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cde9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.423913:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413710 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cde9 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.423915:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413717 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdf0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.423916:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00010000:00010000:1.0:1651532159.423921:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413717 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdf0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.423925:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532159.423927:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468720384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.423930:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5154
00000100:00100000:1.0:1651532159.423932:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468720448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.423934:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5155
00000001:00080000:1.0:1651532159.488655:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794074 is committed
00010000:00010000:0.0:1651532159.488687:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.488692:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.488712:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468715328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 428682us (428754us total) trans 158913794074 rc 0/0
00000100:00100000:0.0:1651532159.488715:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4817
00010000:00010000:1.0:1651532159.488716:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.488721:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.488722:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.488725:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.488731:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.488732:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.488732:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.488736:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.488743:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.488747:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41360d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->10121215] (req 3043328->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.488750:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.488757:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.489050:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.489065:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468720704
00000100:00100000:0.0:1651532159.489065:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.489073:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.489074:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5156
00000100:00100000:1.0:1651532159.489076:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468720704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.489085:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.489089:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41371e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cdf7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.489090:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468720768
00010000:00010000:1.0:1651532159.489094:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.489097:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41371e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdf7 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.489101:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41371e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdf7 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.489104:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532159.489104:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468720832
00000100:00100000:1.0:1651532159.489120:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468720704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.489122:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5156
00000100:00100000:1.0:1651532159.489132:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4826
00000100:00100000:0.0:1651532159.489138:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4827
00000100:00100000:1.0:1651532159.489139:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468720768:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532159.489140:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468720832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532159.489145:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.489148:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489152:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532159.489153:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489156:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489158:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532159.489159:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.489163:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.489164:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.489167:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.489170:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532159.489171:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489175:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.489175:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489178:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.489178:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489182:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.489182:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.489194:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.489197:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.489219:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468716608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 286643us (286818us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532159.489220:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.489223:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4818
00010000:00010000:1.0:1651532159.489224:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.489225:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489228:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489233:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.489234:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.489234:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489238:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.489238:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532159.489252:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489255:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41364c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1400832->10252287] (req 1400832->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.489262:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468720960
00000100:00100000:1.0:1651532159.489270:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5157
00000100:00100000:1.0:1651532159.489271:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468720960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.489274:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.489274:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.489280:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489285:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413733 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cdfe expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.489292:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413733 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdfe expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.489296:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413733 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cdfe expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.489302:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532159.489311:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468720960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.489313:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5157
00000100:00100000:0.0:1651532159.489643:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.489663:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468721152
00000100:00100000:0.0:1651532159.489667:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.489697:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468721280
00000100:00100000:1.0:1651532159.489705:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5158
00000100:00100000:1.0:1651532159.489707:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468721152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.489710:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.489714:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41373a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce05 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.489719:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5159
00010000:00010000:1.0:1651532159.489721:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41373a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce05 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532159.489722:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468721280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.489725:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41373a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce05 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.489726:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.489728:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532159.489730:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413741 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce0c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.489741:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468721152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.489744:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5158
00010000:00010000:0.0:1651532159.489745:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413741 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce0c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.489749:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413741 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce0c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.489753:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532159.489762:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468721280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.489765:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5159
00000100:00100000:0.0:1651532159.490027:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.490035:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468721472
00000100:00100000:0.0:1651532159.490050:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5160
00000100:00100000:0.0:1651532159.490052:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468721472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.490056:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.490061:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413748 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce13 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.490089:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413748 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce13 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.490094:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413748 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce13 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.490098:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532159.490109:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468721472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.490112:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5160
00000100:00100000:0.0:1651532159.490139:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.490171:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468721600
00000100:00100000:0.0:1651532159.490185:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5161
00000100:00100000:0.0:1651532159.490187:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468721600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.490191:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.490194:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41374f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce1a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.490202:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41374f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce1a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.490206:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41374f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce1a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.490209:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532159.490219:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468721600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.490222:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5161
00000100:00100000:0.0:1651532159.490375:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.490382:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468721728
00000100:00100000:0.0:1651532159.490395:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5162
00000100:00100000:0.0:1651532159.490397:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468721728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.490400:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.490404:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413756 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce21 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.490411:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413756 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce21 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.490415:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413756 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce21 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.490421:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532159.490431:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468721728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.490435:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5162
00000100:00100000:0.0:1651532159.490493:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.490502:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468721856
00000100:00100000:0.0:1651532159.490513:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5163
00000100:00100000:0.0:1651532159.490515:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468721856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.490518:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.490522:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41375d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce28 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.490529:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41375d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce28 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.490533:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41375d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce28 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.490536:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532159.490545:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468721856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.490548:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5163
00000100:00100000:0.0:1651532159.490678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.490685:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468721984
00000100:00100000:0.0:1651532159.490699:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5164
00000100:00100000:0.0:1651532159.490701:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468721984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.490704:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.490708:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413764 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce2f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.490715:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413764 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce2f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.490719:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413764 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce2f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.490723:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532159.490732:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468721984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.490735:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5164
00000100:00100000:0.0:1651532159.490964:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.490972:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468722240
00000100:00100000:0.0:1651532159.490984:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5165
00000100:00100000:0.0:1651532159.490986:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468722240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.490989:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.490993:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41376b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce36 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.491000:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41376b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce36 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.491007:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41376b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce36 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.491010:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532159.491020:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468722240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.491022:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5165
00000100:00100000:0.0:1651532159.491251:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.491258:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468722368
00000100:00100000:0.0:1651532159.491272:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5166
00000100:00100000:0.0:1651532159.491274:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468722368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.491278:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.491281:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413772 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce3d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.491288:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413772 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce3d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.491292:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413772 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce3d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.491295:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532159.491305:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468722368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.491309:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5166
00000001:00080000:1.0:1651532159.613652:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794075 is committed
00010000:00010000:0.0:1651532159.613696:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.613701:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.613725:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.613725:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468716544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 411129us (411309us total) trans 158913794075 rc 0/0
00000100:00100000:0.0:1651532159.613728:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4819
00010000:00010000:1.0:1651532159.613734:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.613735:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.613739:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.613744:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.613745:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.613746:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.613749:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.613766:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.613769:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413653 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2555904->8048639] (req 2555904->8048639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.613770:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.613777:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.614129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.614142:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.614148:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.614154:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.614171:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468722688
00000100:00100000:0.0:1651532159.614171:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.614181:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468722624
00000100:00100000:1.0:1651532159.614185:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468722752
00000100:00100000:1.0:1651532159.614188:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468722880
00000100:00100000:0.0:1651532159.614191:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468722560
00000100:00100000:1.0:1651532159.614192:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5167
00000100:00100000:1.0:1651532159.614194:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468722688:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532159.614199:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4828
00000100:00100000:0.0:1651532159.614201:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468722624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532159.614203:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.614207:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413779 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce44 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.614209:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614213:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.614216:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413779 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce44 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.614216:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.614217:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532159.614218:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614221:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413779 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce44 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.614221:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614225:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532159.614232:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.614235:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.614241:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468722688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.614244:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5167
00000100:00100000:1.0:1651532159.614256:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5168
00000100:00100000:1.0:1651532159.614258:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468722752:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532159.614259:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468717952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350277us (350356us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532159.614261:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532159.614263:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4820
00010000:00010000:1.0:1651532159.614264:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413787 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce4b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614268:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532159.614268:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4829
00000100:00100000:0.0:1651532159.614269:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468722560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532159.614271:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413787 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce4b expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.614275:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413787 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce4b expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.614275:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.614279:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532159.614280:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614281:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532159.614283:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.614286:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:1.0:1651532159.614287:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468722752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (133us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532159.614287:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.614290:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5168
00010000:00010000:0.0:1651532159.614291:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.614294:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5169
00010000:00010000:0.0:1651532159.614294:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.614295:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468722880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.614297:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614298:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.614300:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413795 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce52 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614304:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.614305:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413795 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce52 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.614309:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413795 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce52 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.614312:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532159.614317:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468722880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (146us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.614319:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5169
00010000:00010000:1.0:1651532159.614326:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614329:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.614330:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614334:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614370:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.614371:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.614372:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614381:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614390:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614393:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413684 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1683456->10371071] (req 1683456->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614398:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614401:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.614717:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.614725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.614744:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.614754:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468723008
00000100:00100000:0.0:1651532159.614765:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468723136
00000100:00100000:0.0:1651532159.614769:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468723264
00000100:00100000:0.0:1651532159.614772:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5170
00000100:00100000:0.0:1651532159.614774:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468723008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.614777:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.614781:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41379c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce59 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.614789:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41379c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce59 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532159.614795:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5171
00010000:00010000:0.0:1651532159.614796:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41379c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce59 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532159.614797:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468723136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.614800:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00010000:00010000:1.0:1651532159.614802:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532159.614826:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468723008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.614829:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5170
00010000:00010000:1.0:1651532159.614833:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce60 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.614834:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5172
00000100:00100000:0.0:1651532159.614836:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468723264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.614839:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.614841:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137aa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce67 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.614846:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce60 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.614848:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce67 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.614852:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce67 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.614854:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce60 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.614855:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00010000:00010000:1.0:1651532159.614859:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532159.614860:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468723264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.614863:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5172
00000100:00100000:1.0:1651532159.614886:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468723136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 88us (160us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.614889:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5171
00000100:00100000:0.0:1651532159.615176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.615195:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468723648
00000100:00100000:1.0:1651532159.615207:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5173
00000100:00100000:1.0:1651532159.615209:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468723648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.615212:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.615216:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce6e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.615223:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce6e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.615227:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce6e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.615230:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532159.615251:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468723648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.615254:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5173
00000100:00100000:0.0:1651532159.615506:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.615524:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468723904
00000100:00100000:1.0:1651532159.615536:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5174
00000100:00100000:1.0:1651532159.615537:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468723904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.615541:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.615544:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce75 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.615550:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce75 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.615554:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce75 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.615557:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532159.615571:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468723904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.615573:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5174
00000001:00080000:1.0:1651532159.730328:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794076 is committed
00010000:00010000:1.0:1651532159.730355:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730360:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.730386:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468717888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466398us (466474us total) trans 158913794076 rc 0/0
00000100:00100000:1.0:1651532159.730390:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4821
00010000:00010000:1.0:1651532159.730398:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730401:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.730402:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730405:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730411:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.730411:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.730412:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730416:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730433:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730436:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41368b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1273856->8552447] (req 1273856->8552447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.730437:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.730442:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.730799:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.730825:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468724160
00000100:00100000:0.0:1651532159.730833:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.730845:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468724096
00000100:00100000:1.0:1651532159.730854:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4830
00000100:00100000:1.0:1651532159.730856:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468724160:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532159.730856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.730867:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532159.730868:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730873:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532159.730874:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.730875:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4831
00010000:00010000:1.0:1651532159.730877:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532159.730877:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.730877:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468724096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532159.730882:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730885:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.730887:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.730891:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532159.730893:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.730894:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468724288
00010000:00010000:0.0:1651532159.730896:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532159.730896:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.730904:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468724416
00000100:00100000:1.0:1651532159.730910:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5175
00010000:00010000:0.0:1651532159.730911:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.730912:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468724288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.730915:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.730915:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730917:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce7c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730924:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce7c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.730929:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce7c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.730932:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532159.730945:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468724288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.730948:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5175
00000100:00100000:1.0:1651532159.730952:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5176
00000100:00100000:1.0:1651532159.730954:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468724416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.730956:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.730959:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137d4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce83 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.730964:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce83 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.730968:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce83 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.730971:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532159.730976:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468724416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.730978:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5176
00000100:00100000:0.0:1651532159.731255:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.731263:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468724608
00000100:00100000:0.0:1651532159.731271:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5177
00000100:00100000:0.0:1651532159.731273:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468724608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.731277:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.731281:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4137db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce8a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.731289:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4137db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce8a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.731294:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4137db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce8a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.731297:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532159.731307:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468724608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.731310:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5177
00000001:00080000:1.0:1651532159.855318:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794077 is committed
00010000:00010000:0.0:1651532159.855360:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.855365:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855384:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.855388:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468718656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499587us (499647us total) trans 158913794077 rc 0/0
00010000:00010000:1.0:1651532159.855389:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.855390:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.855392:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4822
00010000:00010000:1.0:1651532159.855394:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855399:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.855400:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.855401:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855404:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855407:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.855408:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.855408:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855411:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855414:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.855414:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.855415:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855420:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855442:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855446:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4136a7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [57344->3993599] (req 57344->3993599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.855450:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855452:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855455:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.855455:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855483:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855487:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.855734:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.855747:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468724800
00000100:00100000:0.0:1651532159.855797:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5178
00000100:00100000:0.0:1651532159.855800:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468724800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.855833:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.855838:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4137e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce91 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.855847:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4137e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce91 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.855851:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4137e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce91 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.855855:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532159.855863:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468724800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (131us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.855866:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5178
00010000:00010000:1.0:1651532159.855939:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855943:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.855964:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468718720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 500125us (500205us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532159.855968:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4823
00010000:00010000:1.0:1651532159.855978:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.855982:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.855993:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468719232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433489us (433620us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532159.855996:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4824
00010000:00010000:1.0:1651532159.856004:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856010:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.856011:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856016:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856018:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856025:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532159.856027:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856032:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856047:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856050:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4136ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1626112->8196095] (req 1626112->8196095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856057:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.856058:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.856059:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856064:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856081:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856085:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856094:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856098:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4136d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5951488->6303743] (req 5951488->6303743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.856442:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.856451:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.856460:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.856468:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.856477:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.856485:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468725120
00000100:00100000:0.0:1651532159.856495:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468725248
00000100:00100000:0.0:1651532159.856498:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468725312
00000100:00100000:0.0:1651532159.856501:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5179
00000100:00100000:0.0:1651532159.856503:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468725120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.856506:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532159.856507:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468724928
00010000:00010000:0.0:1651532159.856510:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4137e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce98 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856519:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4137e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce98 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532159.856525:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468724992
00010000:00010000:0.0:1651532159.856530:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4137e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce98 expref: 23 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.856534:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:1.0:1651532159.856541:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4832
00000100:00100000:1.0:1651532159.856544:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754468724928:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532159.856549:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754468725120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.856552:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5179
00010000:00010000:1.0:1651532159.856554:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.856557:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5180
00000100:00100000:0.0:1651532159.856558:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468725248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.856561:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.856564:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4137f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ce9f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856570:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4137f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce9f expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.856572:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532159.856573:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856576:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532159.856577:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856580:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4137f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ce9f expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.856581:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856584:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00010000:00010000:1.0:1651532159.856585:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.856590:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468725248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.856592:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5180
00000100:00100000:1.0:1651532159.856593:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4833
00000100:00100000:1.0:1651532159.856595:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468724992:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532159.856596:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5181
00000100:00100000:0.0:1651532159.856598:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468725312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.856600:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.856602:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856605:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532159.856606:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856609:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532159.856609:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856611:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413805 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cea6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856613:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.856615:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.856618:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413805 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cea6 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.856622:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413805 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cea6 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.856625:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532159.856631:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468725312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (154us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.856634:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5181
00000001:00080000:1.0:1651532159.988646:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794079 is committed
00010000:00010000:1.0:1651532159.988668:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.988672:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988681:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988686:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.988693:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468720768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499558us (499627us total) trans 158913794079 rc 0/0
00000100:00100000:1.0:1651532159.988696:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4826
00010000:00010000:1.0:1651532159.988704:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.988708:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.988709:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.988712:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.988712:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468719168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566186us (566319us total) trans 158913794078 rc 0/0
00000100:00100000:0.0:1651532159.988715:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4825
00010000:00010000:1.0:1651532159.988718:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.988720:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413725 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2117632->9412607] (req 2117632->9412607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988723:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988727:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532159.988728:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988731:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988736:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.988737:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.988738:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988740:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988744:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.988744:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.988745:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988748:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988759:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988763:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4136df lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->1351679] (req 1253376->1351679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988773:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988778:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988827:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.988830:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.989121:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.989145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.989147:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468725696
00000100:00100000:1.0:1651532159.989161:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.989168:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468725632
00000100:00100000:1.0:1651532159.989183:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4834
00000100:00100000:1.0:1651532159.989186:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468725696:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532159.989192:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4835
00000100:00100000:0.0:1651532159.989194:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468725632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532159.989199:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989202:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.989204:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532159.989205:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532159.989206:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989210:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532159.989211:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989214:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989217:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532159.989217:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.989221:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989222:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989225:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989228:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.989233:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468725760
00010000:00010000:0.0:1651532159.989240:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.989241:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5182
00000100:00100000:1.0:1651532159.989242:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468725760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.989243:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.989245:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.989248:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41381a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cead expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.989260:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532159.989263:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468720832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 500122us (500190us total) trans 0 rc 45056/45056
00000100:00100000:0.0:1651532159.989266:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4827
00010000:00010000:1.0:1651532159.989268:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41381a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cead expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.989272:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41381a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cead expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.989276:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532159.989277:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989283:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.989285:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468725760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.989288:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5182
00000100:00100000:0.0:1651532159.989297:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468722624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375095us (375155us total) trans 0 rc 45056/45056
00000100:00100000:0.0:1651532159.989299:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4828
00010000:00010000:1.0:1651532159.989301:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.989305:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003325411e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.989306:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.989309:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989310:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989314:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532159.989315:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989315:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.989318:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41372c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->9883647] (req 167936->9883647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989318:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989323:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.989324:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532159.989324:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989327:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989334:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989336:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413780 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->10326015] (req 344064->10326015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989342:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989345:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.989772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.989788:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.989788:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468726080
00000100:00100000:1.0:1651532159.989796:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.989800:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468726016
00000100:00100000:1.0:1651532159.989814:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.989822:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4836
00000100:00100000:0.0:1651532159.989824:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468726080:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532159.989828:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4837
00000100:00100000:1.0:1651532159.989831:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468726016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532159.989833:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989838:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532159.989839:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989839:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989841:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532159.989842:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.989848:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532159.989850:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532159.989850:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.989854:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989855:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.989858:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532159.989862:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468726208
00000100:00100000:1.0:1651532159.989869:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468726336
00000100:00100000:1.0:1651532159.989873:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5183
00000100:00100000:1.0:1651532159.989875:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468726208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.989878:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.989880:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41382f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ceb4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532159.989884:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5184
00000100:00100000:0.0:1651532159.989886:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468726336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.989888:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41382f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ceb4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.989889:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.989892:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41382f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ceb4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.989892:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413836 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cebb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.989895:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532159.989901:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413836 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cebb expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532159.989905:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468726208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.989908:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5183
00010000:00010000:0.0:1651532159.989908:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413836 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cebb expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.989914:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532159.989951:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468726336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.989955:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5184
00000100:00100000:1.0:1651532159.989962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.989976:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468726464
00000100:00100000:0.0:1651532159.989986:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5185
00000100:00100000:0.0:1651532159.989988:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468726464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.989992:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.989997:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41383d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cec2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.990007:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41383d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cec2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.990023:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41383d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cec2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.990027:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532159.990044:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468726464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.990049:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5185
00000100:00100000:1.0:1651532159.990237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532159.990248:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.990248:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468726784
00000100:00100000:0.0:1651532159.990262:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468726912
00000100:00100000:1.0:1651532159.990266:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5186
00000100:00100000:1.0:1651532159.990273:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468726784:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532159.990273:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5187
00000100:00100000:0.0:1651532159.990275:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468726912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532159.990277:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.990279:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532159.990280:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413844 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cec9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.990282:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41384b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ced0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532159.990288:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413844 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cec9 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.990290:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41384b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ced0 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.990295:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f413844 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cec9 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.990296:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41384b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ced0 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532159.990298:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532159.990302:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:1.0:1651532159.990308:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468726784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532159.990310:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5186
00000100:00100000:0.0:1651532159.990327:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468726912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.990330:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5187
00000100:00100000:1.0:1651532159.990365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.990376:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468727040
00000100:00100000:0.0:1651532159.990384:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5188
00000100:00100000:0.0:1651532159.990386:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ca61221 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468727040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.990389:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.990394:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413852 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ced7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.990404:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413852 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ced7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.990408:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413852 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ced7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.990412:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532159.990427:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ca61221 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468727040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.990430:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5188
00000100:00100000:1.0:1651532159.990750:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.990768:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468727296
00000100:00100000:0.0:1651532159.990776:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5189
00000100:00100000:0.0:1651532159.990777:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468727296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.990781:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.990785:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413859 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cede expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.990792:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413859 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cede expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.990823:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413859 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cede expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.990827:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532159.990839:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468727296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.990842:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5189
00000100:00100000:1.0:1651532159.991092:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532159.991104:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468727488
00000100:00100000:0.0:1651532159.991112:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5190
00000100:00100000:0.0:1651532159.991114:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468727488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532159.991117:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532159.991121:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413860 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cee5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532159.991128:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413860 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cee5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.991132:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413860 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cee5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532159.991135:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:0.0:1651532159.991150:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468727488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532159.991153:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5190
00000001:00080000:1.0:1651532160.088659:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794080 is committed
00002000:00010000:0.0:1651532160.088689:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532158 -> 1651532159
00010000:00010000:0.0:1651532160.088693:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.088697:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.088720:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cfa1573 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468722560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474449us (474571us total) trans 158913794080 rc 0/0
00000100:00100000:0.0:1651532160.088723:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4829
00010000:00010000:0.0:1651532160.088731:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.088734:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532160.088736:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.088738:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.088744:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.088744:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.088745:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.088748:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.088755:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.088765:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.088771:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.088771:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41378e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2371584->10321919] (req 2371584->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.089178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.089192:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468727808
00000100:00100000:1.0:1651532160.089198:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.089214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.089214:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468727744
00000100:00100000:1.0:1651532160.089223:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.089231:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4838
00000100:00100000:0.0:1651532160.089233:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468727808:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532160.089238:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4839
00010000:00010000:0.0:1651532160.089240:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.089241:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468727744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532160.089244:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.089245:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.089248:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532160.089249:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089250:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.089253:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089257:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532160.089258:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089261:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089264:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532160.089264:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.089268:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089269:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089272:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089275:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.089278:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468727936
00000100:00100000:0.0:1651532160.089286:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468728000
00000100:00100000:0.0:1651532160.089293:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5191
00000100:00100000:0.0:1651532160.089294:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468727936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.089297:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.089297:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.089300:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.089300:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413875 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ceec expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.089305:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.089308:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413875 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ceec expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.089312:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413875 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ceec expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.089315:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532160.089316:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468724160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358459us (358518us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532160.089321:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4830
00000100:00100000:0.0:1651532160.089324:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468727936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.089327:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5191
00000100:00100000:1.0:1651532160.089329:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5192
00000100:00100000:1.0:1651532160.089331:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468728000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.089334:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.089337:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41387c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cef3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.089339:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089343:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.089344:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532160.089356:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089359:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41387c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cef3 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.089360:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089365:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41387c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cef3 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.089365:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.089366:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.089367:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089369:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532160.089370:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.089376:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468728000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (153us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532160.089377:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.089379:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5192
00010000:00010000:0.0:1651532160.089380:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4137bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->7544831] (req 90112->7544831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.089386:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.089389:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.089924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.089935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.089939:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468728256
00000100:00100000:1.0:1651532160.089942:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.089951:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.089954:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468728384
00000100:00100000:0.0:1651532160.089957:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468728512
00000100:00100000:1.0:1651532160.089958:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468728448
00000100:00100000:0.0:1651532160.089960:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5193
00000100:00100000:0.0:1651532160.089962:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468728256:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532160.089965:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5194
00010000:00010000:0.0:1651532160.089966:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532160.089967:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468728384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.089970:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413883 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cefa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.089972:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.089976:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41388a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf01 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.089978:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413883 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cefa expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.089984:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41388a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf01 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.089985:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413883 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cefa expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.089988:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41388a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf01 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.089989:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:1.0:1651532160.089991:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532160.090004:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468728256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.090006:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5193
00000100:00100000:1.0:1651532160.090009:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468728384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.090012:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5195
00000100:00100000:1.0:1651532160.090013:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5194
00000100:00100000:0.0:1651532160.090013:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468728512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.090016:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.090018:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413891 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf0f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.090019:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5196
00000100:00100000:1.0:1651532160.090021:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468728448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.090023:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.090024:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413891 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf0f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.090025:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413898 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf08 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.090028:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413891 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf0f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.090031:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00010000:00010000:1.0:1651532160.090032:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413898 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf08 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.090035:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413898 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf08 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532160.090037:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468728512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.090039:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5195
00010000:00010000:1.0:1651532160.090041:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532160.090047:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468728448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.090050:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5196
00000100:00100000:1.0:1651532160.090466:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.090474:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.090486:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468728704
00000100:00100000:0.0:1651532160.090493:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468728832
00000100:00100000:1.0:1651532160.090497:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5197
00000100:00100000:1.0:1651532160.090498:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468728704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.090502:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.090505:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41389f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf16 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.090507:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5198
00000100:00100000:0.0:1651532160.090509:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468728832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.090512:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.090513:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41389f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf16 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.090516:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41389f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf16 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.090516:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4138a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf1d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.090520:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:0.0:1651532160.090523:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4138a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf1d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.090527:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4138a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf1d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532160.090529:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468728704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532160.090531:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:1.0:1651532160.090532:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5197
00000100:00100000:0.0:1651532160.090539:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468728832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.090541:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5198
00000100:00100000:1.0:1651532160.090844:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.090863:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468729088
00000100:00100000:0.0:1651532160.090871:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5199
00000100:00100000:0.0:1651532160.090873:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468729088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.090876:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.090879:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf24 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.090887:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf24 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.090891:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf24 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.090894:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532160.090911:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468729088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.090913:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5199
00000001:00080000:1.0:1651532160.246933:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794081 is committed
00010000:00010000:0.0:1651532160.246966:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.246971:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.246994:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468724096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516116us (516160us total) trans 158913794081 rc 0/0
00000100:00100000:0.0:1651532160.246997:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4831
00010000:00010000:0.0:1651532160.247005:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.247009:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532160.247010:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.247013:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.247018:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.247018:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.247019:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.247023:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.247034:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.247038:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4137c6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1069056->9392127] (req 1069056->9392127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.247053:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.247058:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.247436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.247452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.247452:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468729472
00000100:00100000:1.0:1651532160.247460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.247471:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.247472:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468729408
00000100:00100000:1.0:1651532160.247479:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.247488:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4840
00000100:00100000:1.0:1651532160.247489:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.247490:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468729472:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532160.247497:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4841
00010000:00010000:0.0:1651532160.247497:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.247499:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468729408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532160.247502:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532160.247503:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.247506:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532160.247507:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.247508:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.247511:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.247512:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532160.247514:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.247517:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532160.247518:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.247521:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.247522:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.247526:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.247530:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468729536
00000100:00100000:0.0:1651532160.247535:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468729664
00000100:00100000:0.0:1651532160.247537:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468729728
00000100:00100000:0.0:1651532160.247539:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468729792
00000100:00100000:0.0:1651532160.247542:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5200
00000100:00100000:0.0:1651532160.247543:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468729536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.247546:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.247548:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4138c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf2b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.247555:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4138c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf2b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.247559:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4138c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf2b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.247562:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532160.247577:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468729536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.247580:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5200
00000100:00100000:0.0:1651532160.247585:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5201
00000100:00100000:0.0:1651532160.247587:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468729664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.247590:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.247592:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4138c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf32 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.247594:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5202
00000100:00100000:1.0:1651532160.247597:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468729728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.247600:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4138c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf32 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.247603:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.247604:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4138c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf32 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.247607:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00010000:00010000:1.0:1651532160.247608:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4138d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf39 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.247613:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468729664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.247615:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5201
00000100:00100000:0.0:1651532160.247619:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5203
00010000:00010000:1.0:1651532160.247621:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4138d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf39 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532160.247621:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468729792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.247623:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.247625:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4138d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf40 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.247629:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4138d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf39 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.247630:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4138d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf40 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.247633:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4138d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf40 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.247635:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532160.247636:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532160.247641:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468729792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (152us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.247643:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5203
00000100:00100000:1.0:1651532160.247661:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468729728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (181us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.247664:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5202
00000100:00100000:1.0:1651532160.248064:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.248073:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.248085:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468729984
00000100:00100000:0.0:1651532160.248091:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468730176
00000100:00100000:1.0:1651532160.248097:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5204
00000100:00100000:1.0:1651532160.248099:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468729984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.248102:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.248106:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138de lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf47 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.248106:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5205
00000100:00100000:0.0:1651532160.248107:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468730176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.248111:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.248114:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4138e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf4e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.248117:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf47 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.248121:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf47 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.248122:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4138e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf4e expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.248125:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532160.248126:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4138e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf4e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.248130:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532160.248137:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468729984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.248140:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5204
00000100:00100000:0.0:1651532160.248145:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468730176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.248148:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5205
00000100:00100000:1.0:1651532160.248415:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.248427:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468730304
00000100:00100000:0.0:1651532160.248435:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5206
00000100:00100000:0.0:1651532160.248437:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468730304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.248441:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.248444:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4138ec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf55 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.248451:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4138ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf55 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.248456:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4138ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf55 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.248459:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532160.248469:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468730304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.248471:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5206
00000001:00080000:1.0:1651532160.330335:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794082 is committed
00010000:00010000:1.0:1651532160.330362:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330366:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.330390:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468724928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 473845us (473948us total) trans 158913794082 rc 0/0
00010000:00010000:0.0:1651532160.330391:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.330393:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4832
00010000:00010000:0.0:1651532160.330395:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532160.330397:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330400:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330406:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.330406:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.330407:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330410:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330413:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.330414:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.330415:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330418:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330426:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330430:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4137f0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1118208->8773631] (req 1118208->8773631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330443:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330447:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330476:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330480:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.330748:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.330761:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468730624
00010000:00010000:1.0:1651532160.330770:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.330770:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5207
00000100:00100000:0.0:1651532160.330772:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468730624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.330774:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330776:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.330780:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4138f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf5c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.330793:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468724992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474197us (474342us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532160.330796:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4833
00010000:00010000:0.0:1651532160.330796:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.330799:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4138f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf5c expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.330814:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4138f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf5c expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.330817:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:1.0:1651532160.330819:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330823:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.330826:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468730624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.330835:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5207
00000100:00100000:1.0:1651532160.330836:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058d1514d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468725696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341650us (341715us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532160.330839:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4834
00010000:00010000:0.0:1651532160.330842:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330846:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532160.330847:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330850:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330852:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330855:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330856:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532160.330857:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.330858:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4137fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4845568->8601599] (req 4845568->8601599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330860:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330865:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.330866:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.330867:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330869:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330879:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330882:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41380c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4849664->9007103] (req 4849664->9007103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330891:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.330894:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.331300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.331310:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.331317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.331324:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468730816
00000100:00100000:1.0:1651532160.331334:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468730752
00000100:00100000:1.0:1651532160.331344:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4842
00000100:00100000:1.0:1651532160.331355:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468730816:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532160.331360:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4843
00010000:00010000:1.0:1651532160.331363:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.331363:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468730752:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532160.331367:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532160.331368:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.331371:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532160.331372:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.331376:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.331380:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.331380:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.331384:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532160.331385:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.331388:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:1.0:1651532160.331389:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468731072
00010000:00010000:0.0:1651532160.331389:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.331394:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.331399:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5208
00000100:00100000:1.0:1651532160.331401:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468731072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.331403:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.331404:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.331406:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413908 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf63 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.331416:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413908 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf63 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.331420:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413908 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf63 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.331424:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532160.331436:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468731072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.331439:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5208
00000100:00100000:1.0:1651532160.331691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.331698:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468731264
00000100:00100000:1.0:1651532160.331709:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5209
00000100:00100000:1.0:1651532160.331711:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468731264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.331714:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.331717:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41390f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf6a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.331725:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41390f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf6a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.331729:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41390f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf6a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.331732:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532160.331744:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468731264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.331746:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5209
00000001:00080000:1.0:1651532160.430333:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794083 is committed
00010000:00010000:1.0:1651532160.430368:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.430372:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.430396:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f178c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468725632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 441201us (441235us total) trans 158913794083 rc 0/0
00010000:00010000:0.0:1651532160.430397:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.430400:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4835
00010000:00010000:0.0:1651532160.430401:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532160.430402:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430406:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430412:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.430413:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.430413:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430416:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430420:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.430420:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.430421:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430424:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430438:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430443:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413813 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2166784->8830975] (req 2166784->8830975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430452:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430456:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.430457:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.430461:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430471:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430474:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.430491:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.430495:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532160.430496:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.430499:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.430513:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.430516:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413821 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8568832->8572927] (req 8568832->8572927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.430522:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000365505ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468726080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 440697us (440750us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532160.430526:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4836
00000100:00100000:1.0:1651532160.430748:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.430760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.430768:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468731456
00000100:00100000:1.0:1651532160.430778:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468731520
00000100:00100000:1.0:1651532160.430797:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4844
00000100:00100000:0.0:1651532160.430797:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.430799:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468731456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532160.430827:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.430830:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4845
00010000:00010000:1.0:1651532160.430832:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532160.430833:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.430833:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468731520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532160.430836:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532160.430837:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.430841:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.430844:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430859:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430864:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532160.430865:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430868:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532160.430869:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430873:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430877:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.430891:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.430899:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468731712
00000100:00100000:0.0:1651532160.430906:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468731776
00000100:00100000:0.0:1651532160.430915:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5210
00000100:00100000:0.0:1651532160.430917:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468731712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.430921:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.430924:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413924 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf71 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.430925:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5211
00000100:00100000:1.0:1651532160.430929:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468731776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.430932:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413924 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf71 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.430935:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.430939:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413924 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf71 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.430940:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41392b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf78 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.430942:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:1.0:1651532160.430952:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41392b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf78 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532160.430953:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468731712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (158us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532160.430956:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41392b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf78 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532160.430956:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5210
00010000:00010000:1.0:1651532160.430960:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532160.430994:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468731776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.430997:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5211
00000001:00080000:1.0:1651532160.588667:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794084 is committed
00010000:00010000:1.0:1651532160.588683:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.588687:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.588705:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067ce0c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468726016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 598873us (598916us total) trans 158913794084 rc 0/0
00000100:00100000:1.0:1651532160.588710:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4837
00010000:00010000:1.0:1651532160.588717:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.588720:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532160.588722:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.588724:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.588729:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.588730:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.588731:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.588734:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.588747:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.588750:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413828 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->3702783] (req 905216->3702783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.588760:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.588765:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.589052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.589062:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.589068:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.589086:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468731968
00000100:00100000:1.0:1651532160.589096:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468732032
00010000:00010000:0.0:1651532160.589096:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.589101:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.589105:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4846
00000100:00100000:1.0:1651532160.589107:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468731968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532160.589114:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589119:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532160.589120:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589123:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532160.589124:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.589124:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468727808:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499890us (499953us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532160.589127:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4838
00010000:00010000:1.0:1651532160.589128:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589131:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.589133:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4847
00000100:00100000:0.0:1651532160.589135:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468732032:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532160.589140:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468732096
00010000:00010000:0.0:1651532160.589142:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.589149:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5212
00000100:00100000:1.0:1651532160.589151:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468732096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.589153:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.589154:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.589155:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589156:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413940 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf7f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.589158:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532160.589158:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589161:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.589164:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589165:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413940 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf7f expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.589168:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589169:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f413940 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf7f expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.589173:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532160.589176:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.589179:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532160.589180:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.589181:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468732096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (113us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532160.589183:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.589184:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5212
00010000:00010000:0.0:1651532160.589187:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.589188:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.589189:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.589194:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.589204:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.589207:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413867 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->8433663] (req 458752->8433663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589208:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589212:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.589618:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.589630:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.589635:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468732224
00000100:00100000:0.0:1651532160.589638:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.589652:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468732352
00000100:00100000:0.0:1651532160.589655:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468732416
00000100:00100000:1.0:1651532160.589656:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5213
00000100:00100000:1.0:1651532160.589658:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468732224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.589662:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532160.589663:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5214
00000100:00100000:0.0:1651532160.589665:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468732352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.589667:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413947 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf86 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.589669:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.589673:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41394e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf8d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589678:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413947 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf86 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.589681:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41394e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf8d expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.589683:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f413947 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf86 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.589686:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41394e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf8d expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.589687:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532160.589689:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:1.0:1651532160.589699:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468732224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.589699:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468732352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.589702:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5213
00000100:00100000:0.0:1651532160.589703:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5214
00000100:00100000:1.0:1651532160.589707:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5215
00000100:00100000:1.0:1651532160.589709:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468732416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.589712:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.589715:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413955 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf94 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.589744:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413955 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf94 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.589749:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413955 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf94 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.589752:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532160.589759:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468732416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (121us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.589762:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5215
00000100:00100000:0.0:1651532160.590035:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.590054:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468732608
00000100:00100000:1.0:1651532160.590066:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5216
00000100:00100000:1.0:1651532160.590068:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468732608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.590071:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.590075:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41395c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cf9b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.590082:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41395c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf9b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.590086:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41395c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cf9b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.590089:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532160.590099:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468732608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.590102:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5216
00000001:00080000:1.0:1651532160.705358:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794085 is committed
00002000:00010000:1.0:1651532160.705374:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532159 -> 1651532160
00002000:00010000:1.0:1651532160.705375:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532158 -> 1651532160
00010000:00010000:1.0:1651532160.705378:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705382:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.705406:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468727744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616164us (616208us total) trans 158913794085 rc 0/0
00000100:00100000:1.0:1651532160.705409:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4839
00010000:00010000:1.0:1651532160.705417:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705423:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532160.705425:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705428:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705433:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.705433:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.705434:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705437:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705444:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.705446:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.705452:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705456:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41386e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [94208->9474047] (req 94208->9474047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.705855:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.705866:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.705873:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468733056
00000100:00100000:0.0:1651532160.705874:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.705883:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.705889:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468732992
00000100:00100000:0.0:1651532160.705889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.705895:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4848
00000100:00100000:1.0:1651532160.705897:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468733056:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532160.705901:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4849
00000100:00100000:0.0:1651532160.705903:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468732992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532160.705904:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705911:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.705912:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.705912:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705915:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.705916:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532160.705918:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.705921:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.705923:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532160.705924:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.705929:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.705932:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.705934:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468733120
00010000:00010000:0.0:1651532160.705935:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.705943:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468733248
00000100:00100000:1.0:1651532160.705945:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468733312
00000100:00100000:1.0:1651532160.705948:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5217
00000100:00100000:1.0:1651532160.705950:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468733120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.705952:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.705954:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705955:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413971 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfa2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.705958:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.705961:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.705964:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413971 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfa2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.705975:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f413971 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfa2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532160.705979:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468729472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458488us (458543us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532160.705982:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4840
00010000:00010000:1.0:1651532160.705983:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532160.705991:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5218
00000100:00100000:1.0:1651532160.705993:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468733120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.705993:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468733248:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532160.705996:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5217
00010000:00010000:0.0:1651532160.705996:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.705999:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413978 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfa9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.706001:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5219
00000100:00100000:1.0:1651532160.706002:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468733312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.706005:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.706005:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.706007:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41397f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfb0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.706008:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413978 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfa9 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.706012:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.706012:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413978 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfa9 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.706014:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41397f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfb0 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.706015:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00010000:00010000:1.0:1651532160.706018:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41397f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfb0 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.706021:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532160.706022:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468733248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (139us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.706024:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5218
00000100:00100000:1.0:1651532160.706026:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468733312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (138us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.706029:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5219
00010000:00010000:1.0:1651532160.706035:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.706039:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532160.706040:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.706043:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.706047:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.706048:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.706049:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.706052:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.706059:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.706061:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4138b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->9740287] (req 253952->9740287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.706067:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.706070:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.706585:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.706593:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.706605:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468733504
00000100:00100000:0.0:1651532160.706613:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468733888
00000100:00100000:1.0:1651532160.706615:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.706617:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468734016
00000100:00100000:0.0:1651532160.706620:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5220
00000100:00100000:0.0:1651532160.706622:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468733504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.706625:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.706629:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413986 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfb7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.706632:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5221
00000100:00100000:1.0:1651532160.706634:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468733888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.706636:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413986 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfb7 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.706638:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.706640:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413986 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfb7 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.706642:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41398d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfbe expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.706644:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00010000:00010000:1.0:1651532160.706650:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41398d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfbe expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532160.706654:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468733504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (69us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532160.706655:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41398d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfbe expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532160.706657:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5220
00010000:00010000:1.0:1651532160.706659:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532160.706661:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5222
00000100:00100000:0.0:1651532160.706663:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468734016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.706665:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532160.706667:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468733888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (74us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532160.706668:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413994 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfc5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.706670:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5221
00010000:00010000:0.0:1651532160.706673:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413994 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfc5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.706677:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413994 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfc5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.706680:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532160.706686:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468734016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.706688:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5222
00000100:00100000:1.0:1651532160.706979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.706990:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468734336
00000100:00100000:0.0:1651532160.707001:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5223
00000100:00100000:0.0:1651532160.707003:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468734336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.707006:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.707010:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41399b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfcc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.707017:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41399b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfcc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.707021:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f41399b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfcc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532160.707024:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532160.707034:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468734336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.707037:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5223
00000001:00080000:1.0:1651532160.805376:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794086 is committed
00010000:00010000:1.0:1651532160.805392:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.805397:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.805420:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468729408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557920us (557968us total) trans 158913794086 rc 0/0
00000100:00100000:1.0:1651532160.805424:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4841
00010000:00010000:0.0:1651532160.805424:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.805430:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532160.805431:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.805435:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.805441:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.805442:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.805443:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.805446:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.805456:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.805462:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4138bb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->8937471] (req 737280->8937471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.805470:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.805475:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.805855:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.805867:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.805867:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468734528
00000100:00100000:1.0:1651532160.805874:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.805885:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5224
00000100:00100000:1.0:1651532160.805887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.805887:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468734528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.805891:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.805895:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4139a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfd3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.805900:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468734784
00010000:00010000:0.0:1651532160.805901:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.805904:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4139a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfd3 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532160.805909:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5225
00010000:00010000:0.0:1651532160.805909:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4139a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfd3 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532160.805910:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468734784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.805912:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00010000:00010000:1.0:1651532160.805914:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.805918:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfda expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.805924:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532160.805924:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468734528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (70us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532160.805927:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfda expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532160.805927:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5224
00010000:00010000:1.0:1651532160.805932:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfda expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.805935:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532160.805936:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468734592
00000100:00100000:1.0:1651532160.805943:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468734784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.805948:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468734656
00000100:00100000:0.0:1651532160.805956:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4850
00000100:00100000:1.0:1651532160.805958:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5225
00000100:00100000:0.0:1651532160.805958:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468734592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532160.805965:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.805966:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4851
00000100:00100000:1.0:1651532160.805968:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468734656:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532160.805970:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532160.805971:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.805974:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.805974:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532160.805974:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.805978:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532160.805979:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.805982:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532160.805983:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.805987:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.805988:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.805991:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.805991:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.806003:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.806006:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.806019:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f144bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468730816:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474664us (474719us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532160.806034:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.806038:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532160.806039:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.806042:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.806043:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4842
00010000:00010000:0.0:1651532160.806047:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.806047:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.806049:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.806052:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.806058:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.806061:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4138fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->8019967] (req 1167360->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.806066:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.806069:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.806388:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.806413:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.806476:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468734976
00000100:00100000:0.0:1651532160.806488:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468735168
00000100:00100000:0.0:1651532160.806493:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5226
00000100:00100000:0.0:1651532160.806495:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468734976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.806499:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532160.806503:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5227
00010000:00010000:0.0:1651532160.806503:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139be lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfe1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.806507:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468735168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532160.806511:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfe1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.806513:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532160.806518:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfe1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.806519:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfe8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.806522:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00010000:00010000:1.0:1651532160.806531:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfe8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532160.806532:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468734976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532160.806535:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5226
00010000:00010000:1.0:1651532160.806536:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfe8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.806539:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532160.806562:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468735168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (149us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.806565:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5227
00000100:00100000:1.0:1651532160.806849:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.806857:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468735296
00000100:00100000:1.0:1651532160.806870:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5228
00000100:00100000:1.0:1651532160.806872:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468735296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.806876:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.806879:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cfef expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.806887:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfef expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.806891:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cfef expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.806894:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532160.806906:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468735296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.806909:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5228
00000001:00080000:1.0:1651532160.905371:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794087 is committed
00010000:00010000:0.0:1651532160.905403:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905408:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.905430:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baf029d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468730752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574067us (574120us total) trans 158913794087 rc 0/0
00000100:00100000:0.0:1651532160.905434:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4843
00010000:00010000:0.0:1651532160.905442:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905445:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532160.905446:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905449:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905457:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.905458:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532160.905459:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905462:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905468:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905471:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413901 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->10321919] (req 606208->10321919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.905477:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.905482:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532160.905782:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532160.905794:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468735552
00000100:00100000:1.0:1651532160.905819:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.905833:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468735616
00000100:00100000:0.0:1651532160.905845:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4852
00000100:00100000:0.0:1651532160.905848:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468735552:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532160.905852:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4853
00000100:00100000:1.0:1651532160.905853:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468735616:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532160.905855:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905860:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532160.905861:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905861:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905864:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532160.905864:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.905871:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532160.905873:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.905875:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532160.905876:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.905882:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905882:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532160.905886:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.905888:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532160.905902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532160.905963:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468735936
00000100:00100000:1.0:1651532160.905980:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5229
00000100:00100000:1.0:1651532160.905983:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468735936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532160.905988:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532160.905993:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cff6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532160.906006:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cff6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.906014:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cff6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532160.906020:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532160.906049:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468735936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (146us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532160.906052:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5229
00000001:00080000:1.0:1651532161.046055:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794088 is committed
00010000:00010000:1.0:1651532161.046071:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046075:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.046101:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000710b397f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468731456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 615301us (615353us total) trans 158913794088 rc 0/0
00010000:00010000:0.0:1651532161.046103:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.046104:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4844
00010000:00010000:0.0:1651532161.046107:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.046108:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.046112:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.046117:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.046118:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.046119:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.046122:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.046129:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.046135:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413916 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->7372799] (req 0->7372799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046149:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046154:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046536:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046541:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.046555:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009d8d169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468731520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 615722us (615794us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532161.046558:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4845
00010000:00010000:1.0:1651532161.046564:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046568:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532161.046569:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046571:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046577:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.046578:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.046579:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046582:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046589:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046591:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41391d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3215360->9568255] (req 3215360->9568255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046596:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.046599:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.046976:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.046984:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.046991:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.046998:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468736448
00000100:00100000:1.0:1651532161.047008:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468736384
00000100:00100000:1.0:1651532161.047014:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4854
00000100:00100000:1.0:1651532161.047016:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468736448:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532161.047026:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.047030:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.047031:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.047035:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.047041:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4855
00000100:00100000:1.0:1651532161.047043:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468736384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532161.047047:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.047050:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532161.047051:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.047054:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.047056:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532161.047057:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.047061:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.047066:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.047070:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.047077:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468736576
00000100:00100000:1.0:1651532161.047091:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5230
00000100:00100000:1.0:1651532161.047092:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468736576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.047095:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.047098:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4139f6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44cffd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.047105:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4139f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cffd expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.047109:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4139f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44cffd expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.047113:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532161.047123:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468736576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (132us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.047126:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5230
00000100:00100000:1.0:1651532161.047367:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.047374:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468736704
00000100:00100000:1.0:1651532161.047387:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5231
00000100:00100000:1.0:1651532161.047389:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468736704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.047392:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.047396:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4139fd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d004 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.047403:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4139fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d004 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.047407:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4139fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d004 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.047410:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532161.047419:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468736704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.047422:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5231
00000001:00080000:1.0:1651532161.155362:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794089 is committed
00010000:00010000:1.0:1651532161.155379:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155383:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.155407:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df95fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468731968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566299us (566356us total) trans 158913794089 rc 0/0
00010000:00010000:0.0:1651532161.155409:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.155411:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4846
00010000:00010000:0.0:1651532161.155414:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.155415:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155418:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155424:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.155425:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.155425:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155429:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155432:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.155432:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.155433:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155436:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155449:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155452:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413932 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5009408->5021695] (req 5009408->5021695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155457:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155458:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155461:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155462:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.155754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.155762:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532161.155782:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155787:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155790:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155795:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.155818:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468732032:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566667us (566741us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532161.155820:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468733056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449922us (449966us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532161.155822:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4847
00000100:00100000:1.0:1651532161.155824:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4848
00010000:00010000:1.0:1651532161.155832:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155832:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155835:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.155835:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532161.155837:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155837:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155839:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155842:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155846:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155848:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.155848:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.155849:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155851:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413963 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2170880->8650751] (req 2170880->8650751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155852:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.155858:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468736832
00010000:00010000:0.0:1651532161.155859:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.155862:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413939 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [794624->9269247] (req 794624->9269247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.155868:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468736896
00000100:00100000:1.0:1651532161.155872:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5232
00000100:00100000:1.0:1651532161.155874:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468736832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.155875:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155877:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.155879:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155888:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a04 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d00b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.155896:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a04 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d00b expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.155900:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a04 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d00b expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.155903:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532161.155903:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5233
00000100:00100000:0.0:1651532161.155905:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468736896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.155908:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532161.155911:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468736832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (158us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532161.155912:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413a0b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d012 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.155914:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5232
00010000:00010000:0.0:1651532161.155920:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413a0b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d012 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.155924:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413a0b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d012 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.155927:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532161.155934:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468736896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (172us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.155937:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5233
00000100:00100000:1.0:1651532161.156411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.156425:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.156426:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.156436:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.156441:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468737088
00000100:00100000:1.0:1651532161.156443:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468736960
00000100:00100000:0.0:1651532161.156456:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4856
00000100:00100000:0.0:1651532161.156458:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468737088:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532161.156463:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4857
00000100:00100000:1.0:1651532161.156465:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468736960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532161.156466:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.156470:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532161.156472:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.156473:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.156474:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532161.156475:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.156479:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.156480:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532161.156481:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.156485:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.156485:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.156493:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468737280
00010000:00010000:0.0:1651532161.156496:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.156498:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468737344
00000100:00100000:1.0:1651532161.156502:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5234
00000100:00100000:1.0:1651532161.156503:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468737280:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532161.156505:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5235
00010000:00010000:1.0:1651532161.156506:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532161.156506:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079770f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468737344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.156508:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a20 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d019 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.156509:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.156512:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413a27 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d020 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.156515:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a20 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d019 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.156519:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a20 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d019 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.156519:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413a27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d020 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.156523:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532161.156524:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413a27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d020 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.156527:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532161.156537:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468737280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.156541:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5234
00000100:00100000:0.0:1651532161.156543:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079770f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468737344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.156546:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5235
00000100:00100000:1.0:1651532161.156849:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.156860:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468737600
00000100:00100000:0.0:1651532161.156872:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5236
00000100:00100000:0.0:1651532161.156874:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468737600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.156877:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.156881:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a2e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d027 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.156895:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a2e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d027 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.156899:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a2e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d027 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.156903:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532161.156914:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468737600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.156917:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5236
00000100:00100000:1.0:1651532161.157127:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.157137:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468737728
00000100:00100000:0.0:1651532161.157148:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5237
00000100:00100000:0.0:1651532161.157150:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468737728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.157153:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.157156:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a35 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d02e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.157163:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a35 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d02e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.157167:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a35 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d02e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.157170:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532161.157180:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468737728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.157191:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5237
00000100:00100000:1.0:1651532161.157410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.157421:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468737856
00000100:00100000:0.0:1651532161.157431:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5238
00000100:00100000:0.0:1651532161.157433:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468737856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.157436:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.157440:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413a3c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d035 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.157446:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413a3c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d035 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.157450:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413a3c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d035 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.157454:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532161.157464:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468737856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.157466:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5238
00000001:00080000:1.0:1651532161.222095:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794090 is committed
00010000:00010000:0.0:1651532161.222125:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.222130:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.222152:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468732992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516248us (516285us total) trans 158913794090 rc 0/0
00000100:00100000:0.0:1651532161.222164:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4849
00010000:00010000:0.0:1651532161.222172:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.222175:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.222177:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.222180:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.222185:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.222185:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.222186:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.222189:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.222197:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.222199:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41396a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1736704->7569407] (req 1736704->7569407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.222205:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.222208:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.222579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.222587:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.222597:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.222610:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.222618:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468738048
00000100:00100000:1.0:1651532161.222629:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468737984
00000100:00100000:1.0:1651532161.222635:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4858
00000100:00100000:1.0:1651532161.222637:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468738048:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532161.222645:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.222650:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532161.222651:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532161.222652:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.222656:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.222663:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4859
00000100:00100000:1.0:1651532161.222664:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468737984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532161.222668:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.222672:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532161.222673:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.222676:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.222679:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532161.222679:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.222684:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.222687:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.222690:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.222696:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468738176
00000100:00100000:1.0:1651532161.222697:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468738240
00000100:00100000:1.0:1651532161.222703:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5239
00000100:00100000:0.0:1651532161.222709:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5240
00000100:00100000:0.0:1651532161.222711:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468738176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532161.222713:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468738240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.222715:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.222717:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.222718:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413a51 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d03c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.222722:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413a58 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d043 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.222726:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413a51 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d03c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.222730:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413a51 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d03c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.222734:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532161.222735:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413a58 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d043 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.222742:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413a58 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d043 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532161.222747:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468738176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (150us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.222749:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5240
00010000:00010000:1.0:1651532161.222756:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532161.222767:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468738240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (163us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.222771:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5239
00000100:00100000:0.0:1651532161.248145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532161.248154:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233088
00000100:00100000:0.0:1651532161.248162:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 68
00000100:00100000:0.0:1651532161.248164:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e73fb30f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951233088:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532161.248170:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 544768 granted 353342016 pending 430080 free 81138851840 avail 76965158912
00000100:00100000:0.0:1651532161.248187:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e73fb30f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951233088:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 22us (43us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532161.248190:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 68
00000001:00080000:1.0:1651532161.288817:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794091 is committed
00010000:00010000:0.0:1651532161.288851:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.288856:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.288878:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468734592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482919us (483011us total) trans 158913794091 rc 0/0
00010000:00010000:1.0:1651532161.288879:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.288882:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4850
00010000:00010000:1.0:1651532161.288884:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532161.288885:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.288888:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.288894:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.288895:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.288895:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.288898:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.288907:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.288910:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4139b0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [258048->9715711] (req 258048->9715711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.288914:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.288918:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.289312:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.289324:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.289330:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468738688
00000100:00100000:0.0:1651532161.289331:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.289337:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.289356:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468738752
00000100:00100000:1.0:1651532161.289360:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468738944
00000100:00100000:1.0:1651532161.289362:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468739008
00000100:00100000:1.0:1651532161.289365:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5241
00000100:00100000:1.0:1651532161.289367:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468738688:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532161.289370:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5242
00010000:00010000:1.0:1651532161.289371:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532161.289372:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468738752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.289375:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413a5f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d04a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.289377:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.289380:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.289382:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413a66 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d051 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.289384:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413a5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d04a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.289388:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f413a5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d04a expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.289389:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.289392:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532161.289392:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413a66 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d051 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.289397:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413a66 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d051 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.289401:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532161.289404:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468738688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.289407:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5241
00000100:00100000:0.0:1651532161.289410:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468738752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.289412:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5243
00000100:00100000:1.0:1651532161.289413:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468738944:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532161.289413:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5242
00010000:00010000:1.0:1651532161.289416:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.289418:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413a6d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d058 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.289420:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5244
00000100:00100000:0.0:1651532161.289421:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468739008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.289423:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.289424:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.289425:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413a6d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d058 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.289426:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413a74 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d05f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.289429:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f413a6d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d058 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.289431:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.289432:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532161.289433:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413a74 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d05f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.289437:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413a74 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d05f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532161.289438:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468738944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.289440:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5243
00010000:00010000:0.0:1651532161.289443:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532161.289449:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468739008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.289451:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5244
00010000:00010000:0.0:1651532161.289463:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.289467:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.289482:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468734656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483513us (483607us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532161.289484:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4851
00010000:00010000:0.0:1651532161.289490:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.289493:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.289494:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.289497:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.289502:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.289502:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.289503:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.289507:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.289514:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.289516:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4139b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->9801727] (req 1777664->9801727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.289522:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.289525:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.289850:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.289870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.289877:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468739200
00000100:00100000:1.0:1651532161.289888:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468739264
00000100:00100000:1.0:1651532161.289892:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5245
00000100:00100000:1.0:1651532161.289894:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468739200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.289898:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.289901:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f413a7b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d066 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.289909:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f413a7b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d066 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.289913:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f413a7b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d066 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.289917:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532161.289926:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468739200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.289929:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5245
00000100:00100000:1.0:1651532161.289933:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5246
00000100:00100000:1.0:1651532161.289935:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b9096eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468739264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.289937:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.289939:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413a82 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d06d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.289945:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413a82 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d06d expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.289948:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f413a82 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d06d expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.289951:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532161.289956:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b9096eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468739264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.289958:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5246
00000100:00100000:0.0:1651532161.290039:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.290060:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.290061:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468739648
00000100:00100000:0.0:1651532161.290069:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.290070:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5247
00000100:00100000:1.0:1651532161.290072:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468739648:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532161.290075:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.290086:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468739520
00010000:00010000:1.0:1651532161.290093:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.290097:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413a89 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d074 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.290105:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413a89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d074 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.290109:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f413a89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d074 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532161.290115:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468739584
00010000:00010000:1.0:1651532161.290117:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532161.290122:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4860
00000100:00100000:0.0:1651532161.290124:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a238cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468739520:12345-10.240.43.64@tcp:4:fio.
00000100:00100000:1.0:1651532161.290128:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468739648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.290131:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5247
00010000:00010000:0.0:1651532161.290132:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.290136:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468739712
00010000:00010000:0.0:1651532161.290136:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532161.290137:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.290140:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.290144:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5248
00000100:00100000:1.0:1651532161.290146:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468739712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.290149:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.290149:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532161.290150:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.290151:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f413a97 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d07b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.290155:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.290158:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f413a97 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d07b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.290158:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.290161:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f413a97 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d07b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.290161:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.290165:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532161.290168:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4861
00000100:00100000:0.0:1651532161.290170:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f315f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468739584:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532161.290171:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468739712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.290173:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5248
00010000:00010000:0.0:1651532161.290175:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.290179:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532161.290179:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.290194:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532161.290195:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.290199:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.290203:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.290225:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.290232:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.290242:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468739840
00000100:00100000:0.0:1651532161.290242:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468739968
00000100:00100000:0.0:1651532161.290252:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5249
00000100:00100000:0.0:1651532161.290254:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468739968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.290257:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532161.290258:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5250
00000100:00100000:1.0:1651532161.290260:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b9b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468739840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.290260:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413aa5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d089 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.290263:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.290266:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f413aac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d082 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.290268:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413aa5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d089 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.290272:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413aa5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d089 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.290273:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f413aac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d082 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.290276:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00010000:00010000:1.0:1651532161.290277:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f413aac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d082 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.290281:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532161.290289:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468739968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.290291:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5249
00000100:00100000:1.0:1651532161.290295:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b9b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468739840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.290297:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5250
00000100:00100000:0.0:1651532161.290400:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.290419:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468740096
00000100:00100000:1.0:1651532161.290427:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5251
00000100:00100000:1.0:1651532161.290429:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa3ce2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468740096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.290432:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.290435:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413ab3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d090 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.290445:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413ab3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d090 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.290449:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413ab3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d090 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.290453:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532161.290462:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa3ce2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468740096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.290464:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5251
00000100:00100000:0.0:1651532161.290579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.290597:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468740288
00000100:00100000:1.0:1651532161.290605:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5252
00000100:00100000:1.0:1651532161.290606:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468740288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.290610:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.290613:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413aba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d097 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.290620:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413aba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d097 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.290624:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413aba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d097 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.290627:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532161.290636:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468740288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.290639:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5252
00000001:00080000:1.0:1651532161.397186:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794092 is committed
00010000:00010000:0.0:1651532161.397217:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397221:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.397239:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468735552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491391us (491457us total) trans 158913794092 rc 0/0
00000100:00100000:0.0:1651532161.397242:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4852
00010000:00010000:0.0:1651532161.397249:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397252:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.397253:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397256:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397261:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.397262:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.397263:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397266:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397272:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.397272:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.397273:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397276:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397291:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397294:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4139d3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->9281535] (req 1720320->9281535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.397301:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.397306:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397326:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397329:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397343:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397357:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.397373:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468736448:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350357us (350398us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532161.397378:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4854
00010000:00010000:0.0:1651532161.397389:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397393:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.397394:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397397:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397402:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397424:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4139e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3293184->3297279] (req 3293184->3297279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.397662:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.397676:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.397691:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468740608
00000100:00100000:0.0:1651532161.397694:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468740800
00000100:00100000:1.0:1651532161.397701:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5253
00000100:00100000:1.0:1651532161.397703:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468740608:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532161.397704:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5254
00000100:00100000:0.0:1651532161.397706:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468740800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.397707:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.397709:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.397711:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ac1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d09e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397713:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ac8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0a5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.397717:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.397718:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.397722:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ac1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d09e expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.397722:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ac8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0a5 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.397726:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ac1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d09e expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.397727:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ac8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0a5 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.397729:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:0.0:1651532161.397730:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532161.397740:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468740608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.397740:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468740800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.397743:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5254
00000100:00100000:1.0:1651532161.397744:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5253
00010000:00010000:1.0:1651532161.397757:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.397761:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.397780:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468735616:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491926us (491977us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532161.397783:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4853
00010000:00010000:0.0:1651532161.397794:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397815:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.397816:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397819:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397825:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.397825:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.397826:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397829:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397838:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.397841:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4139da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1724416->9138175] (req 1724416->9138175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.397848:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532161.397859:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.397863:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.397902:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468740928
00000100:00100000:1.0:1651532161.397914:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4862
00000100:00100000:1.0:1651532161.397916:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0aea5df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468740928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532161.397922:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.397926:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532161.397927:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.397930:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532161.397931:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.397946:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.397950:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.397967:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.397985:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468740992
00000100:00100000:0.0:1651532161.397997:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4863
00000100:00100000:0.0:1651532161.397999:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468740992:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532161.398005:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.398010:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532161.398011:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.398014:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532161.398014:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.398019:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.398022:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.398073:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.398080:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468741184
00000100:00100000:1.0:1651532161.398108:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5255
00000100:00100000:1.0:1651532161.398110:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468741184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.398113:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.398117:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413add lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0ac expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.398125:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413add lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0ac expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.398129:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413add lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0ac expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.398132:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532161.398145:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468741184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.398148:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5255
00000100:00100000:1.0:1651532161.398202:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.398277:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468741376
00000100:00100000:1.0:1651532161.398293:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5256
00000100:00100000:1.0:1651532161.398296:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c39d25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468741376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.398301:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.398306:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413ae4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0b3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.398318:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413ae4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0b3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.398323:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413ae4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0b3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.398326:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532161.398341:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c39d25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468741376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.398344:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5256
00000100:00100000:0.0:1651532161.398376:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.398401:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468741568
00000100:00100000:1.0:1651532161.398413:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5257
00000100:00100000:1.0:1651532161.398415:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468741568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.398418:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.398422:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413aeb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0ba expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.398446:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413aeb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0ba expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.398450:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413aeb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0ba expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.398454:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532161.398462:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468741568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.398465:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5257
00000100:00100000:0.0:1651532161.398713:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.398732:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468741760
00000100:00100000:1.0:1651532161.398745:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5258
00000100:00100000:1.0:1651532161.398747:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468741760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.398750:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.398754:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0c1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.398761:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0c1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.398765:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0c1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.398768:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532161.398778:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468741760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.398781:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5258
00000001:00080000:1.0:1651532161.530477:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794093 is committed
00002000:00010000:1.0:1651532161.530491:0:330054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532160 -> 1651532161
00002000:00010000:1.0:1651532161.530493:0:330054:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532160 -> 1651532161
00010000:00010000:1.0:1651532161.530495:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.530499:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.530522:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468736384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 483478us (483537us total) trans 158913794093 rc 0/0
00000100:00100000:1.0:1651532161.530525:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4855
00010000:00010000:0.0:1651532161.530527:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530532:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.530533:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530537:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530543:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.530543:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.530544:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530547:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530551:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.530551:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.530552:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530554:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530557:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.530558:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.530558:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530564:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530575:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530578:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4139ef lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1110016->9158655] (req 1110016->9158655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530584:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.530586:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530587:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.530590:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530632:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.530637:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.530944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.530952:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.530963:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.530964:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468741888
00000100:00100000:1.0:1651532161.530983:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.530984:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468741952
00000100:00100000:1.0:1651532161.530992:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4864
00000100:00100000:1.0:1651532161.530994:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468741888:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532161.531002:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4865
00000100:00100000:0.0:1651532161.531004:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468741952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532161.531009:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531014:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.531015:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531018:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532161.531019:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531019:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531023:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531026:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.531027:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532161.531028:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531031:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531031:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.531039:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468742208
00010000:00010000:0.0:1651532161.531043:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531046:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.531051:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468742336
00000100:00100000:1.0:1651532161.531057:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5259
00000100:00100000:1.0:1651532161.531059:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468742208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.531062:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.531065:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413b07 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0c8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531072:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413b07 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0c8 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532161.531076:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468738048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 308438us (308498us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532161.531079:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4858
00010000:00010000:1.0:1651532161.531082:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413b07 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0c8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.531086:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532161.531088:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5260
00000100:00100000:0.0:1651532161.531090:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468742336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.531093:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532161.531095:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468742208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (131us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.531097:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5259
00010000:00010000:0.0:1651532161.531097:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413b0e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0cf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531105:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413b0e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0cf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.531109:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413b0e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0cf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.531113:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532161.531119:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468742336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.531122:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5260
00010000:00010000:0.0:1651532161.531128:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531132:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.531133:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531136:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531140:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531143:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f413a43 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->8302591] (req 12288->8302591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531151:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531154:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531163:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.531171:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468737088:12345-10.240.43.64@tcp:3:fio.0 Request processed in 374712us (374760us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532161.531172:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532161.531174:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531177:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531182:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.531183:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.531184:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531186:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.531190:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4856
00010000:00010000:1.0:1651532161.531193:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531196:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413a12 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096->4059135] (req 4096->4059135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531201:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531204:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.531530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.531538:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.531544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.531553:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468742592
00000100:00100000:1.0:1651532161.531560:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468742720
00000100:00100000:1.0:1651532161.531563:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468742848
00000100:00100000:1.0:1651532161.531565:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5261
00000100:00100000:1.0:1651532161.531567:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468742592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.531571:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.531574:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413b15 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0d6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531581:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413b15 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0d6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.531586:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413b15 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0d6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.531589:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532161.531611:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468742592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.531615:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5262
00000100:00100000:1.0:1651532161.531618:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5261
00000100:00100000:0.0:1651532161.531618:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468742720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.531621:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532161.531623:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5263
00000100:00100000:1.0:1651532161.531625:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb589f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468742848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.531625:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b1c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0dd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531627:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.531630:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413b23 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0e4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531633:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b1c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0dd expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.531636:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413b23 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0e4 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.531637:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b1c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0dd expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.531640:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413b23 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0e4 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.531641:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532161.531646:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532161.531649:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468742720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.531652:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb589f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468742848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.531652:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5262
00000100:00100000:1.0:1651532161.531655:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5263
00000100:00100000:1.0:1651532161.531681:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.531691:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468742976
00000100:00100000:1.0:1651532161.531697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.531706:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468742912
00000100:00100000:0.0:1651532161.531716:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4866
00000100:00100000:0.0:1651532161.531717:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468742976:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532161.531724:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531728:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532161.531729:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.531732:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.531734:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4867
00000100:00100000:1.0:1651532161.531737:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468742912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532161.531744:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531749:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532161.531750:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531752:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531755:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531758:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532161.531758:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531763:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531766:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531769:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.531772:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.532002:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.532009:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468743232
00000100:00100000:1.0:1651532161.532020:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5264
00000100:00100000:1.0:1651532161.532022:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468743232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.532025:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.532028:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413b38 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0eb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.532035:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413b38 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0eb expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.532039:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413b38 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0eb expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.532042:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532161.532052:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468743232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.532055:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5264
00000100:00100000:1.0:1651532161.532290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.532297:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468743424
00000100:00100000:1.0:1651532161.532310:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5265
00000100:00100000:1.0:1651532161.532312:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468743424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.532315:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.532319:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413b3f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0f2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.532326:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413b3f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0f2 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.532330:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413b3f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0f2 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.532333:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532161.532342:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468743424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.532345:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5265
00000100:00100000:1.0:1651532161.532555:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.532562:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468743616
00000100:00100000:1.0:1651532161.532574:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5266
00000100:00100000:1.0:1651532161.532576:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468743616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.532580:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.532583:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413b46 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d0f9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.532590:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413b46 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0f9 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.532594:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413b46 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d0f9 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.532597:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532161.532607:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468743616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.532609:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5266
00000100:00100000:1.0:1651532161.532843:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.532850:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468743744
00000100:00100000:1.0:1651532161.532862:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5267
00000100:00100000:1.0:1651532161.532864:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468743744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.532867:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.532870:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b4d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d100 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.532877:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b4d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d100 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.532881:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b4d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d100 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.532885:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532161.532894:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468743744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.532897:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5267
00000001:00080000:1.0:1651532161.605776:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794095 is committed
00010000:00010000:1.0:1651532161.605797:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.605813:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605819:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605827:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.605833:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468736960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449367us (449408us total) trans 158913794094 rc 0/0
00000100:00100000:1.0:1651532161.605837:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4857
00000100:00100000:0.0:1651532161.605843:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468737984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 383178us (383256us total) trans 158913794095 rc 0/0
00000100:00100000:0.0:1651532161.605846:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4859
00010000:00010000:0.0:1651532161.605853:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605857:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.605858:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605861:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605866:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605869:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f413a19 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8347648->8351743] (req 8347648->8351743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605873:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605875:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.605876:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605879:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605882:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.605882:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.605883:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605886:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605892:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605895:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f413a4a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3772416->7667711] (req 3772416->7667711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605900:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.605903:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.606247:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.606258:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.606267:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.606274:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468743872
00000100:00100000:1.0:1651532161.606286:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468743936
00000100:00100000:1.0:1651532161.606294:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4868
00000100:00100000:1.0:1651532161.606296:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468743872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532161.606303:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.606308:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532161.606309:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.606312:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532161.606313:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.606318:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.606321:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.606328:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468744064
00000100:00100000:0.0:1651532161.606332:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4869
00000100:00100000:1.0:1651532161.606337:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5268
00000100:00100000:1.0:1651532161.606339:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468744064:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532161.606340:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468743936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532161.606342:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.606345:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413b5b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d107 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.606359:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.606365:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532161.606366:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.606369:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532161.606369:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.606374:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.606376:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413b5b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d107 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.606378:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.606385:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413b5b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d107 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.606391:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532161.606410:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468744064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 69us (142us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.606415:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5268
00000001:00080000:1.0:1651532161.672285:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794096 is committed
00010000:00010000:0.0:1651532161.672317:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672326:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.672362:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a238cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468739520:12345-10.240.43.64@tcp:4:fio. Request processed in 382237us (382301us total) trans 158913794096 rc 0/0
00010000:00010000:1.0:1651532161.672363:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.672366:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4860
00010000:00010000:1.0:1651532161.672368:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532161.672370:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.672373:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.672379:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.672380:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.672380:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.672383:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.672394:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.672397:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413a90 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1384448->10235903] (req 1384448->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672406:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672410:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.672772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.672791:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468744320
00000100:00100000:1.0:1651532161.672821:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5269
00000100:00100000:1.0:1651532161.672823:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051966bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468744320:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532161.672826:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532161.672827:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.672836:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413b69 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d10e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.672836:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532161.672845:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.672848:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413b69 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d10e expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532161.672848:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532161.672853:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413b69 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d10e expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.672856:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:0.0:1651532161.672857:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672862:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.672867:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051966bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468744320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.672876:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5269
00000100:00100000:0.0:1651532161.672879:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f315f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468739584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 382708us (382810us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532161.672882:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468744384
00000100:00100000:0.0:1651532161.672882:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4861
00000100:00100000:1.0:1651532161.672885:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468744512
00000100:00100000:1.0:1651532161.672888:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468744640
00000100:00100000:1.0:1651532161.672891:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5270
00000100:00100000:1.0:1651532161.672893:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468744384:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532161.672893:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5271
00010000:00010000:1.0:1651532161.672895:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532161.672895:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468744512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.672898:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413b70 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d115 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672899:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.672903:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.672903:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413b77 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d11c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.672905:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413b70 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d115 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.672909:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413b70 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d115 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.672909:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.672912:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413b77 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d11c expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.672915:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:0.0:1651532161.672916:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413b77 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d11c expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.672920:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:1.0:1651532161.672922:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468744384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.672925:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5270
00000100:00100000:0.0:1651532161.672926:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468744512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.672928:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5272
00000100:00100000:1.0:1651532161.672930:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468744640:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532161.672930:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5271
00010000:00010000:1.0:1651532161.672932:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.672934:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413b7e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d123 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.672939:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.672940:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413b7e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d123 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.672943:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.672944:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413b7e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d123 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.672946:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532161.672947:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:0.0:1651532161.672948:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672951:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.672952:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468744640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.672954:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5272
00010000:00010000:0.0:1651532161.672955:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.672956:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.672957:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672960:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672971:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672974:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413a9e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2510848->9900031] (req 2510848->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672983:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.672986:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.673469:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.673476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.673483:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.673490:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468744832
00000100:00100000:0.0:1651532161.673500:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468744768
00000100:00100000:0.0:1651532161.673505:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4870
00000100:00100000:0.0:1651532161.673507:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468744832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532161.673515:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.673519:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532161.673521:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.673524:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.673530:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4871
00000100:00100000:0.0:1651532161.673532:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468744768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532161.673536:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.673540:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532161.673540:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.673543:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.673546:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532161.673546:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.673550:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.673553:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.673556:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.673564:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468744896
00000100:00100000:0.0:1651532161.673576:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5273
00000100:00100000:0.0:1651532161.673577:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468744896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.673580:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.673583:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413b93 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d12a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.673591:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413b93 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d12a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.673595:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413b93 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d12a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.673599:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532161.673611:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468744896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.673614:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5273
00000100:00100000:0.0:1651532161.673860:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.673867:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468745472
00000100:00100000:0.0:1651532161.673878:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5274
00000100:00100000:0.0:1651532161.673880:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468745472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.673884:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.673887:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413b9a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d131 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.673897:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413b9a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d131 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.673901:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413b9a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d131 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.673904:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532161.673916:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468745472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.673919:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5274
00000100:00100000:0.0:1651532161.674107:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.674114:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468745600
00000100:00100000:0.0:1651532161.674124:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5275
00000100:00100000:0.0:1651532161.674126:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468745600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.674129:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.674132:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413ba1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d138 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.674139:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413ba1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d138 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.674143:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413ba1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d138 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.674146:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532161.674158:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468745600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.674160:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5275
00000001:00080000:1.0:1651532161.780649:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794097 is committed
00010000:00010000:0.0:1651532161.780680:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780685:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.780702:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0aea5df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468740928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 382785us (382854us total) trans 158913794097 rc 0/0
00000100:00100000:0.0:1651532161.780705:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4862
00010000:00010000:0.0:1651532161.780711:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780715:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.780716:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780719:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780724:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.780724:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532161.780725:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780728:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780737:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780740:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f413acf lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->8617983] (req 950272->8617983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780745:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780748:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780938:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.780942:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.780963:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468740992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 382964us (382996us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532161.780966:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4863
00010000:00010000:1.0:1651532161.780968:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.780976:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532161.780978:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.780981:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.780987:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.780988:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.780989:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.780992:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.780995:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.780996:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.780996:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.780999:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781002:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.781002:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.781003:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781006:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781020:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781023:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413ad6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10178559] (req 2965504->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781027:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781029:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781032:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781032:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781057:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781061:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.781244:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.781265:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468745920
00000100:00100000:0.0:1651532161.781276:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5276
00000100:00100000:0.0:1651532161.781278:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468745920:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532161.781279:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532161.781282:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.781297:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413ba8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d13f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781310:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413ba8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d13f expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.781314:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413ba8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d13f expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.781318:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532161.781327:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468745920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.781330:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5276
00000100:00100000:0.0:1651532161.781335:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468745984
00000100:00100000:0.0:1651532161.781340:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5277
00000100:00100000:0.0:1651532161.781342:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468745984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.781344:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.781360:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413baf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d146 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781367:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413baf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d146 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.781371:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413baf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d146 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.781374:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532161.781381:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468745984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.781383:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5277
00010000:00010000:0.0:1651532161.781395:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781399:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.781409:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087620958 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468741952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 250405us (250457us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532161.781412:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4865
00010000:00010000:0.0:1651532161.781417:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781451:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532161.781461:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781465:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781470:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.781471:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532161.781473:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413b00 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [155648->7491583] (req 155648->7491583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.781489:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532161.781489:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781496:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.781503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.781514:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468742976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 249796us (249834us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532161.781517:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4866
00000100:00100000:0.0:1651532161.781522:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468746176
00000100:00100000:0.0:1651532161.781531:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468746240
00000100:00100000:0.0:1651532161.781536:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4872
00000100:00100000:0.0:1651532161.781538:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468746176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532161.781545:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781549:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532161.781550:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781553:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532161.781553:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781558:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781561:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781562:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781567:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532161.781568:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4873
00010000:00010000:1.0:1651532161.781569:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.781570:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468746240:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532161.781572:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781574:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781578:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781578:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532161.781579:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781581:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413b2a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4096000->6094847] (req 4096000->6094847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781582:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532161.781582:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781605:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781608:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.781615:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468746304
00000100:00100000:0.0:1651532161.781625:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5278
00000100:00100000:0.0:1651532161.781627:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a1abca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468746304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.781630:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.781632:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413bc4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d14d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781639:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413bc4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d14d expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.781643:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413bc4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d14d expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.781646:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532161.781658:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a1abca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468746304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (155us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.781661:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5278
00000100:00100000:0.0:1651532161.781857:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.781868:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468746624
00000100:00100000:0.0:1651532161.781876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.781886:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468746688
00000100:00100000:0.0:1651532161.781888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.781896:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4874
00000100:00100000:1.0:1651532161.781898:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468746624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532161.781905:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781909:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.781911:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.781917:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468746816
00010000:00010000:1.0:1651532161.781919:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532161.781920:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.781926:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5279
00000100:00100000:0.0:1651532161.781928:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468746816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.781929:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781931:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.781933:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781935:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413bd2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d154 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.781940:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4875
00000100:00100000:1.0:1651532161.781942:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468746688:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532161.781942:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413bd2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d154 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532161.781946:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413bd2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d154 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.781949:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.781949:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00010000:00010000:1.0:1651532161.781953:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.781954:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781956:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532161.781957:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781960:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.781963:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.781972:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468746816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532161.781975:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5279
00000100:00100000:1.0:1651532161.781981:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532161.782015:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468746944
00000100:00100000:0.0:1651532161.782024:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5280
00000100:00100000:0.0:1651532161.782025:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468746944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.782028:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532161.782029:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532161.782031:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413be0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d15b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.782036:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468747072
00010000:00010000:0.0:1651532161.782038:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413be0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d15b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532161.782043:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5281
00000100:00100000:1.0:1651532161.782044:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468747072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.782045:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413be0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d15b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.782047:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532161.782048:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00010000:00010000:1.0:1651532161.782051:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413be7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d162 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.782057:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468746944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (77us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532161.782059:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413be7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d162 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532161.782060:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5280
00010000:00010000:1.0:1651532161.782066:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413be7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d162 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.782069:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532161.782078:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468747072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.782081:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5281
00000100:00100000:1.0:1651532161.782321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.782328:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468747264
00000100:00100000:1.0:1651532161.782335:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5282
00000100:00100000:1.0:1651532161.782336:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023c32fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468747264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.782340:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.782343:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413bee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d169 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.782361:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413bee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d169 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.782365:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413bee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d169 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.782368:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532161.782381:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023c32fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468747264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.782386:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5282
00000100:00100000:0.0:1651532161.782411:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.782425:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468747392
00000100:00100000:1.0:1651532161.782439:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5283
00000100:00100000:1.0:1651532161.782441:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468747392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.782444:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.782447:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413bf5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d170 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.782454:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413bf5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d170 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.782457:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413bf5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d170 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.782461:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532161.782473:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468747392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.782475:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5283
00000001:00080000:1.0:1651532161.888980:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794098 is committed
00010000:00010000:1.0:1651532161.888996:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.889000:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.889018:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006efc17ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468741888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 358023us (358075us total) trans 158913794098 rc 0/0
00000100:00100000:1.0:1651532161.889022:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4864
00010000:00010000:1.0:1651532161.889029:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.889033:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532161.889034:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.889037:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.889042:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.889042:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.889043:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.889046:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.889053:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.889056:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413af9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9523200->9879551] (req 9523200->9879551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.889060:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.889063:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532161.947398:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794099 is committed
00010000:00010000:1.0:1651532161.947413:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947417:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.947435:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468742912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 415698us (415738us total) trans 158913794099 rc 0/0
00000100:00100000:1.0:1651532161.947439:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4867
00010000:00010000:1.0:1651532161.947446:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947450:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532161.947451:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947454:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947459:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.947459:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532161.947460:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947463:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947472:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947475:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413b31 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [929792->9826303] (req 929792->9826303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947481:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947484:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.947800:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.947828:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.947836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.947843:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468747904
00000100:00100000:1.0:1651532161.947852:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5284
00000100:00100000:1.0:1651532161.947854:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a1abca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468747904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.947858:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.947862:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413bfc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d177 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947871:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413bfc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d177 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.947875:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413bfc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d177 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.947879:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532161.947893:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a1abca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468747904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.947896:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5284
00000100:00100000:1.0:1651532161.947909:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468747968
00000100:00100000:0.0:1651532161.947916:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.947921:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468747840
00000100:00100000:1.0:1651532161.947931:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4876
00000100:00100000:1.0:1651532161.947933:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468747968:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532161.947951:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4877
00010000:00010000:1.0:1651532161.947954:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532161.947954:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468747840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532161.947959:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532161.947960:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532161.947961:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.947963:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947964:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.947968:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532161.947969:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.947972:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468748032
00010000:00010000:0.0:1651532161.947972:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.947975:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532161.947976:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532161.947983:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5285
00000100:00100000:1.0:1651532161.947985:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468748032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532161.947987:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947988:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.947990:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413c11 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d17e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.947990:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532161.947994:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.947999:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413c11 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d17e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.948003:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413c11 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d17e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.948007:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532161.948019:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468748032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.948022:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5285
00000100:00100000:1.0:1651532161.948156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.948163:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468748288
00000100:00100000:1.0:1651532161.948173:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5286
00000100:00100000:1.0:1651532161.948175:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468748288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.948178:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.948182:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c18 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d185 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.948189:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c18 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d185 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.948193:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c18 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d185 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.948196:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532161.948208:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468748288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.948211:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5286
00000100:00100000:1.0:1651532161.948448:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532161.948454:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468748480
00000100:00100000:1.0:1651532161.948465:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5287
00000100:00100000:1.0:1651532161.948466:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468748480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532161.948470:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532161.948473:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c1f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d18c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532161.948480:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c1f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d18c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.948484:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c1f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d18c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532161.948487:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532161.948498:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468748480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532161.948501:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5287
00000001:00080000:1.0:1651532162.014338:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794100 is committed
00010000:00010000:1.0:1651532162.014365:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014369:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.014390:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468743872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 408093us (408143us total) trans 158913794100 rc 0/0
00000100:00100000:1.0:1651532162.014393:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4868
00010000:00010000:1.0:1651532162.014400:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014404:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.014405:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014408:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014413:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.014413:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.014414:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014417:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014420:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.014421:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.014422:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014424:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014440:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014443:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413b54 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4583424->7905279] (req 4583424->7905279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.014453:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.014457:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014485:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014489:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.014641:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.014646:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014658:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014662:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.014662:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468743936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408327us (408403us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532162.014665:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4869
00010000:00010000:0.0:1651532162.014673:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.014676:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532162.014677:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9529893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468744832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341168us (341208us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532162.014677:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.014680:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4870
00010000:00010000:0.0:1651532162.014681:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.014686:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014687:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.014689:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413b62 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [921600->9351167] (req 921600->9351167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014690:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.014691:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014697:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014702:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.014703:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.014704:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014707:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014725:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014728:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413b85 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1847296->6746111] (req 1847296->6746111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.014744:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.014746:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532162.014748:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.014761:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468748608
00000100:00100000:0.0:1651532162.014769:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5288
00000100:00100000:0.0:1651532162.014771:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468748608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.014780:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.014784:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413c26 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d193 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.014792:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413c26 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d193 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.014797:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413c26 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d193 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.014800:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532162.014826:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468748608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.014831:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5288
00000100:00100000:1.0:1651532162.015027:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.015044:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.015059:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468748736
00000100:00100000:1.0:1651532162.015060:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.015070:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.015076:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468748672
00000100:00100000:0.0:1651532162.015083:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4878
00000100:00100000:0.0:1651532162.015085:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468748736:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532162.015086:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4879
00000100:00100000:1.0:1651532162.015089:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468748672:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532162.015092:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.015096:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.015097:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.015097:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.015100:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532162.015101:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.015105:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.015106:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.015109:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532162.015109:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.015113:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.015114:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.015117:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.015117:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.015125:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468748864
00000100:00100000:0.0:1651532162.015130:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468748992
00000100:00100000:0.0:1651532162.015134:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5289
00000100:00100000:0.0:1651532162.015135:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468748864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.015138:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.015155:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413c3b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d19a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.015163:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413c3b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d19a expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.015167:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413c3b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d19a expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.015170:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:0.0:1651532162.015184:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468748864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.015187:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5289
00000100:00100000:1.0:1651532162.015190:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5290
00000100:00100000:1.0:1651532162.015194:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468748992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.015200:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.015205:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c42 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1a1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.015206:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532162.015218:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c42 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1a1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.015226:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c42 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1a1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532162.015231:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468749120
00000100:00100000:0.0:1651532162.015238:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5291
00000100:00100000:0.0:1651532162.015239:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468749120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.015241:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:0.0:1651532162.015243:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.015246:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c49 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1a8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.015253:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c49 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1a8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.015257:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c49 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1a8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.015263:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:1.0:1651532162.015269:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468748992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 75us (199us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.015272:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5290
00000100:00100000:0.0:1651532162.015278:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468749120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.015281:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5291
00000100:00100000:0.0:1651532162.015510:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.015516:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468749376
00000100:00100000:0.0:1651532162.015523:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5292
00000100:00100000:0.0:1651532162.015524:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468749376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.015528:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.015531:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413c50 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1af expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.015538:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413c50 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1af expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.015542:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413c50 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1af expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.015546:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532162.015562:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468749376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.015565:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5292
00000100:00100000:0.0:1651532162.015844:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.015851:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468749568
00000100:00100000:0.0:1651532162.015857:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5293
00000100:00100000:0.0:1651532162.015859:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468749568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.015862:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.015865:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413c57 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1b6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.015872:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413c57 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1b6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.015876:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413c57 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1b6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.015879:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532162.015894:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468749568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.015897:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5293
00000001:00080000:1.0:1651532162.139114:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794101 is committed
00010000:00010000:1.0:1651532162.139130:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139135:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.139159:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009620f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468744768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 465625us (465681us total) trans 158913794101 rc 0/0
00000100:00100000:1.0:1651532162.139162:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4871
00010000:00010000:1.0:1651532162.139170:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139174:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.139175:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139178:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139183:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.139183:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.139185:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139188:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.139201:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139204:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.139206:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139207:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413b8c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1904640->8683519] (req 1904640->8683519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.139586:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.139596:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.139605:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.139612:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.139619:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.139628:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468750016
00000100:00100000:1.0:1651532162.139642:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468749760
00000100:00100000:0.0:1651532162.139642:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468749952
00000100:00100000:0.0:1651532162.139645:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468750144
00000100:00100000:0.0:1651532162.139649:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5294
00000100:00100000:0.0:1651532162.139650:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468750016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532162.139655:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468749824
00010000:00010000:0.0:1651532162.139659:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532162.139662:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4880
00010000:00010000:0.0:1651532162.139663:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413c5e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1c4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.139664:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468749760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532162.139671:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.139671:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413c5e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1c4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.139675:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.139676:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139679:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532162.139680:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139684:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.139684:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413c5e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1c4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.139687:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00010000:00010000:1.0:1651532162.139690:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.139697:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4881
00000100:00100000:0.0:1651532162.139698:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468750016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.139699:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468749824:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532162.139701:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5294
00010000:00010000:1.0:1651532162.139703:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.139705:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5295
00010000:00010000:1.0:1651532162.139707:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532162.139707:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468749952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.139708:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.139709:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.139710:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532162.139711:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.139712:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413c73 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1bd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139714:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.139717:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.139718:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413c73 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1bd expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.139724:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413c73 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1bd expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532162.139725:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5296
00000100:00100000:1.0:1651532162.139727:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468750144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.139727:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00010000:00010000:1.0:1651532162.139729:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.139732:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413c7a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1cb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.139732:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468749952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (120us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.139735:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5295
00010000:00010000:1.0:1651532162.139739:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413c7a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1cb expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.139743:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413c7a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1cb expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.139747:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532162.139755:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468750144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (136us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.139758:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5296
00000001:00080000:1.0:1651532162.247481:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794102 is committed
00010000:00010000:0.0:1651532162.247524:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.247530:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.247556:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468746176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466017us (466086us total) trans 158913794102 rc 0/0
00000100:00100000:0.0:1651532162.247560:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4872
00010000:00010000:0.0:1651532162.247569:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.247572:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532162.247574:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.247577:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.247585:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532162.247586:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532162.247587:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.247590:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.247597:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.247600:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413bb6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1253376->9748479] (req 1253376->9748479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.247606:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.247609:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.247948:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.247965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.247971:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.247986:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532162.247994:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.247995:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468750464
00010000:00010000:0.0:1651532162.247999:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.248002:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468750528
00000100:00100000:1.0:1651532162.248005:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468750656
00000100:00100000:1.0:1651532162.248014:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468750720
00000100:00100000:1.0:1651532162.248017:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5297
00000100:00100000:1.0:1651532162.248019:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468750464:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532162.248019:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468746240:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466447us (466529us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532162.248023:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532162.248024:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4873
00010000:00010000:1.0:1651532162.248027:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413c81 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1d2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248033:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532162.248033:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5298
00000100:00100000:0.0:1651532162.248035:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468750528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.248036:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413c81 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1d2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.248039:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.248041:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f413c81 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1d2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.248043:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413c88 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1d9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248044:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:0.0:1651532162.248049:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532162.248052:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413c88 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1d9 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532162.248053:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468750464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.248056:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5297
00010000:00010000:0.0:1651532162.248056:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413c88 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1d9 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.248059:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:1.0:1651532162.248061:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5299
00000100:00100000:1.0:1651532162.248062:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468750656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.248065:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532162.248066:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468750528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (101us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532162.248067:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413c8f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1e0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.248069:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5298
00010000:00010000:1.0:1651532162.248071:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.248073:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413c8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1e0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532162.248074:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5300
00000100:00100000:0.0:1651532162.248076:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468750720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.248077:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413c8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1e0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.248078:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.248080:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:0.0:1651532162.248080:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413c96 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1e7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.248085:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468750656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (115us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532162.248085:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532162.248087:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413c96 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1e7 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532162.248088:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5299
00010000:00010000:0.0:1651532162.248091:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413c96 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1e7 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.248094:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00010000:00010000:1.0:1651532162.248095:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248098:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.248099:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.248099:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468750720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.248101:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5300
00010000:00010000:1.0:1651532162.248102:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248107:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.248107:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.248108:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248111:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248118:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248121:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413bbd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1585152->10403839] (req 1585152->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248126:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248129:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.248506:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.248519:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.248520:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468750912
00000100:00100000:1.0:1651532162.248528:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.248537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.248545:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468750976
00000100:00100000:0.0:1651532162.248555:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4882
00000100:00100000:0.0:1651532162.248557:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468750912:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532162.248561:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4883
00000100:00100000:1.0:1651532162.248563:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468750976:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532162.248564:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.248569:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532162.248570:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248572:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.248573:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532162.248573:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248578:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.248579:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248582:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532162.248582:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.248586:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248587:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248590:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.248590:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.248598:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468751040
00000100:00100000:0.0:1651532162.248604:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468751168
00000100:00100000:0.0:1651532162.248611:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5301
00000100:00100000:0.0:1651532162.248612:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468751040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532162.248614:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5302
00010000:00010000:0.0:1651532162.248615:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532162.248616:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468751168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.248618:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413cab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1ee expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248619:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.248622:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413cb2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1f5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248630:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413cb2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1f5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.248634:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413cb2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1f5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.248637:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:0.0:1651532162.248641:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413cab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1ee expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.248645:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413cab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1ee expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532162.248648:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468751168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (111us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532162.248648:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532162.248651:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5302
00000100:00100000:0.0:1651532162.248657:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468751040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (129us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.248660:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5301
00000100:00100000:1.0:1651532162.248666:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.248680:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468751296
00000100:00100000:1.0:1651532162.248685:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.248689:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5303
00000100:00100000:0.0:1651532162.248691:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468751296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.248694:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.248697:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413cb9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d1fc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.248706:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413cb9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1fc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.248710:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413cb9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d1fc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.248713:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532162.248724:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468751296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.248725:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468751424
00000100:00100000:0.0:1651532162.248727:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5303
00000100:00100000:1.0:1651532162.248737:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5304
00000100:00100000:1.0:1651532162.248739:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468751424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.248742:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.248745:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413cc0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d203 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.248752:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413cc0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d203 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.248757:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413cc0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d203 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.248770:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532162.248783:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468751424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.248786:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5304
00000100:00100000:1.0:1651532162.249028:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.249051:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.249064:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468751616
00000100:00100000:1.0:1651532162.249070:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.249078:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468751808
00000100:00100000:1.0:1651532162.249081:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468751872
00000100:00100000:0.0:1651532162.249083:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5305
00000100:00100000:0.0:1651532162.249084:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468751616:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532162.249087:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5306
00010000:00010000:0.0:1651532162.249088:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532162.249089:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468751808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.249091:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413cc7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d20a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.249092:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.249096:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d211 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.249098:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413cc7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d20a expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.249102:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413cc7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d20a expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.249103:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d211 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.249106:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532162.249107:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d211 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.249110:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532162.249116:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468751616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.249118:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468751808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.249118:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5305
00000100:00100000:1.0:1651532162.249120:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5306
00000100:00100000:0.0:1651532162.249123:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5307
00000100:00100000:0.0:1651532162.249125:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468751872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.249127:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.249130:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413cd5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d218 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.249135:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413cd5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d218 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.249139:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413cd5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d218 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.249142:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532162.249147:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468751872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.249149:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5307
00000100:00100000:1.0:1651532162.249384:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.249396:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.249396:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468752064
00000100:00100000:0.0:1651532162.249408:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468752192
00000100:00100000:0.0:1651532162.249416:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5308
00000100:00100000:0.0:1651532162.249417:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468752064:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532162.249419:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5309
00010000:00010000:0.0:1651532162.249420:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532162.249421:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468752192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.249424:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.249424:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413cdc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d21f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.249428:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413ce3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d226 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.249434:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413cdc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d21f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.249435:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413ce3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d226 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.249438:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413cdc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d21f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.249439:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413ce3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d226 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.249441:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00010000:00010000:1.0:1651532162.249443:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532162.249451:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468752192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.249451:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468752064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.249453:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5309
00000100:00100000:0.0:1651532162.249455:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5308
00000100:00100000:1.0:1651532162.249679:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.249690:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468752448
00000100:00100000:0.0:1651532162.249698:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5310
00000100:00100000:0.0:1651532162.249699:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468752448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.249703:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.249706:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413cea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d22d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.249713:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413cea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d22d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.249717:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413cea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d22d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.249720:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532162.249729:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468752448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.249732:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5310
00000001:00080000:1.0:1651532162.364119:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794103 is committed
00010000:00010000:1.0:1651532162.364135:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364139:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.364157:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468746624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582258us (582300us total) trans 158913794103 rc 0/0
00000100:00100000:1.0:1651532162.364162:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4874
00010000:00010000:1.0:1651532162.364169:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364173:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.364174:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364177:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364182:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.364183:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.364183:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364186:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364189:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.364190:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.364191:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364193:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364200:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364206:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413bcb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2932736->6778879] (req 2932736->6778879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364211:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364214:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364242:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364245:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364256:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364259:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.364273:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468746688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 582330us (582396us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532162.364276:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4875
00010000:00010000:1.0:1651532162.364302:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364334:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.364335:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364338:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364344:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364357:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413bd9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4374528->4378623] (req 4374528->4378623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364446:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364450:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.364470:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468747968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416536us (416642us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532162.364473:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4876
00010000:00010000:1.0:1651532162.364480:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364484:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.364485:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364488:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364492:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.364493:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.364494:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364505:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364515:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364518:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413c03 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->10125311] (req 167936->10125311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.364518:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.364523:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.364712:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.364723:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.364733:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.364741:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468752832
00000100:00100000:0.0:1651532162.364754:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5311
00000100:00100000:0.0:1651532162.364756:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468752832:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532162.364757:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468752640
00010000:00010000:0.0:1651532162.364760:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.364763:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413cf1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d234 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.364768:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468752704
00010000:00010000:0.0:1651532162.364771:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413cf1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d234 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532162.364774:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4884
00000100:00100000:1.0:1651532162.364775:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468752640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532162.364775:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413cf1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d234 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.364779:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00010000:00010000:1.0:1651532162.364782:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364787:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.364788:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.364789:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468752832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532162.364793:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00000100:00100000:0.0:1651532162.364793:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5311
00010000:00010000:1.0:1651532162.364794:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364798:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364802:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.364824:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4885
00000100:00100000:1.0:1651532162.364826:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468752704:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532162.364831:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364841:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.364842:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364844:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532162.364845:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364849:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.364852:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.364870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.364908:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468753024
00000100:00100000:0.0:1651532162.364917:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5312
00000100:00100000:0.0:1651532162.364919:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468753024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.364922:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.364935:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d06 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d23b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.364943:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d06 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d23b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.364947:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d06 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d23b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.364950:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532162.364963:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468753024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.364966:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5312
00000100:00100000:0.0:1651532162.365242:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.365250:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468753344
00000100:00100000:0.0:1651532162.365263:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5313
00000100:00100000:0.0:1651532162.365265:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468753344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.365268:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.365272:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d0d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d242 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.365283:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d0d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d242 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.365286:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d0d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d242 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.365290:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532162.365303:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468753344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.365306:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5313
00000100:00100000:0.0:1651532162.365536:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.365543:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468753472
00000100:00100000:0.0:1651532162.365556:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5314
00000100:00100000:0.0:1651532162.365558:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468753472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.365561:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.365565:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d14 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d249 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.365572:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d14 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d249 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.365576:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d14 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d249 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.365579:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532162.365593:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468753472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.365596:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5314
00000001:00080000:1.0:1651532162.505822:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794104 is committed
00010000:00010000:0.0:1651532162.505853:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.505857:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.505878:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468747840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557924us (558042us total) trans 158913794104 rc 0/0
00010000:00010000:1.0:1651532162.505881:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.505881:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4877
00010000:00010000:1.0:1651532162.505886:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003325411e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.505887:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.505890:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.505896:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.505897:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.505898:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.505901:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.505910:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.505919:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.505920:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413c0a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1871872->9506815] (req 1871872->9506815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.505924:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.506248:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.506257:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.506269:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.506274:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468753728
00000100:00100000:1.0:1651532162.506286:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468753600
00000100:00100000:1.0:1651532162.506298:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4886
00000100:00100000:1.0:1651532162.506300:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468753728:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532162.506301:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.506305:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506307:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506316:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.506318:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506321:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.506323:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468748736:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491237us (491302us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532162.506327:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4878
00000100:00100000:1.0:1651532162.506329:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4887
00000100:00100000:1.0:1651532162.506330:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468753600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532162.506335:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.506335:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468753792
00010000:00010000:1.0:1651532162.506339:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.506340:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.506345:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5315
00010000:00010000:1.0:1651532162.506358:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506361:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532162.506362:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506367:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.506367:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468753792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.506370:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.506371:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.506373:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.506375:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d29 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d250 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506380:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.506380:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.506383:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532162.506383:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d29 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d250 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.506384:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506387:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.506387:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d29 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d250 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.506390:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:1.0:1651532162.506392:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.506393:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.506393:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506396:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.506398:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468753792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (129us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.506401:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5315
00010000:00010000:1.0:1651532162.506402:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506405:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413c2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [782336->10076159] (req 782336->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506410:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506413:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.506427:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.506447:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468753920
00000100:00100000:1.0:1651532162.506455:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5316
00000100:00100000:1.0:1651532162.506456:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468753920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.506460:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.506471:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d30 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d257 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506479:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d30 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d257 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.506483:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d30 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d257 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.506487:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532162.506500:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468753920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.506503:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5316
00000100:00100000:0.0:1651532162.506766:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.506780:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.506786:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468754048
00000100:00100000:0.0:1651532162.506787:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468754240
00000100:00100000:0.0:1651532162.506795:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5317
00000100:00100000:0.0:1651532162.506796:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468754240:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532162.506797:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5318
00000100:00100000:1.0:1651532162.506799:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468754048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.506800:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.506815:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.506819:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d37 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d265 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.506823:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d3e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d25e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.506827:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d37 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d265 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.506831:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d37 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d265 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.506832:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d3e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d25e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.506835:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00010000:00010000:1.0:1651532162.506836:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d3e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d25e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.506839:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532162.506846:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468754240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.506849:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5317
00000100:00100000:1.0:1651532162.506855:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468754048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.506857:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5318
00000100:00100000:0.0:1651532162.507088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.507095:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468754496
00000100:00100000:0.0:1651532162.507109:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5319
00000100:00100000:0.0:1651532162.507110:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043cbf4a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468754496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.507114:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.507117:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d45 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d26c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.507124:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d45 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d26c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.507128:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d45 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d26c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.507134:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532162.507148:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043cbf4a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468754496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.507151:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5319
00000001:00080000:1.0:1651532162.564602:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794105 is committed
00010000:00010000:1.0:1651532162.564618:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.564622:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.564645:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468748672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549556us (549601us total) trans 158913794105 rc 0/0
00000100:00100000:1.0:1651532162.564649:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4879
00010000:00010000:1.0:1651532162.564656:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.564662:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.564663:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.564666:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.564671:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.564672:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.564673:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.564676:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.564692:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.564695:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413c34 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6242303] (req 626688->6242303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.564701:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.564703:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.565020:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.565038:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.565048:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.565061:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468754880
00000100:00100000:0.0:1651532162.565072:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5320
00000100:00100000:0.0:1651532162.565074:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468754880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.565078:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.565081:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d4c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d273 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.565089:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d4c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d273 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.565093:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d4c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d273 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.565096:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532162.565106:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468754880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.565108:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5320
00000100:00100000:1.0:1651532162.565122:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468754624
00000100:00100000:0.0:1651532162.565147:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4888
00000100:00100000:1.0:1651532162.565148:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468754688
00000100:00100000:0.0:1651532162.565150:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468754624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532162.565157:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.565167:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532162.565168:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4889
00010000:00010000:0.0:1651532162.565168:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.565171:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:1.0:1651532162.565172:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468754688:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532162.565172:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.565176:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.565180:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.565184:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.565191:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.565192:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.565195:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532162.565196:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.565200:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.565204:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532162.656319:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794106 is committed
00010000:00010000:1.0:1651532162.656335:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656339:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.656372:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468749760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516707us (516786us total) trans 158913794106 rc 0/0
00000100:00100000:1.0:1651532162.656375:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4880
00010000:00010000:1.0:1651532162.656382:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656386:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.656387:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656390:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656395:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.656395:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.656396:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656399:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656406:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656409:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413c65 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->6795263] (req 1179648->6795263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656426:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656429:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656616:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656621:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.656641:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468749824:12345-10.240.43.64@tcp:3:fio.0 Request processed in 516941us (517044us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532162.656644:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4881
00010000:00010000:1.0:1651532162.656651:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656655:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.656656:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656658:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656663:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.656664:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.656677:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656681:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656691:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656694:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413c6c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->9383935] (req 1122304->9383935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.656697:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.656702:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.656870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.656894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.656907:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468755008
00000100:00100000:1.0:1651532162.656917:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468755136
00000100:00100000:1.0:1651532162.656924:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5321
00000100:00100000:1.0:1651532162.656925:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468755008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.656929:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.656933:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413d61 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d27a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.656941:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413d61 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d27a expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.656945:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413d61 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d27a expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.656949:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532162.656961:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468755008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.656964:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5321
00000100:00100000:0.0:1651532162.656969:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5322
00000100:00100000:0.0:1651532162.656971:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468755136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.656975:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.656979:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d68 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d281 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.656987:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d68 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d281 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.657019:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413d68 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d281 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.657023:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532162.657032:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468755136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.657035:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5322
00000100:00100000:1.0:1651532162.657052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.657093:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.657094:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468755264
00000100:00100000:0.0:1651532162.657108:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468755328
00000100:00100000:1.0:1651532162.657113:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4890
00000100:00100000:1.0:1651532162.657115:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468755264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532162.657122:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.657122:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4891
00000100:00100000:0.0:1651532162.657124:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468755328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532162.657127:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.657128:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.657130:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532162.657131:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.657133:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.657135:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.657137:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532162.657138:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.657141:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532162.657142:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.657147:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.657147:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.657151:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.657316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.657328:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.657328:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468755520
00000100:00100000:0.0:1651532162.657338:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468755648
00000100:00100000:0.0:1651532162.657345:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5323
00000100:00100000:0.0:1651532162.657355:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468755520:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532162.657357:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5324
00000100:00100000:1.0:1651532162.657359:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7427c63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468755648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.657359:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.657363:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.657363:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413d7d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d288 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.657366:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413d84 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d28f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.657370:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413d7d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d288 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.657374:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413d84 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d28f expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.657374:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413d7d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d288 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.657378:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00010000:00010000:1.0:1651532162.657379:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413d84 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d28f expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.657382:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532162.657389:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468755520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.657390:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7427c63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468755648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.657392:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5323
00000100:00100000:1.0:1651532162.657393:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5324
00000100:00100000:1.0:1651532162.657659:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.657667:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.657673:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468755776
00000100:00100000:1.0:1651532162.657679:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468755840
00000100:00100000:1.0:1651532162.657687:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5325
00000100:00100000:1.0:1651532162.657689:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468755776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.657692:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532162.657692:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5326
00000100:00100000:0.0:1651532162.657694:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468755840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.657696:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413d8b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d296 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.657698:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.657701:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413d92 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d29d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.657703:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413d8b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d296 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.657709:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413d92 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d29d expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.657711:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413d8b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d296 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.657713:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413d92 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d29d expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.657714:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:0.0:1651532162.657716:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532162.657726:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468755776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.657728:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5325
00000100:00100000:0.0:1651532162.657731:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468755840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.657734:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5326
00000001:00080000:1.0:1651532162.723253:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794107 is committed
00010000:00010000:0.0:1651532162.723284:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.723289:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.723308:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468750912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474751us (474803us total) trans 158913794107 rc 0/0
00000100:00100000:0.0:1651532162.723312:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4882
00010000:00010000:1.0:1651532162.723314:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723318:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.723319:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723323:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723329:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.723329:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.723330:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723333:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723341:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723344:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413c9d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6135808->10076159] (req 6135808->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.723345:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.723358:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.723635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.723648:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532162.723664:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.723666:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468756096
00010000:00010000:0.0:1651532162.723668:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.723679:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468756288
00000100:00100000:1.0:1651532162.723684:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5327
00000100:00100000:0.0:1651532162.723685:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468750976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 475122us (475166us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532162.723686:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468756096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532162.723688:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4883
00010000:00010000:1.0:1651532162.723690:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.723693:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413d99 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2a4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.723696:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5328
00000100:00100000:0.0:1651532162.723698:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468756288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.723699:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.723701:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413d99 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2a4 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.723701:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.723704:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413da0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2ab expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723706:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413d99 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2a4 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.723709:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:0.0:1651532162.723710:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532162.723712:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413da0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2ab expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.723716:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413da0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2ab expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532162.723718:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468756096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (84us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532162.723720:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532162.723721:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5327
00000100:00100000:0.0:1651532162.723726:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468756288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (78us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532162.723728:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.723728:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5328
00010000:00010000:1.0:1651532162.723731:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.723732:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723735:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723739:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.723740:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.723741:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723743:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723750:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723753:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413ca4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5292032->10264575] (req 5292032->10264575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723758:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.723770:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.724093:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.724101:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.724109:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.724115:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.724122:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468756480
00000100:00100000:0.0:1651532162.724131:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468756352
00000100:00100000:0.0:1651532162.724139:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4892
00000100:00100000:0.0:1651532162.724141:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6801443 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468756480:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532162.724148:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.724153:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532162.724154:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532162.724154:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.724155:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4893
00000100:00100000:1.0:1651532162.724158:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfde6df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468756352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532162.724158:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.724166:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468756736
00010000:00010000:1.0:1651532162.724169:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.724170:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468756800
00000100:00100000:0.0:1651532162.724178:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5329
00000100:00100000:0.0:1651532162.724179:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d2cf024f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468756736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.724182:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.724184:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413db5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2b2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.724187:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.724189:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.724194:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.724199:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532162.724200:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.724208:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.724208:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413db5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2b2 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.724211:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.724212:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413db5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2b2 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.724216:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532162.724226:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d2cf024f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468756736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (117us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532162.724228:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.724229:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5329
00000100:00100000:1.0:1651532162.724238:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5330
00000100:00100000:1.0:1651532162.724240:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468756800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.724243:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.724246:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413dbc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2b9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.724253:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413dbc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2b9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.724267:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413dbc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2b9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.724271:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532162.724293:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468756800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (177us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.724296:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5330
00000100:00100000:0.0:1651532162.724514:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.724532:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468756992
00000100:00100000:1.0:1651532162.724543:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5331
00000100:00100000:1.0:1651532162.724545:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468756992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.724548:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.724551:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dc3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2c0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.724559:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dc3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2c0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.724562:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dc3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2c0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.724566:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532162.724578:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468756992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.724580:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5331
00000001:00080000:1.0:1651532162.789724:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794108 is committed
00002000:00010000:1.0:1651532162.789738:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532161 -> 1651532162
00010000:00010000:1.0:1651532162.789741:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789745:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.789769:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468752640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 424992us (425057us total) trans 158913794108 rc 0/0
00000100:00100000:1.0:1651532162.789772:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4884
00010000:00010000:1.0:1651532162.789779:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789783:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.789784:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789787:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789792:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.789793:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.789793:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789797:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789825:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.789826:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.789827:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789830:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789838:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789841:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413cf8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3817472->9236479] (req 3817472->9236479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789846:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789849:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789875:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.789878:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.790112:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532162.790142:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.790142:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468757248
00010000:00010000:1.0:1651532162.790149:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.790149:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5332
00000100:00100000:0.0:1651532162.790151:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468757248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.790155:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.790159:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413dca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2c7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.790168:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468752704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425341us (425444us total) trans 0 rc 49152/49152
00000100:00100000:1.0:1651532162.790171:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4885
00010000:00010000:0.0:1651532162.790171:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532162.790174:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413dca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2c7 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.790179:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413dca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2c7 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.790181:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.790182:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00010000:00010000:1.0:1651532162.790184:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.790190:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468757248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.790193:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5332
00000100:00100000:1.0:1651532162.790195:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1eea46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468753728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 283895us (283948us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532162.790198:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4886
00010000:00010000:1.0:1651532162.790203:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790206:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.790207:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790210:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790215:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790218:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413cff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->10235903] (req 114688->10235903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790221:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790224:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.790225:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790236:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790240:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.790240:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.790241:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790244:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790251:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790254:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413d1b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5562368->8785919] (req 5562368->8785919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790259:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790262:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.790575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.790585:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.790593:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.790601:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468757568
00000100:00100000:0.0:1651532162.790607:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5333
00000100:00100000:0.0:1651532162.790609:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468757568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.790612:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.790631:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413dd1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2ce expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.790639:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413dd1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2ce expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.790643:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413dd1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2ce expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.790646:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532162.790647:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468757440
00000100:00100000:0.0:1651532162.790655:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468757568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.790657:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5333
00000100:00100000:1.0:1651532162.790660:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468757504
00000100:00100000:1.0:1651532162.790676:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4894
00000100:00100000:1.0:1651532162.790679:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a1abca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468757440:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532162.790679:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532162.790690:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790697:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.790699:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.790704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.790712:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4895
00000100:00100000:0.0:1651532162.790714:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468757504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532162.790717:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532162.790718:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.790722:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790723:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.790726:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532162.790727:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.790730:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532162.790731:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.790734:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.790736:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.790739:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.790746:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468757824
00000100:00100000:0.0:1651532162.790752:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468757952
00000100:00100000:0.0:1651532162.790756:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5334
00000100:00100000:0.0:1651532162.790757:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468757824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.790760:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.790762:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413de6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2d5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.790769:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413de6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2d5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.790773:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413de6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2d5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.790776:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532162.790785:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468757824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.790788:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5334
00000100:00100000:0.0:1651532162.790792:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5335
00000100:00100000:0.0:1651532162.790793:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468757952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.790796:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.790797:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413ded lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2dc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.790817:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413ded lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2dc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.790821:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413ded lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2dc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.790824:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532162.790836:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468757952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (132us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.790839:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5335
00000100:00100000:0.0:1651532162.790950:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.790957:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468758080
00000100:00100000:0.0:1651532162.790964:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5336
00000100:00100000:0.0:1651532162.790966:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468758080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.790969:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.790972:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413df4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2e3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.790982:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413df4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2e3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.790986:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413df4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2e3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.790989:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532162.790998:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468758080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.791000:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5336
00000100:00100000:0.0:1651532162.791191:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.791197:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468758400
00000100:00100000:0.0:1651532162.791204:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5337
00000100:00100000:0.0:1651532162.791205:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468758400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.791208:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.791211:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413dfb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2ea expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.791218:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413dfb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2ea expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.791222:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413dfb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2ea expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.791225:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532162.791234:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468758400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (44us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.791237:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5337
00000100:00100000:0.0:1651532162.791487:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.791494:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468758528
00000100:00100000:0.0:1651532162.791500:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5338
00000100:00100000:0.0:1651532162.791502:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468758528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532162.791505:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532162.791518:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e02 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2f1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.791526:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e02 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2f1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.791530:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e02 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2f1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532162.791533:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:0.0:1651532162.791543:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468758528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532162.791546:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5338
00000001:00080000:1.0:1651532162.866821:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794109 is committed
00010000:00010000:1.0:1651532162.866837:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.866851:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.866875:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468753600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 360543us (360617us total) trans 158913794109 rc 0/0
00000100:00100000:1.0:1651532162.866878:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4887
00010000:00010000:1.0:1651532162.866885:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.866889:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532162.866890:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.866893:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.866898:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.866898:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532162.866899:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.866902:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.866922:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.866925:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413d22 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1859584->8966143] (req 1859584->8966143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.866935:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.866940:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.867279:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.867296:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468758720
00000100:00100000:0.0:1651532162.867300:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532162.867310:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.867312:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468758784
00000100:00100000:0.0:1651532162.867317:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532162.867321:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4896
00000100:00100000:1.0:1651532162.867323:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468758720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532162.867330:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.867332:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532162.867334:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532162.867340:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.867343:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:0.0:1651532162.867343:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4897
00010000:00010000:1.0:1651532162.867344:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532162.867345:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468758784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532162.867359:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.867362:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.867363:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.867367:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532162.867368:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.867370:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468758912
00010000:00010000:0.0:1651532162.867371:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532162.867372:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532162.867376:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.867377:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468759040
00000100:00100000:1.0:1651532162.867379:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468759104
00010000:00010000:0.0:1651532162.867380:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532162.867382:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5339
00000100:00100000:1.0:1651532162.867384:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097358b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468758912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.867387:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.867390:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413e17 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2f8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.867397:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413e17 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2f8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.867402:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413e17 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2f8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.867405:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532162.867418:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097358b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468758912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (108us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.867421:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5339
00000100:00100000:1.0:1651532162.867426:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5340
00000100:00100000:1.0:1651532162.867428:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468759040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.867430:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.867432:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e1e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d2ff expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.867438:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e1e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2ff expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.867442:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e1e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d2ff expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.867445:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532162.867450:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468759040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (133us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.867453:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5340
00000100:00100000:1.0:1651532162.867456:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5341
00000100:00100000:1.0:1651532162.867458:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468759104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532162.867460:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532162.867461:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413e25 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d306 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532162.867467:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413e25 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d306 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.867473:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413e25 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d306 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532162.867478:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532162.867509:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468759104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (176us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532162.867515:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5341
00000001:00080000:1.0:1651532163.025621:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794110 is committed
00010000:00010000:0.0:1651532163.025651:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.025659:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.025680:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468754624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 460530us (460661us total) trans 158913794110 rc 0/0
00010000:00010000:1.0:1651532163.025682:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.025684:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4888
00010000:00010000:1.0:1651532163.025688:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.025689:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.025694:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.025700:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.025701:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.025702:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.025705:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.025714:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.025717:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413d53 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [98304->6926335] (req 98304->6926335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.025731:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.025734:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.025978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.025991:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.025997:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468759488
00000100:00100000:0.0:1651532163.026005:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.026015:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468759552
00000100:00100000:1.0:1651532163.026018:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468759616
00000100:00100000:0.0:1651532163.026021:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5342
00000100:00100000:0.0:1651532163.026023:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468759488:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532163.026026:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5343
00010000:00010000:0.0:1651532163.026027:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532163.026028:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468759552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.026031:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413e2c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d30d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026032:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.026036:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413e33 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d314 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026036:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.026039:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413e2c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d30d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.026044:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413e2c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d30d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.026045:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.026047:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:1.0:1651532163.026048:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413e33 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d314 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.026053:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413e33 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d314 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.026057:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532163.026057:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468759488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.026062:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5342
00000100:00100000:1.0:1651532163.026066:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468759552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.026067:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5344
00000100:00100000:1.0:1651532163.026069:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5343
00000100:00100000:0.0:1651532163.026069:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468759616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.026071:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.026073:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e3a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d31b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026078:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.026080:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e3a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d31b expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.026082:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026086:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026090:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e3a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d31b expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.026093:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:1.0:1651532163.026098:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468754688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 460926us (461060us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532163.026100:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468759616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.026101:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4889
00000100:00100000:0.0:1651532163.026102:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5344
00010000:00010000:1.0:1651532163.026106:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026109:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.026110:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026116:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026121:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.026121:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.026122:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026125:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026132:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026141:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026145:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026158:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413d5a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->9396223] (req 135168->9396223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.026503:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.026533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.026544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.026545:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468759808
00000100:00100000:0.0:1651532163.026551:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.026559:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468759872
00000100:00100000:0.0:1651532163.026563:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.026567:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4898
00000100:00100000:1.0:1651532163.026569:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468759808:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532163.026575:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4899
00010000:00010000:1.0:1651532163.026576:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.026577:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468759872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532163.026581:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532163.026582:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026586:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026587:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532163.026588:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026592:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532163.026593:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026596:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532163.026597:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026600:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026601:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026604:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026605:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.026612:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468759744
00000100:00100000:0.0:1651532163.026623:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468760000
00000100:00100000:0.0:1651532163.026626:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468760064
00000100:00100000:1.0:1651532163.026628:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5345
00000100:00100000:1.0:1651532163.026629:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468759744:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532163.026630:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5346
00000100:00100000:0.0:1651532163.026632:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468760000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.026633:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.026635:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.026636:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413e4f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d322 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.026638:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e56 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d329 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026643:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413e4f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d322 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.026645:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e56 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d329 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.026647:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413e4f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d322 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.026649:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e56 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d329 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.026651:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:0.0:1651532163.026652:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532163.026666:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468759744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (164us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.026669:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5345
00000100:00100000:0.0:1651532163.026670:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468760000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.026673:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5346
00000100:00100000:1.0:1651532163.026675:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5347
00000100:00100000:1.0:1651532163.026677:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468760064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.026679:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.026682:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413e5d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d330 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.026688:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413e5d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d330 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.026691:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413e5d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d330 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.026695:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532163.026700:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468760064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.026703:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5347
00000100:00100000:0.0:1651532163.026994:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.027013:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468760384
00000100:00100000:1.0:1651532163.027024:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5348
00000100:00100000:1.0:1651532163.027026:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468760384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.027029:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.027032:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413e64 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d337 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.027039:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413e64 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d337 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.027046:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413e64 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d337 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.027049:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532163.027061:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468760384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.027064:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5348
00000100:00100000:0.0:1651532163.027307:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.027324:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468760512
00000100:00100000:1.0:1651532163.027334:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5349
00000100:00100000:1.0:1651532163.027335:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0a0376b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468760512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.027339:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.027341:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413e6b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d33e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.027355:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413e6b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d33e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.027360:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413e6b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d33e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.027363:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532163.027374:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0a0376b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468760512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.027377:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5349
00000001:00080000:1.0:1651532163.123063:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794111 is committed
00002000:00010000:0.0:1651532163.123094:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532161 -> 1651532162
00010000:00010000:0.0:1651532163.123097:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123102:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.123120:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468755264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466004us (466068us total) trans 158913794111 rc 0/0
00000100:00100000:0.0:1651532163.123123:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4890
00010000:00010000:0.0:1651532163.123130:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123137:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532163.123138:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123141:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123146:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.123146:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.123147:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123150:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123153:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.123154:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.123154:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123157:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123164:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123167:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f413d6f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1630208->8466431] (req 1630208->8466431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123175:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123177:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123197:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123200:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123210:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123213:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.123231:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b64487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468755328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466106us (466139us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532163.123234:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4891
00010000:00010000:1.0:1651532163.123237:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123242:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.123243:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123246:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123253:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123255:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413d76 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8073216->8077311] (req 8073216->8077311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123431:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123435:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123449:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123453:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.123454:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.123457:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6801443 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468756480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 399314us (399364us total) trans 0 rc 28672/28672
00010000:00010000:1.0:1651532163.123458:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.123460:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4892
00010000:00010000:1.0:1651532163.123463:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.123463:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.123464:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123468:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123475:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123477:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413da7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->9052159] (req 3108864->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123483:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123493:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.123714:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.123725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.123726:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468760832
00000100:00100000:1.0:1651532163.123735:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.123741:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468760768
00000100:00100000:0.0:1651532163.123750:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4900
00000100:00100000:0.0:1651532163.123752:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468760832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532163.123759:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123764:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532163.123765:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532163.123766:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123769:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.123776:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4901
00000100:00100000:0.0:1651532163.123777:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468760768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532163.123782:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123785:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532163.123786:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123791:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123794:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532163.123794:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123799:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123801:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.123821:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468760960
00000100:00100000:1.0:1651532163.123833:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5350
00000100:00100000:1.0:1651532163.123835:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468760960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.123835:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123839:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.123843:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413e80 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d345 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123851:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413e80 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d345 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532163.123851:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532163.123855:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413e80 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d345 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.123859:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532163.123859:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.123865:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468761216
00000100:00100000:1.0:1651532163.123871:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468760960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.123871:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468761280
00000100:00100000:1.0:1651532163.123873:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5350
00000100:00100000:0.0:1651532163.123875:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5351
00000100:00100000:0.0:1651532163.123877:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468761216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.123880:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.123884:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413e87 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d34c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.123892:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413e87 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d34c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532163.123893:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5352
00000100:00100000:1.0:1651532163.123895:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468761280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.123896:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413e87 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d34c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.123899:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.123900:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:1.0:1651532163.123901:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413e8e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d353 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.123908:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413e8e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d353 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532163.123908:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468761216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.123910:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5351
00010000:00010000:1.0:1651532163.123911:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413e8e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d353 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.123915:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532163.123922:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468761280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.123924:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5352
00000100:00100000:0.0:1651532163.124165:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.124184:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468761408
00000100:00100000:1.0:1651532163.124195:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5353
00000100:00100000:1.0:1651532163.124197:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468761408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.124200:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.124204:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413e95 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d35a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.124211:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413e95 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d35a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.124214:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413e95 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d35a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.124218:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532163.124236:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468761408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.124239:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5353
00000100:00100000:0.0:1651532163.124260:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.124273:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468761600
00000100:00100000:1.0:1651532163.124283:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5354
00000100:00100000:1.0:1651532163.124285:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468761600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.124288:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.124291:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413e9c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d361 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.124297:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413e9c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d361 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.124301:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413e9c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d361 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.124305:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532163.124312:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468761600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.124314:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5354
00000100:00100000:0.0:1651532163.124532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.124550:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468761728
00000100:00100000:1.0:1651532163.124563:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5355
00000100:00100000:1.0:1651532163.124565:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468761728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.124568:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.124571:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413ea3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d368 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.124578:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413ea3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d368 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.124582:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413ea3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d368 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.124585:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532163.124595:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468761728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.124597:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5355
00000001:00080000:1.0:1651532163.239712:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794112 is committed
00010000:00010000:1.0:1651532163.239728:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.239735:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.239756:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfde6df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468756352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 515598us (515654us total) trans 158913794112 rc 0/0
00000100:00100000:1.0:1651532163.239759:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4893
00010000:00010000:0.0:1651532163.239759:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.239764:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532163.239765:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.239768:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.239774:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.239775:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.239775:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.239778:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.239788:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.239791:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f413dae lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3477504->9564159] (req 3477504->9564159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.239816:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.239825:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.240138:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.240145:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.240156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.240157:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468761984
00000100:00100000:0.0:1651532163.240170:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468761920
00000100:00100000:0.0:1651532163.240178:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4902
00000100:00100000:0.0:1651532163.240180:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7427c63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468761984:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532163.240187:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.240191:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532163.240192:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.240195:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532163.240196:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.240200:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.240203:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.240216:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4903
00000100:00100000:0.0:1651532163.240218:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468761920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532163.240222:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.240226:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532163.240227:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.240229:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532163.240230:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.240233:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.240236:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.240237:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468762176
00000100:00100000:1.0:1651532163.240249:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5356
00000100:00100000:1.0:1651532163.240251:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468762176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.240254:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.240258:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413eb8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d36f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.240266:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413eb8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d36f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.240270:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413eb8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d36f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.240274:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532163.240285:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468762176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.240287:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5356
00000100:00100000:1.0:1651532163.240521:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.240529:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468762304
00000100:00100000:1.0:1651532163.240542:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5357
00000100:00100000:1.0:1651532163.240544:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468762304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.240548:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.240551:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ebf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d376 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.240558:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ebf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d376 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.240562:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ebf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d376 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.240566:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532163.240575:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468762304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.240578:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5357
00000100:00100000:1.0:1651532163.240787:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.240794:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468762432
00000100:00100000:1.0:1651532163.240819:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5358
00000100:00100000:1.0:1651532163.240821:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bb47476 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468762432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.240824:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.240828:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413ec6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d37d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.240835:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413ec6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d37d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.240839:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413ec6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d37d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.240842:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532163.240852:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bb47476 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468762432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.240854:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5358
00000001:00080000:1.0:1651532163.348046:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794113 is committed
00010000:00010000:1.0:1651532163.348062:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348066:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.348082:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a1abca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468757440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557402us (557507us total) trans 158913794113 rc 0/0
00000100:00100000:1.0:1651532163.348085:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4894
00010000:00010000:1.0:1651532163.348091:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348098:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.348099:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348102:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348106:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.348107:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.348108:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348111:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348124:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348127:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413dd8 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2359296->9011199] (req 2359296->9011199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.348136:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.348140:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.348321:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.348326:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348340:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348345:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.348346:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.348358:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468757504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 557642us (557772us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532163.348361:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4895
00010000:00010000:1.0:1651532163.348364:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348369:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.348369:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.348370:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348373:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348380:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348383:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413ddf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1163264->5697535] (req 1163264->5697535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348389:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348392:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.348456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.348464:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.348475:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468762560
00000100:00100000:0.0:1651532163.348479:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468762624
00000100:00100000:1.0:1651532163.348486:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5359
00000100:00100000:1.0:1651532163.348488:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468762560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.348492:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532163.348492:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5360
00000100:00100000:0.0:1651532163.348494:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468762624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.348495:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413ecd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d384 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.348497:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.348501:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413ed4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d38b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348503:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413ecd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d384 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.348507:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413ecd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d384 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.348510:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413ed4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d38b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.348511:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:0.0:1651532163.348514:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413ed4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d38b expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.348517:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:1.0:1651532163.348521:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468762560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.348524:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5359
00000100:00100000:0.0:1651532163.348526:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468762624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.348529:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5360
00000100:00100000:1.0:1651532163.348691:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.348703:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.348703:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468762880
00000100:00100000:1.0:1651532163.348711:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468762816
00000100:00100000:0.0:1651532163.348716:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4904
00000100:00100000:0.0:1651532163.348718:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468762880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532163.348725:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.348726:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4905
00000100:00100000:1.0:1651532163.348728:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468762816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532163.348729:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532163.348730:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.348733:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532163.348734:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348735:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.348738:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348739:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532163.348740:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348743:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532163.348744:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.348748:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348749:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348752:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.348855:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.348871:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468763072
00000100:00100000:1.0:1651532163.348875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.348887:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468763328
00000100:00100000:0.0:1651532163.348895:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5361
00000100:00100000:0.0:1651532163.348896:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468763072:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532163.348898:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5362
00000100:00100000:1.0:1651532163.348900:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468763328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.348900:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.348903:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413ee9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d392 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.348904:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.348908:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413ef0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d399 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.348911:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413ee9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d392 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.348915:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413ef0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d399 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.348915:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413ee9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d392 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.348919:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413ef0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d399 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.348921:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00010000:00010000:1.0:1651532163.348922:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532163.348934:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468763072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.348937:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5361
00000100:00100000:1.0:1651532163.348940:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468763328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.348943:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5362
00000001:00080000:1.0:1651532163.464740:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794114 is committed
00010000:00010000:1.0:1651532163.464755:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.464759:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.464781:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468758720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 597457us (597503us total) trans 158913794114 rc 0/0
00010000:00010000:0.0:1651532163.464783:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.464785:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4896
00010000:00010000:0.0:1651532163.464787:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532163.464789:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.464792:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.464798:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.464798:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.464799:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.464811:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.464819:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.464822:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f413e09 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->9961471] (req 278528->9961471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.464830:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.464833:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.465085:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.465100:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532163.465108:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.465109:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468763584
00010000:00010000:0.0:1651532163.465112:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.465118:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468763712
00000100:00100000:1.0:1651532163.465132:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5363
00000100:00100000:1.0:1651532163.465134:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468763584:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532163.465140:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468758784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 597794us (597840us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532163.465142:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532163.465143:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4897
00010000:00010000:1.0:1651532163.465146:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413ef7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3a0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.465152:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532163.465152:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5364
00000100:00100000:0.0:1651532163.465153:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468763712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.465155:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413ef7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3a0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.465157:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.465159:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413ef7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3a0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.465160:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413efe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3a7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.465162:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:0.0:1651532163.465165:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.465168:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413efe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3a7 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532163.465170:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468763584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (86us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532163.465172:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f413efe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3a7 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532163.465173:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5363
00010000:00010000:0.0:1651532163.465176:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00010000:00010000:1.0:1651532163.465180:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.465183:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.465185:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.465188:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.465192:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.465193:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.465193:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.465201:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468763712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (100us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532163.465204:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.465204:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5364
00010000:00010000:1.0:1651532163.465211:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.465214:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f413e10 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->7974911] (req 581632->7974911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.465217:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.465221:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.465241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.465257:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468763840
00000100:00100000:0.0:1651532163.465265:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5365
00000100:00100000:0.0:1651532163.465267:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468763840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.465269:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.465281:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413f05 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3ae expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.465289:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413f05 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3ae expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.465293:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f413f05 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3ae expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.465296:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532163.465308:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468763840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.465312:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5365
00000100:00100000:1.0:1651532163.465556:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.465574:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.465574:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468764096
00000100:00100000:1.0:1651532163.465583:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.465587:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5366
00000100:00100000:0.0:1651532163.465589:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468764096:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532163.465590:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468764032
00010000:00010000:0.0:1651532163.465593:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.465596:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413f0c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3b5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.465602:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468764160
00010000:00010000:0.0:1651532163.465609:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413f0c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3b5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532163.465620:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4906
00000100:00100000:1.0:1651532163.465622:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468764032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532163.465629:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.465630:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f413f0c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3b5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.465633:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532163.465634:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.465634:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00010000:00010000:1.0:1651532163.465637:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532163.465638:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.465642:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.465649:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468764096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (94us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532163.465652:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.465662:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5366
00000100:00100000:0.0:1651532163.465672:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4907
00000100:00100000:0.0:1651532163.465673:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468764160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532163.465680:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.465685:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532163.465686:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.465691:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532163.465692:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.465694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532163.465696:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.465706:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.465714:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468764416
00000100:00100000:0.0:1651532163.465721:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5367
00000100:00100000:0.0:1651532163.465722:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468764416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.465725:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.465727:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413f21 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3bc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.465734:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413f21 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3bc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.465738:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f413f21 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3bc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.465741:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:0.0:1651532163.465754:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468764416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.465759:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5367
00000100:00100000:1.0:1651532163.465897:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.465907:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468764544
00000100:00100000:0.0:1651532163.465914:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5368
00000100:00100000:0.0:1651532163.465916:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468764544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.465919:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.465922:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413f28 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3c3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.465928:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413f28 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3c3 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.465932:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f413f28 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3c3 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.465936:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532163.465949:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468764544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.465951:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5368
00000100:00100000:1.0:1651532163.466000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.466009:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468764672
00000100:00100000:0.0:1651532163.466015:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5369
00000100:00100000:0.0:1651532163.466017:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468764672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.466020:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.466023:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413f2f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3ca expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.466029:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413f2f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3ca expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.466034:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f413f2f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3ca expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.466037:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532163.466049:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468764672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.466052:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5369
00000100:00100000:1.0:1651532163.466167:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.466176:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468764800
00000100:00100000:0.0:1651532163.466183:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5370
00000100:00100000:0.0:1651532163.466184:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468764800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.466187:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.466191:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f413f36 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3d1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.466197:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f413f36 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3d1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.466201:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f413f36 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3d1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.466204:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532163.466217:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468764800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.466219:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5370
00000001:00080000:1.0:1651532163.564740:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794115 is committed
00010000:00010000:0.0:1651532163.564777:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.564781:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.564801:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468759808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 538231us (538267us total) trans 158913794115 rc 0/0
00010000:00010000:1.0:1651532163.564814:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.564815:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4898
00010000:00010000:1.0:1651532163.564818:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.564820:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.564823:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.564828:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.564829:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.564830:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.564833:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.564836:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.564837:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.564837:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.564840:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.564850:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.564860:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413e41 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [81920->8392703] (req 81920->8392703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.564866:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.564870:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.564872:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.564875:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.565142:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.565149:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532163.565172:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.565176:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565180:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565184:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.565194:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468759872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 538616us (538650us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532163.565197:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4899
00000100:00100000:1.0:1651532163.565204:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099575644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468760832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441451us (441490us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532163.565205:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.565207:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4900
00010000:00010000:0.0:1651532163.565211:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532163.565212:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565215:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.565215:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565219:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532163.565220:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565221:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.565223:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f413e48 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [135168->6946815] (req 135168->6946815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565224:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565228:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.565229:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.565230:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.565230:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468765120
00010000:00010000:1.0:1651532163.565233:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.565236:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468765184
00010000:00010000:1.0:1651532163.565248:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.565249:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5371
00000100:00100000:0.0:1651532163.565250:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468765120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.565251:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f413e72 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [147456->10334207] (req 147456->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.565253:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.565256:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f413f3d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3d8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.565259:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5372
00000100:00100000:1.0:1651532163.565261:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468765184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.565263:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f413f3d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3d8 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.565264:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.565267:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413f44 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3df expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.565267:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f413f3d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3d8 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.565273:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532163.565274:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413f44 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3df expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.565278:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413f44 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3df expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532163.565280:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468765120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (140us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532163.565282:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532163.565283:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5371
00000100:00100000:1.0:1651532163.565289:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468765184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (139us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532163.565289:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.565291:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5372
00010000:00010000:0.0:1651532163.565293:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.565698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.565709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.565709:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468765440
00000100:00100000:1.0:1651532163.565716:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.565718:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5373
00000100:00100000:1.0:1651532163.565725:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.565725:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468765440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.565729:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532163.565731:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532163.565732:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f413f4b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3e6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.565740:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532163.565745:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f413f4b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3e6 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532163.565747:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468765376
00010000:00010000:0.0:1651532163.565749:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f413f4b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3e6 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.565753:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532163.565759:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468765312
00000100:00100000:1.0:1651532163.565767:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4908
00000100:00100000:1.0:1651532163.565769:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e36e2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468765376:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532163.565772:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468765440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.565775:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5373
00010000:00010000:1.0:1651532163.565776:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565780:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532163.565780:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468765504
00010000:00010000:1.0:1651532163.565781:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532163.565782:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.565783:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468765632
00010000:00010000:1.0:1651532163.565785:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.565786:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468765760
00000100:00100000:0.0:1651532163.565788:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5374
00000100:00100000:0.0:1651532163.565790:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468765504:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532163.565792:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5375
00010000:00010000:0.0:1651532163.565792:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532163.565793:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468765632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.565795:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f413f59 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3ed expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565796:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.565799:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413f60 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3f4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.565802:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f413f59 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3ed expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.565819:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413f60 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3f4 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.565820:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f413f59 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3ed expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.565823:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:1.0:1651532163.565824:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413f60 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3f4 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.565827:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532163.565830:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468765504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.565833:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5374
00000100:00100000:1.0:1651532163.565836:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468765632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.565838:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5376
00000100:00100000:1.0:1651532163.565839:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5375
00000100:00100000:0.0:1651532163.565839:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468765760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.565842:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.565844:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f413f67 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d3fb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.565853:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f413f67 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3fb expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532163.565854:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4909
00000100:00100000:1.0:1651532163.565856:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd50a695 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468765312:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532163.565857:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f413f67 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d3fb expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.565860:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:1.0:1651532163.565862:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565865:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532163.565865:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009897060f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468765760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (125us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532163.565866:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.565867:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5376
00010000:00010000:1.0:1651532163.565869:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565872:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532163.565872:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565876:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565882:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.565885:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.566266:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.566273:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.566286:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.566295:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468765888
00000100:00100000:0.0:1651532163.566297:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468766080
00000100:00100000:1.0:1651532163.566302:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468766144
00000100:00100000:0.0:1651532163.566304:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5377
00000100:00100000:0.0:1651532163.566306:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd511b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468765888:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532163.566309:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5378
00010000:00010000:0.0:1651532163.566309:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532163.566310:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468766080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.566313:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f413f75 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d402 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.566314:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.566317:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f7c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d409 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.566320:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f413f75 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d402 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.566325:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f7c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d409 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.566325:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f413f75 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d402 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.566328:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:1.0:1651532163.566329:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f7c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d409 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.566332:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532163.566338:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd511b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468765888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.566340:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468766080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.566341:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5377
00000100:00100000:1.0:1651532163.566345:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5378
00000100:00100000:0.0:1651532163.566347:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5379
00000100:00100000:0.0:1651532163.566359:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468766144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.566361:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.566364:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413f83 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d410 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.566370:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413f83 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d410 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.566374:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413f83 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d410 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.566377:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532163.566383:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468766144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.566385:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5379
00000100:00100000:1.0:1651532163.566658:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.566670:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468766400
00000100:00100000:0.0:1651532163.566678:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5380
00000100:00100000:0.0:1651532163.566680:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468766400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.566683:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.566687:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413f8a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d417 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.566693:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413f8a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d417 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.566697:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413f8a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d417 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.566701:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532163.566710:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468766400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.566713:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5380
00000100:00100000:1.0:1651532163.566931:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.566941:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468766528
00000100:00100000:0.0:1651532163.566949:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5381
00000100:00100000:0.0:1651532163.566951:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468766528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.566954:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.566957:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f91 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d41e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.566964:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f91 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d41e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.566968:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f91 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d41e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.566971:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532163.566981:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468766528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.566983:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5381
00000001:00080000:1.0:1651532163.631455:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794116 is committed
00002000:00010000:0.0:1651532163.631484:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532162 -> 1651532163
00010000:00010000:0.0:1651532163.631488:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.631491:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.631511:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7683e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468760768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507732us (507785us total) trans 158913794116 rc 0/0
00010000:00010000:1.0:1651532163.631514:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.631514:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4901
00010000:00010000:1.0:1651532163.631518:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.631519:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631523:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631528:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.631529:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.631530:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631533:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631542:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631545:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f413e79 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->9400319] (req 1388544->9400319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.631550:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.631554:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.631770:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.631820:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.631837:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.631845:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468766720
00010000:00010000:0.0:1651532163.631848:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.631852:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.631856:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468766656
00000100:00100000:1.0:1651532163.631862:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4910
00000100:00100000:1.0:1651532163.631863:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0a0376b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468766720:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532163.631866:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7427c63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468761984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391686us (391729us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532163.631870:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.631870:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4902
00010000:00010000:1.0:1651532163.631874:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.631875:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.631875:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4911
00000100:00100000:0.0:1651532163.631877:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468766656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532163.631878:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532163.631878:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631883:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.631884:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631886:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.631888:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532163.631889:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.631892:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532163.631893:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.631897:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.631900:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631905:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631908:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.631909:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631912:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631919:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.631920:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.631921:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631924:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631932:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631935:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f413eaa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1843200->7344127] (req 1843200->7344127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.631942:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468766784
00000100:00100000:0.0:1651532163.631946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.631959:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468766912
00000100:00100000:1.0:1651532163.631964:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5382
00000100:00100000:1.0:1651532163.631965:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468766784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.631968:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.631971:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413fa6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d425 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.631986:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631987:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413fa6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d425 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.631990:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.631991:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413fa6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d425 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.631997:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532163.632012:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468766784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (174us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.632014:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5382
00000100:00100000:1.0:1651532163.632020:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5383
00000100:00100000:1.0:1651532163.632021:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468766912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.632024:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.632026:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413fad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d42c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.632033:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413fad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d42c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.632036:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413fad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d42c expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.632039:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532163.632054:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468766912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (108us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.632057:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5383
00000100:00100000:0.0:1651532163.632319:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.632337:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468767104
00000100:00100000:1.0:1651532163.632347:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5384
00000100:00100000:1.0:1651532163.632357:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468767104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.632360:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.632363:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413fb4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d433 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.632370:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413fb4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d433 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.632374:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413fb4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d433 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.632377:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532163.632397:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468767104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.632400:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5384
00000100:00100000:0.0:1651532163.632503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.632521:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468767424
00000100:00100000:1.0:1651532163.632531:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5385
00000100:00100000:1.0:1651532163.632533:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468767424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.632536:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.632539:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413fbb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d43a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.632546:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413fbb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d43a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.632550:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413fbb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d43a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.632553:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532163.632565:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468767424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.632568:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5385
00000001:00080000:1.0:1651532163.764787:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794117 is committed
00010000:00010000:0.0:1651532163.764818:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.764822:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.764843:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000800b9431 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468761920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524625us (524698us total) trans 158913794117 rc 0/0
00010000:00010000:1.0:1651532163.764844:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.764847:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4903
00010000:00010000:1.0:1651532163.764849:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.764850:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.764853:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.764859:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.764859:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.764860:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.764863:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.764873:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.764876:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f413eb1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7069695] (req 3239936->7069695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.764883:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.764887:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.765207:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.765217:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.765224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.765235:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.765240:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468767808
00000100:00100000:0.0:1651532163.765241:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.765251:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468767936
00000100:00100000:1.0:1651532163.765254:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468768000
00000100:00100000:1.0:1651532163.765258:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5386
00000100:00100000:1.0:1651532163.765259:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468767808:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532163.765259:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468767680
00010000:00010000:1.0:1651532163.765263:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.765266:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413fc2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d441 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.765272:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468767744
00000100:00100000:0.0:1651532163.765280:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4912
00010000:00010000:1.0:1651532163.765281:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532163.765282:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468767680:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532163.765284:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413fc2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d441 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.765288:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f413fc2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d441 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.765289:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765292:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:0.0:1651532163.765294:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532163.765295:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.765300:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532163.765301:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.765305:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468767808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.765308:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5386
00010000:00010000:0.0:1651532163.765312:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.765313:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5387
00000100:00100000:1.0:1651532163.765315:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468767936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.765316:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765317:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.765320:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413fd0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d448 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765324:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.765326:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413fd0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d448 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.765326:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.765329:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765334:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f413fd0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d448 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.765343:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532163.765347:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468762880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416628us (416656us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532163.765359:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4904
00000100:00100000:1.0:1651532163.765361:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468767936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (126us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.765364:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5387
00000100:00100000:0.0:1651532163.765364:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4913
00000100:00100000:0.0:1651532163.765366:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468767744:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532163.765369:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5388
00000100:00100000:1.0:1651532163.765370:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468768000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.765372:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765373:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.765375:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413fde lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d44f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.765376:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.765377:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.765380:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532163.765381:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765386:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.765388:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413fde lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d44f expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.765388:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.765391:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765392:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f413fde lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d44f expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.765395:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532163.765402:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468768000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (161us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.765404:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5388
00010000:00010000:1.0:1651532163.765412:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765416:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.765417:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765420:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765424:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.765424:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.765425:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765454:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765463:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765466:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f413edb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->6356991] (req 552960->6356991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765471:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765474:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.765767:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.765776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.765783:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.765790:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468768192
00000100:00100000:0.0:1651532163.765796:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468768320
00000100:00100000:0.0:1651532163.765798:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468768384
00000100:00100000:0.0:1651532163.765801:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5389
00000100:00100000:0.0:1651532163.765815:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468768192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.765819:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.765822:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f413fe5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d456 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.765830:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f413fe5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d456 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.765835:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f413fe5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d456 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.765841:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532163.765849:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5390
00000100:00100000:1.0:1651532163.765851:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468768320:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532163.765851:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468768192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.765854:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5389
00010000:00010000:1.0:1651532163.765855:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.765858:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413fec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d45d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.765859:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5391
00000100:00100000:0.0:1651532163.765861:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468768384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.765863:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.765865:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f413ff3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d464 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.765866:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413fec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d45d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.765870:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f413fec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d45d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.765871:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f413ff3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d464 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.765873:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:0.0:1651532163.765875:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f413ff3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d464 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.765878:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532163.765882:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468768320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.765884:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5390
00000100:00100000:0.0:1651532163.765884:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468768384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.765886:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5391
00000100:00100000:0.0:1651532163.766117:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.766124:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468768576
00000100:00100000:0.0:1651532163.766131:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5392
00000100:00100000:0.0:1651532163.766132:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468768576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.766137:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.766140:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f413ffa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d46b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.766147:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f413ffa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d46b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.766151:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f413ffa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d46b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.766154:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532163.766163:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468768576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (47us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.766166:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5392
00000001:00080000:1.0:1651532163.864761:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794118 is committed
00002000:00010000:1.0:1651532163.864775:0:330054:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532162 -> 1651532163
00010000:00010000:1.0:1651532163.864778:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.864782:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.864817:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468762816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516088us (516113us total) trans 158913794118 rc 0/0
00000100:00100000:1.0:1651532163.864821:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4905
00010000:00010000:1.0:1651532163.864828:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.864831:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.864832:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.864835:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.864848:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.864848:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.864849:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.864853:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.864860:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.864863:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f413ee2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->9768959] (req 1085440->9768959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.864868:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.864871:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.865167:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.865177:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.865185:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.865192:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.865198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.865205:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468768896
00000100:00100000:0.0:1651532163.865214:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468769024
00000100:00100000:0.0:1651532163.865217:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468769088
00000100:00100000:0.0:1651532163.865220:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5393
00000100:00100000:0.0:1651532163.865221:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468768896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.865225:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.865236:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414001 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d472 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.865240:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468768832
00010000:00010000:0.0:1651532163.865247:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414001 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d472 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532163.865250:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468768768
00010000:00010000:0.0:1651532163.865251:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414001 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d472 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.865255:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532163.865260:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4914
00000100:00100000:1.0:1651532163.865262:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468768832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532163.865269:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.865271:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468768896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (85us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532163.865274:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532163.865274:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5393
00010000:00010000:1.0:1651532163.865275:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.865278:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.865279:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5394
00000100:00100000:0.0:1651532163.865281:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468769024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.865283:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532163.865286:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4915
00010000:00010000:0.0:1651532163.865286:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41400f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d479 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.865287:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468768768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532163.865291:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.865292:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41400f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d479 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.865295:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532163.865296:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.865298:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.865301:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532163.865301:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.865305:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41400f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d479 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.865306:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.865309:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.865309:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:1.0:1651532163.865312:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.865314:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468769024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.865317:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5394
00000100:00100000:1.0:1651532163.865320:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5395
00000100:00100000:1.0:1651532163.865321:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468769088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.865323:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.865326:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41401d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d480 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.865332:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41401d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d480 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.865336:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41401d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d480 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.865339:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532163.865385:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468769088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (186us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.865390:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5395
00000001:00080000:1.0:1651532163.973116:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794119 is committed
00010000:00010000:1.0:1651532163.973131:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973135:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.973157:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468764032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507534us (507583us total) trans 158913794119 rc 0/0
00000100:00100000:1.0:1651532163.973161:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4906
00010000:00010000:1.0:1651532163.973167:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973171:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.973172:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973175:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973180:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.973180:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.973181:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973184:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973190:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.973191:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.973191:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973203:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973216:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973219:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f413f13 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [139264->7573503] (req 139264->7573503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973225:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973228:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.973229:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.973234:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.973533:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.973546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.973552:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468769344
00000100:00100000:0.0:1651532163.973564:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468769472
00000100:00100000:1.0:1651532163.973569:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5396
00000100:00100000:1.0:1651532163.973571:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468769344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.973575:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532163.973577:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5397
00010000:00010000:1.0:1651532163.973578:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414024 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d487 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.973579:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046351af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468769472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.973583:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.973584:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532163.973586:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41402b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d48e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973587:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414024 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d487 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.973591:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414024 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d487 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.973592:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.973594:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:0.0:1651532163.973595:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41402b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d48e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.973599:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41402b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d48e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.973602:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532163.973607:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468769344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.973610:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5396
00000100:00100000:0.0:1651532163.973617:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046351af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468769472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (70us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532163.973621:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.973621:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5397
00010000:00010000:1.0:1651532163.973625:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.973634:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.973637:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e36e2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468765376:12345-10.240.43.64@tcp:3:fio.0 Request processed in 407867us (407928us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532163.973638:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.973639:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4908
00010000:00010000:1.0:1651532163.973654:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.973655:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468764160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 507980us (508071us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532163.973657:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.973658:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.973658:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4907
00010000:00010000:1.0:1651532163.973661:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973669:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973672:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f413f52 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8331263] (req 102400->8331263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973675:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973678:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532163.973678:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973681:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973684:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.973685:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532163.973686:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973688:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973720:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973723:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f413f1a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1818624->9961471] (req 1818624->9961471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973729:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.973732:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.974038:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.974045:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.974055:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.974061:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468769920
00000100:00100000:0.0:1651532163.974082:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5398
00000100:00100000:0.0:1651532163.974084:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468769920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.974087:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532163.974091:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414032 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d495 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532163.974097:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468769792
00010000:00010000:0.0:1651532163.974099:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414032 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d495 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532163.974107:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468769856
00000100:00100000:1.0:1651532163.974116:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4916
00000100:00100000:1.0:1651532163.974118:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468769792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532163.974121:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414032 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d495 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974125:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.974127:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:1.0:1651532163.974130:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532163.974131:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.974133:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532163.974134:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.974136:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468769920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (81us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532163.974138:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.974139:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5398
00010000:00010000:1.0:1651532163.974142:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.974147:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4917
00000100:00100000:0.0:1651532163.974149:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468769856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532163.974155:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.974159:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532163.974160:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.974163:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532163.974164:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.974168:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.974171:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532163.974186:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.974214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532163.974221:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468770240
00000100:00100000:0.0:1651532163.974227:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468770304
00000100:00100000:0.0:1651532163.974235:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5399
00000100:00100000:0.0:1651532163.974236:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468770240:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532163.974238:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5400
00010000:00010000:0.0:1651532163.974239:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532163.974240:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468770304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532163.974243:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414047 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d49c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.974244:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.974247:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41404e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4a3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532163.974249:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414047 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d49c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974254:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41404e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4a3 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.974254:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414047 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d49c expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532163.974257:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:1.0:1651532163.974258:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41404e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4a3 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974262:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532163.974267:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468770240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532163.974269:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5399
00000100:00100000:1.0:1651532163.974271:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468770304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.974273:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5400
00000100:00100000:0.0:1651532163.974416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.974434:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468770432
00000100:00100000:1.0:1651532163.974446:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5401
00000100:00100000:1.0:1651532163.974447:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468770432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.974450:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.974454:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414055 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4aa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.974460:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414055 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4aa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974464:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414055 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4aa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974468:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532163.974480:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468770432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.974482:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5401
00000100:00100000:0.0:1651532163.974527:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.974537:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468770560
00000100:00100000:1.0:1651532163.974545:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5402
00000100:00100000:1.0:1651532163.974547:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468770560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.974550:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.974553:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41405c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4b1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.974559:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41405c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4b1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974562:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41405c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4b1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974566:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532163.974577:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468770560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.974579:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5402
00000100:00100000:0.0:1651532163.974614:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.974623:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468770688
00000100:00100000:1.0:1651532163.974632:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5403
00000100:00100000:1.0:1651532163.974633:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468770688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.974637:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.974640:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414063 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4b8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.974646:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414063 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4b8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974649:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414063 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4b8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974653:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532163.974663:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468770688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.974666:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5403
00000100:00100000:0.0:1651532163.974859:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532163.974868:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468770944
00000100:00100000:1.0:1651532163.974877:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5404
00000100:00100000:1.0:1651532163.974879:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468770944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532163.974881:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532163.974884:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41406a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4bf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532163.974890:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41406a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4bf expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974894:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41406a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4bf expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532163.974900:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532163.974911:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468770944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532163.974914:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5404
00000001:00080000:1.0:1651532164.039849:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794120 is committed
00010000:00010000:1.0:1651532164.039864:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.039868:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.039890:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd50a695 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468765312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474033us (474173us total) trans 158913794120 rc 0/0
00000100:00100000:1.0:1651532164.039893:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4909
00010000:00010000:1.0:1651532164.039901:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.039904:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.039905:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.039908:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.039913:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.039913:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.039915:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.039918:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.039935:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.039938:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f413f6e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->7413759] (req 634880->7413759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.039944:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.039947:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.040140:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.040151:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468771264
00000100:00100000:0.0:1651532164.040159:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.040172:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468771328
00000100:00100000:1.0:1651532164.040183:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4918
00000100:00100000:1.0:1651532164.040185:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468771264:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532164.040186:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4919
00000100:00100000:0.0:1651532164.040188:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468771328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532164.040191:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.040196:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.040197:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.040200:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532164.040201:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.040205:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.040209:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040209:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040214:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.040215:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040218:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532164.040219:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.040222:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.040225:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040228:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040238:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.040245:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0a0376b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468766720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408381us (408476us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532164.040248:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4910
00010000:00010000:0.0:1651532164.040250:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040254:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532164.040255:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040258:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040262:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.040263:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.040264:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040269:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040275:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040278:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f413f98 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [143360->7856127] (req 143360->7856127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040283:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.040286:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.040315:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.040335:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468771520
00000100:00100000:1.0:1651532164.040363:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5405
00000100:00100000:1.0:1651532164.040365:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b9096eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468771520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.040368:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.040372:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41407f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4c6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.040379:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41407f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4c6 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.040395:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41407f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4c6 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.040398:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532164.040410:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b9096eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468771520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.040413:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5405
00000100:00100000:0.0:1651532164.040584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.040612:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468771648
00000100:00100000:1.0:1651532164.040621:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5406
00000100:00100000:1.0:1651532164.040623:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468771648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.040626:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.040629:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f414086 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4cd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.040636:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f414086 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4cd expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.040640:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f414086 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4cd expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.040643:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532164.040655:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468771648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.040658:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5406
00000100:00100000:0.0:1651532164.040687:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.040707:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468771840
00000100:00100000:1.0:1651532164.040721:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5407
00000100:00100000:1.0:1651532164.040723:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468771840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.040726:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.040729:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41408d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4d4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.040736:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41408d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4d4 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.040740:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41408d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4d4 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.040743:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532164.040754:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468771840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.040757:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5407
00000100:00100000:0.0:1651532164.040788:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.040797:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468771968
00000100:00100000:1.0:1651532164.040822:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5408
00000100:00100000:1.0:1651532164.040824:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468771968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.040827:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.040830:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414094 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4db expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.040836:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414094 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4db expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.040843:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414094 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4db expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.040846:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532164.040858:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468771968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.040860:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5408
00000100:00100000:0.0:1651532164.040965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.040983:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468772096
00000100:00100000:1.0:1651532164.040993:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5409
00000100:00100000:1.0:1651532164.040995:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468772096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.040998:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.041001:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41409b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4e2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.041008:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41409b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4e2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.041012:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41409b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4e2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.041015:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532164.041026:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468772096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.041029:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5409
00000100:00100000:0.0:1651532164.041122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.041131:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468772224
00000100:00100000:1.0:1651532164.041139:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5410
00000100:00100000:1.0:1651532164.041141:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468772224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.041144:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.041147:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4140a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4e9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.041153:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4140a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4e9 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.041156:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4140a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4e9 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.041160:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532164.041170:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468772224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.041173:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5410
00000100:00100000:0.0:1651532164.041203:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.041212:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468772416
00000100:00100000:1.0:1651532164.041220:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5411
00000100:00100000:1.0:1651532164.041221:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468772416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.041224:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.041227:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4140a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4f0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.041233:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4140a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4f0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.041239:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4140a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4f0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.041243:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532164.041253:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468772416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.041255:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5411
00000100:00100000:0.0:1651532164.041333:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.041342:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468772608
00000100:00100000:1.0:1651532164.041358:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5412
00000100:00100000:1.0:1651532164.041359:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468772608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.041362:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.041365:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4140b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4f7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.041371:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4140b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4f7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.041375:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4140b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4f7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.041378:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532164.041389:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468772608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.041392:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5412
00000100:00100000:0.0:1651532164.041478:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.041487:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468772736
00000100:00100000:1.0:1651532164.041496:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5413
00000100:00100000:1.0:1651532164.041497:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b9b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468772736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.041500:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.041503:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d4fe expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.041509:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4fe expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.041513:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d4fe expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.041516:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532164.041527:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b9b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468772736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.041529:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5413
00000001:00080000:1.0:1651532164.131548:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794121 is committed
00010000:00010000:0.0:1651532164.131580:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.131588:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.131611:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.131611:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f066f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468766656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499733us (499791us total) trans 158913794121 rc 0/0
00000100:00100000:0.0:1651532164.131614:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4911
00010000:00010000:1.0:1651532164.131616:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.131617:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.131620:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.131629:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.131629:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.131630:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.131633:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.131643:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.131652:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f413f9f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->10330111] (req 2375680->10330111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.131652:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.131656:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.132035:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.132042:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.132052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.132053:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468772928
00000100:00100000:0.0:1651532164.132061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.132068:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468772992
00000100:00100000:0.0:1651532164.132068:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.132074:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4920
00000100:00100000:0.0:1651532164.132075:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468773056
00000100:00100000:1.0:1651532164.132076:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa3ce2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468772928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532164.132082:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.132082:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468773184
00000100:00100000:0.0:1651532164.132085:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468773248
00010000:00010000:1.0:1651532164.132087:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.132088:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.132088:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5414
00010000:00010000:1.0:1651532164.132090:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:0.0:1651532164.132090:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468773056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.132091:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.132094:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.132098:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.132098:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d505 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.132101:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.132106:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d505 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532164.132110:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4921
00000100:00100000:1.0:1651532164.132111:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468772992:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532164.132111:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d505 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.132114:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:1.0:1651532164.132116:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.132119:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.132120:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.132123:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532164.132123:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.132124:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468773056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (72us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532164.132127:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.132127:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5414
00010000:00010000:1.0:1651532164.132129:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.132132:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5415
00000100:00100000:0.0:1651532164.132133:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468773184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532164.132136:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532164.132137:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5416
00000100:00100000:1.0:1651532164.132138:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468773248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532164.132138:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4140d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d50c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.132141:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.132143:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4140da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d513 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.132143:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4140d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d50c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.132147:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4140d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d50c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.132150:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4140da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d513 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.132150:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:1.0:1651532164.132154:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4140da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d513 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532164.132155:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468773184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (94us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532164.132157:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532164.132157:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5415
00000100:00100000:1.0:1651532164.132167:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468773248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.132170:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5416
00000001:00080000:1.0:1651532164.198259:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794122 is committed
00010000:00010000:0.0:1651532164.198289:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.198294:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.198315:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2fea28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468767680:12345-10.240.43.64@tcp:4:fio.0 Request processed in 433032us (433109us total) trans 158913794122 rc 0/0
00010000:00010000:1.0:1651532164.198317:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.198319:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4912
00010000:00010000:1.0:1651532164.198321:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.198322:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198325:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198331:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.198331:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.198332:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198335:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198339:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.198339:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.198340:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198342:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198372:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198375:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f413fc9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10153983] (req 409600->10153983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198382:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198385:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.198386:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.198390:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.198644:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532164.198671:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198676:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.198678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.198690:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468773632
00000100:00100000:0.0:1651532164.198698:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468773760
00000100:00100000:1.0:1651532164.198705:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468768832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 333442us (333539us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532164.198707:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5417
00000100:00100000:1.0:1651532164.198709:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4914
00000100:00100000:0.0:1651532164.198709:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c39d25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468773632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532164.198713:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.198717:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4140e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d51a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.198718:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5418
00000100:00100000:1.0:1651532164.198720:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468773760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.198723:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.198723:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.198726:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4140e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d51a expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.198727:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4140e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d521 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198732:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.198734:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4140e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d51a expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.198735:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4140e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d521 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.198737:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:1.0:1651532164.198739:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4140e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d521 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.198742:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532164.198745:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c39d25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468773632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.198748:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5417
00000100:00100000:1.0:1651532164.198749:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468773760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.198752:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5418
00010000:00010000:0.0:1651532164.198755:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.198759:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532164.198760:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.198763:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.198768:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.198771:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414008 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2002944->7307263] (req 2002944->7307263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.198780:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.198786:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198799:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198814:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.198815:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.198815:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4ab15f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468767744:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433448us (433597us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532164.198818:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4913
00010000:00010000:1.0:1651532164.198819:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198824:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.198824:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.198825:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198828:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198835:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198837:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f413fd7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1687552->8372223] (req 1687552->8372223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198843:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.198846:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.199220:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.199231:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.199237:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468773952
00000100:00100000:0.0:1651532164.199238:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.199247:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468774016
00000100:00100000:1.0:1651532164.199251:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5419
00000100:00100000:1.0:1651532164.199253:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468773952:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532164.199256:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468774080
00010000:00010000:1.0:1651532164.199257:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.199260:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4140ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d528 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.199264:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4922
00000100:00100000:0.0:1651532164.199266:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468774016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532164.199274:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4140ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d528 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.199274:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.199278:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532164.199279:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.199282:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532164.199283:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.199286:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4140ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d528 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.199287:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.199290:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:0.0:1651532164.199293:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.199303:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468773952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.199306:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5419
00000100:00100000:0.0:1651532164.199306:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4923
00000100:00100000:0.0:1651532164.199309:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468774080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532164.199313:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.199317:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.199318:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.199320:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532164.199321:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.199338:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.199342:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.199366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.199376:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468774208
00000100:00100000:1.0:1651532164.199383:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5420
00000100:00100000:1.0:1651532164.199385:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb589f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468774208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.199388:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532164.199393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.199403:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.199410:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468774336
00010000:00010000:1.0:1651532164.199411:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414104 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d52f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.199416:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468774400
00010000:00010000:1.0:1651532164.199419:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414104 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d52f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532164.199419:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5421
00000100:00100000:0.0:1651532164.199421:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468774336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.199423:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414104 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d52f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.199424:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.199426:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00010000:00010000:0.0:1651532164.199427:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41410b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d536 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.199435:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41410b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d536 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.199439:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41410b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d536 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532164.199444:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb589f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468774208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.199447:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5420
00010000:00010000:0.0:1651532164.199450:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532164.199453:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5422
00000100:00100000:1.0:1651532164.199454:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468774400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.199457:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532164.199459:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468774336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (66us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532164.199460:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414112 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d53d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.199462:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5421
00010000:00010000:1.0:1651532164.199466:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414112 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d53d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.199470:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414112 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d53d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.199473:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532164.199479:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468774400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.199481:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5422
00000100:00100000:0.0:1651532164.199610:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.199620:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468774528
00000100:00100000:1.0:1651532164.199628:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5423
00000100:00100000:1.0:1651532164.199629:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468774528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.199632:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.199635:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414119 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d544 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.199652:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414119 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d544 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.199656:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414119 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d544 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.199659:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:1.0:1651532164.199672:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000412d5cef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468774528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.199674:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5423
00000100:00100000:0.0:1651532164.199911:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.199921:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468774848
00000100:00100000:1.0:1651532164.199928:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5424
00000100:00100000:1.0:1651532164.199929:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468774848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.199933:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.199936:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414120 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d54b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.199942:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414120 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d54b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.199946:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414120 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d54b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.199949:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:1.0:1651532164.199962:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468774848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.199965:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5424
00000001:00080000:1.0:1651532164.248548:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794123 is committed
00010000:00010000:1.0:1651532164.248563:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248567:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.248588:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468768768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 383300us (383411us total) trans 158913794123 rc 0/0
00000100:00100000:1.0:1651532164.248591:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4915
00010000:00010000:1.0:1651532164.248598:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248602:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.248603:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248606:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248610:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.248611:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.248612:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248615:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248634:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248637:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414016 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3473408->4685823] (req 3473408->4685823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248642:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248645:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.248872:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.248882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.248917:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468775104
00000100:00100000:0.0:1651532164.248930:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468775040
00000100:00100000:0.0:1651532164.248938:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4924
00000100:00100000:0.0:1651532164.248940:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468775104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532164.248946:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.248953:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532164.248954:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532164.248955:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.248957:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4925
00010000:00010000:0.0:1651532164.248958:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.248959:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb589f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468775040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532164.248967:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248972:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.248973:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.248974:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532164.248976:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248985:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532164.248985:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.248990:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468775168
00010000:00010000:1.0:1651532164.248993:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.248996:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.248999:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5425
00000100:00100000:0.0:1651532164.249001:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468775168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.249004:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.249004:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.249007:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414135 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d552 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.249014:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414135 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d552 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.249018:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414135 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d552 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.249022:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532164.249032:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468775168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.249035:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5425
00000100:00100000:0.0:1651532164.249261:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.249268:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468775296
00000100:00100000:0.0:1651532164.249282:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5426
00000100:00100000:0.0:1651532164.249283:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468775296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532164.249287:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.249290:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41413c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d559 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.249298:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41413c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d559 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.249302:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41413c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d559 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.249305:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532164.249314:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468775296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.249317:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5426
00000001:00080000:1.0:1651532164.389937:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794124 is committed
00010000:00010000:1.0:1651532164.389952:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.389956:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.389978:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468769792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 415859us (415941us total) trans 158913794124 rc 0/0
00010000:00010000:0.0:1651532164.389980:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.389981:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4916
00010000:00010000:0.0:1651532164.389985:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532164.389986:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.389990:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.389998:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.389999:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.390000:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.390003:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.390010:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.390013:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414039 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1339392->7086079] (req 1339392->7086079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390018:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390030:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390221:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390225:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.390245:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468769856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416094us (416198us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532164.390248:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4917
00010000:00010000:1.0:1651532164.390254:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390258:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.390259:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390262:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390273:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.390273:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.390274:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390283:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390289:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.390290:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532164.390292:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414040 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2154496->4599807] (req 2154496->4599807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390298:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.390299:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468775488
00010000:00010000:1.0:1651532164.390301:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.390309:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5427
00000100:00100000:0.0:1651532164.390311:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468775488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532164.390315:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.390318:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414143 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d560 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.390332:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414143 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d560 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.390336:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414143 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d560 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.390342:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532164.390362:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468775488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.390365:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5427
00000100:00100000:1.0:1651532164.390546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.390557:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468775744
00000100:00100000:0.0:1651532164.390568:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5428
00000100:00100000:0.0:1651532164.390569:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd511b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468775744:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532164.390571:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532164.390573:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.390576:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41414a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d567 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.390579:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532164.390583:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41414a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d567 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532164.390586:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468775616
00010000:00010000:0.0:1651532164.390587:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41414a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d567 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.390591:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532164.390596:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468775680
00000100:00100000:0.0:1651532164.390601:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd511b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468775744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.390606:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4926
00000100:00100000:1.0:1651532164.390608:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468775616:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532164.390610:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5428
00010000:00010000:1.0:1651532164.390615:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.390617:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4927
00010000:00010000:1.0:1651532164.390619:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532164.390619:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468775680:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532164.390620:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390623:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532164.390624:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.390625:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390628:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.390629:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532164.390630:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.390633:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532164.390634:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390638:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.390638:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.390642:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.390691:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.390728:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468775936
00000100:00100000:1.0:1651532164.390739:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5429
00000100:00100000:1.0:1651532164.390741:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468775936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.390744:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.390748:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41415f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d56e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.390756:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41415f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d56e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.390760:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41415f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d56e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.390763:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532164.390777:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468775936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.390779:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5429
00000001:00080000:1.0:1651532164.456663:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794125 is committed
00010000:00010000:1.0:1651532164.456678:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.456682:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.456700:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468771264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 416514us (416560us total) trans 158913794125 rc 0/0
00000100:00100000:1.0:1651532164.456703:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4918
00010000:00010000:1.0:1651532164.456709:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.456712:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.456713:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.456716:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.456721:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.456721:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.456722:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.456725:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.456738:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.456741:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414071 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1286144->5238783] (req 1286144->5238783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.456750:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.456755:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.457080:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.457099:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468776448
00000100:00100000:1.0:1651532164.457109:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5430
00000100:00100000:1.0:1651532164.457111:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468776448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.457115:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.457115:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.457118:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414166 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d575 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457120:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.457124:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.457126:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414166 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d575 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.457131:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414166 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d575 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.457134:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532164.457136:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468771328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416946us (416976us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532164.457139:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4919
00000100:00100000:1.0:1651532164.457142:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468776448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.457144:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5430
00010000:00010000:0.0:1651532164.457146:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457149:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532164.457150:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457153:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.457158:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.457159:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457162:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457175:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457178:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414078 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9703423] (req 106496->9703423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.457184:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.457188:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.457583:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.457594:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.457594:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468776512
00000100:00100000:1.0:1651532164.457602:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.457605:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468776640
00000100:00100000:1.0:1651532164.457609:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4928
00000100:00100000:1.0:1651532164.457617:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468776512:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532164.457617:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4929
00000100:00100000:0.0:1651532164.457619:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468776640:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532164.457625:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457626:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.457630:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.457631:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.457634:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532164.457634:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457638:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532164.457639:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457642:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532164.457643:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.457647:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457648:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.457650:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.457651:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.457659:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468776832
00000100:00100000:1.0:1651532164.457667:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5431
00000100:00100000:1.0:1651532164.457669:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468776832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.457671:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.457674:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41417b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d57c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.457681:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41417b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d57c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.457688:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41417b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d57c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.457691:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:1.0:1651532164.457704:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468776832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.457707:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5431
00000100:00100000:1.0:1651532164.457915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.457922:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468777024
00000100:00100000:1.0:1651532164.457928:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5432
00000100:00100000:1.0:1651532164.457930:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468777024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.457933:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.457937:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414182 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d583 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.457944:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414182 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d583 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.457948:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414182 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d583 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.457951:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532164.457965:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468777024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.457969:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5432
00000100:00100000:1.0:1651532164.458160:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.458167:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468777152
00000100:00100000:1.0:1651532164.458173:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5433
00000100:00100000:1.0:1651532164.458175:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468777152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.458178:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.458181:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414189 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d58a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.458188:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414189 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d58a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.458192:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414189 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d58a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.458195:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532164.458208:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468777152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.458211:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5433
00000100:00100000:1.0:1651532164.458402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.458409:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468777280
00000100:00100000:1.0:1651532164.458415:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5434
00000100:00100000:1.0:1651532164.458416:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468777280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.458419:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.458422:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414190 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d591 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.458430:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414190 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d591 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.458433:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414190 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d591 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.458437:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:1.0:1651532164.458450:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468777280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.458452:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5434
00000100:00100000:1.0:1651532164.458626:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.458632:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468777408
00000100:00100000:1.0:1651532164.458638:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5435
00000100:00100000:1.0:1651532164.458639:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468777408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.458642:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.458645:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414197 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d598 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.458652:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414197 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d598 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.458655:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414197 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d598 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.458658:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:1.0:1651532164.458671:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468777408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.458674:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5435
00000001:00080000:1.0:1651532164.581636:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794126 is committed
00010000:00010000:1.0:1651532164.581652:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581656:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.581673:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa3ce2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468772928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449596us (449638us total) trans 158913794126 rc 0/0
00000100:00100000:1.0:1651532164.581676:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4920
00010000:00010000:1.0:1651532164.581682:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581686:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.581687:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581690:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581694:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.581695:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.581696:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581699:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581706:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581709:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4140be lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2818048->9224191] (req 2818048->9224191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581714:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581717:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581909:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581914:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.581934:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468772992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449822us (449892us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532164.581937:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4921
00010000:00010000:1.0:1651532164.581944:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581948:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.581949:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581954:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581959:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.581960:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.581960:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581972:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581981:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.581984:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4140cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1691648->10145791] (req 1691648->10145791) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.581988:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.581993:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.582079:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.582089:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468777536
00000100:00100000:1.0:1651532164.582098:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5436
00000100:00100000:1.0:1651532164.582099:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051966bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468777536:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532164.582101:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532164.582115:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532164.582116:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468777728
00010000:00010000:1.0:1651532164.582119:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41419e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d59f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.582124:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5437
00000100:00100000:0.0:1651532164.582126:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468777728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.582127:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41419e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d59f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.582131:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.582134:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41419e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d59f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.582135:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4141a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5a6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.582137:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00010000:00010000:0.0:1651532164.582143:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4141a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5a6 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532164.582147:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051966bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468777536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (69us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532164.582148:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4141a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5a6 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532164.582150:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5436
00010000:00010000:0.0:1651532164.582151:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532164.582160:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468777728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.582163:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5437
00000100:00100000:0.0:1651532164.582358:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.582368:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468777792
00000100:00100000:0.0:1651532164.582369:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.582379:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.582386:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468777856
00000100:00100000:1.0:1651532164.582393:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4930
00000100:00100000:1.0:1651532164.582395:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468777792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532164.582401:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.582405:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.582406:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.582409:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532164.582410:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.582414:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.582418:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.582425:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4931
00000100:00100000:1.0:1651532164.582427:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468777856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532164.582431:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.582434:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.582435:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.582438:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532164.582438:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.582442:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.582451:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.582467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.582480:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468777920
00000100:00100000:0.0:1651532164.582491:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5438
00000100:00100000:0.0:1651532164.582493:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468777920:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532164.582494:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468778048
00010000:00010000:0.0:1651532164.582497:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532164.582501:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5439
00010000:00010000:0.0:1651532164.582501:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4141ba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5ad expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.582503:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468778048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.582506:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.582508:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4141ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5ad expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.582509:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4141c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5b4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.582516:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4141ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5ad expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.582519:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4141c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5b4 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.582519:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:1.0:1651532164.582523:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4141c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5b4 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.582526:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532164.582540:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468778048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.582543:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5439
00000100:00100000:0.0:1651532164.582550:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468777920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (170us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.582553:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5438
00000100:00100000:1.0:1651532164.582586:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.582620:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468778176
00000100:00100000:0.0:1651532164.582628:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5440
00000100:00100000:0.0:1651532164.582630:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468778176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532164.582633:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.582637:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4141c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5bb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.582644:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4141c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5bb expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.582648:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4141c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5bb expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.582651:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532164.582663:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468778176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.582666:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5440
00000100:00100000:0.0:1651532164.582849:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.582857:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.582863:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468778304
00000100:00100000:0.0:1651532164.582872:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468778368
00000100:00100000:1.0:1651532164.582881:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5441
00000100:00100000:1.0:1651532164.582884:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468778304:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532164.582884:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5442
00000100:00100000:0.0:1651532164.582886:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468778368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.582887:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.582889:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.582891:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4141cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5c2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.582893:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5c9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.582898:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4141cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5c2 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.582900:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5c9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.582902:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4141cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5c2 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.582904:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5c9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.582906:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:0.0:1651532164.582907:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532164.582916:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468778304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.582916:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468778368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.582918:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5442
00000100:00100000:1.0:1651532164.582920:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5441
00000100:00100000:0.0:1651532164.583136:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.583154:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468778688
00000100:00100000:1.0:1651532164.583162:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5443
00000100:00100000:1.0:1651532164.583164:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468778688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.583167:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.583170:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4141dd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5d0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.583177:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4141dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5d0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.583181:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4141dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5d0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.583184:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532164.583194:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468778688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.583196:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5443
00000100:00100000:0.0:1651532164.583428:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.583439:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468778880
00000100:00100000:1.0:1651532164.583446:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5444
00000100:00100000:1.0:1651532164.583447:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468778880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.583451:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.583454:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4141e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5d7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.583460:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4141e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5d7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.583465:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4141e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5d7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.583468:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:1.0:1651532164.583477:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468778880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.583479:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5444
00000001:00080000:1.0:1651532164.690000:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794127 is committed
00002000:00010000:0.0:1651532164.690028:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532163 -> 1651532164
00002000:00010000:0.0:1651532164.690030:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532163 -> 1651532164
00010000:00010000:0.0:1651532164.690033:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690040:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.690056:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dfad5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468774016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490789us (490825us total) trans 158913794127 rc 0/0
00000100:00100000:0.0:1651532164.690059:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4922
00010000:00010000:0.0:1651532164.690066:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690069:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532164.690071:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690073:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690078:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.690079:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.690080:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690083:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690086:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.690086:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.690087:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690092:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690100:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690102:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4140f6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1716224->9166847] (req 1716224->9166847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690107:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690110:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690136:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690140:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690330:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690334:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690366:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.690368:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468775104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441427us (441496us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532164.690371:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.690372:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.690372:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4924
00010000:00010000:1.0:1651532164.690375:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690381:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690382:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690384:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414127 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1314816->9277439] (req 1314816->9277439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.690386:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690397:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.690400:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085bd48e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468774080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491091us (491161us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532164.690403:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532164.690403:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4923
00010000:00010000:1.0:1651532164.690404:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690407:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690411:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.690411:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.690412:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690415:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690422:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690425:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4140fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5685248->10362879] (req 5685248->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690430:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690440:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.690518:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.690537:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468779072
00000100:00100000:1.0:1651532164.690547:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5445
00000100:00100000:1.0:1651532164.690549:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468779072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.690552:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.690556:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4141eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5de expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690563:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4141eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5de expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.690567:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4141eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5de expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.690571:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:1.0:1651532164.690581:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468779072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.690583:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5445
00000100:00100000:1.0:1651532164.690876:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.690891:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.690902:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468779392
00000100:00100000:1.0:1651532164.690909:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.690919:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468779328
00000100:00100000:1.0:1651532164.690921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.690928:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4932
00000100:00100000:0.0:1651532164.690930:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468779392:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532164.690935:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468779264
00010000:00010000:0.0:1651532164.690937:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.690944:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468779584
00010000:00010000:0.0:1651532164.690947:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532164.690951:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5446
00000100:00100000:1.0:1651532164.690952:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468779264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532164.690952:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532164.690953:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690956:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.690956:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.690959:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4141f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5e5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.690963:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4933
00000100:00100000:0.0:1651532164.690965:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468779328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532164.690969:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4141f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5e5 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.690973:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4141f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5e5 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.690977:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532164.690987:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468779264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.690989:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5446
00010000:00010000:0.0:1651532164.690993:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.690994:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5447
00000100:00100000:1.0:1651532164.690995:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468779584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532164.690997:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.690998:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.690998:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.691000:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414207 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5ec expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.691001:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.691003:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532164.691004:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.691008:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414207 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5ec expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.691008:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.691011:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.691012:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414207 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5ec expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.691015:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:0.0:1651532164.691015:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.691020:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468779584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.691023:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5447
00000100:00100000:0.0:1651532164.691033:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.691105:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468779776
00000100:00100000:1.0:1651532164.691118:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5448
00000100:00100000:1.0:1651532164.691120:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468779776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.691123:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.691127:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41420e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5f3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.691134:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41420e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5f3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.691138:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41420e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5f3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.691141:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532164.691157:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468779776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (123us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.691159:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5448
00000100:00100000:1.0:1651532164.691418:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.691425:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468780160
00000100:00100000:1.0:1651532164.691432:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5449
00000100:00100000:1.0:1651532164.691434:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468780160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.691437:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.691440:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414215 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d5fa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.691449:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414215 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5fa expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.691453:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414215 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d5fa expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.691456:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:1.0:1651532164.691470:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468780160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.691473:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5449
00000100:00100000:1.0:1651532164.691681:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.691688:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468780352
00000100:00100000:1.0:1651532164.691694:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5450
00000100:00100000:1.0:1651532164.691695:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468780352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.691698:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.691701:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41421c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d601 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.691708:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41421c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d601 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.691712:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41421c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d601 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.691715:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:1.0:1651532164.691728:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468780352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.691731:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5450
00000001:00080000:1.0:1651532164.798371:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794128 is committed
00010000:00010000:1.0:1651532164.798388:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.798392:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.798414:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb589f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468775040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549454us (549532us total) trans 158913794128 rc 0/0
00010000:00010000:0.0:1651532164.798415:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.798418:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4925
00010000:00010000:0.0:1651532164.798420:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532164.798421:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798425:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798430:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.798431:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.798431:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798434:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798444:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798447:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41412e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3350528->9412607] (req 3350528->9412607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.798460:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.798464:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.798774:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.798782:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.798792:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.798793:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468780480
00000100:00100000:1.0:1651532164.798799:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.798818:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468780544
00000100:00100000:0.0:1651532164.798827:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4934
00000100:00100000:0.0:1651532164.798829:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468780480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532164.798836:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798841:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532164.798842:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798847:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532164.798848:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798852:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798856:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.798863:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4935
00000100:00100000:0.0:1651532164.798865:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468780544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532164.798869:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.798873:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468780672
00010000:00010000:0.0:1651532164.798873:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532164.798874:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798876:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532164.798877:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.798880:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.798885:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468780736
00000100:00100000:1.0:1651532164.798891:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5451
00000100:00100000:1.0:1651532164.798893:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468780672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532164.798894:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.798897:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.798901:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f414231 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d608 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.798905:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5452
00000100:00100000:0.0:1651532164.798906:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468780736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.798909:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f414231 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d608 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.798909:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.798912:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414238 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d60f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.798913:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f414231 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d608 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.798916:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00010000:00010000:0.0:1651532164.798919:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414238 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d60f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.798924:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414238 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d60f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.798933:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532164.798940:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468780672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (147us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.798943:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5451
00000100:00100000:0.0:1651532164.798943:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468780736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.798946:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5452
00000100:00100000:1.0:1651532164.799188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.799199:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468780864
00000100:00100000:1.0:1651532164.799200:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.799206:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468780928
00000100:00100000:1.0:1651532164.799207:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5453
00000100:00100000:1.0:1651532164.799210:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468780864:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532164.799215:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5454
00000100:00100000:0.0:1651532164.799217:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468780928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.799218:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.799220:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.799221:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41423f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d616 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.799223:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414246 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d61d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.799229:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41423f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d616 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.799231:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414246 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d61d expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.799233:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f41423f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d616 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.799235:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414246 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d61d expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.799239:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00010000:00010000:0.0:1651532164.799239:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532164.799250:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468780864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.799250:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468780928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.799252:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5454
00000100:00100000:1.0:1651532164.799254:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5453
00000100:00100000:1.0:1651532164.799503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.799510:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468781120
00000100:00100000:1.0:1651532164.799517:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5455
00000100:00100000:1.0:1651532164.799518:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468781120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.799521:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.799524:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41424d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d624 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.799531:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41424d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d624 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.799535:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41424d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d624 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.799539:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532164.799552:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468781120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.799555:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5455
00000001:00080000:1.0:1651532164.911663:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794129 is committed
00010000:00010000:1.0:1651532164.911678:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911684:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.911701:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468775616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 521092us (521130us total) trans 158913794129 rc 0/0
00000100:00100000:1.0:1651532164.911704:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4926
00010000:00010000:1.0:1651532164.911710:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911713:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.911714:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911717:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911722:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.911723:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.911724:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911726:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911739:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911743:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414151 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8777727] (req 3108864->8777727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.911751:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.911756:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.911922:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.911926:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911937:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911941:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.911942:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911945:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.911945:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468775680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 521325us (521365us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532164.911948:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4927
00010000:00010000:1.0:1651532164.911950:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.911951:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.911952:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911955:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911962:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911964:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414158 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1523712->9478143] (req 1523712->9478143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911970:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.911973:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.912082:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.912106:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468781376
00000100:00100000:1.0:1651532164.912115:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5456
00000100:00100000:1.0:1651532164.912117:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468781376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.912132:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.912136:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414254 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d62b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.912143:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414254 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d62b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.912147:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414254 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d62b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.912151:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532164.912164:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468781376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.912167:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5456
00000100:00100000:0.0:1651532164.912339:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.912346:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.912365:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532164.912374:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468781440
00000100:00100000:1.0:1651532164.912378:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468781504
00000100:00100000:0.0:1651532164.912387:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4936
00000100:00100000:0.0:1651532164.912389:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468781440:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532164.912395:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4937
00010000:00010000:0.0:1651532164.912396:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.912397:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468781504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532164.912400:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532164.912401:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.912404:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.912404:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532164.912404:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.912409:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.912410:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532164.912411:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.912415:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.912415:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.912418:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.912423:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468781632
00000100:00100000:1.0:1651532164.912428:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5457
00000100:00100000:1.0:1651532164.912429:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468781632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.912432:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.912434:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f414269 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d632 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.912440:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f414269 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d632 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.912444:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f414269 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d632 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.912448:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:1.0:1651532164.912468:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468781632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.912471:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5457
00000100:00100000:0.0:1651532164.912508:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.912514:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468781760
00000100:00100000:1.0:1651532164.912524:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5458
00000100:00100000:1.0:1651532164.912526:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468781760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.912529:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.912532:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414270 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d639 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.912539:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414270 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d639 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.912543:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414270 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d639 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.912546:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:1.0:1651532164.912555:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468781760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.912558:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5458
00000001:00080000:1.0:1651532164.979713:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794130 is committed
00010000:00010000:1.0:1651532164.979728:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.979732:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.979754:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468776512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 522136us (522172us total) trans 158913794130 rc 0/0
00010000:00010000:0.0:1651532164.979756:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.979757:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4928
00010000:00010000:0.0:1651532164.979760:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532164.979761:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.979764:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.979770:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.979770:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532164.979772:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.979775:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.979782:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.979785:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41416d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [233472->10207231] (req 233472->10207231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.979792:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.979814:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.980070:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532164.980086:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980090:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.980103:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468776640:12345-10.240.43.64@tcp:3:fio.0 Request processed in 522483us (522509us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532164.980106:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4929
00010000:00010000:1.0:1651532164.980112:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980115:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532164.980116:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980119:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980124:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.980125:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532164.980126:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980136:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980145:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980148:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414174 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2723840->10203135] (req 2723840->10203135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980154:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980156:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532164.980178:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468782016
00000100:00100000:1.0:1651532164.980190:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5459
00000100:00100000:1.0:1651532164.980192:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468782016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.980195:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.980198:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414277 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d640 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980206:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414277 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d640 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.980210:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414277 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d640 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.980213:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:1.0:1651532164.980220:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468782016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (150us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.980223:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5459
00000100:00100000:1.0:1651532164.980250:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.980291:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468782144
00000100:00100000:1.0:1651532164.980304:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5460
00000100:00100000:1.0:1651532164.980305:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468782144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.980309:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532164.980311:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41427e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d647 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980318:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41427e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d647 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.980322:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41427e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d647 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.980325:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:1.0:1651532164.980335:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468782144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532164.980337:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5460
00000100:00100000:1.0:1651532164.980642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.980650:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.980657:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.980663:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532164.980674:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468782336
00000100:00100000:0.0:1651532164.980674:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468782400
00000100:00100000:0.0:1651532164.980682:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468782528
00000100:00100000:1.0:1651532164.980683:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468782272
00000100:00100000:0.0:1651532164.980687:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5461
00000100:00100000:1.0:1651532164.980689:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4938
00000100:00100000:0.0:1651532164.980689:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468782400:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532164.980691:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468782336:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532164.980692:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.980696:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414285 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d64e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980698:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980703:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.980704:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980707:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532164.980707:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980712:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.980713:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414285 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d64e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532164.980716:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.980717:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414285 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d64e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532164.980723:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4939
00000100:00100000:1.0:1651532164.980724:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468782272:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532164.980724:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:1.0:1651532164.980729:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980732:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532164.980733:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.980737:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468782400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.980740:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5461
00010000:00010000:1.0:1651532164.980743:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.980745:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5462
00010000:00010000:1.0:1651532164.980746:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532164.980747:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532164.980747:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468782528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532164.980750:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.980750:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532164.980752:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41429a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d655 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980753:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532164.980756:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532164.980758:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41429a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d655 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.980762:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41429a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d655 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532164.980765:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532164.980770:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468782528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532164.980772:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5462
00000001:00080000:1.0:1651532165.187971:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794131 is committed
00010000:00010000:1.0:1651532165.187987:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.187991:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188010:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.188015:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ff3878 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468777792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 605619us (605666us total) trans 158913794131 rc 0/0
00010000:00010000:0.0:1651532165.188016:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.188017:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.188018:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4930
00010000:00010000:0.0:1651532165.188021:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188027:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.188027:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.188028:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188031:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188035:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.188035:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.188036:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188038:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188050:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188053:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4141ac lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->9908223] (req 405504->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188062:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.188065:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188065:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.188069:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.188452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.188463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.188465:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468782912
00000100:00100000:1.0:1651532165.188472:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.188488:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468783040
00000100:00100000:0.0:1651532165.188492:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468783104
00000100:00100000:0.0:1651532165.188495:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5463
00000100:00100000:0.0:1651532165.188497:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468782912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532165.188498:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5464
00000100:00100000:1.0:1651532165.188500:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468783040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.188501:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.188504:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.188504:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4142a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d65c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.188508:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142a8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d663 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188510:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.188513:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4142a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d65c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.188514:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.188517:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d663 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.188518:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4142a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d65c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.188521:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:1.0:1651532165.188522:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d663 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.188525:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532165.188536:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468782912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.188539:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5463
00000100:00100000:1.0:1651532165.188542:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468783040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.188545:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5465
00000100:00100000:1.0:1651532165.188546:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5464
00000100:00100000:0.0:1651532165.188547:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468783104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.188549:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.188552:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4142af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d66a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.188558:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.188562:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188568:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.188570:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4142af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d66a expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.188574:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4142af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d66a expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532165.188576:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000379b91d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468779392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 497646us (497685us total) trans 0 rc 36864/36864
00010000:00010000:0.0:1651532165.188577:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532165.188579:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4932
00000100:00100000:0.0:1651532165.188583:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468783104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (111us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532165.188585:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.188586:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5465
00010000:00010000:1.0:1651532165.188588:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532165.188589:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.188592:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.188597:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188598:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.188600:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4141f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1318912->10096639] (req 1318912->10096639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188602:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.188617:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a1fef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468777856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 606190us (606248us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532165.188620:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4931
00010000:00010000:0.0:1651532165.188631:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188634:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.188635:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188641:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188646:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.188646:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.188647:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188650:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188657:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188660:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4141b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1130496->9187327] (req 1130496->9187327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188664:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.188667:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.189037:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.189059:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468783424
00000100:00100000:1.0:1651532165.189064:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.189073:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5466
00000100:00100000:0.0:1651532165.189075:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468783424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.189079:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532165.189083:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532165.189083:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4142b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d671 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.189091:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4142b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d671 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532165.189092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532165.189101:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4142b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d671 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532165.189102:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468783360
00010000:00010000:0.0:1651532165.189104:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532165.189112:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468783296
00000100:00100000:0.0:1651532165.189119:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468783424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.189122:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5466
00000100:00100000:1.0:1651532165.189123:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4940
00000100:00100000:1.0:1651532165.189125:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468783360:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532165.189127:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468783552
00000100:00100000:0.0:1651532165.189135:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5467
00000100:00100000:0.0:1651532165.189136:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468783552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.189137:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.189139:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.189142:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532165.189142:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4142c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d678 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.189143:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.189146:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532165.189147:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.189151:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.189151:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4142c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d678 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.189155:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.189155:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4142c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d678 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.189159:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532165.189162:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4941
00000100:00100000:1.0:1651532165.189164:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043cbf4a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468783296:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532165.189165:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468783552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.189167:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5467
00010000:00010000:1.0:1651532165.189168:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.189172:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532165.189172:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.189175:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532165.189175:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.189182:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.189185:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.189439:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.189457:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468783936
00000100:00100000:0.0:1651532165.189464:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5468
00000100:00100000:0.0:1651532165.189466:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468783936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.189469:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.189472:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4142d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d67f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.189479:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4142d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d67f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.189483:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4142d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d67f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.189487:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532165.189516:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468783936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.189518:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5468
00000100:00100000:1.0:1651532165.189535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.189547:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468784064
00000100:00100000:0.0:1651532165.189553:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5469
00000100:00100000:0.0:1651532165.189555:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468784064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.189557:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.189561:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4142d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d686 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.189570:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4142d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d686 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.189573:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4142d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d686 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.189577:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532165.189589:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468784064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.189591:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5469
00000100:00100000:1.0:1651532165.189762:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.189773:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468784256
00000100:00100000:0.0:1651532165.189780:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5470
00000100:00100000:0.0:1651532165.189782:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468784256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.189785:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.189789:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4142e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d68d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.189795:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4142e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d68d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.189799:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4142e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d68d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.189817:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532165.189831:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cb55821 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468784256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.189834:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5470
00000100:00100000:1.0:1651532165.190064:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.190075:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468784512
00000100:00100000:0.0:1651532165.190083:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5471
00000100:00100000:0.0:1651532165.190084:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468784512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.190088:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.190091:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d694 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.190098:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d694 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.190102:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d694 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.190105:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532165.190118:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468784512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.190121:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5471
00000001:00080000:1.0:1651532165.287988:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794132 is committed
00010000:00010000:0.0:1651532165.288017:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288028:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.288050:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001de03696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468779328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 597083us (597140us total) trans 158913794132 rc 0/0
00000100:00100000:0.0:1651532165.288054:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4933
00010000:00010000:0.0:1651532165.288062:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288065:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.288066:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288069:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288074:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.288075:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.288076:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288079:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288086:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288089:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414200 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [569344->6213631] (req 569344->6213631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288094:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288097:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.288438:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.288448:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.288456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.288465:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.288480:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468784832
00000100:00100000:1.0:1651532165.288492:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468784768
00000100:00100000:1.0:1651532165.288499:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4942
00000100:00100000:1.0:1651532165.288501:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468784832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532165.288508:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.288513:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532165.288514:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.288517:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532165.288518:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.288522:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.288526:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.288528:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4943
00000100:00100000:0.0:1651532165.288531:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468784768:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532165.288533:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468784896
00010000:00010000:0.0:1651532165.288539:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.288542:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468785088
00000100:00100000:1.0:1651532165.288548:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5472
00000100:00100000:1.0:1651532165.288550:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468784896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.288553:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.288554:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532165.288555:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4142fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d69b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288555:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288558:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532165.288558:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288563:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.288564:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4142fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d69b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.288567:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.288568:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4142fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d69b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.288572:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532165.288574:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5473
00000100:00100000:0.0:1651532165.288576:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097358b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468785088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.288579:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532165.288583:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468784896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (135us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.288586:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5472
00010000:00010000:0.0:1651532165.288590:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414303 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6a2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.288597:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414303 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6a2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.288601:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414303 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6a2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.288605:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532165.288619:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097358b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468785088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (154us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.288622:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5473
00000100:00100000:1.0:1651532165.288883:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.288891:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468785280
00000100:00100000:1.0:1651532165.288898:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5474
00000100:00100000:1.0:1651532165.288900:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468785280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.288903:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.288907:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41430a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6a9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.288914:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41430a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6a9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.288918:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41430a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6a9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.288921:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532165.288931:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468785280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.288933:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5474
00000001:00080000:1.0:1651532165.354700:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794133 is committed
00010000:00010000:0.0:1651532165.354729:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.354733:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.354753:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468780480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 555922us (555979us total) trans 158913794133 rc 0/0
00010000:00010000:1.0:1651532165.354756:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.354756:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4934
00010000:00010000:1.0:1651532165.354761:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532165.354762:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.354765:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.354774:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.354775:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.354776:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.354779:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.354788:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.354791:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414223 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2269184->9900031] (req 2269184->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.354797:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.354801:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.355110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.355123:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.355135:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468785408
00010000:00010000:0.0:1651532165.355140:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.355146:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468785536
00010000:00010000:0.0:1651532165.355150:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.355152:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5475
00000100:00100000:1.0:1651532165.355154:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468785408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.355157:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.355161:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414311 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6b0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.355168:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468780544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 556302us (556385us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532165.355171:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4935
00010000:00010000:1.0:1651532165.355172:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.355175:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414311 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6b0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.355178:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355179:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414311 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6b0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.355182:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532165.355183:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00010000:00010000:0.0:1651532165.355183:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355186:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355191:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.355191:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532165.355192:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468785408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (83us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532165.355192:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.355195:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5475
00010000:00010000:0.0:1651532165.355195:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355198:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.355199:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.355199:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.355200:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5476
00000100:00100000:1.0:1651532165.355201:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468785536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.355204:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.355205:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355206:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414318 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6b7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355215:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355218:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41422a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4227072->10448895] (req 4227072->10448895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355219:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414318 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6b7 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.355223:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355224:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414318 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6b7 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.355226:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355227:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:1.0:1651532165.355232:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468785536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.355235:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5476
00010000:00010000:1.0:1651532165.355241:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355244:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355430:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355434:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.355453:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468781504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 443055us (443106us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532165.355457:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355462:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.355463:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.355464:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4937
00010000:00010000:0.0:1651532165.355466:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355471:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355477:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414262 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [45056->8867839] (req 45056->8867839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.355672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.355680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.355690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.355692:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468785856
00000100:00100000:1.0:1651532165.355699:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468785728
00000100:00100000:0.0:1651532165.355714:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4944
00000100:00100000:0.0:1651532165.355716:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468785856:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532165.355717:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4945
00000100:00100000:1.0:1651532165.355718:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468785728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532165.355724:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355725:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355728:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.355729:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355732:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532165.355732:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355736:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532165.355737:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355740:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532165.355741:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355745:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355745:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355748:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.355749:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.355757:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468785920
00000100:00100000:0.0:1651532165.355764:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5477
00000100:00100000:0.0:1651532165.355765:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468785920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.355768:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.355771:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41432d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6be expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355778:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41432d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6be expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.355782:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41432d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6be expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.355786:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532165.355796:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468785920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.355829:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5477
00000100:00100000:1.0:1651532165.355835:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.355870:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468786176
00000100:00100000:0.0:1651532165.355877:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5478
00000100:00100000:1.0:1651532165.355878:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.355878:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468786176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.355887:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532165.355889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532165.355890:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414334 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6c5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.355896:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468786240
00010000:00010000:0.0:1651532165.355898:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414334 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6c5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532165.355901:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468786368
00010000:00010000:0.0:1651532165.355902:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414334 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6c5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532165.355904:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5479
00000100:00100000:1.0:1651532165.355905:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468786240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.355905:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:1.0:1651532165.355909:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.355912:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41433b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6cc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.355915:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468786176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.355918:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5478
00010000:00010000:1.0:1651532165.355919:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41433b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6cc expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532165.355922:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5480
00010000:00010000:1.0:1651532165.355923:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41433b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6cc expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532165.355924:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468786368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.355927:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:0.0:1651532165.355927:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.355929:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414342 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6d3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.355934:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414342 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6d3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532165.355935:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468786240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.355937:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5479
00010000:00010000:0.0:1651532165.355938:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414342 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6d3 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.355941:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532165.355947:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468786368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.355949:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5480
00000100:00100000:1.0:1651532165.356196:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.356208:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468786624
00000100:00100000:0.0:1651532165.356216:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5481
00000100:00100000:0.0:1651532165.356218:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468786624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.356221:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.356225:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414349 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6da expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.356234:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414349 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6da expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.356238:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414349 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6da expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.356256:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532165.356269:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468786624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.356272:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5481
00000100:00100000:1.0:1651532165.356297:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.356315:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468786752
00000100:00100000:0.0:1651532165.356322:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5482
00000100:00100000:0.0:1651532165.356324:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468786752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.356327:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.356330:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414350 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6e1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.356337:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414350 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6e1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.356340:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414350 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6e1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.356344:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532165.356362:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468786752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.356365:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5482
00000100:00100000:1.0:1651532165.356559:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.356569:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468787008
00000100:00100000:0.0:1651532165.356577:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5483
00000100:00100000:0.0:1651532165.356578:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468787008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.356582:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.356585:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414357 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6e8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.356592:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414357 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6e8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.356596:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414357 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6e8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.356599:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532165.356608:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468787008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.356610:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5483
00000100:00100000:1.0:1651532165.356834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.356842:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468787136
00000100:00100000:0.0:1651532165.356850:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5484
00000100:00100000:0.0:1651532165.356851:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468787136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.356854:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.356857:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41435e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6ef expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.356864:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41435e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6ef expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.356868:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41435e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6ef expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.356872:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532165.356881:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468787136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (47us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.356883:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5484
00000001:00080000:1.0:1651532165.405020:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794134 is committed
00010000:00010000:0.0:1651532165.405051:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405056:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.405076:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468781440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 492687us (492737us total) trans 158913794134 rc 0/0
00010000:00010000:1.0:1651532165.405079:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.405079:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4936
00010000:00010000:1.0:1651532165.405084:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532165.405085:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405088:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405094:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.405095:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.405096:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405099:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405106:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405109:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41425b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9351168->9543679] (req 9351168->9543679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405114:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405119:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.405320:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.405328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.405338:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468787328
00000100:00100000:0.0:1651532165.405348:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468787264
00000100:00100000:0.0:1651532165.405369:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4946
00000100:00100000:0.0:1651532165.405370:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468787328:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532165.405378:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4947
00010000:00010000:0.0:1651532165.405378:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.405380:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468787264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532165.405382:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.405383:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405386:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532165.405387:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405388:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405391:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405392:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532165.405394:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405396:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532165.405397:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405401:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405401:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405405:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405413:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405416:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.405431:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468782336:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424740us (424790us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532165.405434:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4938
00010000:00010000:0.0:1651532165.405440:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405444:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.405445:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405447:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405452:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.405453:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.405453:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405456:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405468:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405471:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f41428c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->10244095] (req 3342336->10244095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405476:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.405479:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.405741:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.405748:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468787520
00000100:00100000:0.0:1651532165.405756:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5485
00000100:00100000:0.0:1651532165.405757:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468787520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.405761:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.405764:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414373 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6f6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.405772:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414373 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6f6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.405776:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414373 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6f6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.405779:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532165.405788:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468787520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.405791:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5485
00000001:00080000:1.0:1651532165.538088:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794135 is committed
00010000:00010000:1.0:1651532165.538103:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.538107:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.538132:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468782272:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557406us (557481us total) trans 158913794135 rc 0/0
00010000:00010000:0.0:1651532165.538134:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.538135:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4939
00010000:00010000:0.0:1651532165.538138:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.538139:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538143:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538148:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.538149:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.538149:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538153:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538162:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538165:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414293 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1085440->10162175] (req 1085440->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.538178:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.538183:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.538559:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.538578:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.538590:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.538599:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.538605:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468787776
00000100:00100000:1.0:1651532165.538607:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.538620:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468787840
00010000:00010000:1.0:1651532165.538625:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.538625:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4948
00000100:00100000:0.0:1651532165.538627:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468787776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532165.538629:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538633:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538638:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532165.538639:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538641:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532165.538642:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.538647:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468783360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 349521us (349588us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532165.538650:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4940
00010000:00010000:0.0:1651532165.538653:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.538656:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4949
00010000:00010000:0.0:1651532165.538656:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.538658:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bb47476 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468787840:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532165.538663:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468787904
00010000:00010000:1.0:1651532165.538667:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.538672:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468787968
00000100:00100000:0.0:1651532165.538675:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468788096
00010000:00010000:1.0:1651532165.538678:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532165.538678:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5486
00010000:00010000:1.0:1651532165.538679:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.538679:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468787904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.538682:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532165.538682:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.538683:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538685:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414388 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d6fd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.538687:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538689:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.538691:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538692:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414388 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6fd expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.538696:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414388 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d6fd expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.538697:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.538700:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.538700:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532165.538701:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.538704:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.538708:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532165.538708:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468787904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (118us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532165.538709:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.538710:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.538711:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5486
00010000:00010000:1.0:1651532165.538713:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.538715:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5487
00000100:00100000:0.0:1651532165.538716:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468787968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.538718:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.538719:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538720:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41438f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d704 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.538722:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4142bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3035136->9916415] (req 3035136->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538726:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41438f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d704 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.538727:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.538730:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538733:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41438f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d704 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.538736:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532165.538740:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468787968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (141us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.538742:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5487
00000100:00100000:0.0:1651532165.538746:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5488
00000100:00100000:0.0:1651532165.538747:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468788096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.538749:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.538751:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414396 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d70b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.538756:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414396 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d70b expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.538760:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414396 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d70b expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.538763:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532165.538767:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468788096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (160us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.538770:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5488
00000100:00100000:0.0:1651532165.539131:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.539139:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.539152:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.539161:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468788224
00000100:00100000:1.0:1651532165.539164:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468788416
00000100:00100000:0.0:1651532165.539170:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468788480
00000100:00100000:0.0:1651532165.539173:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5489
00000100:00100000:0.0:1651532165.539175:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468788224:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532165.539178:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5490
00010000:00010000:0.0:1651532165.539178:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532165.539180:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468788480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.539182:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41439d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d712 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.539183:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.539187:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143a4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d720 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.539189:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41439d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d712 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.539193:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41439d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d712 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.539196:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d720 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.539196:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:1.0:1651532165.539200:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d720 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.539204:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:0.0:1651532165.539208:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468788224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.539211:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5489
00000100:00100000:0.0:1651532165.539216:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5491
00000100:00100000:0.0:1651532165.539218:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468788416:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532165.539220:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468788480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (68us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532165.539220:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.539222:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4143ab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d719 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.539223:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5490
00010000:00010000:0.0:1651532165.539228:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4143ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d719 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.539232:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4143ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d719 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.539235:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532165.539241:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468788416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.539243:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5491
00000001:00080000:1.0:1651532165.629819:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794136 is committed
00010000:00010000:1.0:1651532165.629834:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.629838:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.629860:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043cbf4a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468783296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 440695us (440776us total) trans 158913794136 rc 0/0
00010000:00010000:0.0:1651532165.629862:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.629863:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4941
00010000:00010000:0.0:1651532165.629866:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.629867:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.629871:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.629876:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.629877:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.629878:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.629881:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.629890:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.629896:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4142cb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->8695807] (req 16384->8695807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.629909:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.629913:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.630203:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.630212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.630218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.630230:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.630236:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468789120
00000100:00100000:1.0:1651532165.630243:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468788992
00000100:00100000:0.0:1651532165.630247:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468789184
00000100:00100000:0.0:1651532165.630254:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5492
00000100:00100000:0.0:1651532165.630255:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468789120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.630259:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532165.630262:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468788928
00010000:00010000:0.0:1651532165.630262:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4143b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d727 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630267:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532165.630268:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4950
00000100:00100000:1.0:1651532165.630270:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468788992:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532165.630270:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4143b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d727 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.630274:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4143b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d727 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.630277:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630277:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:1.0:1651532165.630281:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.630283:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532165.630283:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.630290:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468789120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (71us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532165.630292:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.630292:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5492
00000100:00100000:0.0:1651532165.630297:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5493
00000100:00100000:1.0:1651532165.630299:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4951
00000100:00100000:0.0:1651532165.630299:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468789184:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532165.630301:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468788928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532165.630301:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.630303:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4143c0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d72e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.630306:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630308:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.630310:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532165.630310:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.630313:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532165.630314:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630317:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4143c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d72e expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.630318:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630321:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4143c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d72e expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.630324:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630324:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532165.630330:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468789184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.630332:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5493
00010000:00010000:1.0:1651532165.630334:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.630336:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.630364:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468784832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341862us (341926us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532165.630364:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.630367:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4942
00010000:00010000:0.0:1651532165.630368:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.630369:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630372:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630377:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.630377:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.630378:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630384:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630391:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630393:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4142ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [614400->8876031] (req 614400->8876031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630398:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630401:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.630682:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.630702:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468789312
00000100:00100000:0.0:1651532165.630710:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5494
00000100:00100000:0.0:1651532165.630712:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468789312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.630716:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.630719:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4143ce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d735 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630727:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4143ce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d735 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.630731:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4143ce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d735 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.630735:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532165.630753:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468789312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.630756:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5494
00000100:00100000:1.0:1651532165.630876:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.630887:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468789504
00000100:00100000:1.0:1651532165.630888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.630899:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468789696
00000100:00100000:0.0:1651532165.630903:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5495
00000100:00100000:0.0:1651532165.630905:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468789504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.630908:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.630912:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4143d5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d73c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630919:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4143d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d73c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.630922:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4143d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d73c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.630926:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532165.630939:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468789504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.630942:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5495
00000100:00100000:0.0:1651532165.630947:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5496
00000100:00100000:0.0:1651532165.630948:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468789696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.630952:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.630954:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4143dc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d743 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.630959:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4143dc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d743 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.630963:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4143dc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d743 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.630966:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532165.630976:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468789696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.630979:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5496
00000001:00080000:1.0:1651532165.754795:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794137 is committed
00002000:00010000:0.0:1651532165.754824:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532164 -> 1651532165
00010000:00010000:0.0:1651532165.754827:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.754831:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.754851:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468784768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466320us (466395us total) trans 158913794137 rc 0/0
00000100:00100000:0.0:1651532165.754854:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4943
00010000:00010000:1.0:1651532165.754856:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.754862:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532165.754863:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.754867:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.754873:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.754874:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.754876:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.754879:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.754889:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.754904:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4142f5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1609728->8253439] (req 1609728->8253439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.754906:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.754913:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.755209:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.755219:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.755225:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.755236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.755242:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.755246:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468790080
00000100:00100000:1.0:1651532165.755262:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468790016
00000100:00100000:1.0:1651532165.755269:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4952
00000100:00100000:1.0:1651532165.755271:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468790080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532165.755279:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.755282:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.755291:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468790144
00010000:00010000:1.0:1651532165.755296:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532165.755296:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468790208
00010000:00010000:1.0:1651532165.755298:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.755299:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468790272
00010000:00010000:1.0:1651532165.755301:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00000100:00100000:0.0:1651532165.755301:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468790336
00010000:00010000:1.0:1651532165.755302:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.755303:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5497
00000100:00100000:0.0:1651532165.755305:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046351af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468790144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.755307:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755308:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.755312:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4143ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d74a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.755314:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755317:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.755320:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4143ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d74a expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532165.755323:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4953
00010000:00010000:0.0:1651532165.755324:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4143ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d74a expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532165.755325:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468790016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532165.755327:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532165.755331:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.755334:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532165.755335:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.755341:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046351af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468790144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (121us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.755343:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5497
00010000:00010000:1.0:1651532165.755346:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.755348:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00000100:00100000:0.0:1651532165.755348:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5498
00000100:00100000:0.0:1651532165.755360:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468790208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.755361:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755363:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.755366:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755366:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4143f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d751 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.755369:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755370:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.755372:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755373:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4143f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d751 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.755377:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4143f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d751 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.755380:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532165.755386:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468790208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (150us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.755389:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5498
00000100:00100000:0.0:1651532165.755393:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5499
00000100:00100000:0.0:1651532165.755394:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468790272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.755397:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.755398:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4143ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d758 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755405:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.755407:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4143ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d758 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.755410:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4143ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d758 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.755413:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532165.755420:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468790272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (178us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.755423:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5499
00000100:00100000:0.0:1651532165.755426:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5500
00000100:00100000:0.0:1651532165.755428:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468790336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.755430:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.755440:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414406 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d75f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755445:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.755447:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414406 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d75f expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.755451:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414406 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d75f expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.755455:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532165.755461:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468790336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (179us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.755463:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5500
00010000:00010000:0.0:1651532165.755475:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755478:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.755490:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468785856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 399773us (399819us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532165.755492:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4944
00010000:00010000:0.0:1651532165.755497:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755501:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.755502:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755505:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755509:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.755510:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.755511:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755514:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755528:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755532:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41431f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->5337087] (req 638976->5337087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.755538:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.755542:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.755649:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.755657:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468790464
00000100:00100000:0.0:1651532165.755670:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5501
00000100:00100000:0.0:1651532165.755672:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468790464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.755675:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.755678:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41440d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d766 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755719:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41440d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d766 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.755723:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41440d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d766 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.755726:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532165.755735:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468790464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.755737:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5501
00000100:00100000:0.0:1651532165.755772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.755780:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468790592
00000100:00100000:0.0:1651532165.755790:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5502
00000100:00100000:0.0:1651532165.755792:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468790592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.755795:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.755799:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414414 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d76d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.755823:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414414 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d76d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.755827:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414414 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d76d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.755830:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532165.755843:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468790592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.755846:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5502
00000100:00100000:0.0:1651532165.755921:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.755932:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468790720
00000100:00100000:1.0:1651532165.755946:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5503
00000100:00100000:1.0:1651532165.755948:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468790720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.755952:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.755956:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41441b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d774 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.755965:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41441b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d774 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.755970:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41441b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d774 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.755973:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:1.0:1651532165.756010:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468790720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.756014:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5503
00000100:00100000:0.0:1651532165.756040:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.756057:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468790976
00000100:00100000:1.0:1651532165.756069:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5504
00000100:00100000:1.0:1651532165.756070:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b9096eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468790976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.756074:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.756078:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414422 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d77b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.756085:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414422 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d77b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.756089:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414422 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d77b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.756092:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532165.756101:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b9096eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468790976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.756104:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5504
00000001:00080000:1.0:1651532165.888130:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794138 is committed
00010000:00010000:1.0:1651532165.888147:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888151:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.888177:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468785728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532458us (532497us total) trans 158913794138 rc 0/0
00010000:00010000:0.0:1651532165.888179:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.888181:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4945
00010000:00010000:0.0:1651532165.888184:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003325411e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532165.888185:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888188:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888196:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.888197:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.888198:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888201:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888208:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888211:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414326 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->9367551] (req 2641920->9367551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888227:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888237:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.888632:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.888642:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.888659:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.888672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.888680:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.888682:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468791552
00000100:00100000:0.0:1651532165.888696:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468791488
00000100:00100000:0.0:1651532165.888705:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4954
00000100:00100000:0.0:1651532165.888707:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468791552:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532165.888710:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4955
00000100:00100000:1.0:1651532165.888713:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468791488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532165.888713:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888717:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.888718:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888721:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532165.888722:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888722:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888729:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532165.888730:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888733:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532165.888734:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888737:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888738:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888741:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888742:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.888749:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468791424
00000100:00100000:0.0:1651532165.888756:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468791616
00000100:00100000:0.0:1651532165.888759:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468791744
00000100:00100000:0.0:1651532165.888761:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5505
00010000:00010000:1.0:1651532165.888763:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.888763:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468791424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.888766:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888766:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.888768:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414437 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d782 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.888773:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.888776:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414437 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d782 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.888780:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414437 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d782 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532165.888782:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468787328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483410us (483462us total) trans 0 rc 36864/36864
00010000:00010000:0.0:1651532165.888783:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532165.888785:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4946
00000100:00100000:0.0:1651532165.888792:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468791424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (160us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.888793:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5506
00000100:00100000:1.0:1651532165.888795:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468791616:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532165.888795:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5505
00010000:00010000:1.0:1651532165.888798:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532165.888800:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5507
00010000:00010000:1.0:1651532165.888801:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41443e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d789 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.888802:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468791744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.888819:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.888821:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.888822:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414445 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d790 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888824:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41443e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d789 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.888826:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532165.888828:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414445 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d790 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.888829:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41443e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d789 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.888832:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00010000:00010000:0.0:1651532165.888832:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414445 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d790 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.888836:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532165.888840:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468791616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (168us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.888842:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468791744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (162us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.888844:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5506
00000100:00100000:0.0:1651532165.888846:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5507
00010000:00010000:1.0:1651532165.888852:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888855:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532165.888856:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888859:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888863:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.888864:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532165.888865:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888868:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888875:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888878:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414365 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->9883647] (req 237568->9883647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888883:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.888912:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.889309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.889317:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.889322:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.889328:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.889337:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468791936
00000100:00100000:0.0:1651532165.889342:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468792128
00000100:00100000:0.0:1651532165.889344:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468792192
00000100:00100000:0.0:1651532165.889346:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468792320
00000100:00100000:0.0:1651532165.889349:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5508
00000100:00100000:0.0:1651532165.889361:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468791936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.889366:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.889369:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41444c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d797 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.889377:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41444c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d797 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889380:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41444c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d797 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889384:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532165.889389:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5509
00000100:00100000:1.0:1651532165.889391:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468792128:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532165.889393:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468791936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (85us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532165.889395:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532165.889396:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5508
00010000:00010000:1.0:1651532165.889399:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414453 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d79e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.889401:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5510
00000100:00100000:0.0:1651532165.889403:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468792192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.889405:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.889407:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414453 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d79e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889407:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41445a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7a5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.889412:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414453 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d79e expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889413:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41445a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7a5 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.889415:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00010000:00010000:0.0:1651532165.889416:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41445a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7a5 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889422:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532165.889424:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468792128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.889427:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5509
00000100:00100000:0.0:1651532165.889428:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468792192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.889430:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5510
00000100:00100000:1.0:1651532165.889433:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5511
00000100:00100000:1.0:1651532165.889435:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468792320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.889437:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532165.889439:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414461 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7ac expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.889461:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414461 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7ac expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.889482:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414461 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7ac expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.889486:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532165.889503:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468792320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 67us (174us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.889508:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5511
00000100:00100000:1.0:1651532165.889711:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.889722:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532165.889735:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468792448
00000100:00100000:0.0:1651532165.889740:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468792512
00000100:00100000:1.0:1651532165.889746:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5512
00000100:00100000:1.0:1651532165.889748:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c39d25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468792448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532165.889751:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532165.889753:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5513
00010000:00010000:1.0:1651532165.889755:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414468 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7b3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532165.889755:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468792512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.889758:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.889761:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41446f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7ba expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532165.889762:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414468 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7b3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.889767:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414468 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7b3 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889768:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41446f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7ba expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532165.889770:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00010000:00010000:0.0:1651532165.889772:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41446f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7ba expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889776:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532165.889782:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c39d25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468792448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532165.889786:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5512
00000100:00100000:0.0:1651532165.889790:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468792512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.889793:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5513
00000100:00100000:0.0:1651532165.889851:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.889874:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468792704
00000100:00100000:0.0:1651532165.889881:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5514
00000100:00100000:0.0:1651532165.889883:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468792704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.889886:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.889890:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414476 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7c1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532165.889892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532165.889896:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414476 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7c1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889907:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414476 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7c1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889911:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532165.889920:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468792704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.889923:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5514
00000100:00100000:0.0:1651532165.889927:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468792832
00000100:00100000:0.0:1651532165.889938:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5515
00000100:00100000:0.0:1651532165.889940:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468792832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.889943:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.889946:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41447d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7c8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.889952:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41447d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7c8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889955:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41447d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7c8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.889961:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532165.889967:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468792832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.889970:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5515
00000100:00100000:1.0:1651532165.890212:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532165.890223:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468793152
00000100:00100000:0.0:1651532165.890231:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5516
00000100:00100000:0.0:1651532165.890233:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468793152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532165.890236:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532165.890239:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414484 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7cf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532165.890246:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414484 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7cf expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.890250:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414484 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7cf expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532165.890253:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532165.890263:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468793152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532165.890265:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5516
00000001:00080000:1.0:1651532166.013111:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794139 is committed
00010000:00010000:1.0:1651532166.013127:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.013131:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013153:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.013155:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468787264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 607774us (607826us total) trans 158913794139 rc 0/0
00010000:00010000:0.0:1651532166.013157:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532166.013158:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4947
00010000:00010000:0.0:1651532166.013159:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013162:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013167:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.013168:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.013169:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013172:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013179:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013182:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41436c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2752512->10027007] (req 2752512->10027007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013187:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013190:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.013480:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.013493:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.013496:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468793344
00000100:00100000:0.0:1651532166.013500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.013510:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468793408
00000100:00100000:1.0:1651532166.013514:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468793472
00000100:00100000:0.0:1651532166.013518:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5517
00000100:00100000:0.0:1651532166.013520:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468793408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.013523:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532166.013526:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4956
00010000:00010000:0.0:1651532166.013527:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41448b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7d6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.013529:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468793344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532166.013538:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.013562:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.013564:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013564:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41448b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7d6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.013567:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532166.013567:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013574:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41448b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7d6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.013575:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013578:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:1.0:1651532166.013579:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.013587:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4957
00000100:00100000:1.0:1651532166.013589:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468793472:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532166.013589:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c664d994 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468793408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.013592:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5517
00010000:00010000:1.0:1651532166.013594:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.013597:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.013598:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.013601:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532166.013601:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.013605:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.013608:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.013625:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.013654:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468793600
00000100:00100000:0.0:1651532166.013661:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5518
00000100:00100000:0.0:1651532166.013663:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468793600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.013666:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.013670:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4144a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7dd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.013676:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4144a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7dd expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.013680:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4144a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7dd expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.013684:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532166.013693:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468793600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.013696:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5518
00000001:00080000:1.0:1651532166.088190:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794140 is committed
00010000:00010000:0.0:1651532166.088216:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088220:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.088241:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468787776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549613us (549682us total) trans 158913794140 rc 0/0
00000100:00100000:0.0:1651532166.088244:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4948
00010000:00010000:1.0:1651532166.088245:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088250:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532166.088251:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088255:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088261:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.088261:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.088262:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088265:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088268:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.088269:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.088269:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088272:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088295:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088299:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41437a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9842687] (req 1327104->9842687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088306:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088309:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088341:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088345:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088368:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088371:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088387:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088391:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.088392:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088396:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088406:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.088407:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bb47476 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468787840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 549748us (549828us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532166.088411:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4949
00010000:00010000:0.0:1651532166.088412:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414381 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5013504->5017599] (req 5013504->5017599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.088565:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.088583:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468793920
00000100:00100000:0.0:1651532166.088591:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5519
00010000:00010000:1.0:1651532166.088593:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.088593:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468793920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.088596:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.088598:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088600:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4144a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7e4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088607:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.088610:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4144a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7e4 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532166.088629:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468788992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458358us (458426us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532166.088632:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4950
00010000:00010000:0.0:1651532166.088649:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4144a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7e4 expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.088653:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:1.0:1651532166.088655:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088661:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532166.088661:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468793920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (97us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532166.088662:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.088664:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5519
00010000:00010000:1.0:1651532166.088665:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088671:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.088671:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.088672:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088675:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.088678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532166.088691:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088694:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4143b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [53248->10338303] (req 53248->10338303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.088696:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532166.088706:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088726:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.088759:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468794112
00000100:00100000:0.0:1651532166.088778:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468794048
00000100:00100000:1.0:1651532166.088785:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4958
00000100:00100000:1.0:1651532166.088787:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468794112:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532166.088794:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4959
00000100:00100000:0.0:1651532166.088796:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468794048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532166.088801:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088815:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088820:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532166.088821:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088824:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532166.088824:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088828:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.088830:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088833:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532166.088833:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088837:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088838:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.088841:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.088841:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.089143:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.089150:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468794432
00000100:00100000:0.0:1651532166.089157:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5520
00000100:00100000:0.0:1651532166.089159:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468794432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.089162:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.089165:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4144bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7eb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.089173:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4144bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7eb expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.089180:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4144bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7eb expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.089183:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532166.089192:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468794432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.089195:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5520
00000001:00080000:1.0:1651532166.196510:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794141 is committed
00010000:00010000:1.0:1651532166.196526:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.196541:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.196565:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468788928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566262us (566353us total) trans 158913794141 rc 0/0
00000100:00100000:1.0:1651532166.196568:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4951
00010000:00010000:1.0:1651532166.196576:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.196580:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532166.196581:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.196584:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.196589:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.196589:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.196590:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.196593:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.196614:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.196618:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4143c7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6557696->9920511] (req 6557696->9920511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.196625:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.196628:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.196921:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.196932:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.196938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.196944:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468794688
00000100:00100000:0.0:1651532166.196945:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.196968:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468794624
00000100:00100000:0.0:1651532166.196974:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468794816
00000100:00100000:1.0:1651532166.196977:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4960
00000100:00100000:1.0:1651532166.196978:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468794688:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532166.196981:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468794880
00010000:00010000:1.0:1651532166.196985:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.196990:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5521
00000100:00100000:0.0:1651532166.196991:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468794816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.196995:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.196997:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.196998:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532166.196999:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.196999:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4144ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7f2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.197002:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197005:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.197008:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4144ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7f2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532166.197011:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4961
00010000:00010000:0.0:1651532166.197012:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4144ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7f2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532166.197013:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b9b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468794624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532166.197017:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197018:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532166.197021:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.197022:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.197025:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.197027:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532166.197028:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.197028:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468794816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.197031:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5521
00010000:00010000:1.0:1651532166.197032:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.197035:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.197036:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5522
00000100:00100000:0.0:1651532166.197037:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468794880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.197038:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197040:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.197042:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4144d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d7f9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197046:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.197048:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4144d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7f9 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.197050:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.197053:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197058:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4144d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d7f9 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.197067:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532166.197072:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468790080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441800us (441863us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532166.197074:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468794880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (128us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.197075:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4952
00000100:00100000:0.0:1651532166.197077:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5522
00010000:00010000:0.0:1651532166.197084:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197087:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.197088:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197092:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197096:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.197097:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.197098:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197101:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197111:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.197114:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197115:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4143e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1331200->9408511] (req 1331200->9408511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.197119:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.197142:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.197165:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468794944
00000100:00100000:0.0:1651532166.197208:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5523
00000100:00100000:0.0:1651532166.197210:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468794944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.197214:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.197217:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4144df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d800 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197224:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4144df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d800 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.197231:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4144df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d800 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.197250:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532166.197260:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468794944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.197263:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5523
00000100:00100000:0.0:1651532166.197504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.197511:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468795072
00000100:00100000:0.0:1651532166.197523:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5524
00000100:00100000:0.0:1651532166.197525:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468795072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.197528:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.197532:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4144e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d807 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197539:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4144e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d807 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.197543:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4144e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d807 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.197546:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532166.197555:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468795072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.197560:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5524
00000100:00100000:0.0:1651532166.197605:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.197613:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468795328
00000100:00100000:0.0:1651532166.197622:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5525
00000100:00100000:0.0:1651532166.197624:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468795328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.197627:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.197630:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4144ed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d80e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.197637:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4144ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d80e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.197641:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4144ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d80e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.197644:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532166.197653:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468795328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.197656:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5525
00000001:00080000:1.0:1651532166.321521:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794142 is committed
00010000:00010000:1.0:1651532166.321536:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.321540:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.321563:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468790016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566237us (566337us total) trans 158913794142 rc 0/0
00000100:00100000:1.0:1651532166.321566:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4953
00010000:00010000:1.0:1651532166.321574:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.321577:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532166.321578:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.321581:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.321586:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.321587:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.321588:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.321591:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.321607:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.321611:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.321616:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.321621:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4143f1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->6676479] (req 172032->6676479) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.321933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.321945:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.321955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.321962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.321969:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468795648
00000100:00100000:0.0:1651532166.321970:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.321981:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468795584
00000100:00100000:0.0:1651532166.321982:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468795712
00000100:00100000:1.0:1651532166.321987:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4962
00000100:00100000:1.0:1651532166.321988:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468795648:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532166.321992:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468795776
00000100:00100000:0.0:1651532166.321995:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468795840
00000100:00100000:0.0:1651532166.321998:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5526
00000100:00100000:0.0:1651532166.321999:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468795712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.322001:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322003:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.322005:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.322006:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322006:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4144fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d815 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322009:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532166.322010:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322013:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.322016:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322016:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4144fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d815 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.322019:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322020:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4144fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d815 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.322024:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532166.322027:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4963
00000100:00100000:1.0:1651532166.322029:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468795584:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532166.322033:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468795712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.322036:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5526
00000100:00100000:0.0:1651532166.322041:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5527
00010000:00010000:1.0:1651532166.322042:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.322042:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468795776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.322045:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.322045:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.322046:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322047:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414509 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d81c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322049:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532166.322049:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322052:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.322054:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322054:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414509 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d81c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.322057:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322058:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414509 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d81c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.322061:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532166.322065:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5528
00000100:00100000:0.0:1651532166.322066:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468795776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.322067:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468795840:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532166.322068:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5527
00010000:00010000:1.0:1651532166.322070:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.322072:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414510 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d823 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322078:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.322079:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322082:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322087:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414510 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d823 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.322098:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414510 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d823 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532166.322098:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468791552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433390us (433455us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532166.322101:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4954
00010000:00010000:1.0:1651532166.322102:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:1.0:1651532166.322111:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468795840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (141us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.322114:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5528
00010000:00010000:1.0:1651532166.322123:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322126:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532166.322127:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322130:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322172:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.322172:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.322173:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322177:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322185:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322202:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414429 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4603904->9555967] (req 4603904->9555967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322210:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.322213:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.322475:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.322500:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468795968
00000100:00100000:0.0:1651532166.322511:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5529
00000100:00100000:0.0:1651532166.322512:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468795968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.322517:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.322521:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414517 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d82a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.322528:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414517 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d82a expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.322532:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414517 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d82a expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.322535:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532166.322544:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468795968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.322547:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5529
00000100:00100000:0.0:1651532166.368105:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532166.368114:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233344
00000100:00100000:0.0:1651532166.368127:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 69
00000100:00100000:0.0:1651532166.368129:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd511b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233344:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532166.368135:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 573440 granted 352522816 pending 200704 free 81138851840 avail 76966678528
00000100:00100000:0.0:1651532166.368147:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd511b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233344:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 17us (42us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532166.368150:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 69
00000001:00080000:1.0:1651532166.388247:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794143 is committed
00010000:00010000:1.0:1651532166.388263:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.388267:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.388291:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468791488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499577us (499631us total) trans 158913794143 rc 0/0
00010000:00010000:0.0:1651532166.388292:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.388294:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4955
00010000:00010000:0.0:1651532166.388297:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.388298:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388302:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388307:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.388308:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.388309:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388312:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388321:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388324:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414430 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [425984->8921087] (req 425984->8921087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.388345:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.388363:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.388690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.388705:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.388734:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468796352
00000100:00100000:1.0:1651532166.388735:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.388742:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.388752:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468796416
00000100:00100000:1.0:1651532166.388755:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.388763:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4964
00000100:00100000:0.0:1651532166.388765:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468796352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532166.388772:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388776:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532166.388777:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532166.388777:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388783:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532166.388784:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388788:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388797:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.388800:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468796480
00000100:00100000:0.0:1651532166.388817:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4965
00000100:00100000:0.0:1651532166.388819:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468796416:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532166.388820:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468796544
00000100:00100000:1.0:1651532166.388823:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468796608
00000100:00100000:1.0:1651532166.388825:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468796672
00010000:00010000:0.0:1651532166.388825:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388828:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532166.388829:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5530
00010000:00010000:0.0:1651532166.388829:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.388830:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468796480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.388832:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532166.388832:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.388834:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.388836:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.388839:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41452c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d831 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.388839:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.388847:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41452c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d831 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532166.388847:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5531
00000100:00100000:0.0:1651532166.388848:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468796544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.388851:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.388852:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f41452c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d831 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.388853:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414533 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d838 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.388855:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00010000:00010000:0.0:1651532166.388860:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414533 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d838 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.388864:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414533 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d838 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532166.388869:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468796480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.388872:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5530
00010000:00010000:0.0:1651532166.388874:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532166.388877:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5532
00000100:00100000:1.0:1651532166.388879:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468796608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.388882:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.388884:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41453a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d83f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.388884:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468796544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (141us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.388886:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5531
00010000:00010000:1.0:1651532166.388891:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41453a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d83f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532166.388892:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5533
00010000:00010000:1.0:1651532166.388894:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41453a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d83f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532166.388894:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468796672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.388896:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.388898:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00010000:00010000:0.0:1651532166.388898:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414541 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d846 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.388904:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468796608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (148us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532166.388904:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414541 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d846 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532166.388906:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5532
00010000:00010000:0.0:1651532166.388911:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414541 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d846 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.388914:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532166.388919:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468796672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.388921:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5533
00000100:00100000:1.0:1651532166.389220:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.389232:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468796800
00000100:00100000:0.0:1651532166.389240:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5534
00000100:00100000:0.0:1651532166.389241:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468796800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.389245:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.389248:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414548 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d84d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.389255:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414548 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d84d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.389259:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414548 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d84d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.389262:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532166.389272:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468796800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.389275:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5534
00000001:00080000:1.0:1651532166.504925:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794144 is committed
00010000:00010000:1.0:1651532166.504940:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.504944:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.504961:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468793344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491432us (491482us total) trans 158913794144 rc 0/0
00000100:00100000:1.0:1651532166.504965:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4956
00010000:00010000:1.0:1651532166.504971:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.504975:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532166.504976:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.504979:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.504984:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.504985:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.504986:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.504988:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.504995:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.504998:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414492 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->10063871] (req 589824->10063871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505003:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505006:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505231:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505236:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.505257:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468793472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491668us (491756us total) trans 0 rc 49152/49152
00000100:00100000:1.0:1651532166.505261:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4957
00010000:00010000:1.0:1651532166.505268:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505271:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532166.505272:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505275:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505280:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.505281:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.505281:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505295:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505312:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505317:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414499 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [454656->7811071] (req 454656->7811071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.505332:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.505337:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.505345:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.505372:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468797056
00000100:00100000:1.0:1651532166.505384:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5535
00000100:00100000:1.0:1651532166.505386:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051966bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468797056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.505399:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.505405:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41454f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d854 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505414:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41454f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d854 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.505418:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41454f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d854 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.505422:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532166.505433:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051966bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468797056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.505436:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5535
00000100:00100000:1.0:1651532166.505669:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.505678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.505684:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.505690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.505703:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.505712:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468797248
00000100:00100000:1.0:1651532166.505724:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468797312
00000100:00100000:1.0:1651532166.505730:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4966
00000100:00100000:1.0:1651532166.505732:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468797248:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532166.505739:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468797440
00010000:00010000:1.0:1651532166.505740:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505747:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532166.505751:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468797568
00000100:00100000:0.0:1651532166.505754:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468797632
00010000:00010000:1.0:1651532166.505758:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505761:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532166.505762:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505767:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505771:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.505774:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5536
00000100:00100000:0.0:1651532166.505775:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468797440:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532166.505779:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4967
00010000:00010000:0.0:1651532166.505779:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532166.505781:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468797312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532166.505783:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41455d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d85b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505787:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.505790:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41455d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d85b expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.505791:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.505792:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505794:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532166.505795:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505798:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.505798:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41455d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d85b expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.505802:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.505802:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532166.505834:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5537
00000100:00100000:1.0:1651532166.505836:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468797568:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532166.505842:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468797440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (157us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532166.505844:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532166.505845:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5536
00010000:00010000:1.0:1651532166.505847:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41456b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d862 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.505851:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5538
00000100:00100000:0.0:1651532166.505852:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468797632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.505855:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41456b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d862 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.505857:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.505859:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41456b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d862 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.505860:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414572 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d869 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.505863:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00010000:00010000:0.0:1651532166.505867:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414572 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d869 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.505871:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414572 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d869 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532166.505872:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468797568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (181us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.505874:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5537
00010000:00010000:0.0:1651532166.505874:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532166.505880:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468797632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (177us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.505882:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5538
00000100:00100000:1.0:1651532166.505891:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.505927:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468797760
00000100:00100000:0.0:1651532166.505935:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5539
00000100:00100000:0.0:1651532166.505937:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468797760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.505940:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.505942:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414579 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d870 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.505949:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414579 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d870 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.505953:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414579 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d870 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.505959:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532166.505971:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468797760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.505973:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5539
00000100:00100000:0.0:1651532166.506288:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.506295:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.506301:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.506314:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468797888
00000100:00100000:0.0:1651532166.506323:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468798080
00000100:00100000:0.0:1651532166.506326:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468798144
00000100:00100000:1.0:1651532166.506330:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5540
00000100:00100000:1.0:1651532166.506332:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468797888:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532166.506332:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5541
00000100:00100000:0.0:1651532166.506334:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468798080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.506336:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.506337:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.506340:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414580 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d877 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.506341:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414587 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d87e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.506349:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414580 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d877 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.506358:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414587 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d87e expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.506362:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414580 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d877 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.506362:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414587 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d87e expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.506366:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00010000:00010000:0.0:1651532166.506366:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532166.506378:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468798080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.506383:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468797888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.506383:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5541
00000100:00100000:1.0:1651532166.506387:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5540
00000100:00100000:0.0:1651532166.506388:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5542
00000100:00100000:0.0:1651532166.506390:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468798144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.506392:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.506395:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41458e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d885 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.506401:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41458e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d885 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.506405:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41458e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d885 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.506408:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532166.506413:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468798144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (112us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.506416:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5542
00000100:00100000:0.0:1651532166.506624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.506631:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468798400
00000100:00100000:0.0:1651532166.506637:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5543
00000100:00100000:0.0:1651532166.506639:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468798400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.506642:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.506645:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414595 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d88c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.506655:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414595 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d88c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.506658:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414595 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d88c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.506662:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532166.506677:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468798400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.506680:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5543
00000100:00100000:0.0:1651532166.506921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.506928:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468798592
00000100:00100000:0.0:1651532166.506934:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5544
00000100:00100000:0.0:1651532166.506936:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468798592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.506939:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.506942:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41459c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d893 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.506949:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41459c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d893 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.506953:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41459c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d893 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.506956:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532166.506972:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468798592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.506975:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5544
00000001:00080000:1.0:1651532166.604954:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794145 is committed
00002000:00010000:0.0:1651532166.604982:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532165 -> 1651532166
00002000:00010000:0.0:1651532166.604984:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532164 -> 1651532166
00010000:00010000:0.0:1651532166.604986:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.604990:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.605006:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468794048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516210us (516311us total) trans 158913794145 rc 0/0
00000100:00100000:0.0:1651532166.605010:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4959
00010000:00010000:0.0:1651532166.605016:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605019:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.605020:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605023:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605028:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.605028:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.605029:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605035:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605038:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.605039:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.605039:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605042:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605054:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605057:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4144b5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->8392703] (req 3252224->8392703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605066:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605071:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605087:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605091:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605311:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605326:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605330:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605335:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.605361:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468794112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 516556us (516666us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532166.605363:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468794688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408384us (408443us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532166.605365:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4958
00000100:00100000:0.0:1651532166.605367:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4960
00010000:00010000:1.0:1651532166.605374:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605378:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532166.605379:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605379:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605382:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605382:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.605384:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605387:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605388:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605391:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4144ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7430144->10170367] (req 7430144->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605392:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.605393:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.605393:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605396:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605406:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605409:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4144c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [458752->3887103] (req 458752->3887103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605430:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.605433:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.605464:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.605481:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468798784
00000100:00100000:1.0:1651532166.605510:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5545
00000100:00100000:1.0:1651532166.605512:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468798784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.605516:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.605520:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d89a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605528:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d89a expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.605533:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d89a expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.605536:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:1.0:1651532166.605551:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468798784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.605554:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5545
00000100:00100000:1.0:1651532166.605902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.605922:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.605930:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468798912
00000100:00100000:1.0:1651532166.605943:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468798976
00000100:00100000:1.0:1651532166.605953:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4968
00000100:00100000:1.0:1651532166.605955:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468798912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532166.605965:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605972:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.605973:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605976:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532166.605977:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605982:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.605985:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.605998:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4969
00000100:00100000:0.0:1651532166.606001:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468798976:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532166.606008:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.606013:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532166.606014:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.606017:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532166.606018:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.606022:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.606025:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.606042:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.606061:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468799360
00000100:00100000:1.0:1651532166.606087:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5546
00000100:00100000:1.0:1651532166.606088:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468799360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.606092:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.606095:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8a1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.606103:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8a1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.606107:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8a1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.606110:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532166.606122:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468799360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.606124:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5546
00000001:00080000:1.0:1651532166.671690:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794146 is committed
00010000:00010000:0.0:1651532166.671720:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.671724:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.671741:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b9b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468794624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474728us (474809us total) trans 158913794146 rc 0/0
00000100:00100000:0.0:1651532166.671744:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4961
00010000:00010000:0.0:1651532166.671751:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.671754:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.671755:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.671758:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.671763:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.671763:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.671764:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.671767:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.671779:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.671782:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4144d1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1839104->9830399] (req 1839104->9830399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.671792:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.671797:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.672097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.672128:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.672139:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.672145:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.672156:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468799680
00000100:00100000:1.0:1651532166.672158:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468799552
00000100:00100000:0.0:1651532166.672167:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468799744
00000100:00100000:0.0:1651532166.672173:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5547
00000100:00100000:0.0:1651532166.672175:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468799680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.672179:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532166.672180:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468799616
00010000:00010000:0.0:1651532166.672182:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4145bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8a8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.672188:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532166.672192:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4970
00000100:00100000:1.0:1651532166.672195:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468799552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532166.672203:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.672208:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4145bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8a8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.672213:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4145bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8a8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.672215:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.672216:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.672217:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:1.0:1651532166.672219:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532166.672220:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.672225:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.672227:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468799680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (88us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532166.672228:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.672230:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5547
00000100:00100000:0.0:1651532166.672235:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5548
00000100:00100000:0.0:1651532166.672237:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468799744:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532166.672240:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4971
00010000:00010000:0.0:1651532166.672241:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532166.672242:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468799616:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532166.672243:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4145cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8af expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.672248:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.672248:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.672250:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4145cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8af expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.672251:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.672252:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.672257:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532166.672258:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.672261:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.672262:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4145cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8af expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.672264:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.672265:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532166.672271:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468799744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.672273:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5548
00010000:00010000:1.0:1651532166.672276:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.672279:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.672287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.672293:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cf372df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468795648:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350304us (350361us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532166.672296:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4962
00010000:00010000:1.0:1651532166.672302:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.672306:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532166.672307:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.672309:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.672316:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468799936
00000100:00100000:0.0:1651532166.672326:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5549
00000100:00100000:0.0:1651532166.672328:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468799936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.672331:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.672334:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4145db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8b6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.672335:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.672336:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.672337:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.672341:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.672347:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4145db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8b6 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.672349:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.672360:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4145db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8b6 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.672364:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f4144f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3715072->10117119] (req 3715072->10117119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.672364:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:1.0:1651532166.672373:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.672374:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468799936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.672376:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5549
00010000:00010000:1.0:1651532166.672378:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.672629:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.672709:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468800064
00000100:00100000:1.0:1651532166.672722:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5550
00000100:00100000:1.0:1651532166.672724:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468800064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.672727:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.672732:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8bd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.672743:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8bd expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.672747:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8bd expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.672750:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:0.0:1651532166.672751:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.672772:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468800448
00000100:00100000:1.0:1651532166.672775:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468800064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (156us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.672784:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5550
00000100:00100000:0.0:1651532166.672798:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5551
00000100:00100000:0.0:1651532166.672800:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468800448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.672814:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.672823:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4145e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8c4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.672831:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4145e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8c4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.672835:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4145e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8c4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.672838:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532166.672848:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468800448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.672851:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5551
00000100:00100000:1.0:1651532166.673073:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.673084:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468800640
00000100:00100000:0.0:1651532166.673095:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5552
00000100:00100000:0.0:1651532166.673096:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468800640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.673100:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.673103:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4145f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8cb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.673110:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4145f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8cb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.673114:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4145f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8cb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.673117:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532166.673127:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468800640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.673130:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5552
00000001:00080000:1.0:1651532166.771705:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794147 is committed
00010000:00010000:1.0:1651532166.771720:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.771724:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.771747:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839d90fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468795584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449718us (449801us total) trans 158913794147 rc 0/0
00000100:00100000:1.0:1651532166.771750:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4963
00010000:00010000:0.0:1651532166.771750:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.771754:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.771755:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.771759:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.771764:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.771765:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.771766:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.771772:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.771779:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.771782:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414502 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1372160->4415487] (req 1372160->4415487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.771797:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.771814:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.772143:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.772154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.772163:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.772171:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.772179:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468800832
00000100:00100000:0.0:1651532166.772180:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468800960
00000100:00100000:0.0:1651532166.772190:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468801152
00000100:00100000:1.0:1651532166.772199:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468800896
00000100:00100000:0.0:1651532166.772202:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5553
00000100:00100000:0.0:1651532166.772204:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468800960:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532166.772206:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4972
00010000:00010000:0.0:1651532166.772207:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532166.772208:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468800832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532166.772211:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4145f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8d2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.772215:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.772218:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4145f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8d2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.772220:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.772221:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.772224:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532166.772225:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.772228:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4145f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8d2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.772229:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.772232:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.772235:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532166.772240:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4973
00000100:00100000:1.0:1651532166.772242:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046351af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468800896:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532166.772247:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468800960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.772250:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5553
00000100:00100000:0.0:1651532166.772254:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5554
00000100:00100000:0.0:1651532166.772256:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468801152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.772259:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.772260:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.772261:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41460c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8d9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.772264:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.772265:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.772268:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532166.772269:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.772275:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.772275:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41460c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8d9 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.772278:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.772279:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41460c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8d9 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.772282:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532166.772288:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468801152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.772290:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5554
00000001:00080000:1.0:1651532166.838425:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794148 is committed
00010000:00010000:1.0:1651532166.838441:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.838445:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.838468:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468796352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449702us (449778us total) trans 158913794148 rc 0/0
00010000:00010000:0.0:1651532166.838469:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.838471:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4964
00010000:00010000:0.0:1651532166.838474:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.838475:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838478:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838484:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.838484:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.838485:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838488:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838496:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838499:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41451e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->9977855] (req 1327104->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838504:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838507:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.838783:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.838796:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532166.838823:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468801408
00000100:00100000:0.0:1651532166.838833:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468801472
00000100:00100000:0.0:1651532166.838838:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5555
00000100:00100000:0.0:1651532166.838840:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468801408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532166.838843:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532166.838844:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5556
00000100:00100000:1.0:1651532166.838848:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468801472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.838853:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532166.838862:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414613 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8e0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.838865:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41461a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8e7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838868:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.838871:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.838871:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414613 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8e0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.838875:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41461a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8e7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.838875:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414613 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8e0 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.838878:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:1.0:1651532166.838879:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f41461a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8e7 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.838883:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:0.0:1651532166.838890:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468801408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532166.838893:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5555
00000100:00100000:1.0:1651532166.838897:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468801472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.838900:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5556
00010000:00010000:0.0:1651532166.838905:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838909:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.838923:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468796416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 450104us (450219us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532166.838926:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4965
00010000:00010000:0.0:1651532166.838936:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838941:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.838943:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838945:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.838946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532166.838950:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.838950:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.838951:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838954:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838963:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838966:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414525 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3964928->9981951] (req 3964928->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838974:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.838977:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.839003:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468801664
00000100:00100000:1.0:1651532166.839012:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5557
00000100:00100000:1.0:1651532166.839014:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468801664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.839018:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.839021:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414621 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8ee expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.839033:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414621 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8ee expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.839040:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414621 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8ee expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.839047:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:1.0:1651532166.839056:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468801664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.839059:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5557
00000100:00100000:1.0:1651532166.839395:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.839404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.839412:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.839419:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468801856
00000100:00100000:1.0:1651532166.839432:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468801728
00000100:00100000:1.0:1651532166.839438:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4974
00000100:00100000:1.0:1651532166.839440:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468801856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532166.839447:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.839452:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.839453:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532166.839454:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.839457:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.839467:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4975
00000100:00100000:1.0:1651532166.839468:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468801920
00000100:00100000:0.0:1651532166.839469:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b9096eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468801728:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532166.839478:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5558
00000100:00100000:1.0:1651532166.839481:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468801920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.839484:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.839487:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41462f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8f5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.839498:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.839503:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41462f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8f5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.839503:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532166.839504:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.839507:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.839509:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532166.839510:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.839514:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f41462f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8f5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532166.839515:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.839517:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.839518:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00010000:00010000:0.0:1651532166.839521:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.839537:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468801920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (124us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.839540:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5558
00000100:00100000:1.0:1651532166.839557:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.839596:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468802176
00000100:00100000:1.0:1651532166.839606:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5559
00000100:00100000:1.0:1651532166.839608:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468802176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.839611:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.839615:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41463d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d8fc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.839622:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41463d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8fc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.839626:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41463d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d8fc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.839632:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:1.0:1651532166.839642:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468802176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.839644:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5559
00000100:00100000:1.0:1651532166.839920:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.839928:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468802432
00000100:00100000:1.0:1651532166.839936:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5560
00000100:00100000:1.0:1651532166.839937:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468802432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.839941:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.839944:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414644 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d903 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.839952:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414644 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d903 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.839956:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414644 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d903 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.839960:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:1.0:1651532166.839969:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468802432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.839971:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5560
00000100:00100000:1.0:1651532166.840214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.840222:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468802624
00000100:00100000:1.0:1651532166.840229:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5561
00000100:00100000:1.0:1651532166.840231:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468802624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.840234:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.840238:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41464b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d90a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.840245:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41464b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d90a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.840248:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41464b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d90a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.840252:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532166.840261:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468802624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.840263:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5561
00000100:00100000:0.0:1651532166.844866:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b6d05b6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966863808:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651532166.845119:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b6d05b6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966863808:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:1.0:1651532166.938444:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794149 is committed
00010000:00010000:0.0:1651532166.938475:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938480:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.938502:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a47f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468797248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432769us (432833us total) trans 158913794149 rc 0/0
00000100:00100000:0.0:1651532166.938505:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4966
00010000:00010000:0.0:1651532166.938512:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938516:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.938517:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938520:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938525:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.938525:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.938526:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938529:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938535:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938538:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414556 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8970239] (req 49152->8970239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.938548:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.938555:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.938824:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.938838:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468802880
00000100:00100000:1.0:1651532166.938847:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5562
00000100:00100000:1.0:1651532166.938848:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468802880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532166.938852:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532166.938856:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414652 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d911 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.938862:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532166.938865:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414652 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d911 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.938869:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414652 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d911 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532166.938872:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00000100:00100000:1.0:1651532166.938882:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468802880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532166.938884:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5562
00010000:00010000:1.0:1651532166.938896:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.938899:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.938920:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e61621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468797312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433138us (433241us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532166.938920:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.938923:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4967
00010000:00010000:0.0:1651532166.938924:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532166.938925:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938928:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938933:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.938934:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532166.938934:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938938:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938947:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938950:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414564 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->9363455] (req 1638400->9363455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938958:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.938961:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532166.939346:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.939374:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532166.939385:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468803008
00000100:00100000:1.0:1651532166.939397:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468803072
00000100:00100000:1.0:1651532166.939405:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4976
00000100:00100000:1.0:1651532166.939407:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c39d25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468803008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532166.939414:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.939418:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532166.939420:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.939422:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532166.939423:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.939427:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532166.939431:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532166.939434:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4977
00000100:00100000:0.0:1651532166.939437:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468803072:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532166.939445:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.939450:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532166.939451:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.939454:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532166.939454:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.939459:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532166.939462:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532167.080104:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794150 is committed
00010000:00010000:0.0:1651532167.080133:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080138:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.080160:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec0f2831 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468798912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474204us (474258us total) trans 158913794150 rc 0/0
00000100:00100000:0.0:1651532167.080165:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4968
00010000:00010000:0.0:1651532167.080172:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080176:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.080177:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080180:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080185:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.080185:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.080186:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080189:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080196:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080199:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4145aa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2314240->9445375] (req 2314240->9445375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080204:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080206:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.080531:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.080541:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532167.080579:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.080581:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468803392
00010000:00010000:0.0:1651532167.080583:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.080590:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468803584
00000100:00100000:1.0:1651532167.080599:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5563
00000100:00100000:1.0:1651532167.080601:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468803392:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532167.080607:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a338d3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468798976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474606us (474685us total) trans 0 rc 40960/40960
00010000:00010000:1.0:1651532167.080610:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532167.080611:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4969
00010000:00010000:1.0:1651532167.080615:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414667 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d918 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080617:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080621:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.080622:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.080623:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.080625:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.080626:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414667 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d918 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.080630:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.080631:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414667 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d918 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.080631:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.080632:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.080634:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00010000:00010000:0.0:1651532167.080635:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080643:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080647:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4145b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->10121215] (req 20480->10121215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.080649:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468803392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.080652:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5563
00000100:00100000:0.0:1651532167.080654:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5564
00000100:00100000:0.0:1651532167.080656:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468803584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.080659:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.080660:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080662:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41466e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d91f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.080664:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.080670:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41466e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d91f expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.080674:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41466e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d91f expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.080677:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532167.080684:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d01615 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468803584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.080687:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5564
00000100:00100000:1.0:1651532167.081154:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.081170:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.081179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.081179:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468803712
00000100:00100000:1.0:1651532167.081188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.081197:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468803840
00000100:00100000:1.0:1651532167.081200:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.081206:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4978
00000100:00100000:0.0:1651532167.081207:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468803712:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532167.081212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532167.081214:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.081221:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532167.081222:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.081224:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468803776
00010000:00010000:0.0:1651532167.081225:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532167.081226:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.081230:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468803968
00010000:00010000:0.0:1651532167.081230:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.081233:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468804032
00010000:00010000:0.0:1651532167.081233:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.081235:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468804160
00000100:00100000:1.0:1651532167.081238:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5565
00000100:00100000:1.0:1651532167.081240:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468803776:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532167.081241:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4979
00000100:00100000:0.0:1651532167.081242:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468803840:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532167.081243:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.081247:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41467c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d926 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.081249:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.081252:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532167.081253:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.081255:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532167.081256:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.081261:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.081262:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41467c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d926 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.081264:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.081266:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41467c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d926 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.081269:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532167.081271:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5566
00000100:00100000:0.0:1651532167.081272:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097358b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468803968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.081275:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.081277:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41468a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d92d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.081280:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754468803776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.081283:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5565
00010000:00010000:0.0:1651532167.081284:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41468a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d92d expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.081288:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5567
00010000:00010000:0.0:1651532167.081288:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41468a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d92d expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.081290:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468804032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.081291:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:1.0:1651532167.081292:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.081294:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414691 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d934 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.081300:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414691 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d934 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532167.081300:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097358b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468803968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (112us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.081303:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5566
00010000:00010000:1.0:1651532167.081304:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414691 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d934 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.081308:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:0.0:1651532167.081308:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5568
00000100:00100000:0.0:1651532167.081309:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468804160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.081312:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532167.081313:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468804032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (119us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532167.081314:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414698 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d93b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.081316:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5567
00010000:00010000:0.0:1651532167.081322:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414698 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d93b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.081326:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414698 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d93b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.081329:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532167.081334:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468804160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.081336:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5568
00000100:00100000:1.0:1651532167.081623:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.081635:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468804352
00000100:00100000:0.0:1651532167.081646:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5569
00000100:00100000:0.0:1651532167.081648:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468804352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.081651:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.081654:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41469f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d942 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.081661:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41469f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d942 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.081663:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532167.081665:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41469f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d942 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.081668:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532167.081673:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468804480
00000100:00100000:0.0:1651532167.081681:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468804352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.081684:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5569
00000100:00100000:1.0:1651532167.081688:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5570
00000100:00100000:1.0:1651532167.081690:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468804480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.081694:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.081698:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d949 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.081705:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d949 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.081709:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d949 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.081712:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:1.0:1651532167.081720:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468804480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.081723:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5570
00000100:00100000:1.0:1651532167.082001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.082009:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468804672
00000100:00100000:1.0:1651532167.082016:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5571
00000100:00100000:1.0:1651532167.082018:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468804672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.082022:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.082025:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4146ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d950 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.082032:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4146ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d950 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.082036:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4146ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d950 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.082039:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532167.082048:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468804672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.082051:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5571
00000001:00080000:1.0:1651532167.213472:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794151 is committed
00010000:00010000:1.0:1651532167.213488:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.213492:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.213514:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468799552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541320us (541418us total) trans 158913794151 rc 0/0
00010000:00010000:0.0:1651532167.213516:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.213518:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4970
00010000:00010000:0.0:1651532167.213520:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.213522:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.213525:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.213530:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.213531:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.213532:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.213535:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.213544:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.213547:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4145c6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [319488->9637887] (req 319488->9637887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.213568:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.213572:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.213863:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.213870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.213881:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468804928
00000100:00100000:1.0:1651532167.213888:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468804992
00000100:00100000:1.0:1651532167.213899:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5572
00000100:00100000:1.0:1651532167.213900:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468804928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.213904:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.213908:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4146b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d957 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.213909:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5573
00000100:00100000:0.0:1651532167.213911:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468804992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.213914:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.213915:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.213916:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4146b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d957 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.213919:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4146bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d95e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.213921:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4146b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d957 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.213924:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:0.0:1651532167.213925:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.213927:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4146bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d95e expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.213931:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4146bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d95e expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.213934:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468804928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (72us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532167.213935:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532167.213936:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5572
00000100:00100000:0.0:1651532167.213944:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468804992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.213946:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5573
00010000:00010000:1.0:1651532167.213947:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.213954:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.213967:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.213970:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468799616:12345-10.240.43.64@tcp:3:fio.0 Request processed in 541727us (541842us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532167.213971:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.213972:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.213973:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4971
00010000:00010000:0.0:1651532167.213975:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.213980:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.213980:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.213981:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.213987:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.213996:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.213999:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4145d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [155648->9854975] (req 155648->9854975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.214008:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.214011:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.214424:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.214455:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.214467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.214479:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468805248
00000100:00100000:0.0:1651532167.214480:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468805440
00000100:00100000:0.0:1651532167.214489:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5574
00000100:00100000:1.0:1651532167.214490:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468805312
00000100:00100000:0.0:1651532167.214491:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468805440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.214494:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532167.214495:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4980
00000100:00100000:1.0:1651532167.214497:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468805248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532167.214498:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4146c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d965 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.214504:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.214506:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4146c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d965 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.214508:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532167.214509:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532167.214510:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.214516:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.214516:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4146c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d965 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.214520:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532167.214522:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4981
00000100:00100000:1.0:1651532167.214524:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468805312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532167.214529:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.214534:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468805440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.214536:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5574
00010000:00010000:1.0:1651532167.214539:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532167.214540:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.214543:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532167.214544:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.214548:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.214551:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532167.280191:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794152 is committed
00010000:00010000:0.0:1651532167.280222:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280227:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.280248:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468800832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 508039us (508106us total) trans 158913794152 rc 0/0
00000100:00100000:0.0:1651532167.280251:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4972
00010000:00010000:0.0:1651532167.280259:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280262:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.280263:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280266:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280271:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.280271:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.280272:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280275:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280279:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.280279:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.280280:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280282:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280289:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280291:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f4145fe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1900544->10219519] (req 1900544->10219519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.280310:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.280315:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.280342:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.280348:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.280585:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.280595:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.280596:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468805696
00000100:00100000:0.0:1651532167.280632:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468805632
00000100:00100000:0.0:1651532167.280641:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5575
00000100:00100000:0.0:1651532167.280642:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468805696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.280646:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.280649:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4146d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d973 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280654:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.280657:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4146d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d973 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.280659:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532167.280664:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4146d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d973 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.280667:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468805824
00010000:00010000:0.0:1651532167.280667:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532167.280674:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5576
00000100:00100000:1.0:1651532167.280676:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468805632:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532167.280680:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468805696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.280683:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5575
00010000:00010000:1.0:1651532167.280687:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532167.280688:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5577
00000100:00100000:0.0:1651532167.280689:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468805824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.280691:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4146de lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d96c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280692:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.280695:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4146e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d97a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.280697:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.280699:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.280700:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4146de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d96c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.280701:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4146e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d97a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.280704:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4146de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d96c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.280705:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4146e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d97a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.280708:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00010000:00010000:0.0:1651532167.280709:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532167.280714:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468805824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.280716:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468805632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.280716:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5577
00000100:00100000:1.0:1651532167.280719:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5576
00010000:00010000:1.0:1651532167.280734:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.280738:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280753:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.280757:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046351af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468800896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508514us (508603us total) trans 0 rc 24576/24576
00010000:00010000:0.0:1651532167.280757:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.280759:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.280760:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4973
00010000:00010000:0.0:1651532167.280761:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280766:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.280770:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280770:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414605 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3231744->7639039] (req 3231744->7639039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.280773:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280783:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.280786:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468801856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441346us (441392us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532167.280786:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.280787:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.280789:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4974
00010000:00010000:0.0:1651532167.280790:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280793:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.280794:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.280795:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280800:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280820:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280823:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414628 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1359872->6975487] (req 1359872->6975487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280828:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.280831:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.281281:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.281292:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.281298:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.281310:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468806208
00000100:00100000:1.0:1651532167.281314:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.281325:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468806080
00000100:00100000:0.0:1651532167.281336:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468806336
00000100:00100000:1.0:1651532167.281346:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468805952
00000100:00100000:0.0:1651532167.281348:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5578
00000100:00100000:0.0:1651532167.281359:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468806208:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532167.281364:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4982
00000100:00100000:1.0:1651532167.281365:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468806080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532167.281367:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.281371:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4146ec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d981 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.281373:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.281379:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532167.281380:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532167.281380:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.281385:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.281385:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4146ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d981 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.281390:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4146ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d981 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.281392:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4983
00000100:00100000:1.0:1651532167.281394:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468805952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532167.281394:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:1.0:1651532167.281398:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.281401:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532167.281402:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.281406:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468806208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.281409:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5578
00010000:00010000:1.0:1651532167.281411:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.281414:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532167.281414:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.281414:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5579
00000100:00100000:0.0:1651532167.281416:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468806336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.281418:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.281419:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.281422:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.281425:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.281429:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414701 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d988 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.281436:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414701 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d988 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.281439:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414701 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d988 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.281442:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532167.281443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.281450:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468806336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.281453:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5579
00000100:00100000:0.0:1651532167.281457:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468806464
00000100:00100000:0.0:1651532167.281461:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5580
00000100:00100000:0.0:1651532167.281462:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468806464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.281465:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.281467:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414708 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d98f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.281473:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414708 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d98f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.281476:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414708 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d98f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.281479:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532167.281489:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468806464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.281492:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5580
00000100:00100000:1.0:1651532167.281725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.281735:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468806592
00000100:00100000:1.0:1651532167.281736:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.281747:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468806720
00000100:00100000:0.0:1651532167.281754:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5581
00000100:00100000:0.0:1651532167.281756:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468806592:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532167.281758:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5582
00010000:00010000:0.0:1651532167.281759:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532167.281760:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468806720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.281762:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41470f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d996 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.281764:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.281769:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414716 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d99d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.281769:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41470f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d996 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.281773:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41470f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d996 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.281779:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532167.281781:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414716 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d99d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.281787:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414716 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d99d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.281791:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532167.281818:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468806592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.281821:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5581
00000100:00100000:1.0:1651532167.281823:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468806720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.281826:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5582
00000100:00100000:1.0:1651532167.281864:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.281904:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468806848
00000100:00100000:1.0:1651532167.281917:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5583
00000100:00100000:1.0:1651532167.281918:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468806848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.281922:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.281925:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41471d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9a4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.281933:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41471d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9a4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.281937:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f41471d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9a4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.281940:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532167.281950:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468806848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.281953:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5583
00000001:00080000:1.0:1651532167.396863:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794153 is committed
00010000:00010000:0.0:1651532167.396893:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.396897:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.396919:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b9096eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468801728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557449us (557515us total) trans 158913794153 rc 0/0
00000100:00100000:0.0:1651532167.396922:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4975
00010000:00010000:0.0:1651532167.396930:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.396933:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.396934:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.396937:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.396942:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.396943:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.396944:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.396947:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.396956:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.396959:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414636 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1847296->7319551] (req 1847296->7319551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.396982:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.396987:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.397320:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.397334:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.397343:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.397346:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468807232
00000100:00100000:1.0:1651532167.397361:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.397372:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468807168
00000100:00100000:0.0:1651532167.397379:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4984
00000100:00100000:0.0:1651532167.397381:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468807232:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532167.397388:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.397392:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532167.397393:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.397396:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532167.397397:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.397401:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.397404:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.397412:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4985
00000100:00100000:0.0:1651532167.397413:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468807168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532167.397418:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.397421:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532167.397422:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.397424:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532167.397425:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.397428:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.397431:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.397435:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468807360
00000100:00100000:0.0:1651532167.397439:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468807424
00000100:00100000:1.0:1651532167.397447:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5584
00000100:00100000:1.0:1651532167.397449:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468807360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.397453:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532167.397454:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5585
00000100:00100000:0.0:1651532167.397456:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468807424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.397457:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414732 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9ab expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.397459:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.397462:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414739 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9b2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.397466:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414732 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9ab expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.397470:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414732 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9ab expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.397471:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414739 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9b2 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.397474:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00010000:00010000:0.0:1651532167.397475:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414739 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9b2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.397479:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532167.397485:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468807360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (142us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.397488:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5584
00000100:00100000:0.0:1651532167.397488:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468807424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.397490:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5585
00000100:00100000:1.0:1651532167.397784:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.397813:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468807616
00000100:00100000:0.0:1651532167.397825:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5586
00000100:00100000:0.0:1651532167.397827:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468807616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.397830:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.397834:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414740 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9b9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.397841:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414740 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9b9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.397845:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414740 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9b9 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.397848:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532167.397862:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468807616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.397865:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5586
00000001:00080000:1.0:1651532167.505180:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794154 is committed
00010000:00010000:1.0:1651532167.505196:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505201:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.505224:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c39d25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468803008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565816us (565878us total) trans 158913794154 rc 0/0
00010000:00010000:0.0:1651532167.505224:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.505227:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4976
00010000:00010000:0.0:1651532167.505229:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.505230:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505233:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505238:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.505239:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.505240:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505243:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505250:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505253:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414659 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1646592->8810495] (req 1646592->8810495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505272:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505277:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505482:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505487:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505505:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.505507:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8c53352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468803072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 566070us (566133us total) trans 0 rc 24576/24576
00010000:00010000:0.0:1651532167.505509:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532167.505511:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4977
00010000:00010000:0.0:1651532167.505511:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505514:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505518:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.505519:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.505519:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505522:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505529:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505532:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414660 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2924544->9461759] (req 2924544->9461759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505537:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505540:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.505577:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.505593:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468807808
00000100:00100000:0.0:1651532167.505602:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5587
00000100:00100000:0.0:1651532167.505603:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468807808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.505608:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.505612:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414747 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9c0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505619:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414747 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9c0 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.505623:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414747 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9c0 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.505625:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532167.505626:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532167.505641:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468807808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.505643:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.505644:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5587
00000100:00100000:0.0:1651532167.505649:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468807872
00000100:00100000:0.0:1651532167.505652:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468807936
00000100:00100000:0.0:1651532167.505654:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5588
00000100:00100000:0.0:1651532167.505656:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468807872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.505658:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.505661:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41474e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9c7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.505667:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41474e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9c7 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.505670:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41474e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9c7 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.505674:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532167.505678:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5589
00000100:00100000:1.0:1651532167.505680:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468807936:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532167.505686:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468807872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.505688:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5588
00010000:00010000:1.0:1651532167.505691:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.505697:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414755 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9ce expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505709:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414755 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9ce expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.505714:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414755 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9ce expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.505717:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532167.505727:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468807936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.505731:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5589
00000100:00100000:1.0:1651532167.505867:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.505876:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.505883:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468808000
00000100:00100000:1.0:1651532167.505896:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468808064
00000100:00100000:1.0:1651532167.505904:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4986
00000100:00100000:1.0:1651532167.505905:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468808000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532167.505912:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505917:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532167.505918:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505921:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532167.505922:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505926:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505929:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.505937:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4987
00000100:00100000:1.0:1651532167.505938:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468808064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532167.505944:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505948:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532167.505949:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505953:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532167.505954:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505960:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.505966:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.506017:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.506026:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.506037:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468808192
00000100:00100000:1.0:1651532167.506038:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468808320
00000100:00100000:1.0:1651532167.506047:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5590
00000100:00100000:1.0:1651532167.506049:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468808320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.506053:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532167.506055:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5591
00010000:00010000:1.0:1651532167.506056:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41476a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9dc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.506057:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468808192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.506060:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.506064:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41476a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9dc expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506064:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414771 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9d5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.506071:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41476a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9dc expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506072:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414771 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9d5 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.506075:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00010000:00010000:0.0:1651532167.506076:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414771 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9d5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506079:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532167.506085:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468808320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.506088:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5590
00000100:00100000:0.0:1651532167.506088:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468808192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.506090:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5591
00000100:00100000:1.0:1651532167.506326:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.506337:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468808576
00000100:00100000:0.0:1651532167.506345:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5592
00000100:00100000:0.0:1651532167.506347:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468808576:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532167.506348:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532167.506363:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.506366:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414778 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9e3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.506374:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414778 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9e3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506378:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414778 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9e3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506381:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532167.506394:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468808576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.506397:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5592
00000100:00100000:0.0:1651532167.506402:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468808704
00000100:00100000:0.0:1651532167.506409:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5593
00000100:00100000:0.0:1651532167.506410:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468808704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.506413:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.506415:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41477f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9ea expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.506421:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41477f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9ea expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506425:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41477f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9ea expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506431:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532167.506441:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468808704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.506443:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5593
00000100:00100000:1.0:1651532167.506619:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.506629:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468808832
00000100:00100000:0.0:1651532167.506636:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5594
00000100:00100000:0.0:1651532167.506637:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468808832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.506640:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.506643:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414786 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9f1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.506650:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414786 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9f1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506654:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414786 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9f1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506657:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532167.506671:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468808832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.506673:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5594
00000100:00100000:1.0:1651532167.506891:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.506901:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468809088
00000100:00100000:0.0:1651532167.506908:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5595
00000100:00100000:0.0:1651532167.506910:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468809088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.506914:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.506917:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41478d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9f8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.506924:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41478d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9f8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506927:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41478d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9f8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.506931:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532167.506944:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468809088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.506946:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5595
00000001:00080000:1.0:1651532167.571905:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794155 is committed
00010000:00010000:0.0:1651532167.571936:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.571940:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.571962:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc232046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468803712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490754us (490809us total) trans 158913794155 rc 0/0
00000100:00100000:0.0:1651532167.571965:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4978
00010000:00010000:0.0:1651532167.571972:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.571975:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.571977:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.571980:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.571985:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.571985:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.571986:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.571989:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.571992:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.571993:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.571994:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.571996:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572003:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572006:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414675 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->10440703] (req 471040->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572011:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572016:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.572023:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.572028:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572029:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572032:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.572049:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066df342a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468803840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 490806us (490879us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532167.572052:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4979
00010000:00010000:0.0:1651532167.572058:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572062:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.572063:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572081:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572086:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572089:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414683 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->1347583] (req 1343488->1347583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.572309:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.572347:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.572381:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468809344
00000100:00100000:1.0:1651532167.572385:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468809472
00000100:00100000:0.0:1651532167.572389:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5596
00000100:00100000:0.0:1651532167.572391:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468809344:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532167.572395:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5597
00010000:00010000:0.0:1651532167.572395:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532167.572397:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468809472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.572398:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414794 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44d9ff expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.572402:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.572406:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414794 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9ff expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.572407:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41479b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da06 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572410:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414794 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44d9ff expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.572413:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:1.0:1651532167.572419:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41479b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da06 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.572425:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f41479b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da06 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.572429:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:0.0:1651532167.572451:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468809344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (142us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.572454:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5596
00000100:00100000:1.0:1651532167.572464:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468809472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (116us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.572467:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5597
00000100:00100000:0.0:1651532167.572469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.572483:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.572508:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.572516:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468809728
00000100:00100000:0.0:1651532167.572524:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468809600
00000100:00100000:0.0:1651532167.572529:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4988
00000100:00100000:0.0:1651532167.572531:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468809728:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532167.572538:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572542:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532167.572543:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532167.572544:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572547:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.572554:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4989
00000100:00100000:0.0:1651532167.572555:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468809600:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532167.572557:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468809664
00010000:00010000:0.0:1651532167.572559:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572562:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532167.572563:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.572566:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5598
00010000:00010000:0.0:1651532167.572566:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.572568:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468809664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.572568:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532167.572569:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.572571:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.572572:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.572575:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da0d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572578:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.572582:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.572583:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da0d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.572587:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da0d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.572591:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532167.572605:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468809664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.572607:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5598
00000100:00100000:1.0:1651532167.572744:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.572752:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468809920
00000100:00100000:1.0:1651532167.572759:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5599
00000100:00100000:1.0:1651532167.572761:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468809920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.572765:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.572768:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4147b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da14 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.572776:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4147b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da14 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.572780:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4147b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da14 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.572783:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532167.572800:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468809920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.572817:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5599
00000001:00080000:1.0:1651532167.696900:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794156 is committed
00010000:00010000:1.0:1651532167.696915:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.696919:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.696941:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004121d93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468805248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482444us (482518us total) trans 158913794156 rc 0/0
00010000:00010000:0.0:1651532167.696943:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.696946:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4980
00010000:00010000:0.0:1651532167.696947:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2e51273 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.696948:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.696951:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.696956:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.696957:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.696958:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.696961:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.696964:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.696964:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.696965:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.696970:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.696979:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.696982:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f4146c9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->9465855] (req 2015232->9465855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.696998:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697002:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697031:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697037:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.697340:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.697348:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.697364:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.697382:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468810240
00010000:00010000:1.0:1651532167.697388:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.697390:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468810368
00010000:00010000:1.0:1651532167.697392:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.697392:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468810432
00000100:00100000:0.0:1651532167.697396:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5600
00000100:00100000:0.0:1651532167.697398:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468810240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.697407:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532167.697411:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d08087a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468805312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 482887us (482957us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532167.697415:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4981
00010000:00010000:0.0:1651532167.697415:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4147be lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da1b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.697421:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532167.697423:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5601
00010000:00010000:0.0:1651532167.697423:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4147be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da1b expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.697425:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468810368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.697427:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4147be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da1b expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.697429:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.697431:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:1.0:1651532167.697432:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4147c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da22 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697437:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532167.697439:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468810240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (100us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532167.697440:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4147c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da22 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532167.697442:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5600
00010000:00010000:1.0:1651532167.697444:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4147c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da22 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532167.697447:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5602
00010000:00010000:1.0:1651532167.697448:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532167.697449:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468810432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.697451:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.697453:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4147cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da29 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.697454:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468810368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.697457:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5601
00010000:00010000:0.0:1651532167.697458:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.697460:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4147cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da29 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.697463:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4147cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da29 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.697466:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:1.0:1651532167.697467:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697470:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.697471:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468810432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.697474:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5602
00000100:00100000:1.0:1651532167.697485:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468806080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416119us (416215us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532167.697486:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.697488:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4982
00010000:00010000:0.0:1651532167.697489:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003325411e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.697491:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.697494:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697499:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.697499:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.697502:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4146d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [909312->7139327] (req 909312->7139327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697506:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532167.697507:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697510:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697515:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.697515:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.697516:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697519:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697526:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.697529:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4146f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2560000->10362879] (req 2560000->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.697544:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.697548:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.697977:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.697993:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468810624
00000100:00100000:1.0:1651532167.697994:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.698006:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.698006:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5603
00000100:00100000:0.0:1651532167.698007:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468810624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.698011:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532167.698014:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532167.698015:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4147d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da30 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.698023:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532167.698028:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4147d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da30 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.698031:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532167.698032:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4147d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da30 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.698036:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532167.698037:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468810560
00000100:00100000:1.0:1651532167.698047:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468810688
00000100:00100000:0.0:1651532167.698048:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468810624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.698050:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5603
00000100:00100000:1.0:1651532167.698056:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4990
00000100:00100000:1.0:1651532167.698058:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051966bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468810560:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532167.698061:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468810816
00010000:00010000:1.0:1651532167.698065:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.698065:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468810944
00000100:00100000:0.0:1651532167.698067:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468811008
00010000:00010000:1.0:1651532167.698070:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532167.698070:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5604
00010000:00010000:1.0:1651532167.698071:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.698071:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468810816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.698074:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532167.698074:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.698075:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.698077:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4147e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da37 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.698079:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.698083:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.698083:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4147e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da37 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.698087:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4147e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da37 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.698090:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4991
00010000:00010000:0.0:1651532167.698090:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532167.698092:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468810688:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532167.698096:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.698096:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468810816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.698098:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5604
00010000:00010000:1.0:1651532167.698099:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532167.698100:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.698102:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5605
00000100:00100000:0.0:1651532167.698104:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468810944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.698105:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532167.698106:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.698106:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.698108:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4147ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da3e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.698110:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.698113:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.698113:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4147ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da3e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.698116:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4147ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da3e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.698119:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5606
00010000:00010000:0.0:1651532167.698119:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532167.698120:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468811008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.698123:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532167.698124:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468810944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (101us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532167.698125:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4147f6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da45 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.698126:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5605
00010000:00010000:1.0:1651532167.698132:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4147f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da45 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.698136:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4147f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da45 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.698140:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:1.0:1651532167.698148:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468811008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.698151:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5606
00000100:00100000:1.0:1651532167.698389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.698397:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468811136
00000100:00100000:1.0:1651532167.698404:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5607
00000100:00100000:1.0:1651532167.698406:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468811136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.698409:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.698413:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4147fd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da4c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.698420:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4147fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da4c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.698424:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f4147fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da4c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.698427:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:1.0:1651532167.698441:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468811136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.698444:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5607
00000100:00100000:1.0:1651532167.698555:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.698563:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468811520
00000100:00100000:1.0:1651532167.698570:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5608
00000100:00100000:1.0:1651532167.698571:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468811520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.698575:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.698578:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414804 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da53 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.698586:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414804 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da53 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.698590:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414804 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da53 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.698593:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:1.0:1651532167.698607:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468811520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.698609:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5608
00000100:00100000:1.0:1651532167.698663:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.698670:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468811648
00000100:00100000:1.0:1651532167.698677:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5609
00000100:00100000:1.0:1651532167.698678:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468811648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.698681:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.698685:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41480b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da5a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.698692:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41480b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da5a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.698696:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41480b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da5a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.698699:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:1.0:1651532167.698712:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468811648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.698717:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5609
00000100:00100000:1.0:1651532167.698928:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.698936:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468811840
00000100:00100000:1.0:1651532167.698943:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5610
00000100:00100000:1.0:1651532167.698944:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468811840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.698948:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.698951:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414812 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da61 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.698958:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414812 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da61 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.698962:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414812 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da61 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.698965:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00000100:00100000:1.0:1651532167.698979:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468811840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.698981:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5610
00000001:00080000:1.0:1651532167.747017:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794157 is committed
00010000:00010000:0.0:1651532167.747048:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747052:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.747075:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468805952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 465680us (465782us total) trans 158913794157 rc 0/0
00000100:00100000:0.0:1651532167.747078:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4983
00010000:00010000:0.0:1651532167.747086:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747089:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.747091:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747096:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747101:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.747102:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.747103:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747106:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747113:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747116:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f4146fa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3543040->6623231] (req 3543040->6623231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747121:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747124:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.747444:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.747456:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.747456:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468812032
00000100:00100000:1.0:1651532167.747465:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.747467:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468812096
00000100:00100000:0.0:1651532167.747479:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4992
00000100:00100000:0.0:1651532167.747480:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468812032:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532167.747481:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4993
00000100:00100000:1.0:1651532167.747483:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468812096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532167.747487:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747492:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532167.747493:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.747494:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747496:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532167.747496:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.747500:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.747501:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.747504:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532167.747505:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.747509:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747509:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747512:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.747513:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.747520:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468812160
00010000:00010000:0.0:1651532167.747525:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.747528:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5611
00010000:00010000:0.0:1651532167.747528:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.747529:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468812160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.747532:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.747535:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414827 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da68 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.747540:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.747542:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414827 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da68 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532167.747544:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468807232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350162us (350224us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532167.747547:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4984
00010000:00010000:1.0:1651532167.747549:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414827 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da68 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.747552:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.747553:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:0.0:1651532167.747556:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.747557:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747560:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.747561:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001606f65a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468812160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.747563:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5611
00010000:00010000:0.0:1651532167.747564:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.747565:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.747566:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747569:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747575:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747578:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414724 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [286720->9801727] (req 286720->9801727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747583:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.747585:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.747987:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.747999:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468812480
00000100:00100000:1.0:1651532167.748008:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5612
00000100:00100000:1.0:1651532167.748010:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468812480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.748013:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.748017:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41482e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da6f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.748025:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41482e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da6f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.748029:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41482e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da6f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.748032:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:1.0:1651532167.748043:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468812480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.748045:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5612
00000100:00100000:0.0:1651532167.748284:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.748304:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468812608
00000100:00100000:1.0:1651532167.748313:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5613
00000100:00100000:1.0:1651532167.748314:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468812608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.748318:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.748321:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414835 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da76 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.748329:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414835 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da76 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.748332:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414835 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da76 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.748336:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:1.0:1651532167.748345:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468812608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.748348:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5613
00000001:00080000:1.0:1651532167.871953:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794158 is committed
00002000:00010000:0.0:1651532167.871982:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532166 -> 1651532167
00010000:00010000:0.0:1651532167.871985:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.871989:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.872010:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468807168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474596us (474676us total) trans 158913794158 rc 0/0
00010000:00010000:1.0:1651532167.872013:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.872014:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4985
00010000:00010000:1.0:1651532167.872018:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532167.872019:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.872022:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.872031:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.872031:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.872032:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.872036:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.872044:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.872059:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41472b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8802303] (req 1658880->8802303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.872068:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.872071:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.872423:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.872443:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.872450:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.872452:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468812800
00000100:00100000:1.0:1651532167.872457:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.872462:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468812736
00000100:00100000:0.0:1651532167.872468:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4994
00000100:00100000:0.0:1651532167.872470:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468812800:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532167.872476:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.872481:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.872482:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.872485:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.872492:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4995
00000100:00100000:0.0:1651532167.872494:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097358b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468812736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532167.872498:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.872501:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532167.872502:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.872505:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.872508:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532167.872508:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.872512:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.872515:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.872516:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468812864
00010000:00010000:0.0:1651532167.872518:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.872528:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468812992
00000100:00100000:1.0:1651532167.872533:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5614
00000100:00100000:1.0:1651532167.872535:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468812864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.872538:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532167.872538:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5615
00000100:00100000:0.0:1651532167.872540:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468812992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.872542:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41484a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da7d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.872543:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.872546:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414851 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da84 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.872550:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41484a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da7d expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.872554:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414851 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da84 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.872561:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414851 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da84 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.872565:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:1.0:1651532167.872567:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f41484a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da7d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.872571:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00000100:00100000:0.0:1651532167.872575:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468812992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.872578:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5615
00000100:00100000:1.0:1651532167.872580:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468812864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.872583:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5614
00000100:00100000:1.0:1651532167.872862:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.872870:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468813184
00000100:00100000:1.0:1651532167.872882:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5616
00000100:00100000:1.0:1651532167.872883:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468813184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532167.872887:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.872891:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414858 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da8b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.872898:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414858 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da8b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.872902:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414858 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da8b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.872906:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:1.0:1651532167.872918:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468813184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.872921:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5616
00000001:00080000:1.0:1651532167.947262:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794159 is committed
00010000:00010000:1.0:1651532167.947277:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.947281:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.947304:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468808000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 441398us (441437us total) trans 158913794159 rc 0/0
00010000:00010000:0.0:1651532167.947305:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.947307:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4986
00010000:00010000:0.0:1651532167.947309:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.947310:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947314:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947319:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.947320:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.947320:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947323:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947327:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.947327:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.947328:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947331:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947339:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947341:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41475c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7516160->9601023] (req 7516160->9601023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947347:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947350:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.947372:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.947377:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.947635:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.947643:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.947658:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468813376
00010000:00010000:1.0:1651532167.947666:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.947666:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468813440
00010000:00010000:1.0:1651532167.947671:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.947671:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5617
00000100:00100000:0.0:1651532167.947673:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468813376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.947676:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.947686:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41485f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da92 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.947689:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468808064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441750us (441813us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532167.947693:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4987
00010000:00010000:0.0:1651532167.947696:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532167.947699:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41485f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da92 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532167.947701:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5618
00000100:00100000:1.0:1651532167.947703:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468813440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.947706:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41485f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da92 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.947707:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.947710:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414866 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44da99 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947710:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:1.0:1651532167.947715:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.947718:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414866 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da99 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532167.947718:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468813376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.947721:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5617
00010000:00010000:1.0:1651532167.947722:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414866 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44da99 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.947725:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:0.0:1651532167.947729:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.947732:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468813440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (89us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532167.947732:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532167.947733:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.947734:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5618
00010000:00010000:0.0:1651532167.947736:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947741:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947744:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414763 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1331200->9101311] (req 1331200->9101311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947753:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.947759:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.947773:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.947776:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468809728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375244us (375307us total) trans 0 rc 36864/36864
00010000:00010000:1.0:1651532167.947777:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532167.947778:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532167.947779:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4988
00010000:00010000:1.0:1651532167.947781:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.947786:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.947787:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.947788:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.947791:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.947801:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.947818:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4147a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->10432511] (req 1122304->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.947826:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.947829:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.948291:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.948302:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532167.948313:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.948313:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468813632
00000100:00100000:1.0:1651532167.948320:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.948327:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468813568
00000100:00100000:1.0:1651532167.948332:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.948333:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4996
00000100:00100000:0.0:1651532167.948335:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468813632:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532167.948343:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4997
00000100:00100000:1.0:1651532167.948346:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468813568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532167.948347:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.948359:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532167.948360:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.948363:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.948363:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532167.948364:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.948368:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532167.948369:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532167.948370:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.948374:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.948374:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.948378:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532167.948381:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468813696
00000100:00100000:1.0:1651532167.948392:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468813824
00000100:00100000:1.0:1651532167.948395:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468813888
00000100:00100000:0.0:1651532167.948398:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5619
00000100:00100000:0.0:1651532167.948400:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468813696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532167.948402:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5620
00010000:00010000:0.0:1651532167.948403:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532167.948404:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468813824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.948405:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41487b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44daa0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532167.948406:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532167.948409:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414882 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44daa7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.948413:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41487b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daa0 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.948416:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414882 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daa7 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.948417:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41487b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daa0 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.948420:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:1.0:1651532167.948421:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414882 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daa7 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532167.948427:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00000100:00100000:0.0:1651532167.948431:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468813696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (141us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.948433:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5619
00000100:00100000:1.0:1651532167.948435:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468813824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (116us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532167.948438:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5620
00000100:00100000:0.0:1651532167.948440:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5621
00000100:00100000:0.0:1651532167.948441:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468813888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.948444:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.948446:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414889 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44daae expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.948452:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414889 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daae expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.948458:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414889 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daae expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.948461:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532167.948466:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468813888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.948469:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5621
00000100:00100000:1.0:1651532167.948706:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532167.948718:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468814080
00000100:00100000:0.0:1651532167.948728:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5622
00000100:00100000:0.0:1651532167.948730:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468814080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532167.948733:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532167.948737:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414890 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dab5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532167.948743:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414890 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dab5 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.948747:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414890 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dab5 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532167.948751:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532167.948761:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468814080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532167.948763:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5622
00000001:00080000:1.0:1651532168.155321:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794160 is committed
00002000:00010000:1.0:1651532168.155336:0:330280:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532166 -> 1651532167
00010000:00010000:1.0:1651532168.155339:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.155343:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.155369:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.155375:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468809600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582819us (582867us total) trans 158913794160 rc 0/0
00010000:00010000:0.0:1651532168.155376:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532168.155377:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.155379:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4989
00010000:00010000:0.0:1651532168.155381:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.155387:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.155387:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.155388:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.155391:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.155401:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.155404:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4147a9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [684032->9560063] (req 684032->9560063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.155412:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.155428:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.155868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.155889:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.155899:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.155906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.155915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.155924:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468814592
00000100:00100000:0.0:1651532168.155935:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468814720
00000100:00100000:0.0:1651532168.155938:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468814848
00000100:00100000:0.0:1651532168.155941:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5623
00000100:00100000:0.0:1651532168.155943:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468814592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.155947:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.155951:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414897 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dabc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.155959:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414897 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dabc expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532168.155960:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468814528
00010000:00010000:0.0:1651532168.155964:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414897 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dabc expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.155967:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532168.155974:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468814464
00000100:00100000:1.0:1651532168.155983:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4998
00000100:00100000:1.0:1651532168.155985:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468814528:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532168.155993:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468814592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.155996:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5623
00010000:00010000:1.0:1651532168.155998:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.156001:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5624
00010000:00010000:1.0:1651532168.156003:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532168.156003:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468814720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.156004:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.156006:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.156007:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532168.156008:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.156009:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4148a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dac3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.156012:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.156016:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.156016:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4148a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dac3 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.156023:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4148a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dac3 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.156026:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532168.156032:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468814720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (126us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.156035:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5625
00000100:00100000:1.0:1651532168.156038:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468814848:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532168.156038:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5624
00010000:00010000:1.0:1651532168.156041:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.156044:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4148ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44daca expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.156046:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4999
00000100:00100000:0.0:1651532168.156048:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468814464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532168.156051:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4148ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daca expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.156054:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.156055:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4148ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daca expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.156058:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532168.156059:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.156062:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:0.0:1651532168.156062:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.156065:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532168.156065:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.156070:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.156071:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468814848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (156us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.156074:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5625
00010000:00010000:0.0:1651532168.156075:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.156078:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.156368:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.156388:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468814976
00000100:00100000:1.0:1651532168.156400:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5626
00000100:00100000:1.0:1651532168.156403:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468814976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.156408:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.156413:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148ba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dad1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.156421:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dad1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.156433:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dad1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.156437:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:1.0:1651532168.156451:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468814976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.156454:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5626
00000100:00100000:0.0:1651532168.156478:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.156499:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468815168
00000100:00100000:1.0:1651532168.156507:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5627
00000100:00100000:1.0:1651532168.156509:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468815168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.156513:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.156516:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4148c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dad8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.156523:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4148c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dad8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.156527:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4148c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dad8 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.156530:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:1.0:1651532168.156538:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468815168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.156541:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5627
00000001:00080000:1.0:1651532168.247014:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794161 is committed
00010000:00010000:1.0:1651532168.247029:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247033:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.247056:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051966bbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468810560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 548997us (549062us total) trans 158913794161 rc 0/0
00000100:00100000:1.0:1651532168.247059:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4990
00010000:00010000:1.0:1651532168.247067:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247073:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532168.247074:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247077:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247082:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.247083:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.247084:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247086:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247108:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247113:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4147da lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6463488->10305535] (req 6463488->10305535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247120:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247123:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.247364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532168.247400:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.247403:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.247417:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468815360
00000100:00100000:0.0:1651532168.247427:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468815488
00000100:00100000:0.0:1651532168.247432:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5628
00010000:00010000:1.0:1651532168.247433:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.247434:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468815360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.247438:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.247447:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4148c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dadf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.247454:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d503912 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468810688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 549361us (549452us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532168.247454:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.247456:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4148c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dadf expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532168.247457:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4991
00010000:00010000:0.0:1651532168.247461:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4148c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dadf expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.247464:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532168.247466:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5629
00000100:00100000:1.0:1651532168.247468:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468815488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.247471:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532168.247473:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468815360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (110us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532168.247474:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4148cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dae6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.247476:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5628
00010000:00010000:1.0:1651532168.247480:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.247483:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4148cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dae6 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.247483:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247487:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f4148cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dae6 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.247487:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b05056e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532168.247488:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247490:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00010000:00010000:0.0:1651532168.247491:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.247496:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.247496:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532168.247497:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468815488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (94us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532168.247497:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.247499:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5629
00010000:00010000:0.0:1651532168.247500:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.247507:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.247510:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f4147e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3252224->9674751] (req 3252224->9674751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.247515:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.247521:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.247852:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.247864:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.247875:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468815616
00000100:00100000:1.0:1651532168.247888:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5000
00000100:00100000:1.0:1651532168.247928:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468815616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532168.247936:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247941:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532168.247942:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247945:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532168.247945:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247950:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247953:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.247962:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468815744
00000100:00100000:1.0:1651532168.247969:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5630
00000100:00100000:1.0:1651532168.247971:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468815744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.247973:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.247975:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4148dd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44daed expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.247982:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4148dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daed expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.247989:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4148dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daed expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.247993:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00000100:00100000:1.0:1651532168.248010:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468815744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (145us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.248013:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5630
00000100:00100000:0.0:1651532168.248023:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.248059:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.248069:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468815680
00000100:00100000:1.0:1651532168.248082:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5001
00000100:00100000:1.0:1651532168.248084:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468815680:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532168.248091:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.248095:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532168.248096:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.248099:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532168.248100:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.248104:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.248107:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.248117:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468815872
00000100:00100000:1.0:1651532168.248123:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5631
00000100:00100000:1.0:1651532168.248124:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468815872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.248127:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.248129:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4148eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44daf4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.248135:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4148eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daf4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.248139:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f4148eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44daf4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.248143:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532168.248152:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468815872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.248155:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5631
00000100:00100000:0.0:1651532168.248433:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.248453:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468816192
00000100:00100000:1.0:1651532168.248462:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5632
00000100:00100000:1.0:1651532168.248464:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468816192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.248467:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.248470:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4148f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dafb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.248478:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4148f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dafb expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.248482:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4148f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dafb expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.248485:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:1.0:1651532168.248495:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468816192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.248498:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5632
00000001:00080000:1.0:1651532168.305407:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794162 is committed
00010000:00010000:0.0:1651532168.305437:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305442:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.305460:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072bb3f9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468812032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557978us (558016us total) trans 158913794162 rc 0/0
00000100:00100000:0.0:1651532168.305463:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4992
00010000:00010000:0.0:1651532168.305470:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305473:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532168.305474:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305477:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305485:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.305486:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.305487:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305490:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305493:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.305493:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.305494:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305497:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305510:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305513:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414819 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [245760->7077887] (req 245760->7077887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305519:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.305521:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305522:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.305526:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305742:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305746:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.305758:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.305762:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f19660e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468812800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433291us (433339us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532168.305763:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532168.305764:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.305765:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4994
00010000:00010000:1.0:1651532168.305767:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.305774:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.305779:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41483c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1343488->3088383] (req 1343488->3088383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.305859:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.305863:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305883:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.305887:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa19de90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468812096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 558403us (558431us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532168.305891:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4993
00010000:00010000:0.0:1651532168.305892:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a75099f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532168.305893:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305896:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305902:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.305902:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.305903:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305906:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305913:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305916:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414820 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [282624->10444799] (req 282624->10444799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305922:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.305925:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.306065:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.306086:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468816704
00000100:00100000:1.0:1651532168.306095:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5633
00000100:00100000:1.0:1651532168.306097:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468816704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.306100:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.306104:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4148f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db02 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.306112:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4148f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db02 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.306116:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f4148f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db02 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.306122:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:1.0:1651532168.306132:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468816704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.306135:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5633
00000100:00100000:0.0:1651532168.306337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.306349:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.306366:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.306367:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468816896
00000100:00100000:0.0:1651532168.306374:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.306383:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.306392:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468816768
00000100:00100000:1.0:1651532168.306401:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5002
00000100:00100000:1.0:1651532168.306403:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468816896:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532168.306406:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5003
00000100:00100000:0.0:1651532168.306408:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468816768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532168.306410:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.306414:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532168.306415:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532168.306416:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.306417:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.306419:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.306421:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532168.306422:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.306425:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.306428:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532168.306429:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.306436:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.306439:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468816960
00010000:00010000:0.0:1651532168.306439:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.306442:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.306447:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468817024
00000100:00100000:1.0:1651532168.306449:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468817088
00000100:00100000:1.0:1651532168.306452:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5634
00000100:00100000:1.0:1651532168.306454:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468816960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.306456:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532168.306457:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5635
00000100:00100000:0.0:1651532168.306458:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468817024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.306459:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41490e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db09 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.306461:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.306464:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414915 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db10 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.306466:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41490e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db09 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.306470:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41490e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db09 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.306471:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414915 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db10 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.306474:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:0.0:1651532168.306476:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414915 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db10 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.306479:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532168.306484:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468816960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.306488:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5634
00000100:00100000:0.0:1651532168.306488:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468817024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (114us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.306491:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5635
00000100:00100000:1.0:1651532168.306495:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5636
00000100:00100000:1.0:1651532168.306497:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468817088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.306502:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.306506:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41491c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db17 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.306515:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41491c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db17 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.306519:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f41491c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db17 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.306522:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532168.306526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.306529:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468817088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (147us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.306532:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5636
00000100:00100000:1.0:1651532168.306537:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468817216
00000100:00100000:1.0:1651532168.306541:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5637
00000100:00100000:1.0:1651532168.306542:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468817216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.306545:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.306547:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414923 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db1e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.306552:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414923 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db1e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.306571:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414923 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db1e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.306575:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532168.306589:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468817216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.306592:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5637
00000100:00100000:1.0:1651532168.306906:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.306915:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.306921:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468817536
00000100:00100000:1.0:1651532168.306927:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468817728
00000100:00100000:1.0:1651532168.306936:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5638
00000100:00100000:1.0:1651532168.306938:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468817536:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532168.306940:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5639
00010000:00010000:1.0:1651532168.306941:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532168.306942:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468817728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.306945:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41492a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db25 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.306946:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.306950:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414931 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db2c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.306952:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41492a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db25 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.306957:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f41492a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db25 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.306957:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414931 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db2c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.306960:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00010000:00010000:0.0:1651532168.306962:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414931 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db2c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.306965:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532168.306972:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468817536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.306975:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5638
00000100:00100000:0.0:1651532168.306980:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468817728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.306983:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5639
00000100:00100000:1.0:1651532168.307280:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.307298:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468817856
00000100:00100000:0.0:1651532168.307310:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5640
00000100:00100000:0.0:1651532168.307312:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468817856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.307316:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.307319:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414938 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db33 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.307327:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414938 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db33 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.307334:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414938 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db33 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.307337:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532168.307347:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468817856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.307350:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5640
00000001:00080000:1.0:1651532168.397075:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794163 is committed
00010000:00010000:0.0:1651532168.397104:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397109:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.397130:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097358b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468812736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524635us (524686us total) trans 158913794163 rc 0/0
00000100:00100000:0.0:1651532168.397133:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4995
00010000:00010000:0.0:1651532168.397140:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397144:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532168.397145:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397148:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397155:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.397156:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.397157:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397160:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397163:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.397164:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.397164:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397167:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397174:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397177:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414843 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->9252863] (req 950272->9252863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397182:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397185:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.397189:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.397194:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.397536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.397544:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.397550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.397556:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.397571:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468818176
00000100:00100000:0.0:1651532168.397580:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468818112
00000100:00100000:0.0:1651532168.397589:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5004
00000100:00100000:0.0:1651532168.397591:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468818176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532168.397598:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397602:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.397603:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397606:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532168.397607:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397611:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397614:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.397619:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5005
00000100:00100000:1.0:1651532168.397621:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468818112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532168.397625:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397628:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.397630:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.397635:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532168.397637:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.397647:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532168.397648:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.397651:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468813632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449315us (449348us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532168.397654:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4996
00010000:00010000:1.0:1651532168.397657:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.397661:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.397663:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468818240
00000100:00100000:0.0:1651532168.397671:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468818304
00000100:00100000:0.0:1651532168.397677:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5641
00000100:00100000:0.0:1651532168.397678:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468818240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.397681:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.397684:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41494d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db3a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.397686:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.397689:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532168.397691:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397692:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41494d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db3a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.397694:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397696:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41494d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db3a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.397699:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.397699:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:1.0:1651532168.397702:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41486d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1368064->6352895] (req 1368064->6352895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.397706:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468818240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (155us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.397708:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5641
00000100:00100000:1.0:1651532168.397710:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5642
00000100:00100000:1.0:1651532168.397712:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468818304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.397715:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.397718:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414954 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db41 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.397725:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414954 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db41 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.397729:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414954 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db41 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.397732:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532168.397741:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468818304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (185us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.397744:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5642
00000100:00100000:0.0:1651532168.398078:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.398092:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.398098:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468818432
00000100:00100000:0.0:1651532168.398099:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468818624
00000100:00100000:0.0:1651532168.398106:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5643
00000100:00100000:1.0:1651532168.398112:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5644
00000100:00100000:1.0:1651532168.398114:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468818432:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532168.398114:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468818624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.398117:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.398118:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.398121:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41495b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db4f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.398122:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414962 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db48 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.398130:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41495b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db4f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.398131:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414962 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db48 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.398134:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41495b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db4f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.398135:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414962 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db48 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.398137:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:1.0:1651532168.398139:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00000100:00100000:0.0:1651532168.398150:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468818624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.398153:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5643
00000100:00100000:1.0:1651532168.398156:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468818432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.398158:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5644
00000001:00080000:1.0:1651532168.480439:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794164 is committed
00010000:00010000:1.0:1651532168.480454:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.480458:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.480480:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468813568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532133us (532166us total) trans 158913794164 rc 0/0
00000100:00100000:1.0:1651532168.480483:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4997
00010000:00010000:0.0:1651532168.480483:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480487:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff8ea379 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532168.480489:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480492:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480497:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.480498:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.480499:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480502:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480511:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480514:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414874 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9854976->10231807] (req 9854976->10231807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480523:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480526:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.480886:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.480896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.480906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.480906:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468818944
00000100:00100000:1.0:1651532168.480912:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.480926:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468819008
00000100:00100000:1.0:1651532168.480929:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5006
00000100:00100000:1.0:1651532168.480931:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468818944:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532168.480934:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5007
00000100:00100000:0.0:1651532168.480936:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468819008:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532168.480940:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480943:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.480945:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532168.480946:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.480949:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532168.480950:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480953:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.480954:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480957:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532168.480958:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.480962:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480963:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.480966:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.480966:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.480973:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468819072
00010000:00010000:0.0:1651532168.480979:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.480983:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468819136
00010000:00010000:0.0:1651532168.480987:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.480990:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5645
00000100:00100000:1.0:1651532168.480991:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468819072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.480994:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.480997:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414977 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db56 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.481002:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.481004:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414977 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db56 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532168.481010:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468814528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 325025us (325143us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532168.481014:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4998
00010000:00010000:1.0:1651532168.481015:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414977 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db56 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.481019:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00010000:00010000:0.0:1651532168.481020:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.481024:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532168.481025:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.481028:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468819072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (121us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532168.481028:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.481031:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5645
00010000:00010000:0.0:1651532168.481032:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.481033:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.481034:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.481035:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5646
00000100:00100000:1.0:1651532168.481037:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468819136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.481037:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.481039:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.481041:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41497e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db5d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.481043:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.481046:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f41489e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2027520->9977855] (req 2027520->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.481047:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41497e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db5d expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.481051:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f41497e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db5d expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.481051:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.481054:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:0.0:1651532168.481054:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.481059:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468819136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (146us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.481061:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5646
00000100:00100000:1.0:1651532168.481512:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.481524:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.481524:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468819456
00000100:00100000:0.0:1651532168.481537:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468819520
00000100:00100000:0.0:1651532168.481547:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5647
00000100:00100000:0.0:1651532168.481549:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468819456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.481552:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.481556:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414985 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db64 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.481557:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5648
00000100:00100000:1.0:1651532168.481559:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468819520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.481563:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.481564:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414985 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db64 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.481567:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41498c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db6b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.481571:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414985 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db64 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.481575:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:1.0:1651532168.481577:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41498c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db6b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.481581:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41498c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db6b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.481584:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532168.481588:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468819456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.481591:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5647
00000100:00100000:1.0:1651532168.481599:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468819520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.481602:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5648
00000001:00080000:1.0:1651532168.577801:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794165 is committed
00010000:00010000:0.0:1651532168.577840:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.577845:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.577864:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468814464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 421815us (421975us total) trans 158913794165 rc 0/0
00000100:00100000:0.0:1651532168.577867:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4999
00010000:00010000:1.0:1651532168.577869:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.577873:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532168.577874:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.577878:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.577884:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.577884:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.577885:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.577888:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.577896:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.577899:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4148b3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->10002431] (req 2064384->10002431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.577903:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.577907:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.578290:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.578304:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.578305:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468819776
00000100:00100000:1.0:1651532168.578315:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.578323:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468819904
00000100:00100000:1.0:1651532168.578325:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.578333:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.578340:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5008
00000100:00100000:1.0:1651532168.578341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.578342:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468819776:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532168.578360:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468819840
00010000:00010000:0.0:1651532168.578364:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.578368:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468819968
00010000:00010000:0.0:1651532168.578369:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532168.578370:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468820032
00010000:00010000:0.0:1651532168.578370:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.578372:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468820096
00010000:00010000:0.0:1651532168.578373:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532168.578374:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.578375:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5649
00000100:00100000:1.0:1651532168.578376:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468819840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.578378:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.578380:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.578382:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.578384:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41499a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db72 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.578390:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5009
00010000:00010000:1.0:1651532168.578392:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41499a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db72 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532168.578392:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c645d881 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754468819904:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532168.578396:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f41499a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db72 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.578397:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.578401:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532168.578401:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.578402:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00010000:00010000:0.0:1651532168.578404:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532168.578405:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.578411:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.578416:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468819840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.578419:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5649
00010000:00010000:0.0:1651532168.578421:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.578424:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5650
00000100:00100000:1.0:1651532168.578425:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be9fcfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468819968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.578428:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532168.578429:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5651
00010000:00010000:1.0:1651532168.578430:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4149a8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db79 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.578430:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009daa8341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468820032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.578433:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.578436:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4149a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db79 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.578436:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4149af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db80 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.578439:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4149a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db79 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.578443:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:0.0:1651532168.578443:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4149af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db80 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532168.578448:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be9fcfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468819968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (124us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532168.578448:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4149af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db80 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532168.578451:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5650
00010000:00010000:0.0:1651532168.578451:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532168.578454:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5652
00000100:00100000:1.0:1651532168.578456:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad64e1dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468820096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.578458:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.578460:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4149b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db87 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.578460:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009daa8341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468820032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.578463:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5651
00010000:00010000:1.0:1651532168.578465:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4149b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db87 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.578469:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4149b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db87 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.578471:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532168.578477:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad64e1dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468820096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (135us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.578479:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5652
00000100:00100000:1.0:1651532168.578777:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.578786:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.578796:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468820288
00000100:00100000:0.0:1651532168.578797:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468820352
00000100:00100000:1.0:1651532168.578820:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5653
00000100:00100000:1.0:1651532168.578822:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcaeca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468820288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.578825:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532168.578825:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5654
00000100:00100000:0.0:1651532168.578827:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c2102e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468820352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.578829:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db8e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.578831:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.578834:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4149c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db95 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.578836:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db8e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.578841:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db8e expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.578842:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4149c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db95 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.578846:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4149c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db95 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.578847:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00010000:00010000:0.0:1651532168.578849:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532168.578859:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcaeca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468820288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.578862:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5653
00000100:00100000:0.0:1651532168.578865:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c2102e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468820352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.578868:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5654
00000001:00080000:1.0:1651532168.727756:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794166 is committed
00010000:00010000:0.0:1651532168.727787:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.727792:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.727824:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468815616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 479896us (479973us total) trans 158913794166 rc 0/0
00000100:00100000:0.0:1651532168.727828:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5000
00010000:00010000:1.0:1651532168.727835:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727840:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ec252b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532168.727841:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727844:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727850:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.727850:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.727851:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727854:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727858:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.727858:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.727859:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727877:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727888:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727891:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f4148d6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4055040->10055679] (req 4055040->10055679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727897:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727900:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727935:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.727941:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.728196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.728204:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.728223:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468820928
00000100:00100000:0.0:1651532168.728230:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468820992
00010000:00010000:1.0:1651532168.728232:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.728237:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5655
00000100:00100000:0.0:1651532168.728239:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468820928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.728242:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.728243:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.728246:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4149cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44db9c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.728258:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532168.728264:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468815680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 480178us (480240us total) trans 0 rc 24576/24576
00010000:00010000:0.0:1651532168.728266:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4149cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db9c expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532168.728267:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5001
00010000:00010000:0.0:1651532168.728270:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4149cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44db9c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.728274:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:1.0:1651532168.728278:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728282:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.728282:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468820928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.728284:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5655
00000100:00100000:0.0:1651532168.728289:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5656
00000100:00100000:0.0:1651532168.728291:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468820992:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532168.728293:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468816896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 421890us (421957us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532168.728293:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.728295:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4149d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dba3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.728296:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5002
00010000:00010000:0.0:1651532168.728300:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.728301:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.728301:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4149d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dba3 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.728304:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532168.728305:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728308:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.728308:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4149d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dba3 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.728311:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:1.0:1651532168.728313:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728316:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f4148e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [180224->8699903] (req 180224->8699903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.728316:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468820992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (112us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532168.728319:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.728319:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5656
00010000:00010000:1.0:1651532168.728322:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532168.728323:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728326:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728329:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.728329:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.728330:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728333:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728343:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728345:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414900 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3248128->10346495] (req 3248128->10346495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728366:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728370:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.728767:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.728778:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.728787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.728793:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468821184
00000100:00100000:0.0:1651532168.728794:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.728815:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468821248
00000100:00100000:1.0:1651532168.728824:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468821120
00000100:00100000:0.0:1651532168.728837:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5010
00000100:00100000:0.0:1651532168.728839:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468821184:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532168.728841:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5011
00000100:00100000:1.0:1651532168.728843:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468821248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532168.728847:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728851:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.728851:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532168.728852:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532168.728852:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728857:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532168.728858:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532168.728859:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728862:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.728862:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.728870:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5012
00000100:00100000:0.0:1651532168.728872:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468821120:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532168.728875:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468821376
00010000:00010000:0.0:1651532168.728877:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.728880:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532168.728883:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5657
00000100:00100000:1.0:1651532168.728885:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468821376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.728886:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728888:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.728889:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728890:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4149ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbaa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.728892:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532168.728893:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.728897:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.728901:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728902:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4149ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbaa expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.728904:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.728906:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f4149ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbaa expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.728910:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532168.728923:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468821376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (128us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.728926:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5657
00000100:00100000:0.0:1651532168.728972:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.728985:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468821504
00000100:00100000:0.0:1651532168.728985:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.728995:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468821632
00000100:00100000:1.0:1651532168.729002:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5658
00000100:00100000:1.0:1651532168.729004:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468821504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.729007:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532168.729007:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5659
00000100:00100000:0.0:1651532168.729009:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468821632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.729010:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4149f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbb1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.729014:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.729017:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4149f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbb1 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.729017:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4149fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbb8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.729021:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f4149f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbb1 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.729025:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0e2fe1d, rc 0)
00010000:00010000:0.0:1651532168.729025:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4149fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbb8 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.729029:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4149fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbb8 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.729032:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532168.729037:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6916cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468821504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.729040:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5658
00000100:00100000:0.0:1651532168.729046:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468821632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.729049:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5659
00000100:00100000:0.0:1651532168.729164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.729184:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468821824
00000100:00100000:1.0:1651532168.729195:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5660
00000100:00100000:1.0:1651532168.729197:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468821824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.729200:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.729204:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a03 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbbf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.729211:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a03 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbbf expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.729215:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a03 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbbf expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.729219:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:1.0:1651532168.729231:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468821824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.729234:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5660
00000001:00080000:1.0:1651532168.794463:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794167 is committed
00002000:00010000:1.0:1651532168.794477:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532167 -> 1651532168
00002000:00010000:1.0:1651532168.794479:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532167 -> 1651532168
00010000:00010000:1.0:1651532168.794481:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.794485:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.794509:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468816768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 488101us (488159us total) trans 158913794167 rc 0/0
00000100:00100000:1.0:1651532168.794513:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5003
00010000:00010000:1.0:1651532168.794520:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.794524:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532168.794525:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.794528:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.794534:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.794534:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.794535:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.794538:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.794565:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.794568:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414907 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [208896->9781247] (req 208896->9781247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.794577:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.794581:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.794873:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.794885:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.794892:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468822144
00000100:00100000:0.0:1651532168.794892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.794904:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468822272
00000100:00100000:1.0:1651532168.794908:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468822400
00000100:00100000:0.0:1651532168.794911:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5661
00000100:00100000:0.0:1651532168.794913:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468822144:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532168.794915:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5662
00000100:00100000:1.0:1651532168.794916:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468822272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.794918:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.794920:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.794922:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414a0a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbc6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.794924:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a11 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbcd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.794928:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.794930:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.794930:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414a0a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbc6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.794933:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a11 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbcd expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.794934:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414a0a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbc6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.794937:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a11 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbcd expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.794938:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:1.0:1651532168.794941:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532168.794947:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468822144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.794949:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468822272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.794950:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5661
00000100:00100000:1.0:1651532168.794952:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5662
00000100:00100000:0.0:1651532168.794955:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5663
00000100:00100000:0.0:1651532168.794957:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468822400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.794959:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532168.794961:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a18 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbd4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.794966:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.794967:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a18 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbd4 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.794971:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a18 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbd4 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.794977:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532168.794983:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468822400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.794985:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5663
00010000:00010000:0.0:1651532168.794996:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.794999:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.795010:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468818176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 397419us (397475us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532168.795013:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5004
00010000:00010000:0.0:1651532168.795018:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795021:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532168.795022:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795025:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795030:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.795030:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532168.795031:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795036:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795050:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795053:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41493f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [49152->8613887] (req 49152->8613887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.795059:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.795063:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.795511:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.795530:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.795540:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.795542:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468822656
00000100:00100000:0.0:1651532168.795548:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532168.795558:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468822720
00000100:00100000:1.0:1651532168.795570:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5013
00000100:00100000:1.0:1651532168.795572:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468822656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532168.795580:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.795584:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532168.795585:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.795586:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5014
00010000:00010000:1.0:1651532168.795588:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00000100:00100000:0.0:1651532168.795588:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468822720:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532168.795589:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.795594:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795596:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.795597:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795600:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532168.795601:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795604:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532168.795605:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795609:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.795613:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468822976
00010000:00010000:0.0:1651532168.795613:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.795619:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468822912
00000100:00100000:0.0:1651532168.795622:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5664
00000100:00100000:0.0:1651532168.795624:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468822976:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532168.795625:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5665
00010000:00010000:0.0:1651532168.795626:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532168.795627:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468822912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532168.795628:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a2d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbe2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.795630:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.795632:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414a34 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbdb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.795635:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbe2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.795639:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414a34 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbdb expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.795639:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbe2 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.795643:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414a34 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbdb expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532168.795643:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:1.0:1651532168.795647:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:0.0:1651532168.795653:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468822976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.795656:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468822912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532168.795656:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5664
00000100:00100000:1.0:1651532168.795658:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5665
00000100:00100000:0.0:1651532168.795670:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.795681:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468823104
00000100:00100000:1.0:1651532168.795688:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5666
00000100:00100000:1.0:1651532168.795690:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468823104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.795692:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.795695:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a3b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbe9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.795715:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a3b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbe9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.795720:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a3b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbe9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.795724:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532168.795738:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468823104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.795741:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5666
00000100:00100000:0.0:1651532168.795934:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.795947:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468823296
00000100:00100000:1.0:1651532168.795955:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5667
00000100:00100000:1.0:1651532168.795957:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468823296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.795960:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.795964:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414a42 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbf0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.795971:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414a42 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbf0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.795975:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414a42 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbf0 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.795978:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532168.795992:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468823296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.795995:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5667
00000001:00080000:1.0:1651532168.944400:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794168 is committed
00010000:00010000:1.0:1651532168.944416:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.944420:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532168.944442:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468818112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 546821us (546898us total) trans 158913794168 rc 0/0
00000100:00100000:1.0:1651532168.944446:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5005
00010000:00010000:1.0:1651532168.944453:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.944457:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532168.944458:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.944461:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.944466:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.944467:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532168.944468:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.944471:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.944478:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.944483:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532168.944488:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.944495:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414946 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [573440->8208383] (req 573440->8208383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532168.944865:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532168.944875:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468823680
00000100:00100000:1.0:1651532168.944884:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5668
00000100:00100000:1.0:1651532168.944886:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468823680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532168.944890:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532168.944893:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414a49 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbf7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532168.944901:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414a49 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbf7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.944905:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414a49 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbf7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532168.944908:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:1.0:1651532168.944922:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468823680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532168.944927:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5668
00000001:00080000:1.0:1651532169.002850:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794169 is committed
00010000:00010000:0.0:1651532169.002880:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.002885:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.002906:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468818944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 521974us (522020us total) trans 158913794169 rc 0/0
00010000:00010000:1.0:1651532169.002908:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.002909:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5006
00010000:00010000:1.0:1651532169.002912:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.002913:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.002917:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.002922:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.002923:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.002924:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.002927:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.002936:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.002946:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.002950:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414969 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [462848->9908223] (req 462848->9908223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.002950:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.003292:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.003302:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.003312:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.003321:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.003329:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468824000
00010000:00010000:0.0:1651532169.003337:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.003338:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468824128
00010000:00010000:0.0:1651532169.003342:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.003346:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5669
00000100:00100000:1.0:1651532169.003348:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468824000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.003361:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.003364:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414a50 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dbfe expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003370:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.003373:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414a50 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbfe expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532169.003374:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468819008:12345-10.240.43.64@tcp:3:fio.0 Request processed in 522437us (522477us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532169.003377:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414a50 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dbfe expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532169.003378:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5007
00010000:00010000:1.0:1651532169.003381:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6cf3eaf, rc 0)
00000100:00100000:0.0:1651532169.003383:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468823872
00000100:00100000:1.0:1651532169.003390:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468824000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.003391:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468823936
00000100:00100000:1.0:1651532169.003393:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5669
00000100:00100000:0.0:1651532169.003397:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5015
00000100:00100000:1.0:1651532169.003398:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5670
00000100:00100000:0.0:1651532169.003398:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468823872:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532169.003400:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468824128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.003402:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.003404:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a57 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc05 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.003405:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003409:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532169.003411:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532169.003412:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.003415:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532169.003415:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003420:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a57 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc05 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.003420:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.003423:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003424:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a57 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc05 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.003427:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003b0993fe, rc 0)
00010000:00010000:0.0:1651532169.003431:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.003433:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468824128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (112us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532169.003434:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532169.003435:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5670
00010000:00010000:0.0:1651532169.003435:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.003440:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.003443:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5016
00000100:00100000:1.0:1651532169.003445:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468823936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532169.003445:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532169.003445:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532169.003446:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.003449:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003450:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003454:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532169.003455:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.003455:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003458:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.003458:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414970 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3420160->9486335] (req 3420160->9486335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003461:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532169.003462:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.003465:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003466:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.003468:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003469:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003475:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.003840:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.003850:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468824256
00000100:00100000:0.0:1651532169.003852:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.003864:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468824384
00000100:00100000:1.0:1651532169.003872:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5671
00000100:00100000:1.0:1651532169.003873:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468824256:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532169.003876:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5672
00010000:00010000:1.0:1651532169.003877:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532169.003878:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468824384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.003880:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414a6c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc0c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.003884:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.003888:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414a6c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc0c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.003888:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414a73 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc13 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.003892:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414a6c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc0c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.003896:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00010000:00010000:0.0:1651532169.003896:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414a73 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc13 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.003900:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414a73 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc13 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.003904:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532169.003909:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468824256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.003912:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5671
00000100:00100000:0.0:1651532169.003919:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468824384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.003922:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5672
00000100:00100000:0.0:1651532169.004170:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.004179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.004192:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468824576
00000100:00100000:0.0:1651532169.004202:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5673
00000100:00100000:1.0:1651532169.004203:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468824640
00000100:00100000:0.0:1651532169.004204:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468824576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.004208:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.004211:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a7a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc1a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.004212:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5674
00000100:00100000:1.0:1651532169.004214:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468824640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.004217:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.004218:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a7a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc1a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.004221:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a81 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc21 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.004225:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a7a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc1a expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.004228:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a81 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc21 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.004229:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:1.0:1651532169.004232:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a81 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc21 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.004235:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532169.004239:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468824576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.004241:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5673
00000100:00100000:1.0:1651532169.004244:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468824640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.004246:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5674
00000001:00080000:1.0:1651532169.119500:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794170 is committed
00010000:00010000:0.0:1651532169.119532:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.119537:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119559:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.119559:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468819776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541216us (541270us total) trans 158913794170 rc 0/0
00000100:00100000:0.0:1651532169.119562:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5008
00010000:00010000:1.0:1651532169.119564:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.119565:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119568:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119574:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.119574:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.119575:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119581:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119584:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.119585:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.119585:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119588:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119591:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.119591:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.119592:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119594:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119623:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119627:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414993 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->10084351] (req 1921024->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119634:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.119635:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119636:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.119640:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.119670:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.119674:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.119924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.119933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.119943:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.119951:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468825088
00000100:00100000:0.0:1651532169.119958:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.119968:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468825152
00000100:00100000:1.0:1651532169.119977:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5675
00000100:00100000:1.0:1651532169.119979:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468825088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.119980:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119983:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.119984:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119987:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a88 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc28 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.119995:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a88 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc28 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532169.120002:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c645d881 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468819904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 541610us (541687us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532169.120005:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414a88 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc28 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532169.120005:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5009
00010000:00010000:1.0:1651532169.120009:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:0.0:1651532169.120011:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468825024
00000100:00100000:1.0:1651532169.120019:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468825088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.120020:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468824960
00000100:00100000:1.0:1651532169.120021:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5675
00000100:00100000:0.0:1651532169.120025:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5017
00000100:00100000:1.0:1651532169.120026:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5676
00000100:00100000:0.0:1651532169.120027:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468825024:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532169.120028:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468825152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.120030:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.120033:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414a96 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc2f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.120033:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.120037:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532169.120039:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.120043:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120044:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414a96 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc2f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.120049:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414a96 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc2f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.120052:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00010000:00010000:0.0:1651532169.120052:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.120055:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532169.120056:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.120057:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468825152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (99us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532169.120059:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.120060:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5676
00010000:00010000:0.0:1651532169.120064:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.120067:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5018
00010000:00010000:0.0:1651532169.120067:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4149a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->8577023] (req 2113536->8577023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.120069:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468824960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532169.120075:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120079:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532169.120080:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120083:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120085:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532169.120086:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120090:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120096:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120099:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120111:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120114:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.120125:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468821248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391282us (391347us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532169.120128:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5011
00010000:00010000:1.0:1651532169.120134:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120137:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003325411e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.120138:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120141:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120146:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.120147:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.120148:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120151:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120163:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120166:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f4149e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1122304->8364031] (req 1122304->8364031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.120173:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.120177:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.120589:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.120601:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.120612:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.120613:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468825344
00000100:00100000:1.0:1651532169.120622:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.120636:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468825536
00000100:00100000:0.0:1651532169.120639:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468825472
00000100:00100000:1.0:1651532169.120643:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468825280
00000100:00100000:0.0:1651532169.120654:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5677
00000100:00100000:1.0:1651532169.120660:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5019
00000100:00100000:0.0:1651532169.120661:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009daa8341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468825344:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532169.120662:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be9fcfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468825280:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532169.120667:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.120670:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.120671:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414aab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc36 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120675:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532169.120676:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120679:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532169.120679:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120688:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.120689:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414aab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc36 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.120691:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.120693:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414aab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc36 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.120696:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532169.120699:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5678
00000100:00100000:1.0:1651532169.120701:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad64e1dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468825536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.120703:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.120706:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414ab2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc44 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.120709:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009daa8341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468825344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.120712:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5677
00000100:00100000:0.0:1651532169.120717:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5679
00010000:00010000:1.0:1651532169.120719:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414ab2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc44 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532169.120719:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcaeca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468825472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.120722:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.120724:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414ab2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc44 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.120724:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414ab9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc3d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.120727:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3601aa2, rc 0)
00010000:00010000:0.0:1651532169.120730:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414ab9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc3d expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.120734:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414ab9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc3d expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532169.120736:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad64e1dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468825536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (124us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.120738:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5678
00010000:00010000:0.0:1651532169.120740:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532169.120746:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcaeca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468825472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.120748:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5679
00000100:00100000:1.0:1651532169.120754:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.120768:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468825728
00000100:00100000:0.0:1651532169.120774:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5680
00000100:00100000:0.0:1651532169.120776:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c2102e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468825728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.120778:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.120781:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414ac0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc4b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.120787:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414ac0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc4b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.120790:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414ac0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc4b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.120794:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532169.120820:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c2102e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468825728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.120823:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5680
00000100:00100000:0.0:1651532169.121205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.121212:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468826240
00000100:00100000:0.0:1651532169.121219:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5681
00000100:00100000:0.0:1651532169.121221:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468826240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.121224:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.121228:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414ac7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc52 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.121234:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414ac7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc52 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.121238:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414ac7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc52 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.121241:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532169.121257:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468826240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.121260:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5681
00000100:00100000:0.0:1651532169.121501:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.121508:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468826432
00000100:00100000:0.0:1651532169.121515:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5682
00000100:00100000:0.0:1651532169.121516:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468826432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.121519:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.121523:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ace lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc59 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.121530:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ace lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc59 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.121534:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ace lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc59 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.121537:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532169.121553:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468826432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.121556:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5682
00000001:00080000:1.0:1651532169.281236:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794172 is committed
00010000:00010000:0.0:1651532169.281268:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.281273:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.281294:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468821184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 552454us (552527us total) trans 158913794171 rc 0/0
00010000:00010000:1.0:1651532169.281296:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.281297:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5010
00010000:00010000:1.0:1651532169.281301:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.281302:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281306:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.281312:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.281315:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281320:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281323:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4149d9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281326:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.281326:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468821120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 552454us (552539us total) trans 158913794172 rc 0/0
00010000:00010000:1.0:1651532169.281329:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532169.281329:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5012
00010000:00010000:1.0:1651532169.281330:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281333:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281336:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.281337:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.281337:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281343:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281350:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281363:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4149e7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1429504->9990143] (req 1429504->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.281373:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.281378:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.281732:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.281747:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468826624
00000100:00100000:1.0:1651532169.281753:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.281764:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.281770:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468826560
00000100:00100000:1.0:1651532169.281772:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.281781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.281783:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5020
00000100:00100000:0.0:1651532169.281789:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c84578f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468826624:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532169.281797:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5021
00010000:00010000:0.0:1651532169.281797:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.281800:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008d3729eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468826560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532169.281801:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532169.281814:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532169.281815:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.281818:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281822:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.281825:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468826688
00010000:00010000:1.0:1651532169.281827:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532169.281828:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.281834:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468826752
00010000:00010000:1.0:1651532169.281836:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.281837:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468826816
00000100:00100000:0.0:1651532169.281839:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5683
00010000:00010000:1.0:1651532169.281840:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532169.281841:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.281841:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007410240 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468826688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.281844:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.281846:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.281847:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414ae3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc60 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281849:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.281853:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.281854:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414ae3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc60 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.281861:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414ae3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc60 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532169.281863:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5684
00000100:00100000:1.0:1651532169.281864:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f469125 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468826752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.281865:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532169.281867:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.281870:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc67 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.281875:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007410240 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468826688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (112us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532169.281877:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc67 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532169.281878:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5683
00010000:00010000:1.0:1651532169.281881:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc67 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532169.281883:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5685
00010000:00010000:1.0:1651532169.281884:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003325411e, rc 0)
00000100:00100000:0.0:1651532169.281884:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077327089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468826816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.281887:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.281889:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414af1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc6e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.281894:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f469125 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468826752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (121us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532169.281895:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414af1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc6e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532169.281898:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5684
00010000:00010000:0.0:1651532169.281898:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414af1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc6e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.281901:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532169.281907:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077327089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468826816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.281909:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5685
00000100:00100000:1.0:1651532169.282208:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.282220:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468827136
00000100:00100000:0.0:1651532169.282232:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5686
00000100:00100000:0.0:1651532169.282234:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031ed18b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468827136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.282237:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.282240:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414af8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc75 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.282247:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414af8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc75 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.282251:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414af8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc75 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.282254:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532169.282264:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031ed18b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468827136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.282267:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5686
00000001:00080000:1.0:1651532169.394448:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794173 is committed
00010000:00010000:0.0:1651532169.394477:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.394482:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.394501:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468822656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 598929us (599010us total) trans 158913794173 rc 0/0
00000100:00100000:0.0:1651532169.394504:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5013
00010000:00010000:1.0:1651532169.394505:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394510:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.394511:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394515:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394521:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.394521:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.394522:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394525:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394535:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394538:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414a1f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3411968->9986047] (req 3411968->9986047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.394541:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.394548:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.394844:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.394854:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.394864:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468827264
00000100:00100000:1.0:1651532169.394877:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468827392
00000100:00100000:0.0:1651532169.394878:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532169.394897:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.394898:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5022
00000100:00100000:1.0:1651532169.394901:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468827264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532169.394901:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394908:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394912:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.394913:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394916:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00000100:00100000:0.0:1651532169.394916:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468822720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 599327us (599386us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532169.394917:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.394919:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5014
00010000:00010000:1.0:1651532169.394921:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394925:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.394925:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5023
00000100:00100000:0.0:1651532169.394926:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468827392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532169.394933:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.394937:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.394938:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.394938:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.394941:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532169.394942:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394947:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532169.394947:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394948:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394951:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.394951:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394959:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.394960:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.394960:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394963:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394971:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.394974:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414a26 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1810432->8200191] (req 1810432->8200191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.394983:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.394987:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.394997:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468827456
00000100:00100000:1.0:1651532169.395006:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5687
00000100:00100000:1.0:1651532169.395008:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468827456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.395011:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.395014:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b0d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc7c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.395022:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b0d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc7c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.395027:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b0d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc7c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.395045:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd9d4843, rc 0)
00000100:00100000:1.0:1651532169.395062:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468827456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (183us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.395065:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5687
00000100:00100000:0.0:1651532169.395282:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.395294:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468827648
00000100:00100000:1.0:1651532169.395306:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5688
00000100:00100000:1.0:1651532169.395308:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468827648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.395311:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.395315:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b14 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc83 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.395322:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b14 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc83 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.395327:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b14 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc83 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.395330:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e831956a, rc 0)
00000100:00100000:1.0:1651532169.395346:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468827648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.395351:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5688
00000100:00100000:0.0:1651532169.395417:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.395440:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468827904
00000100:00100000:0.0:1651532169.395451:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5689
00000100:00100000:0.0:1651532169.395453:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468827904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.395457:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.395461:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b1b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc8a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.395469:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b1b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc8a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.395473:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b1b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc8a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.395479:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532169.395489:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468827904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.395492:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5689
00000001:00080000:1.0:1651532169.461123:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794174 is committed
00010000:00010000:0.0:1651532169.461153:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461158:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461180:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.461182:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b658d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468823872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457783us (457891us total) trans 158913794174 rc 0/0
00000100:00100000:0.0:1651532169.461186:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5015
00010000:00010000:1.0:1651532169.461188:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.461189:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461192:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461198:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.461198:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.461199:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461202:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461206:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.461206:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.461207:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461209:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461237:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461240:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414a5e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1126400->9945087] (req 1126400->9945087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461247:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461249:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461251:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461252:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.461615:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.461624:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.461634:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.461638:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468828288
00000100:00100000:0.0:1651532169.461641:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.461649:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.461663:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468828352
00000100:00100000:1.0:1651532169.461675:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5024
00000100:00100000:1.0:1651532169.461676:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468828288:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532169.461677:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5025
00000100:00100000:0.0:1651532169.461679:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468828352:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532169.461684:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461688:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461689:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532169.461690:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461693:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532169.461694:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461698:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532169.461699:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461702:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532169.461703:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461707:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461708:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461711:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461711:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461722:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461725:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461728:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461736:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.461743:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468825024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341715us (341820us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532169.461746:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5017
00000100:00100000:1.0:1651532169.461751:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468823936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458306us (458449us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532169.461754:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5016
00000100:00100000:0.0:1651532169.461754:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468828480
00000100:00100000:0.0:1651532169.461762:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468828544
00000100:00100000:0.0:1651532169.461765:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468828608
00000100:00100000:0.0:1651532169.461768:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5690
00010000:00010000:1.0:1651532169.461769:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.461770:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468828480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.461772:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.461773:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.461774:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461775:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414b30 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc91 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461777:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461782:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.461783:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461785:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414b30 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc91 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.461786:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414a8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [610304->7909375] (req 610304->7909375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461789:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414b30 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc91 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.461790:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461792:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f4577ef already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532169.461792:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532169.461793:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461796:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461799:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532169.461799:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468828480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (164us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532169.461800:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.461801:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.461801:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5690
00010000:00010000:1.0:1651532169.461817:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.461819:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5691
00000100:00100000:0.0:1651532169.461821:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468828544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.461823:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461823:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.461826:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414a65 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [24576->9916415] (req 24576->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461826:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414b37 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc98 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.461831:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461832:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414b37 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc98 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.461834:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461836:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414b37 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc98 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.461840:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532169.461846:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468828544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (205us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.461848:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5691
00000100:00100000:0.0:1651532169.461852:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5692
00000100:00100000:0.0:1651532169.461853:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468828608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.461855:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.461857:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414b3e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dc9f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.461862:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414b3e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc9f expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.461866:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414b3e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dc9f expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.461869:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532169.461873:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468828608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (225us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.461876:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5692
00000100:00100000:1.0:1651532169.462368:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.462379:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.462380:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468828864
00000100:00100000:1.0:1651532169.462387:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.462391:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468828928
00000100:00100000:0.0:1651532169.462395:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5693
00000100:00100000:0.0:1651532169.462397:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000080b2f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468828864:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532169.462401:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532169.462402:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.462406:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414b45 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dca6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.462407:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.462418:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468829056
00010000:00010000:0.0:1651532169.462419:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414b45 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dca6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.462423:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414b45 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dca6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.462427:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532169.462431:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468828992
00000100:00100000:1.0:1651532169.462437:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5026
00000100:00100000:1.0:1651532169.462439:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468829056:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532169.462441:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000080b2f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468828864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.462443:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5693
00010000:00010000:1.0:1651532169.462446:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.462448:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468829120
00010000:00010000:1.0:1651532169.462451:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532169.462452:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532169.462452:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.462452:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5694
00000100:00100000:0.0:1651532169.462453:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029b159ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468828928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.462455:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.462456:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.462459:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414b53 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcad expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.462462:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5027
00000100:00100000:1.0:1651532169.462464:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468828992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532169.462465:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414b53 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcad expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.462468:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.462469:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414b53 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcad expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.462471:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532169.462472:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.462475:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.462475:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:1.0:1651532169.462477:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532169.462478:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.462480:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029b159ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468828928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (101us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532169.462482:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.462482:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5694
00010000:00010000:1.0:1651532169.462485:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.462486:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5695
00000100:00100000:0.0:1651532169.462488:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468829120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.462489:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.462490:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.462492:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414b61 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcb4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.462497:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414b61 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcb4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.462500:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414b61 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcb4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.462503:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532169.462507:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468829120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 19us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.462509:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5695
00000100:00100000:1.0:1651532169.462835:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.462846:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468829312
00000100:00100000:1.0:1651532169.462847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.462856:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468829440
00000100:00100000:0.0:1651532169.462860:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5696
00000100:00100000:0.0:1651532169.462862:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468829312:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532169.462863:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5697
00000100:00100000:1.0:1651532169.462865:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468829440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.462866:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.462869:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.462870:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414b68 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcbb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.462873:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414b6f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcc2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.462877:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414b68 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcbb expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.462881:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414b68 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcbb expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.462882:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414b6f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcc2 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.462885:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:1.0:1651532169.462886:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414b6f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcc2 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.462891:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:0.0:1651532169.462895:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468829312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.462897:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5696
00000100:00100000:1.0:1651532169.462903:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468829440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.462909:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5697
00000100:00100000:1.0:1651532169.462976:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.462985:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468829568
00000100:00100000:1.0:1651532169.462992:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5698
00000100:00100000:1.0:1651532169.462994:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468829568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.462997:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.463001:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414b76 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcc9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.463008:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414b76 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcc9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.463012:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414b76 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcc9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.463015:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:1.0:1651532169.463029:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468829568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.463032:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5698
00000100:00100000:1.0:1651532169.463187:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.463196:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.463202:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468829760
00000100:00100000:1.0:1651532169.463208:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468829824
00000100:00100000:1.0:1651532169.463216:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5699
00000100:00100000:1.0:1651532169.463218:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468829760:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532169.463220:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5700
00010000:00010000:1.0:1651532169.463222:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532169.463222:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468829824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.463225:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b7d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcd0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.463226:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.463229:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b84 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcd7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.463233:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b7d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcd0 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.463236:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b84 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcd7 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.463237:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b7d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcd0 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.463240:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c308001, rc 0)
00010000:00010000:0.0:1651532169.463240:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b84 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcd7 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.463246:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532169.463253:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468829760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.463255:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5699
00000100:00100000:0.0:1651532169.463260:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468829824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.463263:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5700
00000001:00080000:1.0:1651532169.586156:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794175 is committed
00002000:00010000:1.0:1651532169.586170:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532168 -> 1651532169
00010000:00010000:1.0:1651532169.586174:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586177:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.586195:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468824960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466125us (466251us total) trans 158913794175 rc 0/0
00000100:00100000:1.0:1651532169.586199:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5018
00010000:00010000:1.0:1651532169.586205:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586209:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0993fe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.586210:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586213:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586218:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.586219:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.586220:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586222:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586226:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.586226:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.586227:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586230:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586244:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586247:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0993fe/0xa29a79078f414a9d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [36864->9900031] (req 36864->9900031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586252:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.586254:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586257:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.586259:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586271:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586274:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.586287:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be9fcfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468825280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 465624us (465708us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532169.586290:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5019
00010000:00010000:1.0:1651532169.586296:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586299:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6cf3eaf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.586300:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586303:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586320:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586324:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6cf3eaf/0xa29a79078f414aa4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1880064->1884159] (req 1880064->1884159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.586482:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.586487:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.586507:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c84578f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468826624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 304717us (304776us total) trans 0 rc 28672/28672
00010000:00010000:1.0:1651532169.586508:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.586511:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5020
00010000:00010000:1.0:1651532169.586512:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.586513:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586516:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586521:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.586522:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.586523:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586526:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586533:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.586539:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.586543:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586547:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414ad5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2478080->9756671] (req 2478080->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.586824:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.586833:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.586843:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468830208
00000100:00100000:0.0:1651532169.586843:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.586849:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.586861:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468830144
00000100:00100000:0.0:1651532169.586861:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.586870:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.586873:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5028
00000100:00100000:1.0:1651532169.586879:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468830208:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532169.586880:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5029
00000100:00100000:0.0:1651532169.586883:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468830144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532169.586887:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586891:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532169.586891:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586892:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586895:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532169.586896:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.586900:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532169.586901:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.586904:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532169.586905:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586908:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.586909:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586912:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.586913:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.586921:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468830336
00000100:00100000:1.0:1651532169.586926:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468830464
00000100:00100000:1.0:1651532169.586928:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468830528
00000100:00100000:1.0:1651532169.586931:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468830656
00000100:00100000:1.0:1651532169.586933:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5701
00000100:00100000:1.0:1651532169.586935:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468830336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.586938:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.586940:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414b99 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcde expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586947:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414b99 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcde expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.586954:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e51273/0xa29a79078f414b99 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcde expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.586958:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2e51273, rc 0)
00000100:00100000:1.0:1651532169.586972:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468830336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.586975:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5701
00000100:00100000:1.0:1651532169.586980:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5702
00000100:00100000:1.0:1651532169.586981:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468830464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.586984:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.586986:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414ba0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dce5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.586987:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5703
00000100:00100000:0.0:1651532169.586989:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468830528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.586992:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414ba0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dce5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.586992:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.586996:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ec252b9/0xa29a79078f414ba0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dce5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.586996:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414ba7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcec expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.586999:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ec252b9, rc 0)
00000100:00100000:1.0:1651532169.587004:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468830464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (155us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532169.587004:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414ba7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcec expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532169.587006:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5702
00010000:00010000:0.0:1651532169.587008:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414ba7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcec expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532169.587010:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5704
00010000:00010000:0.0:1651532169.587011:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532169.587012:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468830656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.587014:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.587016:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414bae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcf3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.587020:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468830528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (159us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532169.587021:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414bae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcf3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532169.587023:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5703
00010000:00010000:1.0:1651532169.587024:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4577ef/0xa29a79078f414bae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcf3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.587027:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f4577ef, rc 0)
00000100:00100000:1.0:1651532169.587032:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468830656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (162us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.587035:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5704
00000100:00100000:0.0:1651532169.587296:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.587317:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468830784
00000100:00100000:0.0:1651532169.587320:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.587343:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468830912
00000100:00100000:1.0:1651532169.587360:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5705
00000100:00100000:1.0:1651532169.587361:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468830784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.587365:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532169.587365:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5706
00000100:00100000:0.0:1651532169.587367:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090f29ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468830912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.587369:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414bb5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dcfa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.587371:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.587374:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414bbc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd01 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.587376:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414bb5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcfa expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.587381:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8ea379/0xa29a79078f414bb5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dcfa expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.587382:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414bbc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd01 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.587385:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff8ea379, rc 0)
00010000:00010000:0.0:1651532169.587386:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414bbc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd01 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.587390:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532169.587398:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003c4d859a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468830784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (103us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.587401:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5705
00000100:00100000:0.0:1651532169.587405:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090f29ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468830912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.587408:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5706
00000100:00100000:0.0:1651532169.587536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.587550:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.587561:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468831040
00000100:00100000:1.0:1651532169.587569:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468831104
00000100:00100000:1.0:1651532169.587577:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5707
00000100:00100000:1.0:1651532169.587578:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468831040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532169.587580:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5708
00010000:00010000:1.0:1651532169.587582:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532169.587583:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f38c3f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468831104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.587585:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414bc3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd08 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.587586:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.587589:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414bca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd0f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.587593:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414bc3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd08 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.587596:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414bca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd0f expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.587597:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a75099f/0xa29a79078f414bc3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd08 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.587600:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a75099f, rc 0)
00010000:00010000:0.0:1651532169.587601:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414bca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd0f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.587604:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532169.587613:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468831040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.587616:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5707
00000100:00100000:0.0:1651532169.587619:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f38c3f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468831104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.587621:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5708
00000100:00100000:0.0:1651532169.587666:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.587704:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468831360
00000100:00100000:1.0:1651532169.587715:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5709
00000100:00100000:1.0:1651532169.587717:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047562140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468831360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.587720:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.587724:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f414bd1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd16 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.587731:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f414bd1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd16 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.587734:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b05056e/0xa29a79078f414bd1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd16 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.587738:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b05056e, rc 0)
00000100:00100000:1.0:1651532169.587750:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047562140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468831360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.587753:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5709
00000100:00100000:0.0:1651532169.587904:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.587923:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468831488
00000100:00100000:1.0:1651532169.587934:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5710
00000100:00100000:1.0:1651532169.587936:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073c8f72e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468831488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.587939:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.587943:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bd8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd1d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.587950:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bd8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd1d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.587954:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bd8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd1d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.587961:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532169.587973:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073c8f72e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468831488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.587976:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5710
00000001:00080000:1.0:1651532169.644510:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794176 is committed
00010000:00010000:0.0:1651532169.644541:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.644546:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.644567:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008d3729eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468826560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 362766us (362813us total) trans 158913794176 rc 0/0
00010000:00010000:1.0:1651532169.644569:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.644570:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5021
00010000:00010000:1.0:1651532169.644574:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3601aa2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.644575:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.644578:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.644584:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.644584:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.644585:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.644588:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.644596:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.644601:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.644605:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.644611:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3601aa2/0xa29a79078f414adc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1363968->9412607] (req 1363968->9412607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.644868:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.644900:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.644911:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.644918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.644927:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468831936
00000100:00100000:0.0:1651532169.644940:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468831872
00000100:00100000:1.0:1651532169.644941:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5030
00000100:00100000:1.0:1651532169.644944:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0d9497 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468831936:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532169.644955:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5031
00010000:00010000:1.0:1651532169.644963:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.644966:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468831872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532169.644968:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532169.644969:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.644972:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532169.644973:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.644974:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.644978:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532169.644979:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.644982:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532169.644983:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.644990:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.644991:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.644994:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.644994:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.645002:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468832000
00000100:00100000:1.0:1651532169.645003:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468832064
00000100:00100000:0.0:1651532169.645013:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5711
00000100:00100000:0.0:1651532169.645015:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c207e8e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468832000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.645017:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532169.645019:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5712
00010000:00010000:0.0:1651532169.645020:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414bed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd24 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.645021:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000843fdbf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468832064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.645024:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.645027:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414bf4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd2b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.645027:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414bed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd24 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.645031:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414bed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd24 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.645034:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:1.0:1651532169.645037:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414bf4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd2b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.645041:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414bf4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd2b expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.645044:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532169.645045:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c207e8e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468832000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (134us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.645048:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5711
00000100:00100000:1.0:1651532169.645053:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000843fdbf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468832064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (135us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.645056:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5712
00000100:00100000:0.0:1651532169.645061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.645075:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468832128
00000100:00100000:1.0:1651532169.645085:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5713
00000100:00100000:1.0:1651532169.645087:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c83d56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468832128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.645089:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532169.645094:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532169.645103:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414bfb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd32 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.645114:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468832192
00000100:00100000:0.0:1651532169.645119:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5714
00000100:00100000:0.0:1651532169.645121:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057711e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468832192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.645122:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414bfb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd32 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.645124:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.645127:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414bfb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd32 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.645128:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c02 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd39 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.645130:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532169.645135:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c02 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd39 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.645139:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c02 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd39 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532169.645144:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c83d56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468832128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.645148:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5713
00010000:00010000:0.0:1651532169.645149:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532169.645157:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057711e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468832192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.645160:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5714
00000001:00080000:1.0:1651532169.711491:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794177 is committed
00010000:00010000:0.0:1651532169.711522:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.711526:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.711545:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468827264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 316644us (316702us total) trans 158913794177 rc 0/0
00010000:00010000:1.0:1651532169.711549:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.711549:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5022
00010000:00010000:1.0:1651532169.711553:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003325411e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.711554:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711558:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711563:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.711564:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.711565:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711568:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.711585:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711586:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.711590:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711592:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003325411e/0xa29a79078f414aff lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8466432->8470527] (req 8466432->8470527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.711753:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.711757:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711778:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.711779:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468827392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316851us (316924us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532169.711782:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5023
00010000:00010000:1.0:1651532169.711785:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.711786:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711789:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711793:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.711794:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.711795:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711798:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711829:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711833:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414b06 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [466944->9392127] (req 466944->9392127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711839:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.711842:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.712117:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.712125:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.712131:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.712137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.712147:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468832768
00000100:00100000:0.0:1651532169.712158:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468832704
00000100:00100000:0.0:1651532169.712165:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5032
00000100:00100000:0.0:1651532169.712167:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000937d196b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468832768:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532169.712174:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.712178:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532169.712179:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.712185:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532169.712186:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.712190:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.712194:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.712198:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5033
00000100:00100000:1.0:1651532169.712201:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468832704:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532169.712202:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468832832
00000100:00100000:0.0:1651532169.712210:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468832960
00000100:00100000:0.0:1651532169.712217:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5715
00000100:00100000:0.0:1651532169.712218:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468832832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.712219:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.712221:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.712223:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414c17 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd40 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.712224:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532169.712225:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.712228:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532169.712229:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.712234:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.712234:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414c17 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd40 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.712237:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.712238:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414c17 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd40 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.712242:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532169.712246:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5716
00000100:00100000:1.0:1651532169.712248:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468832960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.712251:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532169.712252:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468832832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (121us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532169.712253:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c1e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd47 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.712255:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5715
00010000:00010000:1.0:1651532169.712260:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c1e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd47 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.712264:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c1e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd47 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.712268:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532169.712277:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468832960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.712326:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5716
00000100:00100000:0.0:1651532169.712555:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.712576:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468833152
00000100:00100000:1.0:1651532169.712589:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5717
00000100:00100000:1.0:1651532169.712591:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468833152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.712594:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.712598:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c25 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd4e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.712605:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c25 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd4e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.712609:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c25 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd4e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.712613:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532169.712626:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468833152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.712628:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5717
00000001:00080000:1.0:1651532169.777953:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794178 is committed
00002000:00010000:1.0:1651532169.777968:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532168 -> 1651532169
00010000:00010000:1.0:1651532169.777971:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.777974:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.777997:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468828288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 316320us (316382us total) trans 158913794178 rc 0/0
00000100:00100000:1.0:1651532169.778001:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5024
00010000:00010000:1.0:1651532169.778008:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778011:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e831956a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.778012:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778015:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778020:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.778021:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.778021:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778025:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778039:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.778041:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.778042:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778050:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778065:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778068:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e831956a/0xa29a79078f414b22 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [28672->9535487] (req 28672->9535487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778075:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778078:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778078:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778083:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.778318:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532169.778342:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778346:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778350:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778363:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.778379:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468829056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 315939us (315992us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532169.778380:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468828352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316700us (316755us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532169.778384:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5026
00000100:00100000:0.0:1651532169.778386:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5025
00010000:00010000:1.0:1651532169.778394:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778404:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9d4843 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.778405:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778409:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778414:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778417:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9d4843/0xa29a79078f414b4c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->4534271] (req 344064->4534271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778423:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778427:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532169.778428:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778431:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778439:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532169.778440:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532169.778441:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778444:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.778447:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532169.778457:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778460:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414b29 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [376832->5562367] (req 376832->5562367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.778469:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468833280
00000100:00100000:1.0:1651532169.778470:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.778484:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468833472
00000100:00100000:0.0:1651532169.778487:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468833536
00000100:00100000:0.0:1651532169.778490:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5718
00000100:00100000:0.0:1651532169.778491:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468833280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.778495:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.778497:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414c2c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd55 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778505:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414c2c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd55 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.778507:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778509:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414c2c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd55 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.778511:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778512:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532169.778526:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468833280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (209us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.778529:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5718
00000100:00100000:0.0:1651532169.778534:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5719
00000100:00100000:0.0:1651532169.778536:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468833472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.778538:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.778540:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414c33 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd5c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778546:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414c33 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd5c expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.778550:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414c33 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd5c expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.778553:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532169.778559:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468833472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.778562:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5719
00000100:00100000:0.0:1651532169.778565:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5720
00000100:00100000:0.0:1651532169.778566:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468833536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.778569:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.778570:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414c3a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd63 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778575:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414c3a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd63 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.778579:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414c3a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd63 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.778582:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532169.778595:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468833536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (125us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.778598:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5720
00000100:00100000:0.0:1651532169.778786:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.778846:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.778857:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468833600
00000100:00100000:0.0:1651532169.778869:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468833664
00000100:00100000:0.0:1651532169.778876:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5034
00000100:00100000:0.0:1651532169.778878:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468833600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532169.778885:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.778888:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5035
00000100:00100000:1.0:1651532169.778890:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009daa8341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468833664:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532169.778890:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532169.778891:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532169.778891:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.778895:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778899:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778904:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532169.778905:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778908:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778910:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532169.778911:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778915:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778918:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.778921:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.778977:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.779012:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468833856
00000100:00100000:1.0:1651532169.779028:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5721
00000100:00100000:1.0:1651532169.779031:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad64e1dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468833856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.779037:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.779048:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c4f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd6a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.779057:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c4f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd6a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.779064:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c4f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd6a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.779068:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532169.779082:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad64e1dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468833856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.779090:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.779097:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5721
00000100:00100000:1.0:1651532169.779103:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468834048
00000100:00100000:0.0:1651532169.779120:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5722
00000100:00100000:0.0:1651532169.779122:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcaeca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468834048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.779126:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.779129:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414c56 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd71 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.779137:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414c56 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd71 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.779141:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414c56 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd71 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.779144:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532169.779154:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcaeca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468834048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.779156:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5722
00000001:00080000:1.0:1651532169.887050:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794179 is committed
00010000:00010000:1.0:1651532169.887067:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887073:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.887092:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468828992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 424627us (424684us total) trans 158913794179 rc 0/0
00000100:00100000:1.0:1651532169.887096:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5027
00010000:00010000:1.0:1651532169.887104:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887108:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0e2fe1d already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.887109:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887112:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887118:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.887118:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.887119:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887123:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887130:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887133:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e2fe1d/0xa29a79078f414b5a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1699840->10080255] (req 1699840->10080255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887138:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887141:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887363:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887368:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532169.887389:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468830208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 300508us (300565us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532169.887394:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5028
00010000:00010000:1.0:1651532169.887402:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887405:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c308001 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532169.887406:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887409:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887414:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.887415:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532169.887416:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887428:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887438:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887441:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c308001/0xa29a79078f414b8b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4136960->9129983] (req 4136960->9129983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.887445:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.887449:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.887544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.887579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.887588:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.887595:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.887596:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468834432
00000100:00100000:0.0:1651532169.887602:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468834496
00000100:00100000:1.0:1651532169.887610:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468834368
00000100:00100000:0.0:1651532169.887617:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468834560
00000100:00100000:1.0:1651532169.887626:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5036
00000100:00100000:0.0:1651532169.887626:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5723
00000100:00100000:1.0:1651532169.887628:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c2102e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468834432:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532169.887628:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f469125 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468834496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.887632:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.887635:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.887636:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414c64 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd78 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887640:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532169.887641:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532169.887642:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887647:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.887648:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414c64 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd78 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.887652:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414c64 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd78 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532169.887654:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5037
00000100:00100000:1.0:1651532169.887655:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007410240 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468834368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532169.887656:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532169.887660:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887663:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532169.887664:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.887668:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f469125 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468834496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.887670:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5723
00010000:00010000:1.0:1651532169.887673:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.887675:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5724
00010000:00010000:1.0:1651532169.887676:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532169.887676:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.887677:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077327089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468834560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.887679:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.887681:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.887682:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414c72 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd7f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887686:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887690:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.887690:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414c72 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd7f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.887694:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414c72 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd7f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.887697:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532169.887702:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077327089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468834560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.887723:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5724
00000100:00100000:1.0:1651532169.887753:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.887765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.887868:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468834624
00000100:00100000:0.0:1651532169.887875:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468834688
00000100:00100000:0.0:1651532169.887883:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5725
00000100:00100000:0.0:1651532169.887885:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468834624:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532169.887886:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5726
00000100:00100000:1.0:1651532169.887888:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468834688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.887888:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.887891:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414c79 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd86 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.887892:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.887897:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414c80 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd8d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.887899:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414c79 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd86 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.887903:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414c79 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd86 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.887906:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:1.0:1651532169.887909:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414c80 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd8d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.887917:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414c80 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd8d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532169.887917:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468834624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (165us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.887920:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5725
00010000:00010000:1.0:1651532169.887924:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532169.887937:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468834688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (171us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.887940:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5726
00000100:00100000:0.0:1651532169.887962:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.887976:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468834880
00000100:00100000:1.0:1651532169.888008:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5727
00000100:00100000:1.0:1651532169.888010:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031ed18b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468834880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.888013:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.888017:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414c87 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd94 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.888026:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414c87 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd94 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.888030:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414c87 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd94 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.888047:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532169.888059:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031ed18b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468834880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.888062:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5727
00000100:00100000:0.0:1651532169.888239:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.888252:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532169.888258:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468835008
00000100:00100000:0.0:1651532169.888260:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468835136
00000100:00100000:1.0:1651532169.888269:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5728
00000100:00100000:1.0:1651532169.888271:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000080b2f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468835008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532169.888274:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532169.888275:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5729
00010000:00010000:1.0:1651532169.888277:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414c8e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dd9b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532169.888277:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029b159ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468835136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.888281:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532169.888284:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414c8e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd9b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.888285:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414c95 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dda2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532169.888289:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414c8e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dd9b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532169.888292:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532169.888292:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414c95 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dda2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.888296:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414c95 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dda2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.888299:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532169.888302:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000080b2f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468835008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532169.888305:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5728
00000100:00100000:0.0:1651532169.888307:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029b159ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468835136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.888310:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5729
00000100:00100000:0.0:1651532169.888363:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.888371:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468835264
00000100:00100000:0.0:1651532169.888377:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5730
00000100:00100000:0.0:1651532169.888379:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468835264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.888382:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.888385:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414c9c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dda9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.888392:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414c9c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dda9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.888396:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414c9c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dda9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.888399:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532169.888411:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468835264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.888414:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5730
00000100:00100000:0.0:1651532169.888545:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532169.888552:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468835392
00000100:00100000:0.0:1651532169.888558:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5731
00000100:00100000:0.0:1651532169.888560:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468835392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532169.888563:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532169.888566:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414ca3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ddb0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532169.888573:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414ca3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddb0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.888577:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414ca3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddb0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532169.888580:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532169.888594:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468835392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532169.888597:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5731
00000001:00080000:0.0:1651532170.037828:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794180 is committed
00010000:00010000:0.0:1651532170.037843:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.037847:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.037863:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468830144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 450980us (451029us total) trans 158913794180 rc 0/0
00000100:00100000:0.0:1651532170.037866:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5029
00010000:00010000:0.0:1651532170.037872:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.037876:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.037877:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.037880:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.037885:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.037886:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.037887:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.037890:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.037903:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.037906:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414b92 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1658880->8191999] (req 1658880->8191999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.037915:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.037922:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.038319:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.038328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.038334:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.038340:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.038346:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.038368:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468835776
00000100:00100000:0.0:1651532170.038379:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468835840
00010000:00010000:1.0:1651532170.038382:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.038384:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5038
00000100:00100000:0.0:1651532170.038386:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468835776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532170.038387:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.038393:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.038397:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.038398:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.038401:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532170.038402:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.038405:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0d9497 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468831936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 393460us (393537us total) trans 0 rc 40960/40960
00010000:00010000:0.0:1651532170.038407:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.038408:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5030
00010000:00010000:0.0:1651532170.038410:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.038415:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5039
00000100:00100000:1.0:1651532170.038417:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468835840:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532170.038417:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468835904
00000100:00100000:0.0:1651532170.038426:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468835968
00000100:00100000:0.0:1651532170.038428:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468836032
00010000:00010000:1.0:1651532170.038431:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.038431:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5732
00000100:00100000:0.0:1651532170.038432:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468835904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.038435:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.038436:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.038437:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.038438:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414cb8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ddb7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.038440:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532170.038441:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.038444:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.038447:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.038447:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414cb8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddb7 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.038450:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.038451:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414cb8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddb7 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.038455:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:1.0:1651532170.038456:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.038460:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532170.038460:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.038463:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.038463:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468835904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.038467:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5732
00010000:00010000:1.0:1651532170.038468:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.038469:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.038469:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.038471:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5733
00010000:00010000:1.0:1651532170.038472:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.038473:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468835968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.038475:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.038477:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414cbf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ddbe expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.038482:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414cbf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddbe expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.038485:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.038488:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414bdf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [835584->10452991] (req 835584->10452991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.038494:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414cbf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddbe expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532170.038496:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5734
00000100:00100000:1.0:1651532170.038498:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468836032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.038498:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:1.0:1651532170.038501:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.038504:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414cc6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ddc5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.038504:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468835968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (163us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.038506:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5733
00010000:00010000:1.0:1651532170.038512:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414cc6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddc5 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.038515:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.038517:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414cc6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddc5 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.038518:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.038520:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532170.038528:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468836032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (181us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.038531:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5734
00000100:00100000:1.0:1651532170.038974:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.038990:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.039000:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.039002:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468836224
00000100:00100000:1.0:1651532170.039011:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.039020:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468836352
00000100:00100000:0.0:1651532170.039022:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468836480
00000100:00100000:1.0:1651532170.039027:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468836544
00000100:00100000:1.0:1651532170.039030:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5735
00000100:00100000:1.0:1651532170.039032:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468836224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.039036:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532170.039037:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5736
00000100:00100000:0.0:1651532170.039039:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468836352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.039040:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414ccd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ddcc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.039042:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.039046:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414cd4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ddd3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.039047:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414ccd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddcc expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.039052:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414ccd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddcc expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.039054:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414cd4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddd3 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.039055:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532170.039058:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414cd4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddd3 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.039061:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532170.039068:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468836224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.039071:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5735
00000100:00100000:1.0:1651532170.039077:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5737
00000100:00100000:0.0:1651532170.039077:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468836352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.039079:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468836544:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532170.039080:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5736
00010000:00010000:1.0:1651532170.039081:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.039083:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414cdb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dde1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.039086:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5738
00000100:00100000:0.0:1651532170.039087:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468836480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.039089:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414cdb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dde1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.039090:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.039092:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414ce2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ddda expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.039096:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414cdb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dde1 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.039098:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414ce2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddda expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.039099:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532170.039102:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414ce2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddda expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532170.039105:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468836544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.039108:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5737
00010000:00010000:0.0:1651532170.039118:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532170.039125:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468836480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (125us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.039128:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5738
00000100:00100000:1.0:1651532170.039444:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.039456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.039456:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468836736
00000100:00100000:1.0:1651532170.039463:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468836800
00000100:00100000:0.0:1651532170.039468:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5739
00000100:00100000:0.0:1651532170.039470:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468836736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.039473:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532170.039476:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5740
00010000:00010000:0.0:1651532170.039477:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414ce9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dde8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.039478:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468836800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.039481:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.039484:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414ce9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dde8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.039485:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414cf0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ddef expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.039488:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414ce9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dde8 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.039491:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532170.039492:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414cf0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddef expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.039496:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414cf0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddef expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.039499:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532170.039501:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468836736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.039504:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5739
00000100:00100000:1.0:1651532170.039507:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468836800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.039511:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5740
00000100:00100000:1.0:1651532170.039771:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.039779:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.039785:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468837120
00000100:00100000:1.0:1651532170.039790:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468837184
00000100:00100000:1.0:1651532170.039799:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5741
00000100:00100000:1.0:1651532170.039801:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468837120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.039813:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532170.039816:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5742
00000100:00100000:0.0:1651532170.039818:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468837184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.039821:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414cf7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ddf6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.039822:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.039829:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414cf7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddf6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.039832:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414cf7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddf6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.039833:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414cfe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ddfd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.039836:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532170.039840:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414cfe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddfd expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.039844:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414cfe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ddfd expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532170.039848:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468837120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.039851:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5741
00010000:00010000:0.0:1651532170.039854:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532170.039862:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468837184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.039865:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5742
00000001:00080000:0.0:1651532170.111302:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794181 is committed
00010000:00010000:0.0:1651532170.111318:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111322:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.111345:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468831872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466378us (466444us total) trans 158913794181 rc 0/0
00000100:00100000:0.0:1651532170.111348:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5031
00010000:00010000:0.0:1651532170.111365:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111368:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.111369:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111380:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111385:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.111386:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.111387:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111390:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111398:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111401:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414be6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [471040->10174463] (req 471040->10174463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111406:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111409:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.111872:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.111883:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468837440
00000100:00100000:1.0:1651532170.111884:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.111893:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.111902:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.111905:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468837504
00000100:00100000:0.0:1651532170.111911:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5040
00000100:00100000:0.0:1651532170.111913:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468837440:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532170.111927:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468837696
00010000:00010000:0.0:1651532170.111931:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.111935:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468837824
00010000:00010000:0.0:1651532170.111936:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.111937:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.111940:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5743
00010000:00010000:0.0:1651532170.111940:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532170.111940:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.111942:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468837696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.111945:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.111946:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.111948:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.111950:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414d0c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de04 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.111956:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532170.111956:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5041
00000100:00100000:0.0:1651532170.111958:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468837504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532170.111959:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414d0c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de04 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.111962:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.111963:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414d0c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de04 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.111966:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532170.111966:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.111967:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111969:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532170.111970:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111976:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.111980:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468837696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.111982:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5743
00010000:00010000:0.0:1651532170.111986:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.111987:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5744
00000100:00100000:1.0:1651532170.111989:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468837824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.111991:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.111994:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d1a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de0b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.111997:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.112000:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112003:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.112005:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d1a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de0b expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532170.112018:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000937d196b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468832768:12345-10.240.43.64@tcp:3:fio.0 Request processed in 399850us (399902us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532170.112019:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d1a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de0b expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532170.112021:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5032
00010000:00010000:1.0:1651532170.112022:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532170.112028:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468837824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (126us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.112031:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5744
00010000:00010000:1.0:1651532170.112039:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112042:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532170.112043:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112046:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112051:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.112052:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.112053:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112065:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112068:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.112069:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.112070:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112072:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112084:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.112086:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112087:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414c09 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2363392->10252287] (req 2363392->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.112090:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112092:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.112095:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.112366:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.112451:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468838144
00000100:00100000:0.0:1651532170.112463:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5745
00000100:00100000:0.0:1651532170.112465:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468838144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.112468:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.112472:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d21 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de12 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.112480:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d21 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de12 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.112485:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d21 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de12 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.112488:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532170.112503:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468838144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (137us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.112506:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5745
00000001:00080000:0.0:1651532170.269583:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794183 is committed
00010000:00010000:0.0:1651532170.269603:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269607:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.269622:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.269626:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.269626:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468833600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490747us (490840us total) trans 158913794182 rc 0/0
00000100:00100000:0.0:1651532170.269629:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5034
00000100:00100000:1.0:1651532170.269647:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468832704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557445us (557522us total) trans 158913794183 rc 0/0
00000100:00100000:1.0:1651532170.269651:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5033
00010000:00010000:1.0:1651532170.269659:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.269663:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532170.269664:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.269667:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269667:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269680:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532170.269681:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269681:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.269684:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414c41 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [167936->2142207] (req 167936->2142207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269685:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269690:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.269691:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.269692:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269695:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269698:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.269698:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.269699:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269702:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269713:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269716:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414c10 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2920448->10350591] (req 2920448->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.269721:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.269724:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269726:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.269728:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.270045:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.270085:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.270098:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.270104:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468838336
00000100:00100000:0.0:1651532170.270105:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.270113:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.270132:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468838464
00000100:00100000:1.0:1651532170.270142:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5042
00000100:00100000:1.0:1651532170.270144:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468838336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532170.270146:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270150:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270151:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270156:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532170.270162:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270165:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532170.270166:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.270170:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c2102e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468834432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 382541us (382626us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532170.270173:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5036
00010000:00010000:1.0:1651532170.270175:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270179:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.270179:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5043
00000100:00100000:0.0:1651532170.270181:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468838464:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532170.270186:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468838400
00010000:00010000:0.0:1651532170.270187:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270191:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532170.270192:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468838528
00010000:00010000:0.0:1651532170.270192:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.270195:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468838720
00010000:00010000:0.0:1651532170.270195:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532170.270196:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.270198:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5746
00000100:00100000:1.0:1651532170.270199:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468838400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.270202:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.270203:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270205:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414d36 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de19 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270207:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270210:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.270213:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414d36 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de19 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.270217:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414d36 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de19 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532170.270219:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5747
00000100:00100000:0.0:1651532170.270221:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468838528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.270223:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532170.270223:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.270226:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d3d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de20 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270231:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532170.270232:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468838400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (188us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532170.270234:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d3d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de20 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532170.270235:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5746
00010000:00010000:0.0:1651532170.270238:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d3d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de20 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532170.270240:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5748
00000100:00100000:1.0:1651532170.270241:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468838720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.270241:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:1.0:1651532170.270244:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.270246:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414d44 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de27 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.270248:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468838528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (143us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532170.270250:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532170.270251:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5747
00010000:00010000:1.0:1651532170.270252:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414d44 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de27 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.270256:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414d44 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de27 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.270259:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532170.270262:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.270264:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468838720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (151us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.270266:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5748
00010000:00010000:0.0:1651532170.270268:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.270269:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270272:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270277:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270277:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270279:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414c5d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2904064->8216575] (req 2904064->8216575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270280:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270288:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.270291:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009daa8341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468833664:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491401us (491445us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532170.270291:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.270292:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.270294:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5035
00010000:00010000:0.0:1651532170.270294:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270298:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.270298:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.270299:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270304:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270314:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270317:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414c48 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [983040->7696383] (req 983040->7696383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270324:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270327:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.270613:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.270635:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.270648:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468838784
00000100:00100000:1.0:1651532170.270660:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468838912
00000100:00100000:1.0:1651532170.270673:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5044
00000100:00100000:1.0:1651532170.270674:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc8fc170 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468838912:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532170.270683:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270687:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532170.270689:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270692:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.270701:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5045
00000100:00100000:0.0:1651532170.270703:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468838784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532170.270711:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270715:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.270716:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270719:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532170.270720:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270725:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270728:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.270747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.270754:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468838976
00000100:00100000:0.0:1651532170.270760:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5749
00000100:00100000:0.0:1651532170.270762:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468838976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.270765:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.270789:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d59 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de2e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.270798:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d59 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de2e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.270817:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d59 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de2e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532170.270821:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532170.270821:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532170.270831:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468839232
00000100:00100000:0.0:1651532170.270832:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468838976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 69us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.270834:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5749
00000100:00100000:1.0:1651532170.270842:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5750
00000100:00100000:1.0:1651532170.270844:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000874d3732 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468839232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.270848:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.270851:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414d60 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de35 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.270861:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414d60 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de35 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.270865:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414d60 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de35 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.270876:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532170.270887:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000874d3732 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468839232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.270890:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5750
00000100:00100000:0.0:1651532170.271124:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.271143:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468839424
00000100:00100000:1.0:1651532170.271154:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5751
00000100:00100000:1.0:1651532170.271156:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008d682773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468839424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.271159:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.271162:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d67 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de3c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.271169:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d67 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de3c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.271173:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d67 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de3c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.271177:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532170.271187:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008d682773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468839424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.271189:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5751
00000100:00100000:0.0:1651532170.271419:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.271437:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468839552
00000100:00100000:1.0:1651532170.271449:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5752
00000100:00100000:1.0:1651532170.271451:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468839552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.271454:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.271457:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414d6e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de43 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.271464:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414d6e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de43 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.271468:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414d6e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de43 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.271472:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532170.271481:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edcb9aea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468839552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.271484:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5752
00000001:00080000:0.0:1651532170.427938:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794184 is committed
00010000:00010000:0.0:1651532170.427953:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.427958:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.427974:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007410240 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468834368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 540318us (540395us total) trans 158913794184 rc 0/0
00000100:00100000:0.0:1651532170.427977:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5037
00010000:00010000:0.0:1651532170.427984:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.427988:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.427989:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.427992:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.427997:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.427997:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.427998:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428001:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428010:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428013:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414c6b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6037504->10133503] (req 6037504->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428018:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428021:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.428405:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.428413:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.428421:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.428433:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468839808
00000100:00100000:1.0:1651532170.428434:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468839936
00000100:00100000:0.0:1651532170.428443:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468839744
00000100:00100000:1.0:1651532170.428449:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5753
00000100:00100000:1.0:1651532170.428452:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000751b73ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468839936:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532170.428455:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5046
00010000:00010000:1.0:1651532170.428456:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532170.428457:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb909c4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468839808:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532170.428461:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414d75 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de4a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428464:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428470:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.428471:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428474:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532170.428475:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428479:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.428480:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414d75 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de4a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.428483:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.428485:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414d75 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de4a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.428489:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532170.428490:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5047
00000100:00100000:0.0:1651532170.428492:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8b308e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468839744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532170.428496:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428499:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.428500:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.428502:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000751b73ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468839936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (80us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532170.428503:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.428505:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5753
00010000:00010000:0.0:1651532170.428505:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532170.428506:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428509:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428512:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.428515:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532170.486277:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794185 is committed
00010000:00010000:0.0:1651532170.486291:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486295:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.486311:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468835776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 447924us (447993us total) trans 158913794185 rc 0/0
00000100:00100000:0.0:1651532170.486314:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5038
00010000:00010000:0.0:1651532170.486321:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486324:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.486325:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486328:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486333:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.486333:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.486334:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486340:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486352:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486363:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414caa lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [331776->6864895] (req 331776->6864895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.486375:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.486380:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.486653:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.486661:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.486679:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468840192
00000100:00100000:0.0:1651532170.486686:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468840320
00010000:00010000:1.0:1651532170.486688:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.486690:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5754
00010000:00010000:1.0:1651532170.486692:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.486692:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad3dede9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468840192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.486695:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.486706:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414d8a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de51 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.486712:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468835840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 448294us (448384us total) trans 0 rc 36864/36864
00010000:00010000:0.0:1651532170.486712:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.486714:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414d8a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de51 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532170.486716:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5039
00010000:00010000:0.0:1651532170.486719:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414d8a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de51 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.486722:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532170.486725:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5755
00000100:00100000:1.0:1651532170.486727:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0ead926 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468840320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.486731:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532170.486731:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad3dede9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468840192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.486734:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5754
00010000:00010000:1.0:1651532170.486735:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414d91 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de58 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.486741:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.486741:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.486744:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414d91 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de58 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.486745:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.486746:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.486748:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414d91 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de58 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.486749:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.486752:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532170.486753:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.486754:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.486755:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486757:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.486758:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0ead926 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468840320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.486761:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5755
00010000:00010000:0.0:1651532170.486764:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486767:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414cb1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [897024->9785343] (req 897024->9785343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486773:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.486778:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.487126:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.487161:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.487168:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.487174:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.487183:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.487202:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468840448
00000100:00100000:0.0:1651532170.487204:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468840576
00000100:00100000:0.0:1651532170.487212:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468840704
00000100:00100000:1.0:1651532170.487218:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468840512
00000100:00100000:1.0:1651532170.487225:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5048
00000100:00100000:1.0:1651532170.487227:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000efc84fd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468840448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532170.487236:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.487240:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468840768
00000100:00100000:0.0:1651532170.487245:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5756
00000100:00100000:0.0:1651532170.487247:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0cacc7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468840576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.487248:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532170.487250:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487251:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.487253:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532170.487254:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487255:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414d9f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de5f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.487263:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487263:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414d9f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de5f expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.487267:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487268:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414d9f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de5f expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.487271:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532170.487275:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5757
00000100:00100000:1.0:1651532170.487277:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021218aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468840704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.487280:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532170.487282:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0cacc7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468840576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (113us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532170.487283:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414da6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de66 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.487286:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5756
00010000:00010000:1.0:1651532170.487290:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414da6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de66 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532170.487291:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5758
00000100:00100000:0.0:1651532170.487293:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b107aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468840768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.487295:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414da6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de66 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.487295:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.487297:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414dad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de6d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.487299:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:0.0:1651532170.487303:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414dad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de6d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.487307:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414dad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de6d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532170.487309:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021218aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468840704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (135us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532170.487310:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532170.487312:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5757
00000100:00100000:0.0:1651532170.487316:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b107aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468840768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (133us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.487318:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5758
00000100:00100000:0.0:1651532170.487326:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5049
00000100:00100000:0.0:1651532170.487327:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008b40c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468840512:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532170.487331:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532170.487333:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487343:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.487345:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487351:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532170.487351:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487365:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487369:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.487376:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468840896
00000100:00100000:0.0:1651532170.487386:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5759
00000100:00100000:0.0:1651532170.487388:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000874d3732 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468840896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.487390:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.487393:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414dbb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de74 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487399:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414dbb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de74 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.487403:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414dbb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de74 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.487407:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532170.487418:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000874d3732 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468840896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.487422:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5759
00000100:00100000:0.0:1651532170.487606:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.487613:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468841088
00000100:00100000:0.0:1651532170.487626:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5760
00000100:00100000:0.0:1651532170.487628:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef8a8610 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468841088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.487632:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.487635:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414dc2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de7b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487642:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414dc2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de7b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.487646:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414dc2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de7b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.487649:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532170.487661:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef8a8610 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468841088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.487664:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5760
00000100:00100000:0.0:1651532170.487886:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.487893:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468841408
00000100:00100000:0.0:1651532170.487904:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5761
00000100:00100000:0.0:1651532170.487905:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005e92531f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468841408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.487909:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.487912:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414dc9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de82 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.487919:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414dc9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de82 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.487923:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414dc9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de82 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.487926:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532170.487937:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005e92531f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468841408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.487940:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5761
00000001:00080000:0.0:1651532170.594615:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794186 is committed
00002000:00010000:0.0:1651532170.594629:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532169 -> 1651532170
00010000:00010000:0.0:1651532170.594632:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594635:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.594652:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468837440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482738us (482781us total) trans 158913794186 rc 0/0
00000100:00100000:0.0:1651532170.594655:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5040
00010000:00010000:0.0:1651532170.594661:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594664:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.594665:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594669:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594674:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.594674:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.594675:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594678:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594685:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594688:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f414d05 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->9760767] (req 110592->9760767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594693:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594696:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594880:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594884:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.594907:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468837504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 482949us (483023us total) trans 0 rc 45056/45056
00000100:00100000:0.0:1651532170.594911:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5041
00010000:00010000:0.0:1651532170.594918:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594921:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.594922:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594925:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594929:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.594930:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.594931:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594934:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594961:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.594965:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f414d13 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [356352->8376319] (req 356352->8376319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.594968:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.594975:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.594980:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.594987:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468841536
00000100:00100000:0.0:1651532170.594998:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5762
00000100:00100000:0.0:1651532170.595000:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000930593e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468841536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.595003:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.595007:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414dd0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de89 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.595013:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414dd0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de89 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595018:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f414dd0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de89 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595021:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532170.595028:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000930593e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468841536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.595031:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5762
00000100:00100000:1.0:1651532170.595262:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.595285:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468841728
00000100:00100000:1.0:1651532170.595287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.595301:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5763
00000100:00100000:1.0:1651532170.595303:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.595303:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007e1f9ee4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468841728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.595311:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532170.595313:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532170.595315:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414dd7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de90 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.595322:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414dd7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de90 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595329:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f414dd7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de90 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595332:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532170.595342:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007e1f9ee4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468841728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.595344:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5763
00000100:00100000:0.0:1651532170.595376:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468842048
00000100:00100000:0.0:1651532170.595385:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5764
00000100:00100000:0.0:1651532170.595386:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e49569a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468842048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.595390:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.595393:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414dde lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de97 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.595399:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414dde lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de97 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595403:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f414dde lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de97 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595406:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532170.595413:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e49569a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468842048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.595416:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5764
00000100:00100000:1.0:1651532170.595424:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.595424:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468841920
00000100:00100000:0.0:1651532170.595441:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468841856
00000100:00100000:0.0:1651532170.595450:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5050
00000100:00100000:0.0:1651532170.595452:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086220170 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468841920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532170.595458:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.595462:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.595463:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532170.595463:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.595467:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.595469:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5051
00000100:00100000:0.0:1651532170.595474:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468842240
00000100:00100000:1.0:1651532170.595478:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c03e11dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468841856:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532170.595483:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5765
00000100:00100000:0.0:1651532170.595484:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071a315ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468842240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.595487:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.595489:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414dec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44de9e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.595492:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.595495:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414dec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de9e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.595497:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532170.595498:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.595501:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.595504:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532170.595504:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.595508:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f414dec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44de9e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.595509:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.595514:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:1.0:1651532170.595515:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.595518:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.595525:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071a315ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468842240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.595527:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5765
00000100:00100000:1.0:1651532170.595787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.595795:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.595813:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468842368
00000100:00100000:0.0:1651532170.595816:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468842496
00000100:00100000:1.0:1651532170.595823:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5766
00000100:00100000:1.0:1651532170.595825:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcad38a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468842368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.595834:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.595837:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414dfa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dea5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.595839:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5767
00000100:00100000:0.0:1651532170.595841:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f76b6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468842496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.595844:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.595846:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414dfa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dea5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595848:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414e01 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44deac expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.595850:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414dfa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dea5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.595853:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532170.595855:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414e01 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44deac expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595859:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f414e01 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44deac expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595862:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532170.595865:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcad38a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468842368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.595868:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5766
00000100:00100000:0.0:1651532170.595870:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f76b6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468842496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.595872:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5767
00000100:00100000:1.0:1651532170.595918:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.595934:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468842624
00000100:00100000:0.0:1651532170.595944:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5768
00000100:00100000:0.0:1651532170.595946:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000593fd88c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468842624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.595950:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.595953:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414e08 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44deb3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.595959:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414e08 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44deb3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595963:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f414e08 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44deb3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.595967:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532170.595976:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000593fd88c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468842624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.595978:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5768
00000100:00100000:1.0:1651532170.596174:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.596185:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468842752
00000100:00100000:0.0:1651532170.596195:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5769
00000100:00100000:0.0:1651532170.596197:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089fc0439 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468842752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.596200:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.596203:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e0f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44deba expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.596211:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e0f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44deba expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.596214:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e0f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44deba expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.596220:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532170.596230:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089fc0439 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468842752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.596233:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5769
00000001:00080000:0.0:1651532170.702935:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794187 is committed
00010000:00010000:1.0:1651532170.702964:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.702969:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.702991:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468838336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432846us (432905us total) trans 158913794187 rc 0/0
00010000:00010000:0.0:1651532170.702992:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.702994:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5042
00010000:00010000:0.0:1651532170.702996:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.702997:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703001:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703006:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.703007:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.703008:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703011:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703014:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.703015:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.703015:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703020:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703028:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703031:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f414d28 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->8945663] (req 524288->8945663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703036:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703039:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703042:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703047:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703060:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703064:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.703080:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc8fc170 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468838912:12345-10.240.43.64@tcp:3:fio.0 Request processed in 432405us (432446us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532170.703084:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5044
00010000:00010000:1.0:1651532170.703117:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703128:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532170.703130:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703133:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703139:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703141:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414d4b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8138752->8142847] (req 8138752->8142847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.703378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.703390:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.703391:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468843072
00000100:00100000:1.0:1651532170.703396:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.703406:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468843008
00000100:00100000:0.0:1651532170.703409:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468843136
00000100:00100000:0.0:1651532170.703417:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5770
00000100:00100000:0.0:1651532170.703419:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bce1c52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468843072:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532170.703420:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5771
00000100:00100000:1.0:1651532170.703422:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025f99ecb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468843008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.703423:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.703426:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.703426:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e16 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dec8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703430:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414e1d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dec1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703436:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.703439:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414e1d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dec1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.703446:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414e1d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dec1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.703449:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532170.703455:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.703458:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e16 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dec8 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.703465:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e16 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dec8 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532170.703468:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025f99ecb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468843008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (78us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532170.703469:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532170.703471:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5771
00000100:00100000:1.0:1651532170.703476:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5772
00000100:00100000:1.0:1651532170.703478:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc05c9cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468843136:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532170.703478:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bce1c52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468843072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.703480:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5770
00010000:00010000:1.0:1651532170.703481:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.703483:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414e24 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44decf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703488:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.703490:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414e24 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44decf expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.703493:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703497:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703501:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414e24 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44decf expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.703504:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532170.703508:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468838464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433327us (433410us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532170.703511:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc05c9cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468843136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (114us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.703511:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5043
00000100:00100000:1.0:1651532170.703514:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5772
00010000:00010000:0.0:1651532170.703516:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703520:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.703521:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703524:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.703529:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532170.703531:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.703532:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.703532:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703535:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.703542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532170.703542:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703545:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f414d2f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4685824->9584639] (req 4685824->9584639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.703558:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.703558:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468843456
00000100:00100000:0.0:1651532170.703570:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468843392
00000100:00100000:0.0:1651532170.703578:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5052
00000100:00100000:0.0:1651532170.703579:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468843456:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532170.703585:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703589:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.703590:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703593:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532170.703593:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703600:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703603:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703609:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.703612:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.703613:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5053
00000100:00100000:1.0:1651532170.703615:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084d1f7a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468843392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532170.703623:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703627:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532170.703628:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703637:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532170.703638:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703643:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703647:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.703655:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468843264
00000100:00100000:1.0:1651532170.703662:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5773
00000100:00100000:1.0:1651532170.703664:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090f29ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468843264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.703667:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.703677:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e39 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ded6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.703687:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e39 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ded6 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.703691:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e39 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ded6 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.703694:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532170.703708:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090f29ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468843264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (179us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.703711:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5773
00000100:00100000:0.0:1651532170.703984:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.704000:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468843648
00000100:00100000:0.0:1651532170.704004:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.704013:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468843776
00000100:00100000:1.0:1651532170.704021:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5774
00000100:00100000:1.0:1651532170.704023:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008d682773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468843648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.704026:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.704030:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e40 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dedd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.704037:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e40 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dedd expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.704041:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e40 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dedd expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.704044:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532170.704054:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008d682773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468843648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.704057:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5774
00000100:00100000:1.0:1651532170.704062:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5775
00000100:00100000:1.0:1651532170.704063:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468843776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.704066:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.704068:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414e47 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dee4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.704073:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414e47 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dee4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.704077:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414e47 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dee4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.704080:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532170.704084:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fa86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468843776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.704087:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5775
00000001:00080000:0.0:1651532170.769893:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794188 is committed
00010000:00010000:0.0:1651532170.769907:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.769911:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.769928:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468838784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499224us (499316us total) trans 158913794188 rc 0/0
00000100:00100000:0.0:1651532170.769931:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5045
00010000:00010000:0.0:1651532170.769937:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.769943:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.769944:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.769947:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.769952:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.769952:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.769953:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.769956:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.769963:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.769966:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f414d52 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2281472->7651327] (req 2281472->7651327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.769971:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.769974:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.770146:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.770151:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.770171:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb909c4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468839808:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341714us (341767us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532170.770175:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.770175:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5046
00010000:00010000:1.0:1651532170.770179:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532170.770181:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770184:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770190:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.770190:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.770191:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770195:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770204:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770207:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f414d7c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1941504->8568831] (req 1941504->8568831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.770208:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.770212:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.770418:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.770429:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.770439:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.770447:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468844352
00000100:00100000:1.0:1651532170.770454:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5776
00000100:00100000:1.0:1651532170.770456:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073c8f72e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468844352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.770460:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.770463:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414e4e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44deeb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770471:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414e4e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44deeb expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.770478:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414e4e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44deeb expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.770481:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532170.770484:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468844160
00000100:00100000:1.0:1651532170.770493:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073c8f72e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468844352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.770496:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5776
00000100:00100000:0.0:1651532170.770504:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468844224
00000100:00100000:0.0:1651532170.770513:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5054
00000100:00100000:0.0:1651532170.770514:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f38c3f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468844160:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532170.770517:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5055
00000100:00100000:1.0:1651532170.770519:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047562140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468844224:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532170.770522:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770526:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.770526:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.770527:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.770530:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532170.770531:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770537:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532170.770538:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770541:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532170.770542:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770546:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.770546:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770550:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.770567:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.770607:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.770618:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468844416
00000100:00100000:0.0:1651532170.770619:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.770633:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468844544
00000100:00100000:0.0:1651532170.770642:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5777
00000100:00100000:1.0:1651532170.770644:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5778
00000100:00100000:0.0:1651532170.770644:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468844416:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532170.770646:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468844544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.770648:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.770649:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.770651:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e63 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44def2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770652:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e6a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44def9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.770660:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e6a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44def9 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.770660:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e63 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44def2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.770664:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e6a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44def9 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.770664:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e63 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44def2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.770668:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532170.770668:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532170.770677:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468844544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.770678:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468844416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.770680:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5778
00000100:00100000:0.0:1651532170.770682:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5777
00000001:00080000:0.0:1651532170.836390:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794189 is committed
00010000:00010000:0.0:1651532170.836405:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836409:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.836425:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8b308e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468839744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 407932us (408011us total) trans 158913794189 rc 0/0
00000100:00100000:0.0:1651532170.836428:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5047
00010000:00010000:0.0:1651532170.836435:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836438:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.836439:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836442:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836447:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.836447:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.836448:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836451:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836463:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836469:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f414d83 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1986560->10469375] (req 1986560->10469375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.836474:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.836479:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.836869:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.836882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.836888:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468844928
00000100:00100000:1.0:1651532170.836890:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.836900:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468844864
00000100:00100000:0.0:1651532170.836909:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5056
00000100:00100000:0.0:1651532170.836910:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c207e8e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468844928:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532170.836919:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5057
00000100:00100000:1.0:1651532170.836921:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000843fdbf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468844864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532170.836923:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836927:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.836928:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532170.836929:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836929:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836932:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.836933:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532170.836934:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.836937:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.836940:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532170.836941:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.836945:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.836948:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.836949:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468844992
00010000:00010000:1.0:1651532170.836951:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.836956:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5779
00000100:00100000:0.0:1651532170.836957:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c83d56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468844992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.836960:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.836963:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414e7f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df00 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.836970:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414e7f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df00 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.836977:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414e7f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df00 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.836980:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532170.836991:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c83d56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468844992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.836994:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5779
00000100:00100000:1.0:1651532170.837262:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.837273:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468845248
00000100:00100000:0.0:1651532170.837285:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5780
00000100:00100000:0.0:1651532170.837287:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057711e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468845248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.837290:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.837293:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414e86 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df07 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.837301:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414e86 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df07 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.837305:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414e86 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df07 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.837308:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532170.837318:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057711e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468845248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.837321:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5780
00000001:00080000:0.0:1651532170.936397:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794190 is committed
00010000:00010000:1.0:1651532170.936425:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.936430:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.936452:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000efc84fd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468840448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449224us (449327us total) trans 158913794190 rc 0/0
00010000:00010000:0.0:1651532170.936453:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.936456:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5048
00010000:00010000:0.0:1651532170.936457:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532170.936458:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936462:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936467:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.936468:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.936468:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936472:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936475:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.936475:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.936476:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936479:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936487:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936490:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f414d98 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [475136->7266303] (req 475136->7266303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936495:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936498:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936519:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936523:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.936878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.936889:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.936890:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468845504
00000100:00100000:1.0:1651532170.936896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.936906:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468845568
00000100:00100000:0.0:1651532170.936909:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468845632
00000100:00100000:0.0:1651532170.936922:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5781
00000100:00100000:0.0:1651532170.936924:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468845504:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532170.936925:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5782
00000100:00100000:1.0:1651532170.936927:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468845568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.936928:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.936931:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.936932:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414e8d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df0e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.936936:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414e94 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df15 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936937:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.936940:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414e8d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df0e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.936942:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.936945:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414e94 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df15 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.936945:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414e8d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df0e expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.936949:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414e94 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df15 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.936951:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532170.936952:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532170.936961:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468845568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.936961:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468845504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.936964:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5781
00000100:00100000:1.0:1651532170.936966:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5782
00000100:00100000:0.0:1651532170.936969:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5783
00000100:00100000:0.0:1651532170.936971:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468845632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532170.936973:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.936975:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414e9b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df1c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.936980:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532170.936981:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414e9b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df1c expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.936985:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414e9b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df1c expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.936988:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532170.936994:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468845632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.936996:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5783
00010000:00010000:0.0:1651532170.937007:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.937011:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.937030:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008b40c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468840512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449702us (449870us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532170.937033:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.937033:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5049
00010000:00010000:1.0:1651532170.937037:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532170.937038:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937041:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.937043:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.937046:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937053:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937056:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f414db4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5152768->7819263] (req 5152768->7819263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.937056:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086220170 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468841920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341604us (341770us total) trans 0 rc 28672/28672
00010000:00010000:1.0:1651532170.937059:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532170.937059:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5050
00010000:00010000:1.0:1651532170.937062:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532170.937062:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937065:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937068:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.937069:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532170.937070:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937073:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937080:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937083:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f414de5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [753664->9981951] (req 753664->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937088:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937116:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.937455:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.937467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.937467:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468845696
00000100:00100000:1.0:1651532170.937476:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532170.937490:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468845760
00000100:00100000:0.0:1651532170.937498:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5058
00000100:00100000:0.0:1651532170.937500:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468845696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532170.937507:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.937510:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.937518:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5059
00000100:00100000:1.0:1651532170.937520:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468845760:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532170.937525:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532170.937526:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937529:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.937529:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532170.937530:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937536:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532170.937538:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937541:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532170.937541:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.937545:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937546:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937549:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.937549:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532170.937557:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468845888
00000100:00100000:0.0:1651532170.937558:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468845952
00000100:00100000:1.0:1651532170.937565:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5784
00000100:00100000:1.0:1651532170.937574:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468845888:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532170.937574:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5785
00000100:00100000:0.0:1651532170.937576:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468845952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.937577:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532170.937579:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.937580:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414eb0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df23 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532170.937582:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414eb7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df2a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937587:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414eb0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df23 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.937589:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414eb7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df2a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.937591:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414eb0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df23 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532170.937593:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414eb7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df2a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.937595:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532170.937596:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532170.937605:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468845888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (129us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.937605:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468845952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532170.937608:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5785
00000100:00100000:1.0:1651532170.937610:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5784
00000100:00100000:0.0:1651532170.937639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.937672:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468846144
00000100:00100000:1.0:1651532170.937679:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5786
00000100:00100000:1.0:1651532170.937681:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468846144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.937684:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.937687:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414ebe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df31 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.937694:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414ebe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df31 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.937698:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414ebe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df31 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.937701:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532170.937714:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468846144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.937717:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5786
00000100:00100000:1.0:1651532170.937978:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532170.937986:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468846464
00000100:00100000:1.0:1651532170.937992:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5787
00000100:00100000:1.0:1651532170.937994:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468846464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532170.937997:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532170.938000:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414ec5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df38 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532170.938010:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414ec5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df38 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.938014:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414ec5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df38 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532170.938017:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532170.938030:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468846464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532170.938033:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5787
00000001:00080000:0.0:1651532171.094062:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794191 is committed
00002000:00010000:1.0:1651532171.094091:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532169 -> 1651532170
00010000:00010000:1.0:1651532171.094095:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094099:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.094121:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c03e11dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468841856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 498642us (498817us total) trans 158913794191 rc 0/0
00010000:00010000:0.0:1651532171.094121:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.094124:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5051
00010000:00010000:0.0:1651532171.094125:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.094126:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094130:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094135:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.094136:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.094136:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094139:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094147:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094150:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f414df3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1142784->8790015] (req 1142784->8790015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094164:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094168:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.094535:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.094553:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.094564:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.094564:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468846784
00000100:00100000:1.0:1651532171.094570:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.094587:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468847040
00000100:00100000:0.0:1651532171.094589:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468846720
00000100:00100000:1.0:1651532171.094594:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468847104
00000100:00100000:0.0:1651532171.094597:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5060
00000100:00100000:0.0:1651532171.094599:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468846784:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532171.094603:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5788
00000100:00100000:1.0:1651532171.094605:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad64e1dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468847040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.094609:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.094612:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414ed3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df3f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094612:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094616:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.094617:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532171.094618:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094621:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.094623:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094624:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414ed3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df3f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.094628:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414ed3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df3f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532171.094630:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5061
00000100:00100000:0.0:1651532171.094631:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468846720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532171.094632:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532171.094636:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094639:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532171.094640:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.094642:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad64e1dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468847040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (78us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532171.094642:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.094644:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5788
00010000:00010000:0.0:1651532171.094645:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532171.094645:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.094649:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5789
00010000:00010000:0.0:1651532171.094649:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.094651:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcaeca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468847104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.094652:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094655:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.094656:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094657:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414ee1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df46 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094661:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.094663:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414ee1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df46 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.094667:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414ee1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df46 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.094670:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532171.094673:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.094675:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcaeca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468847104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.094677:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5789
00000100:00100000:1.0:1651532171.094680:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468847168
00000100:00100000:1.0:1651532171.094684:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5790
00000100:00100000:1.0:1651532171.094686:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468847168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.094688:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.094690:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414ee8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df4d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094694:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.094695:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414ee8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df4d expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.094699:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414ee8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df4d expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.094712:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532171.094719:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.094724:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468847168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.094726:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5790
00010000:00010000:0.0:1651532171.094729:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.094743:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468843456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391163us (391201us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532171.094746:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5052
00010000:00010000:0.0:1651532171.094753:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094756:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.094757:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094760:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094765:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.094765:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.094766:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094772:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094782:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094790:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.094794:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.094800:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414e2b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [593920->9490431] (req 593920->9490431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.095056:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.095071:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.095082:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468847296
00000100:00100000:0.0:1651532171.095090:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468847424
00000100:00100000:0.0:1651532171.095094:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5791
00000100:00100000:0.0:1651532171.095096:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f469125 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468847296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.095099:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.095103:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414eef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df54 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.095111:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414eef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df54 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.095115:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414eef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df54 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.095118:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532171.095128:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f469125 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468847296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.095132:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5791
00000100:00100000:0.0:1651532171.095137:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5792
00000100:00100000:0.0:1651532171.095139:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077327089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468847424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.095142:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.095144:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414ef6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df5b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.095150:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414ef6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df5b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.095154:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414ef6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df5b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.095157:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532171.095162:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077327089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468847424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.095164:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5792
00000100:00100000:1.0:1651532171.095409:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.095421:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.095421:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468847616
00000100:00100000:0.0:1651532171.095433:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468847680
00000100:00100000:0.0:1651532171.095440:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5793
00000100:00100000:0.0:1651532171.095442:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031ed18b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468847616:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532171.095444:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5794
00010000:00010000:0.0:1651532171.095445:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532171.095447:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000080b2f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468847680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.095449:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414efd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df62 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.095450:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.095455:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f04 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df69 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.095456:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414efd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df62 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.095460:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414efd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df62 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.095462:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f04 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df69 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.095463:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532171.095466:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f04 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df69 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.095473:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532171.095473:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031ed18b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468847616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.095476:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5793
00000100:00100000:1.0:1651532171.095481:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000080b2f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468847680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.095484:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5794
00000100:00100000:1.0:1651532171.095691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.095699:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468847872
00000100:00100000:1.0:1651532171.095710:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5795
00000100:00100000:1.0:1651532171.095712:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029b159ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468847872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.095715:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.095718:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f0b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df70 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.095725:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f0b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df70 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.095729:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f0b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df70 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.095732:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532171.095744:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029b159ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468847872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.095746:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5795
00000100:00100000:1.0:1651532171.095930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.095938:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468848064
00000100:00100000:1.0:1651532171.095948:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5796
00000100:00100000:1.0:1651532171.095949:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468848064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.095953:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.095956:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f12 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df77 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.095962:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f12 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df77 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.095966:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f12 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df77 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.095970:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532171.095981:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468848064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.095983:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5796
00000001:00080000:0.0:1651532171.161414:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794192 is committed
00010000:00010000:1.0:1651532171.161445:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.161450:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.161471:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084d1f7a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468843392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457855us (457913us total) trans 158913794192 rc 0/0
00010000:00010000:0.0:1651532171.161473:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.161474:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5053
00010000:00010000:0.0:1651532171.161478:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.161479:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.161482:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.161488:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.161488:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.161489:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.161492:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.161500:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.161511:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f414e32 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->10350591] (req 1171456->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.161517:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.161520:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.161958:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.161971:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.161973:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468848320
00000100:00100000:0.0:1651532171.161979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.161991:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468848192
00000100:00100000:0.0:1651532171.161993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.162000:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5062
00000100:00100000:1.0:1651532171.162002:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468848320:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532171.162006:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532171.162009:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.162013:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.162014:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.162014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532171.162017:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532171.162018:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.162021:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5063
00010000:00010000:1.0:1651532171.162022:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.162024:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468848192:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532171.162026:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.162033:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.162034:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468848384
00000100:00100000:1.0:1651532171.162038:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468848512
00010000:00010000:0.0:1651532171.162038:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532171.162039:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.162040:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468848576
00000100:00100000:1.0:1651532171.162042:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468848704
00010000:00010000:0.0:1651532171.162042:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532171.162042:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.162045:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5797
00000100:00100000:1.0:1651532171.162046:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468848384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.162049:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.162051:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f27 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df7e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.162059:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df7e expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.162059:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.162063:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.162064:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df7e expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.162067:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:0.0:1651532171.162072:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5798
00000100:00100000:0.0:1651532171.162074:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468848512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.162077:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532171.162081:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468848384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.162084:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5797
00010000:00010000:0.0:1651532171.162085:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414f2e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df85 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.162089:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5799
00000100:00100000:1.0:1651532171.162091:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b5f0484 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468848576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.162093:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.162093:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414f2e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df85 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.162095:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f35 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df8c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.162097:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414f2e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df85 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.162100:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532171.162101:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f35 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df8c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.162105:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f35 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df8c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.162108:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532171.162109:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468848512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.162112:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5798
00000100:00100000:1.0:1651532171.162114:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b5f0484 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468848576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.162116:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5799
00000100:00100000:0.0:1651532171.162118:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5800
00000100:00100000:0.0:1651532171.162120:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468848704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.162132:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.162135:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414f3c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df93 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.162141:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414f3c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df93 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.162145:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414f3c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df93 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.162148:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532171.162154:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468848704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (140us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.162157:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5800
00000100:00100000:0.0:1651532171.162450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.162458:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468848896
00000100:00100000:0.0:1651532171.162473:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5801
00000100:00100000:0.0:1651532171.162474:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468848896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.162478:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.162481:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414f43 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44df9a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.162489:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414f43 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df9a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.162493:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414f43 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44df9a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.162518:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532171.162528:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468848896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.162531:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5801
00000100:00100000:0.0:1651532171.162556:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.162579:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468849088
00000100:00100000:0.0:1651532171.162589:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5802
00000100:00100000:0.0:1651532171.162591:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468849088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.162594:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.162598:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f4a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfa1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.162605:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f4a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfa1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.162609:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f4a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfa1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.162612:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532171.162621:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468849088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.162623:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5802
00000100:00100000:0.0:1651532171.162758:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.162765:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468849216
00000100:00100000:0.0:1651532171.162778:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5803
00000100:00100000:0.0:1651532171.162780:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468849216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.162783:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.162787:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f414f51 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfa8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.162793:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f414f51 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfa8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.162797:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f414f51 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfa8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.162801:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532171.162822:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468849216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.162824:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5803
00000001:00080000:0.0:1651532171.253078:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794193 is committed
00010000:00010000:0.0:1651532171.253093:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253097:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.253113:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f38c3f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468844160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482598us (482696us total) trans 158913794193 rc 0/0
00000100:00100000:0.0:1651532171.253116:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5054
00010000:00010000:0.0:1651532171.253123:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253129:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.253130:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253133:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253138:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.253138:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.253139:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253142:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253145:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.253146:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.253146:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253149:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253162:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253165:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f414e55 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->9277439] (req 913408->9277439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253173:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.253174:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253176:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.253179:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253387:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253391:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.253406:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.253410:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c207e8e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468844928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416499us (416542us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532171.253414:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5056
00010000:00010000:1.0:1651532171.253415:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253431:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.253433:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047562140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468844224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 482914us (483003us total) trans 0 rc 24576/24576
00010000:00010000:0.0:1651532171.253435:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.253436:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.253437:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5055
00010000:00010000:0.0:1651532171.253439:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253444:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253450:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f414e71 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1961984->7696383] (req 1961984->7696383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253453:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253456:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.253456:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253459:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253462:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.253463:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.253463:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253466:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253475:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253478:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f414e5c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5087232->8568831] (req 5087232->8568831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.253485:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.253489:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.253598:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.253621:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468849472
00000100:00100000:0.0:1651532171.253633:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5804
00000100:00100000:0.0:1651532171.253635:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468849472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.253639:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.253642:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f414f58 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfaf expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253650:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f414f58 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfaf expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.253654:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f414f58 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfaf expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.253657:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532171.253670:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468849472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.253672:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5804
00000100:00100000:0.0:1651532171.253887:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.253899:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.253907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.253909:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468849728
00000100:00100000:0.0:1651532171.253913:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.253923:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468849664
00000100:00100000:1.0:1651532171.253929:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5064
00000100:00100000:1.0:1651532171.253931:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468849728:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532171.253941:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5065
00000100:00100000:0.0:1651532171.253943:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468849664:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532171.253944:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.253948:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.253950:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253950:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.253952:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532171.253953:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253958:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532171.253960:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253963:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532171.253963:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.253967:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253968:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.253971:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.253971:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.253978:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468849792
00000100:00100000:1.0:1651532171.253979:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468849984
00000100:00100000:1.0:1651532171.253985:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5805
00000100:00100000:1.0:1651532171.253987:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468849984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.253990:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.253998:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f6d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfbd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.254003:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5806
00000100:00100000:0.0:1651532171.254005:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468849792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.254008:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.254009:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f6d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfbd expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.254011:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414f74 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfb6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.254014:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f6d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfbd expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.254017:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532171.254018:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414f74 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfb6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.254022:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f414f74 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfb6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.254025:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532171.254031:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468849984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.254034:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5805
00000100:00100000:0.0:1651532171.254041:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468849792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (133us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.254044:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5806
00000100:00100000:1.0:1651532171.254052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.254082:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468850112
00000100:00100000:0.0:1651532171.254091:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5807
00000100:00100000:0.0:1651532171.254093:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468850112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.254096:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.254099:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414f7b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfc4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.254105:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414f7b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfc4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.254109:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414f7b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfc4 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.254113:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532171.254123:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468850112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.254126:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5807
00000100:00100000:0.0:1651532171.254283:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.254290:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468850240
00000100:00100000:0.0:1651532171.254303:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5808
00000100:00100000:0.0:1651532171.254305:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468850240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.254308:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.254311:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414f82 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfcb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.254321:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414f82 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfcb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.254325:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414f82 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfcb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.254328:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532171.254340:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468850240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.254342:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5808
00000100:00100000:0.0:1651532171.254405:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.254412:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468850432
00000100:00100000:0.0:1651532171.254422:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5809
00000100:00100000:0.0:1651532171.254424:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468850432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.254427:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.254430:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f89 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfd2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.254437:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfd2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.254441:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfd2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.254444:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532171.254455:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468850432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.254458:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5809
00000001:00080000:0.0:1651532171.370694:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794194 is committed
00010000:00010000:1.0:1651532171.370724:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.370729:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.370749:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000843fdbf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468844864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 533826us (533866us total) trans 158913794194 rc 0/0
00000100:00100000:1.0:1651532171.370752:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5057
00010000:00010000:0.0:1651532171.370752:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.370757:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.370758:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.370761:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.370767:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.370768:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.370769:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.370772:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.370779:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.370782:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f414e78 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9990143] (req 2134016->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.370786:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.370798:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.371118:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.371125:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.371136:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.371136:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468850752
00000100:00100000:1.0:1651532171.371145:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468850688
00000100:00100000:0.0:1651532171.371156:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5066
00000100:00100000:0.0:1651532171.371158:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468850752:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532171.371164:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5067
00000100:00100000:1.0:1651532171.371166:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468850688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532171.371169:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.371173:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.371174:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532171.371175:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.371178:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532171.371178:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.371183:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.371184:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.371187:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532171.371188:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.371191:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.371192:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.371195:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.371196:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.371203:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468850816
00000100:00100000:0.0:1651532171.371212:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5810
00000100:00100000:0.0:1651532171.371214:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468850816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.371217:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.371219:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414f9e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfd9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.371226:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414f9e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfd9 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.371233:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414f9e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfd9 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.371237:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532171.371250:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468850816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (114us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.371252:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5810
00000100:00100000:1.0:1651532171.371535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.371552:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468851008
00000100:00100000:0.0:1651532171.371560:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5811
00000100:00100000:0.0:1651532171.371562:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468851008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.371565:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.371568:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414fa5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfe0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.371576:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414fa5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfe0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.371579:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414fa5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfe0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.371583:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532171.371598:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468851008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.371601:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5811
00000100:00100000:1.0:1651532171.488144:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532171.488170:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233472
00000100:00100000:0.0:1651532171.488184:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 70
00000100:00100000:0.0:1651532171.488186:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233472:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532171.488191:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 774144 granted 351978048 pending 114688 free 81138851840 avail 76968140800
00000100:00100000:0.0:1651532171.488206:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1613a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233472:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 20us (63us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532171.488209:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 70
00000001:00080000:0.0:1651532171.519800:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794195 is committed
00010000:00010000:1.0:1651532171.519837:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.519841:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.519863:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085eed07f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468845696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582362us (582408us total) trans 158913794195 rc 0/0
00010000:00010000:0.0:1651532171.519864:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.519866:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5058
00010000:00010000:0.0:1651532171.519869:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.519870:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.519873:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.519878:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.519879:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.519880:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.519883:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.519886:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.519887:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.519887:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.519890:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.519898:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.519901:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f414ea2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [61440->9764863] (req 61440->9764863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.519906:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.519909:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.519913:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.519918:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.520259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.520269:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.520271:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468851264
00000100:00100000:0.0:1651532171.520291:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468851328
00000100:00100000:0.0:1651532171.520298:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5812
00000100:00100000:0.0:1651532171.520300:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468851264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.520301:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520303:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.520305:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520307:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414fac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfe7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520313:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.520315:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414fac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfe7 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532171.520322:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aab68d38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468845760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 582801us (582855us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532171.520325:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5059
00010000:00010000:0.0:1651532171.520328:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414fac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfe7 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.520332:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532171.520334:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5813
00000100:00100000:1.0:1651532171.520336:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468851328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.520339:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532171.520341:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468851264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (82us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532171.520343:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414fb3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dfee expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.520344:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5812
00010000:00010000:1.0:1651532171.520349:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.520351:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414fb3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfee expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.520367:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414fb3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dfee expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.520368:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.520371:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532171.520372:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.520379:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468851328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.520382:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5813
00000100:00100000:0.0:1651532171.520386:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8031eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468846784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425786us (425852us total) trans 0 rc 28672/28672
00010000:00010000:1.0:1651532171.520389:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.520389:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5060
00010000:00010000:1.0:1651532171.520392:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532171.520393:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520395:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.520396:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520398:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.520399:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.520402:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520402:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.520404:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ea9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2899968->6832127] (req 2899968->6832127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520410:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.520410:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.520411:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520414:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520421:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520424:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414ecc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [503808->8495103] (req 503808->8495103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520429:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520432:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.520897:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.520906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.520916:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.520917:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468851584
00000100:00100000:0.0:1651532171.520926:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468851456
00000100:00100000:1.0:1651532171.520933:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5068
00000100:00100000:1.0:1651532171.520935:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468851584:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532171.520941:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5069
00000100:00100000:0.0:1651532171.520943:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468851456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532171.520947:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520950:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.520951:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.520952:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.520958:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532171.520959:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520963:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532171.520964:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520967:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532171.520968:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.520971:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520972:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.520975:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.520975:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.520984:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468851840
00000100:00100000:1.0:1651532171.520991:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5814
00000100:00100000:1.0:1651532171.520992:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468851840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.520995:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.520997:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fc8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dff5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.521004:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fc8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dff5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.521008:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fc8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dff5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.521011:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532171.521022:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468851840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.521026:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5814
00000100:00100000:0.0:1651532171.521244:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.521263:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468852096
00000100:00100000:1.0:1651532171.521270:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5815
00000100:00100000:1.0:1651532171.521272:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468852096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.521275:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.521278:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fcf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44dffc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.521285:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fcf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dffc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.521289:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fcf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44dffc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.521293:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532171.521302:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468852096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.521305:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5815
00000001:00080000:0.0:1651532171.619036:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794196 is committed
00010000:00010000:0.0:1651532171.619051:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619054:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.619071:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a3b309 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468846720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524439us (524518us total) trans 158913794196 rc 0/0
00000100:00100000:0.0:1651532171.619074:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5061
00010000:00010000:0.0:1651532171.619080:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619086:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.619087:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619090:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619095:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.619096:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.619096:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619099:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619111:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619115:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f414eda lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1814528->6078463] (req 1814528->6078463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619123:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619128:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619306:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619313:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.619328:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468848320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 457326us (457371us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532171.619331:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5062
00010000:00010000:1.0:1651532171.619338:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619341:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532171.619342:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619345:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619350:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.619351:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.619351:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619365:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619376:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619380:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f414f19 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [184320->9924607] (req 184320->9924607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619385:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619390:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.619551:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.619569:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468852288
00000100:00100000:0.0:1651532171.619569:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.619576:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.619585:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.619586:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468852224
00000100:00100000:0.0:1651532171.619594:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.619597:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5070
00000100:00100000:1.0:1651532171.619599:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e36e2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468852288:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532171.619601:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468852352
00010000:00010000:1.0:1651532171.619606:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.619608:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468852416
00000100:00100000:0.0:1651532171.619610:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468852480
00010000:00010000:1.0:1651532171.619611:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.619611:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.619613:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5816
00010000:00010000:1.0:1651532171.619614:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532171.619615:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.619615:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468852352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.619618:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.619619:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619622:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619622:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414fdd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e003 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.619629:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5071
00010000:00010000:0.0:1651532171.619630:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414fdd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e003 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532171.619631:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd50a695 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468852224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532171.619635:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f414fdd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e003 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.619636:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619638:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532171.619639:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.619640:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619643:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532171.619643:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619646:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.619651:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468852352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.619654:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5816
00010000:00010000:1.0:1651532171.619656:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.619659:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5817
00000100:00100000:0.0:1651532171.619660:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468852416:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532171.619663:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5818
00010000:00010000:0.0:1651532171.619663:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532171.619664:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468852480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.619665:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414feb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e00a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619667:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.619670:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ff2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e011 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.619671:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414feb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e00a expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.619675:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f414feb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e00a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.619677:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ff2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e011 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.619678:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532171.619681:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f414ff2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e011 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532171.619683:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468852416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (98us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532171.619684:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532171.619692:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468852480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.619697:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5818
00000100:00100000:0.0:1651532171.619701:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5817
00000100:00100000:1.0:1651532171.619713:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.619762:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468852608
00000100:00100000:1.0:1651532171.619770:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5819
00000100:00100000:1.0:1651532171.619771:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468852608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.619775:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.619778:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414ff9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e018 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.619785:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414ff9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e018 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.619789:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f414ff9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e018 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.619792:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532171.619820:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468852608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.619824:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5819
00000100:00100000:0.0:1651532171.620063:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.620077:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.620085:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.620089:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468852800
00000100:00100000:0.0:1651532171.620093:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468852864
00000100:00100000:1.0:1651532171.620097:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468853056
00000100:00100000:0.0:1651532171.620099:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5820
00000100:00100000:0.0:1651532171.620101:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468852800:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532171.620105:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5821
00010000:00010000:0.0:1651532171.620105:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532171.620107:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468852864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.620109:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415000 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e01f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.620110:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.620114:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415007 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e026 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.620116:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415000 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e01f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.620120:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415000 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e01f expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.620123:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415007 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e026 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.620127:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415007 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e026 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.620127:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532171.620131:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532171.620140:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468852800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.620143:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5820
00000100:00100000:1.0:1651532171.620145:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468852864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.620148:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5821
00000100:00100000:0.0:1651532171.620150:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5822
00000100:00100000:0.0:1651532171.620151:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468853056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.620154:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.620156:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41500e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e02d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.620162:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41500e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e02d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.620166:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41500e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e02d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.620168:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532171.620174:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468853056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.620176:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5822
00000100:00100000:0.0:1651532171.620434:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.620440:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468853376
00000100:00100000:0.0:1651532171.620454:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5823
00000100:00100000:0.0:1651532171.620455:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468853376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.620460:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.620463:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415015 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e034 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.620470:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415015 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e034 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.620474:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415015 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e034 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.620477:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532171.620491:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468853376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.620494:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5823
00000100:00100000:0.0:1651532171.620714:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.620721:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468853568
00000100:00100000:0.0:1651532171.620734:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5824
00000100:00100000:0.0:1651532171.620736:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468853568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.620739:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.620743:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41501c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e03b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.620749:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41501c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e03b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.620754:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41501c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e03b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.620757:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532171.620770:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468853568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.620773:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5824
00000100:00100000:0.0:1651532171.620954:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.620961:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468853760
00000100:00100000:0.0:1651532171.620974:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5825
00000100:00100000:0.0:1651532171.620975:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468853760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.620979:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.620982:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415023 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e042 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.620989:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415023 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e042 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.620993:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415023 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e042 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.620996:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532171.621010:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468853760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.621012:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5825
00000001:00080000:0.0:1651532171.735731:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794197 is committed
00010000:00010000:0.0:1651532171.735746:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.735753:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.735769:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468848192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 573745us (573797us total) trans 158913794197 rc 0/0
00000100:00100000:0.0:1651532171.735772:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5063
00010000:00010000:0.0:1651532171.735778:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.735782:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.735783:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.735786:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.735791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.735792:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.735792:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.735795:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.735819:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.735820:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.735822:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f414f20 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [12288->9416703] (req 12288->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.735824:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736002:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736006:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.736025:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.736026:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468849728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 482094us (482158us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532171.736029:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5064
00010000:00010000:0.0:1651532171.736029:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.736030:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.736033:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.736038:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.736039:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.736040:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.736043:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.736050:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.736053:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f414f5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1335296->9183231] (req 1335296->9183231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.736058:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.736061:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.736310:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.736327:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468853888
00000100:00100000:0.0:1651532171.736327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.736334:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.736337:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468853952
00000100:00100000:0.0:1651532171.736340:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.736343:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5072
00000100:00100000:1.0:1651532171.736350:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468853888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532171.736367:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736372:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.736373:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736376:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532171.736376:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736381:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736384:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.736392:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5073
00000100:00100000:1.0:1651532171.736394:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468853952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532171.736399:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736402:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.736403:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736408:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532171.736408:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736412:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736415:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.736429:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468854016
00000100:00100000:1.0:1651532171.736435:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468854144
00000100:00100000:0.0:1651532171.736438:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5826
00000100:00100000:0.0:1651532171.736441:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468854016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532171.736444:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5827
00010000:00010000:0.0:1651532171.736444:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532171.736446:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468854144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.736448:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.736448:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415038 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e049 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736451:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41503f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e050 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.736456:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415038 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e049 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.736458:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41503f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e050 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.736460:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415038 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e049 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.736462:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41503f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e050 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.736464:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532171.736466:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532171.736474:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468854144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (134us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.736474:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468854016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (140us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.736477:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5826
00000100:00100000:1.0:1651532171.736478:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5827
00000100:00100000:0.0:1651532171.736532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.736543:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468854272
00000100:00100000:1.0:1651532171.736550:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5828
00000100:00100000:1.0:1651532171.736552:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468854272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.736555:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.736558:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415046 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e057 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736566:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415046 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e057 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.736570:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415046 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e057 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.736573:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532171.736582:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468854272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.736584:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5828
00000100:00100000:0.0:1651532171.736858:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.736868:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468854464
00000100:00100000:0.0:1651532171.736869:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.736880:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468854592
00000100:00100000:1.0:1651532171.736890:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5829
00000100:00100000:1.0:1651532171.736892:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468854464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.736895:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.736898:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41504d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e05e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.736899:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5830
00000100:00100000:0.0:1651532171.736902:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468854592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.736906:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.736907:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41504d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e05e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.736909:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415054 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e065 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.736911:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41504d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e05e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.736915:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532171.736917:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415054 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e065 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.736921:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415054 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e065 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532171.736924:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468854464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (67us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532171.736924:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532171.736927:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5829
00000100:00100000:0.0:1651532171.736932:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468854592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.736935:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5830
00000100:00100000:0.0:1651532171.737193:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.737200:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468854848
00000100:00100000:0.0:1651532171.737214:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5831
00000100:00100000:0.0:1651532171.737216:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468854848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.737219:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.737223:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41505b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e06c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.737230:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41505b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e06c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.737234:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41505b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e06c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.737238:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532171.737251:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468854848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.737254:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5831
00000100:00100000:0.0:1651532171.737500:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.737507:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468855040
00000100:00100000:0.0:1651532171.737520:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5832
00000100:00100000:0.0:1651532171.737522:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468855040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.737525:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.737529:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415062 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e073 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.737535:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415062 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e073 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.737539:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415062 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e073 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.737543:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532171.737556:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468855040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.737559:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5832
00000100:00100000:0.0:1651532171.737754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.737761:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468855232
00000100:00100000:0.0:1651532171.737774:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5833
00000100:00100000:0.0:1651532171.737776:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468855232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.737779:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.737782:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415069 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e07a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.737789:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415069 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e07a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.737793:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415069 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e07a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.737796:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532171.737819:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468855232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.737822:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5833
00000001:00080000:0.0:1651532171.802442:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794198 is committed
00002000:00010000:0.0:1651532171.802455:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532170 -> 1651532171
00002000:00010000:0.0:1651532171.802457:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532170 -> 1651532171
00010000:00010000:0.0:1651532171.802459:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.802463:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.802485:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468849664:12345-10.240.43.64@tcp:4:fio.0 Request processed in 548541us (548585us total) trans 158913794198 rc 0/0
00010000:00010000:1.0:1651532171.802486:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.802488:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5065
00010000:00010000:1.0:1651532171.802490:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532171.802492:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802495:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802500:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.802501:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.802502:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802505:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802514:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802518:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f414f66 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10125311] (req 671744->10125311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.802522:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.802526:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.802860:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.802900:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.802914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.802921:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468855424
00000100:00100000:0.0:1651532171.802935:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468855360
00000100:00100000:0.0:1651532171.802942:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5074
00000100:00100000:0.0:1651532171.802944:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097358b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468855424:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532171.802945:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5075
00000100:00100000:1.0:1651532171.802948:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468855360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532171.802951:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.802955:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.802956:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.802956:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802960:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.802961:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802964:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802967:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532171.802967:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.802970:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802971:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802974:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.802980:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.802983:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.802986:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.803000:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468855680
00000100:00100000:0.0:1651532171.803007:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468850752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 431848us (431889us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532171.803010:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5066
00000100:00100000:1.0:1651532171.803014:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5834
00000100:00100000:1.0:1651532171.803015:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468855680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.803017:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.803018:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.803020:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532171.803021:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41507e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e081 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.803022:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.803024:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.803026:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.803028:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41507e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e081 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.803029:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.803030:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.803031:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.803034:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.803038:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41507e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e081 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.803043:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.803046:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f414f90 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [335872->8478719] (req 335872->8478719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.803047:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532171.803056:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468855680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (142us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532171.803056:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.803059:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5834
00010000:00010000:0.0:1651532171.803059:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.803349:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.803368:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.803376:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468855872
00000100:00100000:0.0:1651532171.803380:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468855936
00000100:00100000:1.0:1651532171.803383:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5835
00000100:00100000:1.0:1651532171.803384:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468855872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.803388:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532171.803393:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5836
00000100:00100000:0.0:1651532171.803395:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468855936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.803397:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415085 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e088 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.803399:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.803403:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41508c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e08f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.803405:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415085 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e088 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.803410:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415085 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e088 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.803411:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41508c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e08f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.803413:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00010000:00010000:0.0:1651532171.803415:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41508c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e08f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.803418:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532171.803422:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468855872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.803425:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5835
00000100:00100000:0.0:1651532171.803427:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468855936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.803429:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5836
00000100:00100000:1.0:1651532171.803463:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.803491:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468856000
00000100:00100000:0.0:1651532171.803500:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5837
00000100:00100000:0.0:1651532171.803502:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468856000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.803505:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.803508:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415093 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e096 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.803515:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415093 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e096 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.803519:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415093 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e096 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.803522:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532171.803532:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468856000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.803534:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5837
00000100:00100000:1.0:1651532171.803702:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.803713:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468856128
00000100:00100000:1.0:1651532171.803714:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.803723:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468856256
00000100:00100000:1.0:1651532171.803732:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5838
00000100:00100000:1.0:1651532171.803734:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468856128:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532171.803734:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5839
00000100:00100000:0.0:1651532171.803736:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468856256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.803738:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.803739:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.803741:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41509a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e09d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.803743:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0a4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.803748:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41509a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e09d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.803750:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0a4 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.803754:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0a4 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.803755:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41509a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e09d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.803757:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532171.803758:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532171.803771:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468856128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.803774:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5838
00000100:00100000:0.0:1651532171.803780:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468856256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.803783:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5839
00000100:00100000:1.0:1651532171.803990:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.804000:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468856448
00000100:00100000:0.0:1651532171.804010:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5840
00000100:00100000:0.0:1651532171.804012:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000282157fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468856448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532171.804015:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.804018:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150a8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0ab expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.804025:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0ab expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.804029:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0ab expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.804032:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532171.804042:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000282157fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468856448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.804045:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5840
00000001:00080000:0.0:1651532171.894157:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794199 is committed
00010000:00010000:0.0:1651532171.894172:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894176:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.894208:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468850688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 523041us (523082us total) trans 158913794199 rc 0/0
00000100:00100000:0.0:1651532171.894211:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5067
00010000:00010000:0.0:1651532171.894218:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894222:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.894223:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894226:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894231:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.894232:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.894232:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894236:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894245:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894248:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f414f97 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4501504->9224191] (req 4501504->9224191) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.894265:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.894270:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.894555:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.894565:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.894567:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468856704
00000100:00100000:1.0:1651532171.894574:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532171.894587:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468856640
00010000:00010000:1.0:1651532171.894592:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.894593:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5076
00000100:00100000:0.0:1651532171.894595:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b65c3b5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468856704:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532171.894596:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894602:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894606:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.894607:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894610:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00000100:00100000:1.0:1651532171.894614:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468851584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 373678us (373718us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532171.894616:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.894617:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5068
00010000:00010000:0.0:1651532171.894621:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.894623:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5077
00000100:00100000:1.0:1651532171.894625:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c414cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468856640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532171.894625:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.894632:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.894634:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468856896
00010000:00010000:1.0:1651532171.894636:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.894637:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.894640:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00000100:00100000:0.0:1651532171.894644:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5841
00000100:00100000:0.0:1651532171.894646:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009059a7df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468856896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.894648:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894648:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532171.894651:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0b2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.894653:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.894656:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.894663:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.894665:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.894666:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.894668:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894669:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0b2 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.894671:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894673:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0b2 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532171.894677:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532171.894678:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.894678:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532171.894679:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.894683:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.894685:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009059a7df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468856896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532171.894688:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5841
00010000:00010000:1.0:1651532171.894692:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.894695:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f414fba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1921024->8572927] (req 1921024->8572927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894701:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.894705:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532171.960892:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794200 is committed
00010000:00010000:0.0:1651532171.960906:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.960910:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.960926:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468851456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 439982us (440020us total) trans 158913794200 rc 0/0
00000100:00100000:0.0:1651532171.960931:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5069
00010000:00010000:0.0:1651532171.960938:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.960941:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.960942:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.960945:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.960950:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.960951:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.960952:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.960954:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.960967:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.960970:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f414fc1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [770048->6848511] (req 770048->6848511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.960979:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.960984:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.961143:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.961148:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961167:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.961169:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e36e2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468852288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341569us (341618us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532171.961171:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532171.961172:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.961174:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5070
00010000:00010000:0.0:1651532171.961176:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961181:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.961181:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532171.961182:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961185:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961194:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961198:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f414fd6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1134592->9641983] (req 1134592->9641983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961207:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961210:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532171.961281:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.961290:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.961301:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468857216
00000100:00100000:0.0:1651532171.961301:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468857152
00000100:00100000:1.0:1651532171.961314:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5078
00000100:00100000:1.0:1651532171.961316:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028f69b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468857216:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532171.961321:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5079
00010000:00010000:1.0:1651532171.961323:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.961323:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2ac1480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468857152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532171.961327:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532171.961328:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.961331:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532171.961332:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961332:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961336:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532171.961337:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961340:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532171.961341:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.961345:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961345:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.961348:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532171.961349:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532171.961469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.961499:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468857536
00000100:00100000:1.0:1651532171.961509:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5842
00000100:00100000:1.0:1651532171.961511:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468857536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.961515:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.961518:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4150d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0b9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.961526:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4150d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0b9 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.961530:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f4150d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0b9 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.961534:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532171.961546:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468857536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.961548:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5842
00000100:00100000:1.0:1651532171.961790:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.961797:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468857664
00000100:00100000:1.0:1651532171.961820:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5843
00000100:00100000:1.0:1651532171.961822:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468857664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.961826:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.961829:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4150d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0c0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.961836:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4150d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0c0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.961840:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4150d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0c0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.961846:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532171.961858:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468857664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.961861:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5843
00000100:00100000:1.0:1651532171.962049:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.962055:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468857792
00000100:00100000:1.0:1651532171.962061:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5844
00000100:00100000:1.0:1651532171.962063:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468857792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.962066:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.962069:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4150e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0c7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.962076:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4150e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0c7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.962080:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4150e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0c7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.962083:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532171.962095:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468857792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.962098:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5844
00000100:00100000:1.0:1651532171.962276:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532171.962282:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468857920
00000100:00100000:1.0:1651532171.962288:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5845
00000100:00100000:1.0:1651532171.962290:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468857920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532171.962293:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532171.962295:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4150e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0ce expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532171.962302:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4150e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0ce expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.962306:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4150e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0ce expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532171.962309:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532171.962321:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468857920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532171.962324:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5845
00000001:00080000:0.0:1651532172.019520:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794201 is committed
00010000:00010000:0.0:1651532172.019535:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.019539:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.019561:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd50a695 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468852224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 399928us (399992us total) trans 158913794201 rc 0/0
00010000:00010000:1.0:1651532172.019564:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.019564:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5071
00010000:00010000:1.0:1651532172.019568:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532172.019569:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.019573:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.019578:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.019578:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.019580:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.019583:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.019590:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.019593:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f414fe4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->7704575] (req 1896448->7704575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.019599:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.019603:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.019889:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.019896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.019905:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.019915:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468858176
00000100:00100000:0.0:1651532172.019915:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468858112
00000100:00100000:1.0:1651532172.019924:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5846
00000100:00100000:0.0:1651532172.019925:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468858048
00000100:00100000:1.0:1651532172.019926:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002860f824 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468858176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532172.019929:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532172.019931:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5080
00010000:00010000:1.0:1651532172.019932:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4150ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0d5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.019933:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468858112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532172.019939:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4150ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0d5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.019943:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4150ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0d5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.019947:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532172.019955:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.019961:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002860f824 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468858176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.019965:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5846
00010000:00010000:0.0:1651532172.019966:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532172.019967:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.019970:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532172.019971:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.019975:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.019979:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.019989:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5081
00000100:00100000:0.0:1651532172.019991:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468858048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532172.019996:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.020000:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532172.020000:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.020003:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532172.020004:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.020022:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.020025:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.020042:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.020051:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468858304
00000100:00100000:1.0:1651532172.020058:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5847
00000100:00100000:1.0:1651532172.020060:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468858304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532172.020063:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.020067:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415103 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0dc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.020082:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415103 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0dc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.020086:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415103 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0dc expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.020089:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532172.020102:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468858304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.020104:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5847
00000001:00080000:0.0:1651532172.144283:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794202 is committed
00010000:00010000:0.0:1651532172.144298:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144302:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.144323:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000becfc280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468853888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 407972us (408013us total) trans 158913794202 rc 0/0
00000100:00100000:0.0:1651532172.144326:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5072
00010000:00010000:0.0:1651532172.144333:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144337:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532172.144338:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144341:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144346:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.144346:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.144347:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144350:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144353:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.144363:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.144364:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144367:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144383:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144386:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41502a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [905216->9666559] (req 905216->9666559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144392:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144395:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144396:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144401:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.144768:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.144779:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.144791:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468858624
00000100:00100000:0.0:1651532172.144792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.144818:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468858752
00000100:00100000:1.0:1651532172.144822:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468858816
00000100:00100000:1.0:1651532172.144826:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5848
00000100:00100000:1.0:1651532172.144827:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468858624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.144827:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144831:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.144832:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144834:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41510a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0e3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144840:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.144843:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41510a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0e3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532172.144850:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097358b43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468855424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341905us (341990us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532172.144853:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41510a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0e3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532172.144853:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5074
00010000:00010000:1.0:1651532172.144857:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:0.0:1651532172.144860:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.144866:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468858624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (98us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532172.144866:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532172.144867:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.144868:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5848
00010000:00010000:0.0:1651532172.144870:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.144873:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5849
00000100:00100000:1.0:1651532172.144875:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468858752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.144875:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144877:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.144878:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415070 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [348160->5971967] (req 348160->5971967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144880:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415111 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0ea expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144884:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.144886:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415111 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0ea expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532172.144890:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5850
00010000:00010000:1.0:1651532172.144892:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415111 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0ea expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532172.144892:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468858816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532172.144895:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532172.144896:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.144899:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415118 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0f1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.144900:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468858752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (121us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.144902:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5849
00010000:00010000:0.0:1651532172.144904:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.144907:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415118 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0f1 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.144911:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415118 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0f1 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.144913:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144916:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.144917:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532172.144924:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468858816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (132us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.144927:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5850
00000100:00100000:1.0:1651532172.144928:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d627116 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468853952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408534us (408601us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532172.144931:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5073
00010000:00010000:1.0:1651532172.144936:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144940:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532172.144941:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144944:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144951:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.144952:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.144953:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144956:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144963:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144965:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415031 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [344064->10088447] (req 344064->10088447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144970:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.144973:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.145488:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.145503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.145507:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468859072
00000100:00100000:0.0:1651532172.145516:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5851
00000100:00100000:0.0:1651532172.145518:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468859072:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532172.145519:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532172.145527:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532172.145528:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532172.145535:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41511f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0f8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.145536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532172.145543:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41511f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0f8 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532172.145544:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532172.145547:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41511f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0f8 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532172.145550:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468859008
00010000:00010000:0.0:1651532172.145550:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532172.145562:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468858944
00000100:00100000:0.0:1651532172.145566:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468859072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.145570:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5082
00000100:00100000:1.0:1651532172.145572:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000282157fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468859008:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532172.145573:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5851
00000100:00100000:0.0:1651532172.145578:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468859200
00010000:00010000:1.0:1651532172.145579:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.145582:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468859392
00010000:00010000:1.0:1651532172.145583:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532172.145584:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.145584:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468859520
00000100:00100000:0.0:1651532172.145586:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5852
00010000:00010000:1.0:1651532172.145587:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532172.145588:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.145588:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468859200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.145591:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.145592:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.145594:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41512d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e0ff expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.145596:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.145600:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41512d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0ff expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532172.145604:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5853
00010000:00010000:0.0:1651532172.145604:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41512d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e0ff expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532172.145606:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468859392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.145607:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532172.145608:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.145611:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415134 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e106 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.145613:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468859200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.145615:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5852
00010000:00010000:1.0:1651532172.145617:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415134 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e106 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532172.145619:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5854
00000100:00100000:0.0:1651532172.145620:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468859520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.145623:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.145624:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415134 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e106 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.145625:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41513b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e10d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.145627:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532172.145630:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41513b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e10d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.145633:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41513b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e10d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532172.145636:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468859392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.145639:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5853
00010000:00010000:0.0:1651532172.145639:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532172.145644:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468859520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.145647:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5854
00000100:00100000:1.0:1651532172.145652:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5083
00000100:00100000:1.0:1651532172.145653:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009059a7df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468858944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532172.145659:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.145663:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532172.145664:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.145666:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532172.145667:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.145671:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.145674:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.145911:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.145922:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468859648
00000100:00100000:0.0:1651532172.145931:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5855
00000100:00100000:0.0:1651532172.145933:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468859648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.145936:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.145939:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415149 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e114 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.145946:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415149 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e114 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.145950:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415149 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e114 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.145954:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532172.145963:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468859648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.145966:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5855
00000100:00100000:1.0:1651532172.146021:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.146030:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468859840
00000100:00100000:0.0:1651532172.146038:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5856
00000100:00100000:0.0:1651532172.146039:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468859840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.146044:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.146047:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415150 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e11b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.146070:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415150 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e11b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.146075:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415150 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e11b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.146078:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532172.146091:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468859840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.146094:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5856
00000100:00100000:1.0:1651532172.146116:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.146136:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468860096
00000100:00100000:0.0:1651532172.146143:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5857
00000100:00100000:0.0:1651532172.146145:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468860096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.146148:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.146151:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415157 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e122 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.146157:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415157 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e122 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.146161:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415157 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e122 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.146167:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532172.146176:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468860096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.146179:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5857
00000100:00100000:1.0:1651532172.146325:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.146336:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468860288
00000100:00100000:0.0:1651532172.146343:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5858
00000100:00100000:0.0:1651532172.146345:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468860288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.146348:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.146351:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41515e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e129 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.146367:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41515e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e129 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.146371:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41515e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e129 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.146374:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532172.146384:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468860288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.146387:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5858
00000100:00100000:1.0:1651532172.146437:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.146447:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468860480
00000100:00100000:0.0:1651532172.146455:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5859
00000100:00100000:0.0:1651532172.146456:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468860480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.146461:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.146464:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415165 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e130 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.146471:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415165 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e130 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.146475:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415165 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e130 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.146478:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532172.146487:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468860480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.146489:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5859
00000100:00100000:1.0:1651532172.146728:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.146739:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468860736
00000100:00100000:0.0:1651532172.146747:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5860
00000100:00100000:0.0:1651532172.146749:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468860736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.146752:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.146755:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41516c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e137 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.146762:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41516c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e137 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.146766:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41516c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e137 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.146772:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532172.146781:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468860736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.146784:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5860
00000001:00080000:0.0:1651532172.227704:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794203 is committed
00010000:00010000:1.0:1651532172.227732:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.227737:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.227758:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703f3046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468855360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 424810us (424858us total) trans 158913794203 rc 0/0
00010000:00010000:0.0:1651532172.227760:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.227761:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5075
00010000:00010000:0.0:1651532172.227765:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532172.227766:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.227769:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.227775:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.227775:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.227776:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.227779:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.227787:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.227790:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415077 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2039808->10342399] (req 2039808->10342399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.227800:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.227815:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.228097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.228106:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.228116:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.228117:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468860928
00000100:00100000:1.0:1651532172.228124:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.228136:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468860992
00010000:00010000:1.0:1651532172.228141:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.228146:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5084
00000100:00100000:0.0:1651532172.228148:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468860928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532172.228150:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228155:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228159:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532172.228160:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228163:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532172.228163:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.228167:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b65c3b5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468856704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 333572us (333613us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532172.228170:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5076
00010000:00010000:0.0:1651532172.228174:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.228176:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5085
00010000:00010000:0.0:1651532172.228177:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.228178:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468860992:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532172.228185:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.228185:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468861120
00010000:00010000:1.0:1651532172.228188:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.228190:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.228191:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468861184
00010000:00010000:1.0:1651532172.228193:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532172.228194:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.228199:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5861
00000100:00100000:0.0:1651532172.228200:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468861120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.228203:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.228204:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228206:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415181 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e13e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.228208:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228211:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.228214:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415181 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e13e expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.228217:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228218:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415181 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e13e expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.228221:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532172.228222:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228222:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:1.0:1651532172.228225:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.228229:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.228230:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.228230:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.228230:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468861120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (115us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532172.228233:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.228233:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5861
00000100:00100000:0.0:1651532172.228237:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5862
00010000:00010000:1.0:1651532172.228239:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.228239:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468861184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.228241:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.228242:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4150af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1097728->8208383] (req 1097728->8208383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228243:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415188 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e145 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.228247:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228248:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415188 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e145 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.228249:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228252:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415188 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e145 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.228255:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532172.228259:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468861184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.228262:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5862
00000100:00100000:0.0:1651532172.228679:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.228693:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.228701:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468861568
00000100:00100000:0.0:1651532172.228701:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468861632
00000100:00100000:0.0:1651532172.228708:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5863
00000100:00100000:0.0:1651532172.228710:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468861632:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532172.228714:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5864
00000100:00100000:1.0:1651532172.228716:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468861568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.228719:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.228720:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.228723:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41518f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e153 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.228724:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415196 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e14c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.228730:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41518f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e153 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.228733:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415196 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e14c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.228734:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41518f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e153 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.228737:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415196 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e14c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.228738:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:1.0:1651532172.228741:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:0.0:1651532172.228750:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468861632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.228753:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5863
00000100:00100000:1.0:1651532172.228757:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468861568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.228760:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5864
00000100:00100000:0.0:1651532172.228978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.228996:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468861824
00000100:00100000:1.0:1651532172.229008:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5865
00000100:00100000:1.0:1651532172.229010:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468861824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532172.229013:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.229017:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41519d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e15a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.229024:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41519d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e15a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.229028:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41519d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e15a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.229031:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532172.229042:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468861824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.229044:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5865
00000001:00080000:0.0:1651532172.352663:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794204 is committed
00010000:00010000:1.0:1651532172.352692:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.352696:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.352715:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c414cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468856640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 458089us (458150us total) trans 158913794204 rc 0/0
00010000:00010000:0.0:1651532172.352718:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.352719:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5077
00010000:00010000:0.0:1651532172.352723:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532172.352724:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352728:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352733:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.352734:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.352735:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352738:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352748:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352751:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4150b6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5804032->9207807] (req 5804032->9207807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.352762:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.352766:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.352780:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.352783:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352802:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.352814:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028f69b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468857216:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391497us (391524us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532172.352818:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5078
00010000:00010000:0.0:1651532172.352827:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532172.352828:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352832:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352839:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.352840:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.352841:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352844:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352850:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352853:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4150c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6713344->6717439] (req 6713344->6717439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352859:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.352862:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.353103:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.353111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.353118:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.353124:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.353134:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468862080
00000100:00100000:1.0:1651532172.353143:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468861952
00000100:00100000:1.0:1651532172.353149:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5086
00000100:00100000:1.0:1651532172.353151:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468862080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532172.353157:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.353162:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532172.353163:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.353167:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.353168:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468862144
00000100:00100000:1.0:1651532172.353173:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5087
00000100:00100000:1.0:1651532172.353174:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468861952:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532172.353176:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468862208
00010000:00010000:1.0:1651532172.353178:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.353181:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5866
00010000:00010000:1.0:1651532172.353182:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532172.353183:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.353183:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468862144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.353186:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.353188:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.353190:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151b2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e168 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.353191:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532172.353191:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.353196:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.353200:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.353201:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e168 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.353203:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.353205:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e168 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.353209:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532172.353212:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5867
00000100:00100000:1.0:1651532172.353213:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468862208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532172.353216:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.353218:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4151b9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e161 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.353223:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468862144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.353226:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5866
00010000:00010000:1.0:1651532172.353233:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4151b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e161 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.353237:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4151b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e161 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.353240:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532172.353249:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468862208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.353252:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5867
00000001:00080000:0.0:1651532172.510977:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794205 is committed
00010000:00010000:0.0:1651532172.510992:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.510996:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.511017:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2ac1480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468857152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549693us (549736us total) trans 158913794205 rc 0/0
00010000:00010000:1.0:1651532172.511019:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.511020:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5079
00010000:00010000:1.0:1651532172.511024:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532172.511025:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.511029:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.511034:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.511035:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.511036:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.511039:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.511048:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.511051:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4150cb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3051520->9519103] (req 3051520->9519103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511059:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511063:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511241:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511245:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.511264:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011af56c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468858112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491331us (491376us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532172.511268:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5080
00010000:00010000:0.0:1651532172.511274:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511278:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532172.511279:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511282:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511287:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.511287:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.511288:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511291:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511338:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511342:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4150f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4861952->8396799] (req 4861952->8396799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511348:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511351:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.511399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.511406:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468862528
00000100:00100000:0.0:1651532172.511422:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5088
00000100:00100000:0.0:1651532172.511424:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046351af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468862528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532172.511431:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511435:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.511436:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511439:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532172.511439:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511444:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511448:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.511478:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.511488:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.511516:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468862592
00000100:00100000:1.0:1651532172.511534:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5868
00000100:00100000:1.0:1651532172.511536:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468862592:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532172.511538:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532172.511539:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.511543:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4151c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e16f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.511547:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532172.511551:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4151c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e16f expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.511555:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4151c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e16f expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.511558:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532172.511571:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468862592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.511574:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5868
00000100:00100000:1.0:1651532172.511579:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468862656
00000100:00100000:1.0:1651532172.511582:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468862720
00000100:00100000:1.0:1651532172.511585:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5869
00000100:00100000:1.0:1651532172.511586:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468862656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532172.511589:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.511591:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4151ce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e176 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.511600:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4151ce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e176 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.511603:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4151ce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e176 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.511607:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532172.511612:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468862656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.511614:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5869
00000100:00100000:0.0:1651532172.511616:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468862464
00000100:00100000:1.0:1651532172.511618:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5870
00000100:00100000:1.0:1651532172.511619:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468862720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532172.511621:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.511623:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4151d5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e17d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.511630:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5089
00000100:00100000:0.0:1651532172.511632:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468862464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532172.511637:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4151d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e17d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.511639:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.511641:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4151d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e17d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.511644:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532172.511644:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532172.511645:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532172.511645:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.511649:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468862720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (102us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532172.511649:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.511652:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5870
00000100:00100000:1.0:1651532172.511956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.511967:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468863040
00000100:00100000:0.0:1651532172.511979:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5871
00000100:00100000:0.0:1651532172.511981:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468863040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.511984:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.511987:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4151e3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e184 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.511995:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4151e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e184 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.511999:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4151e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e184 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.512003:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532172.512014:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468863040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.512016:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5871
00000100:00100000:1.0:1651532172.512230:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.512240:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468863168
00000100:00100000:0.0:1651532172.512250:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5872
00000100:00100000:0.0:1651532172.512252:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468863168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.512256:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.512259:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4151ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e18b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.512266:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4151ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e18b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.512270:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4151ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e18b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.512273:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532172.512283:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468863168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.512286:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5872
00000100:00100000:1.0:1651532172.512483:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.512494:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468863296
00000100:00100000:0.0:1651532172.512504:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5873
00000100:00100000:0.0:1651532172.512505:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468863296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.512509:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.512512:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4151f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e192 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.512518:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4151f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e192 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.512522:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4151f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e192 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.512526:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532172.512535:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468863296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.512538:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5873
00000100:00100000:1.0:1651532172.512724:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.512734:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468863424
00000100:00100000:0.0:1651532172.512744:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5874
00000100:00100000:0.0:1651532172.512746:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468863424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.512749:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.512752:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e199 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.512759:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e199 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.512763:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e199 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.512766:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532172.512776:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468863424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.512778:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5874
00000001:00080000:0.0:1651532172.577679:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794206 is committed
00010000:00010000:0.0:1651532172.577693:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.577697:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.577719:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9280e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468858048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557727us (557822us total) trans 158913794206 rc 0/0
00000100:00100000:0.0:1651532172.577722:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5081
00010000:00010000:0.0:1651532172.577729:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.577732:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532172.577734:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.577737:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.577750:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.577751:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.577752:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.577755:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.577764:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.577767:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4150fc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2043904->9256959] (req 2043904->9256959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.577776:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.577781:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.578110:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.578121:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.578122:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468863680
00000100:00100000:1.0:1651532172.578129:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.578139:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468863616
00000100:00100000:1.0:1651532172.578142:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.578146:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5090
00000100:00100000:0.0:1651532172.578147:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468863680:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532172.578154:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5091
00010000:00010000:0.0:1651532172.578154:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.578157:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468863616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532172.578158:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.578159:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.578162:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532172.578163:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.578166:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.578180:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532172.578181:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.578184:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532172.578185:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.578192:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.578192:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.578196:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.578196:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.578204:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468863744
00010000:00010000:1.0:1651532172.578208:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.578211:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.578211:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468863808
00000100:00100000:0.0:1651532172.578215:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5875
00000100:00100000:0.0:1651532172.578216:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468863744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.578219:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.578222:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41520d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1a0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.578227:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000282157fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468859008:12345-10.240.43.64@tcp:3:fio.0 Request processed in 432654us (432724us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532172.578227:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.578229:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41520d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1a0 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532172.578230:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5082
00010000:00010000:0.0:1651532172.578233:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41520d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1a0 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.578236:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.578237:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:1.0:1651532172.578240:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532172.578241:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.578244:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.578246:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468863744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (117us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532172.578248:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532172.578248:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5875
00010000:00010000:1.0:1651532172.578249:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.578250:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.578252:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5876
00010000:00010000:1.0:1651532172.578253:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.578259:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.578261:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468863808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532172.578262:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415126 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [655360->10354687] (req 655360->10354687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.578264:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.578266:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f415214 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1a7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.578267:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.578270:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.578272:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f415214 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1a7 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.578276:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f415214 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1a7 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.578279:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532172.578285:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468863808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.578287:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5876
00000100:00100000:1.0:1651532172.578613:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.578624:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468864064
00000100:00100000:0.0:1651532172.578632:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5877
00000100:00100000:0.0:1651532172.578634:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468864064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.578637:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.578640:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41521b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1ae expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.578647:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41521b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1ae expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.578651:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41521b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1ae expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.578663:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532172.578676:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468864064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.578679:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5877
00000001:00080000:0.0:1651532172.677696:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794207 is committed
00010000:00010000:1.0:1651532172.677726:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.677730:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.677752:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009059a7df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468858944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532098us (532233us total) trans 158913794207 rc 0/0
00010000:00010000:0.0:1651532172.677753:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.677755:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5083
00010000:00010000:0.0:1651532172.677758:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532172.677759:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.677762:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.677768:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.677768:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.677769:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.677772:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.677780:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.677783:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415142 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2048000->9687039] (req 2048000->9687039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.677796:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.677800:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.678125:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.678132:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.678139:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.678152:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468864512
00000100:00100000:0.0:1651532172.678158:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468864640
00000100:00100000:1.0:1651532172.678162:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468864384
00000100:00100000:0.0:1651532172.678167:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5878
00000100:00100000:1.0:1651532172.678171:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5092
00000100:00100000:1.0:1651532172.678173:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468864512:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532172.678174:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468864640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.678178:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.678181:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.678181:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415229 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1b5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.678185:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532172.678186:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.678189:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532172.678190:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.678195:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.678196:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415229 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1b5 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.678199:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.678200:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415229 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1b5 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.678204:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532172.678209:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5093
00000100:00100000:1.0:1651532172.678210:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468864384:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532172.678216:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468864640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.678219:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5878
00010000:00010000:1.0:1651532172.678221:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.678225:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532172.678226:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.678228:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.678231:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532172.678231:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.678235:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.678237:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.678240:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.678546:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.678564:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468864768
00000100:00100000:0.0:1651532172.678573:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5879
00000100:00100000:0.0:1651532172.678574:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468864768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.678578:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.678581:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f415237 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1bc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.678589:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f415237 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1bc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.678593:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f415237 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1bc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.678596:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532172.678613:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468864768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.678615:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5879
00000001:00080000:0.0:1651532172.777752:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794208 is committed
00010000:00010000:1.0:1651532172.777780:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.777784:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.777816:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468860928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549667us (549719us total) trans 158913794208 rc 0/0
00010000:00010000:0.0:1651532172.777816:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.777819:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5084
00010000:00010000:0.0:1651532172.777820:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532172.777822:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.777825:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.777830:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.777831:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.777832:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.777835:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.777838:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.777839:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.777839:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.777842:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.777849:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.777851:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415173 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [253952->10031103] (req 253952->10031103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.777863:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.777867:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.777889:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.777893:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.778278:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.778288:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.778290:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468864960
00000100:00100000:1.0:1651532172.778297:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.778310:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468865152
00000100:00100000:0.0:1651532172.778313:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468865216
00000100:00100000:0.0:1651532172.778316:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5880
00000100:00100000:0.0:1651532172.778318:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468864960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.778322:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.778323:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778325:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41523e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1c3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.778327:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778335:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.778337:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41523e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1c3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.778342:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41523e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1c3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532172.778344:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468860992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 550165us (550238us total) trans 0 rc 49152/49152
00000100:00100000:1.0:1651532172.778347:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5085
00010000:00010000:0.0:1651532172.778348:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532172.778366:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468864960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (88us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532172.778368:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778369:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5880
00010000:00010000:1.0:1651532172.778372:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778374:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5881
00000100:00100000:0.0:1651532172.778376:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468865152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.778385:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532172.778387:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468862080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425235us (425284us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532172.778388:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415245 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1ca expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.778389:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5086
00010000:00010000:0.0:1651532172.778393:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.778395:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778396:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415245 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1ca expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.778399:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532172.778400:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778400:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415245 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1ca expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.778403:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778403:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:1.0:1651532172.778409:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778409:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468865152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (121us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532172.778411:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41517a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10084351] (req 520192->10084351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778411:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5881
00010000:00010000:1.0:1651532172.778415:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778415:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5882
00000100:00100000:0.0:1651532172.778417:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468865216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532172.778418:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532172.778419:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778419:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.778421:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778421:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41524c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1d1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.778424:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.778425:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532172.778426:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.778429:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778434:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41524c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1d1 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.778436:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778437:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41524c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1d1 expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.778438:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4151a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->9777151] (req 671744->9777151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778440:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:1.0:1651532172.778444:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778445:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468865216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (148us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532172.778446:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778447:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5882
00000100:00100000:0.0:1651532172.778853:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.778882:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468865472
00000100:00100000:0.0:1651532172.778888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.778899:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.778904:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468865408
00000100:00100000:0.0:1651532172.778906:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.778911:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5094
00000100:00100000:1.0:1651532172.778912:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090f29ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468865472:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532172.778913:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532172.778919:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778920:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468865536
00010000:00010000:1.0:1651532172.778924:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532172.778925:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778926:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468865792
00010000:00010000:1.0:1651532172.778928:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532172.778928:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778929:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468865728
00000100:00100000:0.0:1651532172.778932:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5883
00010000:00010000:1.0:1651532172.778933:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.778933:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c83d56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468865536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532172.778936:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778937:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.778940:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41525a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1d8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.778943:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5095
00000100:00100000:1.0:1651532172.778945:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073c8f72e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468865408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532172.778947:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41525a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1d8 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.778949:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.778953:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532172.778954:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.778956:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532172.778957:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.778961:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778961:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41525a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1d8 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.778963:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.778965:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532172.778978:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c83d56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468865536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.778980:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5883
00000100:00100000:0.0:1651532172.778997:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5884
00000100:00100000:0.0:1651532172.778999:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057711e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468865792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.779008:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.779011:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415268 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1e6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.779018:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415268 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1e6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532172.779020:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532172.779022:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415268 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1e6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779025:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532172.779030:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468865984
00000100:00100000:0.0:1651532172.779037:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057711e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468865792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.779039:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5884
00000100:00100000:1.0:1651532172.779044:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5885
00000100:00100000:1.0:1651532172.779045:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468865728:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532172.779046:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5886
00010000:00010000:1.0:1651532172.779049:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532172.779052:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41526f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1df expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.779054:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468865984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.779057:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.779059:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f415276 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1ed expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.779060:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41526f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1df expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.779065:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41526f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1df expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779066:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f415276 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1ed expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532172.779069:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532172.779070:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f415276 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1ed expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779073:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532172.779077:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468865728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (164us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532172.779080:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5885
00000100:00100000:0.0:1651532172.779080:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468865984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.779082:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5886
00000100:00100000:0.0:1651532172.779296:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.779303:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468866304
00000100:00100000:0.0:1651532172.779309:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5887
00000100:00100000:0.0:1651532172.779311:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0d9497 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468866304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.779314:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.779317:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41527d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1f4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.779324:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41527d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1f4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779365:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41527d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1f4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779369:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532172.779380:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0d9497 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468866304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.779383:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5887
00000100:00100000:1.0:1651532172.779385:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.779424:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468866432
00000100:00100000:0.0:1651532172.779431:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5888
00000100:00100000:0.0:1651532172.779432:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468866432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.779436:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.779439:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f415284 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e1fb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.779464:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f415284 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1fb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779468:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f415284 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e1fb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779471:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532172.779486:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468866432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.779489:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5888
00000100:00100000:1.0:1651532172.779499:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.779511:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468866560
00000100:00100000:0.0:1651532172.779517:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5889
00000100:00100000:0.0:1651532172.779519:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468866560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.779522:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.779525:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41528b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e202 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.779532:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41528b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e202 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779536:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41528b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e202 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779539:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532172.779551:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468866560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.779553:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5889
00000100:00100000:0.0:1651532172.779760:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.779767:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468866816
00000100:00100000:0.0:1651532172.779773:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5890
00000100:00100000:0.0:1651532172.779774:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468866816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.779778:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.779781:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415292 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e209 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.779787:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415292 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e209 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779794:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415292 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e209 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.779797:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532172.779823:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468866816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.779826:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5890
00000001:00080000:0.0:1651532172.927717:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794209 is committed
00010000:00010000:1.0:1651532172.927747:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.927752:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.927773:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468861952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574598us (574662us total) trans 158913794209 rc 0/0
00010000:00010000:0.0:1651532172.927776:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.927777:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5087
00010000:00010000:0.0:1651532172.927781:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532172.927782:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.927785:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.927791:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.927791:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.927792:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.927795:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.927799:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.927799:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532172.927800:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.927812:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.927821:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.927824:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4151ab lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [36864->10137599] (req 36864->10137599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.927830:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.927831:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.927833:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.927835:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.928169:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532172.928178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.928190:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468867136
00000100:00100000:1.0:1651532172.928197:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.928199:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5891
00000100:00100000:0.0:1651532172.928201:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468867136:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532172.928204:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532172.928204:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.928217:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415299 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e210 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.928225:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415299 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e210 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.928232:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415299 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e210 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.928236:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532172.928250:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468867136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.928252:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5891
00000100:00100000:0.0:1651532172.928257:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468867328
00000100:00100000:0.0:1651532172.928264:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5892
00000100:00100000:0.0:1651532172.928266:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468867328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.928269:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.928271:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e217 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.928277:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e217 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.928281:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e217 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.928284:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532172.928288:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468867200
00000100:00100000:0.0:1651532172.928290:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468867328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.928292:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5892
00000100:00100000:1.0:1651532172.928299:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468867072
00010000:00010000:0.0:1651532172.928304:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.928308:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5096
00000100:00100000:1.0:1651532172.928310:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468867200:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532172.928314:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.928319:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.928329:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046351af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468862528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416904us (416931us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532172.928330:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532172.928331:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.928332:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5088
00010000:00010000:1.0:1651532172.928334:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532172.928334:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532172.928337:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5097
00000100:00100000:0.0:1651532172.928338:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468867072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532172.928339:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.928342:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.928344:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.928348:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532172.928349:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.928349:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.928352:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532172.928353:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.928367:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.928371:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.928376:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532172.928377:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.928381:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.928386:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532172.928391:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4151c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [16384->1204223] (req 16384->1204223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532172.928669:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.928681:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468867456
00000100:00100000:0.0:1651532172.928689:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5893
00000100:00100000:0.0:1651532172.928690:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020d04d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468867456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.928694:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.928697:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4152b5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e21e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.928704:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4152b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e21e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.928708:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4152b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e21e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.928711:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532172.928727:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020d04d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468867456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.928730:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5893
00000100:00100000:1.0:1651532172.928996:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532172.929007:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468867648
00000100:00100000:0.0:1651532172.929014:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5894
00000100:00100000:0.0:1651532172.929016:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468867648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532172.929019:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532172.929023:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4152bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e225 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532172.929029:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4152bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e225 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.929033:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4152bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e225 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532172.929037:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532172.929055:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468867648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532172.929057:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5894
00000001:00080000:0.0:1651532173.027740:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794210 is committed
00002000:00010000:1.0:1651532173.027768:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532171 -> 1651532172
00010000:00010000:1.0:1651532173.027772:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.027775:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.027797:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d05b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468862464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516164us (516335us total) trans 158913794210 rc 0/0
00010000:00010000:0.0:1651532173.027798:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.027801:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5089
00010000:00010000:0.0:1651532173.027810:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532173.027812:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.027815:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.027820:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.027821:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.027822:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.027825:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.027832:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.027835:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4151dc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2867200->8503295] (req 2867200->8503295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.027843:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.027854:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.028023:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.028027:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.028050:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.028052:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468863680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449904us (449942us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532173.028054:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532173.028055:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5090
00010000:00010000:0.0:1651532173.028055:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.028058:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.028063:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.028063:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.028064:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.028067:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.028077:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.028080:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4151ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [483328->9527295] (req 483328->9527295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.028089:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.028092:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.028267:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.028274:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.028281:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.028290:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468867904
00000100:00100000:1.0:1651532173.028302:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468867840
00000100:00100000:1.0:1651532173.028310:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5098
00000100:00100000:1.0:1651532173.028311:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468867904:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532173.028319:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.028323:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532173.028324:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.028327:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532173.028328:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.028332:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.028342:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.028352:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5099
00000100:00100000:1.0:1651532173.028354:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468867840:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532173.028366:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468867968
00010000:00010000:1.0:1651532173.028369:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.028372:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.028373:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532173.028374:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.028375:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5895
00010000:00010000:1.0:1651532173.028377:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.028377:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468867968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.028381:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.028384:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4152d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e22c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.028390:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532173.028392:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4152d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e22c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532173.028402:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532173.028403:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4152d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e22c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.028412:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532173.028431:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468868224
00000100:00100000:0.0:1651532173.028435:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468867968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (154us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.028436:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468868288
00000100:00100000:0.0:1651532173.028439:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5895
00000100:00100000:1.0:1651532173.028441:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5896
00000100:00100000:1.0:1651532173.028442:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468868224:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532173.028444:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5897
00010000:00010000:1.0:1651532173.028445:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532173.028446:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468868288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.028448:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4152d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e233 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.028449:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.028452:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4152df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e23a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.028456:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4152d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e233 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.028458:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4152df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e23a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.028464:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4152d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e233 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.028465:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4152df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e23a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.028467:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532173.028468:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532173.028476:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468868224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.028477:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468868288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.028479:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5896
00000100:00100000:0.0:1651532173.028480:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5897
00000100:00100000:1.0:1651532173.028834:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.028846:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.028851:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468868480
00000100:00100000:1.0:1651532173.028853:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468868608
00000100:00100000:0.0:1651532173.028860:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5898
00000100:00100000:1.0:1651532173.028862:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5899
00000100:00100000:0.0:1651532173.028862:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468868480:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532173.028864:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468868608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.028865:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.028867:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.028868:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e241 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.028870:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4152ed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e248 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.028875:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e241 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.028878:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4152ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e248 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.028879:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e241 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.028882:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4152ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e248 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.028883:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:1.0:1651532173.028885:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532173.028896:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468868480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.028899:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5898
00000100:00100000:1.0:1651532173.028902:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468868608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.028906:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5899
00000001:00080000:0.0:1651532173.163415:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794211 is committed
00010000:00010000:0.0:1651532173.163431:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163435:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.163456:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468863616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 585299us (585335us total) trans 158913794211 rc 0/0
00010000:00010000:1.0:1651532173.163459:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.163460:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5091
00010000:00010000:1.0:1651532173.163465:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532173.163467:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163470:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163476:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.163477:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.163478:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163481:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163490:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163493:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415206 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8318976->9617407] (req 8318976->9617407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163496:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163500:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163654:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163658:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.163677:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468864512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 485503us (485553us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532173.163680:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5092
00010000:00010000:0.0:1651532173.163688:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163691:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532173.163693:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163696:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163701:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.163701:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.163702:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163705:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163715:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163718:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415222 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [479232->8998911] (req 479232->8998911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163733:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163738:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.163761:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.163770:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.163795:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468868864
00000100:00100000:0.0:1651532173.163820:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468868928
00000100:00100000:0.0:1651532173.163827:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5100
00000100:00100000:1.0:1651532173.163829:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.163829:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c83d56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468868864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532173.163836:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.163838:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468868992
00010000:00010000:0.0:1651532173.163840:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532173.163841:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163844:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.163847:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5900
00010000:00010000:0.0:1651532173.163847:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532173.163847:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.163849:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468868992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.163851:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163853:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.163854:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163857:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4152fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e24f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163857:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163865:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4152fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e24f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532173.163873:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5101
00000100:00100000:0.0:1651532173.163875:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057711e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468868928:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532173.163878:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4152fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e24f expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.163881:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.163882:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532173.163884:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532173.163885:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163888:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532173.163889:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.163892:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.163896:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468868992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.163899:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5900
00010000:00010000:0.0:1651532173.163902:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.164029:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.164040:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.164108:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468869120
00000100:00100000:1.0:1651532173.164126:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468869248
00000100:00100000:1.0:1651532173.164132:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5901
00000100:00100000:1.0:1651532173.164134:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468869120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.164137:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.164141:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415309 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e256 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.164147:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5902
00000100:00100000:0.0:1651532173.164149:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468869248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.164150:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415309 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e256 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.164153:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.164154:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415309 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e256 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.164157:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532173.164157:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f415310 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e25d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.164165:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f415310 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e25d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532173.164169:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468869120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (157us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532173.164169:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f415310 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e25d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.164172:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532173.164181:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468869248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (140us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.164183:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5902
00000100:00100000:1.0:1651532173.164187:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5901
00000100:00100000:0.0:1651532173.164216:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.164233:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468869376
00000100:00100000:1.0:1651532173.164241:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5903
00000100:00100000:1.0:1651532173.164243:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468869376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.164246:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.164250:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415317 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e264 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.164257:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415317 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e264 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.164261:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415317 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e264 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.164265:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532173.164273:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468869376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.164276:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5903
00000001:00080000:0.0:1651532173.263425:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794212 is committed
00010000:00010000:1.0:1651532173.263454:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263458:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.263480:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468864384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 585269us (585348us total) trans 158913794212 rc 0/0
00000100:00100000:1.0:1651532173.263484:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5093
00010000:00010000:1.0:1651532173.263491:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263495:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532173.263496:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263499:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263503:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.263504:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.263505:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263508:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263531:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263536:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415230 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->8482815] (req 409600->8482815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263542:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263545:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.263841:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.263851:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.263858:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468869696
00000100:00100000:0.0:1651532173.263859:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.263868:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.263885:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468869632
00000100:00100000:0.0:1651532173.263889:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5102
00000100:00100000:0.0:1651532173.263891:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0d9497 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468869696:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532173.263894:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5103
00000100:00100000:1.0:1651532173.263896:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468869632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532173.263899:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263903:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.263904:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.263904:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532173.263905:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263909:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532173.263910:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263913:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263916:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532173.263917:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.263921:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263922:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263925:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.263928:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.263933:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468869824
00010000:00010000:1.0:1651532173.263939:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.263940:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468869888
00010000:00010000:1.0:1651532173.263942:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.263944:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5904
00000100:00100000:0.0:1651532173.263946:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000937d196b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468869824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.263949:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.263962:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41532c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e26b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.263963:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090f29ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468865472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 485050us (485111us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532173.263966:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5094
00010000:00010000:0.0:1651532173.263968:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.263971:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41532c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e26b expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.263978:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41532c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e26b expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.263981:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532173.263989:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000937d196b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468869824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.263992:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5904
00000100:00100000:0.0:1651532173.263997:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5905
00000100:00100000:0.0:1651532173.263998:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468869888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.264001:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.264003:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415333 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e272 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.264007:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.264009:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415333 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e272 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.264012:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415333 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e272 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.264015:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532173.264020:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468869888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (153us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.264023:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5905
00010000:00010000:0.0:1651532173.264028:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.264032:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532173.264033:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.264036:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.264040:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.264041:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.264041:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.264044:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.264055:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.264059:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415253 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1204224->7270399] (req 1204224->7270399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.264077:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.264081:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.264282:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.264299:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468870016
00000100:00100000:0.0:1651532173.264307:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5906
00000100:00100000:0.0:1651532173.264308:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468870016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.264312:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.264315:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41533a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e279 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.264322:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41533a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e279 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.264326:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41533a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e279 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.264329:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532173.264348:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468870016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.264351:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5906
00000100:00100000:0.0:1651532173.264575:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.264583:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468870208
00000100:00100000:0.0:1651532173.264589:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5907
00000100:00100000:0.0:1651532173.264591:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468870208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.264594:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.264598:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415341 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e280 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.264605:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415341 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e280 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.264609:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415341 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e280 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.264612:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532173.264626:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468870208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.264629:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5907
00000001:00080000:0.0:1651532173.346844:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794213 is committed
00010000:00010000:1.0:1651532173.346874:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.346879:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.346900:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073c8f72e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468865408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 567954us (568011us total) trans 158913794213 rc 0/0
00000100:00100000:1.0:1651532173.346903:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5095
00010000:00010000:0.0:1651532173.346903:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.346908:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532173.346909:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.346912:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.346917:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.346918:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.346919:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.346922:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.346931:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.346934:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415261 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [602112->9990143] (req 602112->9990143) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.346952:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.346958:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.347218:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.347231:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.347231:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468870464
00000100:00100000:0.0:1651532173.347240:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5908
00000100:00100000:0.0:1651532173.347242:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468870464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.347245:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532173.347248:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532173.347249:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415348 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e287 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.347254:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.347257:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415348 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e287 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532173.347261:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468870336
00010000:00010000:0.0:1651532173.347261:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415348 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e287 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.347264:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532173.347271:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468870400
00000100:00100000:0.0:1651532173.347283:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468870464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.347284:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5104
00000100:00100000:1.0:1651532173.347286:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059bf1b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468870336:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532173.347286:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5908
00010000:00010000:1.0:1651532173.347294:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.347294:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5105
00000100:00100000:0.0:1651532173.347296:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e94a2d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468870400:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532173.347299:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532173.347300:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.347302:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347303:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532173.347304:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.347307:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.347308:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.347311:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532173.347312:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347315:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.347316:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347319:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.347320:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347331:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347334:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.347349:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468867200:12345-10.240.43.64@tcp:3:fio.0 Request processed in 419038us (419180us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532173.347352:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5096
00010000:00010000:1.0:1651532173.347372:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347377:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532173.347378:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347380:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347385:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.347386:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.347387:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347390:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347402:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347405:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4152a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [532480->8183807] (req 532480->8183807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.347412:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.347415:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.347800:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.347822:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468870720
00000100:00100000:1.0:1651532173.347825:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.347839:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.347839:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468870848
00000100:00100000:1.0:1651532173.347849:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.347849:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468870912
00000100:00100000:0.0:1651532173.347852:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468870976
00000100:00100000:0.0:1651532173.347855:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5909
00000100:00100000:0.0:1651532173.347857:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006ef6773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468870720:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532173.347858:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5910
00000100:00100000:1.0:1651532173.347860:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468870848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.347861:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.347864:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.347864:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41535d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e28e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.347872:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41535d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e28e expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.347881:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415364 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e295 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347890:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415364 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e295 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.347894:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415364 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e295 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.347894:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41535d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e28e expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.347898:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:1.0:1651532173.347900:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532173.347912:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006ef6773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468870720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.347915:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5909
00000100:00100000:1.0:1651532173.347917:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468870848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.347920:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5910
00000100:00100000:0.0:1651532173.347922:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5911
00000100:00100000:0.0:1651532173.347924:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468870912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532173.347926:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5912
00010000:00010000:0.0:1651532173.347927:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532173.347928:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468870976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.347929:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41536b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e29c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.347931:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.347934:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415372 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2a3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.347936:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41536b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e29c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.347940:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415372 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2a3 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.347940:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41536b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e29c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.347943:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:1.0:1651532173.347944:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415372 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2a3 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.347947:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:0.0:1651532173.347949:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468870912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.347952:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5911
00000100:00100000:1.0:1651532173.347954:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468870976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.347956:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5912
00000100:00100000:1.0:1651532173.348266:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.348274:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468871232
00000100:00100000:1.0:1651532173.348286:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5913
00000100:00100000:1.0:1651532173.348288:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468871232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.348293:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.348296:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415379 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2aa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.348304:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415379 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2aa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.348308:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415379 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2aa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.348311:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532173.348321:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468871232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.348323:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5913
00000100:00100000:1.0:1651532173.348575:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.348582:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468871488
00000100:00100000:1.0:1651532173.348596:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5914
00000100:00100000:1.0:1651532173.348598:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468871488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.348601:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.348605:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415380 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2b1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.348612:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415380 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2b1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.348616:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415380 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2b1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.348620:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532173.348630:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468871488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.348632:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5914
00000001:00080000:0.0:1651532173.580053:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794214 is committed
00010000:00010000:0.0:1651532173.580069:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580073:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.580104:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f5fbbf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468867072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 651764us (651907us total) trans 158913794214 rc 0/0
00000100:00100000:0.0:1651532173.580107:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5097
00010000:00010000:0.0:1651532173.580114:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580118:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532173.580119:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580122:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580128:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.580128:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.580129:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580132:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580135:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.580136:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.580136:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580139:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580159:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580162:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4152ae lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->9928703] (req 360448->9928703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580171:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.580174:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580174:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.580181:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.580639:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.580651:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.580651:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468871808
00000100:00100000:1.0:1651532173.580659:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.580665:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468871680
00000100:00100000:0.0:1651532173.580673:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5106
00000100:00100000:1.0:1651532173.580675:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.580675:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468871808:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532173.580685:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532173.580691:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580700:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532173.580701:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.580702:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5107
00000100:00100000:1.0:1651532173.580704:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468871680:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532173.580705:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.580713:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580715:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580726:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.580730:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532173.580732:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.580734:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.580740:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532173.580741:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.580742:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002068cddf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468867904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 552430us (552476us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532173.580745:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.580745:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5098
00010000:00010000:1.0:1651532173.580748:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.580752:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580752:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580755:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532173.580756:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580759:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580764:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580767:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4152c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7929856->10133503] (req 7929856->10133503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.580774:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468871872
00000100:00100000:0.0:1651532173.580779:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468871936
00000100:00100000:0.0:1651532173.580782:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468872128
00000100:00100000:0.0:1651532173.580785:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5915
00000100:00100000:0.0:1651532173.580786:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468871872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.580797:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.580800:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415395 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2b8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.580823:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415395 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2b8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.580827:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415395 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2b8 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.580830:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532173.580837:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5916
00000100:00100000:0.0:1651532173.580838:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468871872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (180us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.580839:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468871936:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532173.580841:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5915
00010000:00010000:1.0:1651532173.580843:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.580846:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41539c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2bf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.580846:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5917
00000100:00100000:0.0:1651532173.580848:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468872128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.580851:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.580853:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4153a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2c6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.580854:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41539c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2bf expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.580859:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41539c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2bf expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.580859:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4153a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2c6 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.580862:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532173.580863:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4153a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2c6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.580869:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532173.580872:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468871936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (202us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.580874:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468872128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (190us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.580875:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5916
00000100:00100000:0.0:1651532173.580877:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5917
00000100:00100000:1.0:1651532173.581166:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.581175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.581188:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468872320
00000100:00100000:0.0:1651532173.581193:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468872384
00000100:00100000:1.0:1651532173.581197:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5918
00000100:00100000:1.0:1651532173.581198:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468872320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.581202:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532173.581202:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5919
00000100:00100000:0.0:1651532173.581203:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468872384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.581206:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153aa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2cd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.581207:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.581210:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2d4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.581213:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2cd expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.581218:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2cd expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.581218:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2d4 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.581221:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532173.581222:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2d4 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.581225:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532173.581234:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468872320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.581237:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5918
00000100:00100000:0.0:1651532173.581240:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468872384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.581243:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5919
00000100:00100000:0.0:1651532173.581296:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.581304:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468872640
00000100:00100000:0.0:1651532173.581311:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5920
00000100:00100000:0.0:1651532173.581312:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468872640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.581316:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.581319:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4153b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2db expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.581326:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4153b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2db expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.581330:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4153b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2db expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.581333:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532173.581342:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468872640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.581344:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5920
00000100:00100000:1.0:1651532173.581522:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.581533:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468872832
00000100:00100000:0.0:1651532173.581541:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5921
00000100:00100000:0.0:1651532173.581543:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468872832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.581546:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.581549:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2e2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.581556:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2e2 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.581560:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2e2 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.581566:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532173.581576:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468872832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.581579:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5921
00000001:00080000:0.0:1651532173.680023:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794215 is committed
00010000:00010000:1.0:1651532173.680051:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680056:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.680074:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee30130 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468867840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 651719us (651799us total) trans 158913794215 rc 0/0
00000100:00100000:1.0:1651532173.680077:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5099
00010000:00010000:1.0:1651532173.680083:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680087:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532173.680088:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680091:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680096:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.680096:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.680097:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680100:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680112:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680115:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4152ca lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [360448->7647231] (req 360448->7647231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.680125:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.680129:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.680532:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.680543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.680552:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468873088
00000100:00100000:0.0:1651532173.680552:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.680559:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.680564:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468873152
00000100:00100000:0.0:1651532173.680565:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.680577:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5108
00000100:00100000:1.0:1651532173.680578:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468873088:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532173.680580:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5109
00000100:00100000:0.0:1651532173.680583:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468873152:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532173.680586:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680591:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532173.680591:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680592:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680595:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532173.680596:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.680601:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532173.680603:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.680606:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532173.680606:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680610:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.680611:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680614:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.680615:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.680622:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468873216
00000100:00100000:1.0:1651532173.680624:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468873280
00000100:00100000:0.0:1651532173.680632:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468873408
00000100:00100000:0.0:1651532173.680635:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5922
00000100:00100000:0.0:1651532173.680637:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468873216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532173.680638:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5923
00000100:00100000:1.0:1651532173.680640:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468873280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.680640:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.680642:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4153d4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2e9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.680643:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.680646:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2f0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.680649:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4153d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2e9 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.680653:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4153d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2e9 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.680654:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2f0 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.680657:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:1.0:1651532173.680661:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2f0 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.680665:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532173.680669:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468873216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.680672:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5922
00000100:00100000:0.0:1651532173.680677:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5924
00000100:00100000:0.0:1651532173.680679:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468873408:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532173.680680:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468873280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (120us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532173.680681:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532173.680683:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5923
00010000:00010000:0.0:1651532173.680683:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2f7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.680689:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2f7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.680693:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2f7 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.680696:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532173.680701:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468873408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.680704:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5924
00000100:00100000:0.0:1651532173.680983:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.680990:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468873664
00000100:00100000:0.0:1651532173.680996:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5925
00000100:00100000:0.0:1651532173.680998:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468873664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.681001:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.681005:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4153e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e2fe expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.681012:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4153e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2fe expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.681018:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4153e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e2fe expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.681022:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532173.681037:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468873664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.681040:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5925
00000001:00080000:0.0:1651532173.796729:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794216 is committed
00002000:00010000:0.0:1651532173.796742:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532172 -> 1651532173
00010000:00010000:0.0:1651532173.796745:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796749:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.796765:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c83d56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468868864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 632935us (633004us total) trans 158913794216 rc 0/0
00000100:00100000:0.0:1651532173.796768:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5100
00010000:00010000:0.0:1651532173.796775:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796778:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532173.796779:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796782:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796787:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.796788:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.796789:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796792:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796795:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.796795:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.796796:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796799:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796823:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796827:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4152f4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1208320->9588735] (req 1208320->9588735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796832:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.796835:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.796836:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.796841:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797058:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797062:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.797078:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057711e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468868928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 633202us (633307us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532173.797081:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5101
00010000:00010000:0.0:1651532173.797088:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797091:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532173.797092:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797095:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797100:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797103:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415302 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4395008->10137599] (req 4395008->10137599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797141:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797146:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.797169:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0d9497 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468869696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533277us (533328us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532173.797173:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5102
00010000:00010000:1.0:1651532173.797180:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797184:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532173.797185:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797188:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797203:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.797204:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.797205:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797211:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797222:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797226:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41531e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3268608->9605119] (req 3268608->9605119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797238:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797241:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.797280:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.797288:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468873920
00000100:00100000:0.0:1651532173.797301:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5926
00000100:00100000:0.0:1651532173.797302:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468873920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.797308:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.797311:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4153f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e305 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797319:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4153f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e305 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.797323:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4153f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e305 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.797327:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532173.797373:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468873920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 69us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.797396:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5926
00000100:00100000:0.0:1651532173.797413:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.797421:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.797431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.797439:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.797461:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468874048
00000100:00100000:0.0:1651532173.797471:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468874112
00000100:00100000:0.0:1651532173.797481:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5110
00000100:00100000:0.0:1651532173.797482:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468874048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532173.797489:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797494:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532173.797495:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797498:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532173.797498:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797503:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.797506:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5111
00010000:00010000:0.0:1651532173.797506:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.797508:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468874112:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532173.797514:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468873984
00010000:00010000:1.0:1651532173.797516:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.797522:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468874176
00000100:00100000:0.0:1651532173.797529:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5927
00000100:00100000:0.0:1651532173.797530:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468873984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.797531:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.797532:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797533:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.797535:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532173.797536:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797536:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415405 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e30c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797540:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797542:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415405 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e30c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.797544:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.797546:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415405 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e30c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.797549:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532173.797561:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468873984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (148us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.797564:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5927
00000100:00100000:1.0:1651532173.797570:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5928
00000100:00100000:1.0:1651532173.797572:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468874176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.797575:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.797578:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41540c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e313 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797586:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41540c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e313 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.797590:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41540c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e313 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.797594:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532173.797603:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468874176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (165us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.797606:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5928
00000100:00100000:0.0:1651532173.797662:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.797674:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468874304
00000100:00100000:1.0:1651532173.797683:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5929
00000100:00100000:1.0:1651532173.797685:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468874304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.797689:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.797692:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415413 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e31a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797700:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415413 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e31a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.797704:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415413 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e31a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.797707:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532173.797717:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468874304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.797720:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5929
00000100:00100000:0.0:1651532173.797905:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.797925:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468874496
00000100:00100000:1.0:1651532173.797933:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5930
00000100:00100000:1.0:1651532173.797935:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468874496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.797939:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.797942:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41541a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e321 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.797952:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41541a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e321 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.797956:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41541a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e321 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.797959:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532173.797970:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468874496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.797972:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5930
00000100:00100000:0.0:1651532173.798030:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.798042:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468874624
00000100:00100000:1.0:1651532173.798050:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5931
00000100:00100000:1.0:1651532173.798052:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468874624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.798055:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.798059:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415421 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e328 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.798066:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415421 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e328 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.798070:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415421 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e328 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.798073:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532173.798082:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468874624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.798085:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5931
00000100:00100000:0.0:1651532173.798198:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.798211:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468874752
00000100:00100000:1.0:1651532173.798219:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5932
00000100:00100000:1.0:1651532173.798221:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468874752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.798224:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.798227:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415428 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e32f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.798234:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415428 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e32f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.798238:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415428 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e32f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.798241:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532173.798250:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468874752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.798253:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5932
00000100:00100000:0.0:1651532173.798370:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.798383:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468874880
00000100:00100000:1.0:1651532173.798391:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5933
00000100:00100000:1.0:1651532173.798393:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468874880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.798396:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.798399:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41542f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e336 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.798406:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41542f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e336 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.798411:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41542f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e336 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.798414:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532173.798424:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468874880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.798426:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5933
00000100:00100000:0.0:1651532173.798469:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.798480:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468875008
00000100:00100000:1.0:1651532173.798488:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5934
00000100:00100000:1.0:1651532173.798490:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468875008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.798493:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.798497:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415436 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e33d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.798504:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415436 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e33d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.798508:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415436 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e33d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.798511:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532173.798520:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468875008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.798523:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5934
00000100:00100000:0.0:1651532173.798710:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.798729:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468875200
00000100:00100000:1.0:1651532173.798737:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5935
00000100:00100000:1.0:1651532173.798739:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468875200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.798742:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.798745:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41543d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e344 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.798752:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41543d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e344 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.798757:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41543d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e344 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.798760:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532173.798769:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468875200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.798772:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5935
00000100:00100000:0.0:1651532173.798958:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.798971:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468875328
00000100:00100000:1.0:1651532173.798979:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5936
00000100:00100000:1.0:1651532173.798981:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468875328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532173.798984:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532173.798987:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415444 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e34b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.798994:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415444 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e34b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.799001:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415444 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e34b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.799004:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532173.799014:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468875328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.799017:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5936
00000001:00080000:0.0:1651532173.921750:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794217 is committed
00010000:00010000:1.0:1651532173.921780:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.921785:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.921809:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.921814:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532173.921818:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468869632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 657921us (657966us total) trans 158913794217 rc 0/0
00010000:00010000:0.0:1651532173.921820:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.921821:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5103
00010000:00010000:0.0:1651532173.921824:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.921829:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.921830:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.921831:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.921834:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.921844:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.921847:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415325 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->4407295] (req 495616->4407295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.921857:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.921860:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.922224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.922233:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.922240:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468875520
00000100:00100000:1.0:1651532173.922253:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468875456
00000100:00100000:1.0:1651532173.922259:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5112
00000100:00100000:1.0:1651532173.922261:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468875520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532173.922268:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.922270:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5113
00000100:00100000:0.0:1651532173.922273:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468875456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532173.922281:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.922283:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532173.922284:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532173.922285:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.922291:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532173.922292:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.922295:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.922298:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532173.922299:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.922302:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.922303:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.922309:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.922312:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532173.972028:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794218 is committed
00010000:00010000:0.0:1651532173.972042:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972046:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.972068:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059bf1b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468870336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 624781us (624836us total) trans 158913794218 rc 0/0
00000100:00100000:0.0:1651532173.972071:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5104
00010000:00010000:0.0:1651532173.972079:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972082:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532173.972083:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972086:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972091:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.972092:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.972093:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972096:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972099:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.972100:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532173.972100:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972103:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972110:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972113:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41534f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [950272->7921663] (req 950272->7921663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972118:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972121:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972146:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972149:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972335:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972339:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.972373:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e94a2d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468870400:12345-10.240.43.64@tcp:3:fio.0 Request processed in 625076us (625125us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532173.972377:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5105
00010000:00010000:0.0:1651532173.972387:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972391:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.972406:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cadb378 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468871808:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391730us (391768us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532173.972409:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5106
00010000:00010000:0.0:1651532173.972414:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.972418:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972418:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532173.972419:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972421:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.972423:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532173.972424:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972427:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.972428:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972430:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415356 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [487424->9994239] (req 487424->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.972434:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.972434:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532173.972435:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.972438:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.972446:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.972461:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415387 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2433024->8171519] (req 2433024->8171519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.972467:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.972470:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.972736:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.972751:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.972756:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468875840
00000100:00100000:1.0:1651532173.972758:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.972767:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5114
00000100:00100000:0.0:1651532173.972769:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468875840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532173.972776:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972780:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532173.972781:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972784:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532173.972784:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972789:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972792:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532173.972837:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468875904
00000100:00100000:0.0:1651532173.972845:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468875968
00000100:00100000:0.0:1651532173.972849:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5937
00000100:00100000:0.0:1651532173.972851:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468875904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.972854:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.972857:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415460 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e352 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972865:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415460 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e352 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.972869:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f415460 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e352 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.972873:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532173.972876:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.972881:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468875904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.972884:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5937
00000100:00100000:1.0:1651532173.972886:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.972889:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468876032
00000100:00100000:0.0:1651532173.972892:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468876096
00000100:00100000:0.0:1651532173.972894:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5938
00000100:00100000:0.0:1651532173.972896:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468875968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.972898:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.972900:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415467 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e359 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972906:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415467 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e359 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.972913:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415467 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e359 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.972916:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532173.972927:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468875968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (168us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.972929:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5938
00000100:00100000:0.0:1651532173.972933:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5939
00000100:00100000:0.0:1651532173.972935:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468876032:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532173.972936:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5940
00010000:00010000:0.0:1651532173.972937:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532173.972938:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047d3441e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468876096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.972939:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41546e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e360 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.972943:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.972944:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41546e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e360 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.972947:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415475 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e367 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.972948:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41546e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e360 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.972951:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:1.0:1651532173.972956:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415475 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e367 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532173.972956:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468876032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.972959:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5939
00010000:00010000:1.0:1651532173.972961:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415475 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e367 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.972976:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532173.972986:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047d3441e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468876096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532173.972989:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5940
00000100:00100000:1.0:1651532173.973334:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.973345:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532173.973363:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.973364:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468876352
00000100:00100000:1.0:1651532173.973374:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532173.973387:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468876288
00000100:00100000:1.0:1651532173.973389:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468876224
00000100:00100000:0.0:1651532173.973396:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5115
00000100:00100000:0.0:1651532173.973398:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468876352:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532173.973404:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468876608
00000100:00100000:1.0:1651532173.973411:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5941
00000100:00100000:1.0:1651532173.973413:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468876224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.973414:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.973416:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.973418:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532173.973419:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.973420:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415483 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e36e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.973422:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532173.973423:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.973428:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.973429:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415483 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e36e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.973432:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532173.973433:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415483 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e36e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532173.973436:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532173.973439:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5116
00000100:00100000:0.0:1651532173.973441:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468876288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532173.973445:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.973446:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468876224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (123us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532173.973449:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532173.973449:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532173.973450:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.973455:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532173.973459:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5941
00000100:00100000:0.0:1651532173.973462:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5942
00000100:00100000:0.0:1651532173.973463:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468876608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532173.973466:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532173.973468:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415491 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e375 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532173.973474:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415491 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e375 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.973478:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415491 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e375 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532173.973481:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532173.973496:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468876608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532173.973498:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5942
00000001:00080000:0.0:1651532174.063514:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794219 is committed
00010000:00010000:1.0:1651532174.063545:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.063550:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.063571:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.063572:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015e6bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468871680:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482867us (482920us total) trans 158913794219 rc 0/0
00000100:00100000:1.0:1651532174.063575:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5107
00010000:00010000:0.0:1651532174.063576:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.063577:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.063580:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.063586:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.063586:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.063587:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.063590:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.063600:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.063603:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41538e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2793472->9912319] (req 2793472->9912319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.063621:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.063627:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.063999:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.064009:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.064011:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468876928
00000100:00100000:1.0:1651532174.064018:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.064033:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468877120
00000100:00100000:0.0:1651532174.064036:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468877056
00000100:00100000:0.0:1651532174.064040:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5943
00000100:00100000:0.0:1651532174.064041:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468876928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.064045:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.064048:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415498 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e37c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.064055:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415498 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e37c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.064063:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f415498 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e37c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.064066:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532174.064079:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468876928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.064082:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5943
00000100:00100000:0.0:1651532174.064087:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5944
00000100:00100000:0.0:1651532174.064089:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468877120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.064091:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.064093:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41549f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e38a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.064099:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41549f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e38a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.064103:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41549f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e38a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532174.064106:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5945
00010000:00010000:0.0:1651532174.064106:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532174.064109:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468877056:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532174.064111:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468877120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (101us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532174.064112:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532174.064113:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5944
00010000:00010000:1.0:1651532174.064117:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4154a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e383 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.064125:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4154a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e383 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.064133:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4154a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e383 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.064136:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532174.064145:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468877056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (127us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.064148:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5945
00000100:00100000:1.0:1651532174.064465:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.064473:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.064484:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468877312
00000100:00100000:1.0:1651532174.064485:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468877376
00000100:00100000:0.0:1651532174.064493:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5946
00000100:00100000:1.0:1651532174.064501:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5947
00000100:00100000:1.0:1651532174.064503:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468877376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.064507:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532174.064514:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468877312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.064517:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.064518:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e398 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.064521:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4154b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e391 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.064526:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e398 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.064529:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4154b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e391 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.064530:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e398 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.064533:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4154b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e391 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.064534:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532174.064536:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532174.064544:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468877376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.064544:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468877312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.064547:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5946
00000100:00100000:1.0:1651532174.064549:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5947
00000100:00100000:1.0:1651532174.064576:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.064596:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468877568
00000100:00100000:0.0:1651532174.064603:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5948
00000100:00100000:0.0:1651532174.064604:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468877568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.064607:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.064610:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e39f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.064616:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e39f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.064620:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e39f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.064623:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532174.064636:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468877568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.064638:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5948
00000001:00080000:0.0:1651532174.205156:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794220 is committed
00010000:00010000:1.0:1651532174.205186:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.205190:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.205208:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ff6350b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468873088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524628us (524676us total) trans 158913794220 rc 0/0
00000100:00100000:1.0:1651532174.205211:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5108
00010000:00010000:1.0:1651532174.205218:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.205221:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532174.205222:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.205225:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.205230:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532174.205231:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532174.205232:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.205235:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.205249:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.205253:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4153c6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->7979007] (req 499712->7979007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205262:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205266:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.205574:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.205583:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.205599:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.205609:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468877952
00010000:00010000:0.0:1651532174.205612:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205616:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.205624:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5117
00000100:00100000:1.0:1651532174.205627:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468877952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532174.205642:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.205649:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094232d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468873152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 525066us (525106us total) trans 0 rc 28672/28672
00010000:00010000:1.0:1651532174.205651:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532174.205653:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.205653:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5109
00010000:00010000:1.0:1651532174.205656:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.205658:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532174.205659:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.205660:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468878016
00010000:00010000:1.0:1651532174.205663:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.205667:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.205671:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5118
00000100:00100000:0.0:1651532174.205673:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468878016:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532174.205678:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205679:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205686:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.205687:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205690:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532174.205691:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205695:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205699:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205706:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205709:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.205710:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205713:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.205716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532174.205717:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.205718:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.205718:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205731:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205737:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205739:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4153cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [712704->10280959] (req 712704->10280959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205745:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205747:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.205764:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468878144
00000100:00100000:0.0:1651532174.205775:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468878208
00000100:00100000:1.0:1651532174.205778:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5949
00000100:00100000:1.0:1651532174.205780:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468878144:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532174.205783:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5950
00010000:00010000:1.0:1651532174.205784:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532174.205785:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468878208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.205787:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4154d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3a6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.205788:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.205791:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4154d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3ad expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.205795:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4154d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3a6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.205799:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4154d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3a6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.205799:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4154d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3ad expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.205815:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532174.205817:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4154d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3ad expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.205821:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532174.205824:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468878144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (225us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.205827:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5949
00000100:00100000:0.0:1651532174.205829:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468878208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.205832:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5950
00000100:00100000:1.0:1651532174.205964:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.205982:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468878272
00000100:00100000:0.0:1651532174.205990:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5951
00000100:00100000:0.0:1651532174.205991:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468878272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.205995:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532174.205997:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532174.205998:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4154de lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3b4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.206005:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4154de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3b4 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.206009:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4154de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3b4 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532174.206019:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468878336
00010000:00010000:0.0:1651532174.206019:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532174.206027:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5952
00000100:00100000:1.0:1651532174.206029:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468878336:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532174.206033:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468878272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.206036:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5951
00010000:00010000:1.0:1651532174.206038:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.206041:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4154e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3bb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.206049:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4154e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3bb expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.206053:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4154e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3bb expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.206056:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532174.206064:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468878336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.206067:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5952
00000100:00100000:1.0:1651532174.206152:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.206173:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468878464
00000100:00100000:0.0:1651532174.206185:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5953
00000100:00100000:0.0:1651532174.206187:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468878464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.206191:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.206195:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4154ec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3c2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.206202:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4154ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3c2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.206206:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4154ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3c2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.206210:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532174.206224:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468878464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.206227:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5953
00000100:00100000:1.0:1651532174.206302:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.206312:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468878656
00000100:00100000:1.0:1651532174.206314:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.206321:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468878848
00000100:00100000:0.0:1651532174.206327:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5954
00000100:00100000:0.0:1651532174.206328:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468878656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532174.206329:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5955
00000100:00100000:1.0:1651532174.206331:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000937d196b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468878848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.206332:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.206335:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.206335:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4154f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3c9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.206339:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4154fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3d0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.206341:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4154f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3c9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.206345:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4154f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3c9 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.206349:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4154fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3d0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.206349:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:1.0:1651532174.206353:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4154fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3d0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532174.206369:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468878656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (68us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532174.206372:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532174.206372:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5954
00000100:00100000:1.0:1651532174.206381:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000937d196b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468878848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.206384:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5955
00000100:00100000:1.0:1651532174.206442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.206450:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468879040
00000100:00100000:1.0:1651532174.206457:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5956
00000100:00100000:1.0:1651532174.206458:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468879040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.206461:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.206465:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415501 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3d7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.206472:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415501 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3d7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.206476:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415501 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3d7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.206479:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532174.206488:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468879040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.206491:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5956
00000100:00100000:1.0:1651532174.206712:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.206720:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468879296
00000100:00100000:1.0:1651532174.206727:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5957
00000100:00100000:1.0:1651532174.206729:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468879296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.206732:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.206735:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415508 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3de expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.206743:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415508 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3de expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.206747:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415508 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3de expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.206750:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532174.206759:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468879296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (47us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.206761:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5957
00000001:00080000:0.0:1651532174.271837:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794221 is committed
00002000:00010000:0.0:1651532174.271851:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532171 -> 1651532173
00010000:00010000:0.0:1651532174.271854:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.271858:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.271879:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468874048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474396us (474457us total) trans 158913794221 rc 0/0
00000100:00100000:0.0:1651532174.271883:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5110
00010000:00010000:0.0:1651532174.271890:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.271893:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.271894:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.271897:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.271902:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.271903:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.271904:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.271907:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.271910:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.271910:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.271911:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.271914:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.271920:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.271923:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4153f7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1638400->6217727] (req 1638400->6217727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.271938:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.271943:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.271972:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.271978:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.272157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.272175:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468879552
00000100:00100000:1.0:1651532174.272176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.272187:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468879488
00000100:00100000:1.0:1651532174.272217:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5119
00000100:00100000:1.0:1651532174.272219:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468879488:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532174.272224:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5120
00000100:00100000:0.0:1651532174.272226:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468879552:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532174.272233:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.272233:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272238:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532174.272239:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272242:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532174.272243:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.272246:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.272247:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.272253:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532174.272253:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272258:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.272258:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272262:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.272262:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.272287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.272305:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532174.272315:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272319:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.272333:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468874112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474825us (474902us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532174.272336:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5111
00010000:00010000:1.0:1651532174.272345:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272349:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.272376:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002903393f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468875520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350114us (350152us total) trans 0 rc 45056/45056
00010000:00010000:0.0:1651532174.272377:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.272378:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5112
00010000:00010000:0.0:1651532174.272382:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.272383:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272385:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.272386:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272390:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.272391:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272392:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.272394:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4153fe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5255168->8626175] (req 5255168->8626175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272397:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272402:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532174.272403:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532174.272404:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.272405:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468879616
00010000:00010000:1.0:1651532174.272407:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.272412:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468879680
00010000:00010000:1.0:1651532174.272417:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272420:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f41544b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->8577023] (req 65536->8577023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.272424:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5958
00000100:00100000:0.0:1651532174.272426:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468879616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.272429:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.272432:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41551d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3e5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.272439:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41551d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3e5 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.272444:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41551d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3e5 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.272447:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532174.272461:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468879616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (175us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.272464:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5958
00000100:00100000:0.0:1651532174.272469:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5959
00000100:00100000:0.0:1651532174.272470:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468879680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.272473:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.272475:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415524 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3ec expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.272481:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415524 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3ec expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.272485:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f415524 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3ec expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.272488:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532174.272498:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468879680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (193us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.272501:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5959
00010000:00010000:0.0:1651532174.272507:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.272510:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.272912:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.272921:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.272942:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.272949:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.272958:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468879872
00000100:00100000:1.0:1651532174.272970:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468879936
00000100:00100000:1.0:1651532174.272978:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5121
00000100:00100000:1.0:1651532174.272980:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006ef6773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468879872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532174.272988:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272995:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532174.272996:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.272999:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532174.272999:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.273004:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.273007:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.273015:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5122
00000100:00100000:0.0:1651532174.273017:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468879936:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532174.273021:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468880000
00010000:00010000:0.0:1651532174.273025:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.273026:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468880256
00010000:00010000:0.0:1651532174.273029:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532174.273030:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5960
00010000:00010000:0.0:1651532174.273031:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532174.273031:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.273032:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468880000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.273034:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.273034:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.273037:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415539 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3f3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.273042:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5961
00010000:00010000:1.0:1651532174.273044:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415539 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3f3 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532174.273044:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468880256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.273047:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.273048:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415539 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3f3 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.273049:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415540 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e3fa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.273055:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532174.273056:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415540 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3fa expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.273060:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f415540 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e3fa expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.273063:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532174.273087:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468880000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.273089:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468880256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.273090:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5960
00000100:00100000:0.0:1651532174.273091:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5961
00000100:00100000:0.0:1651532174.273341:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.273350:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.273370:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468880512
00000100:00100000:1.0:1651532174.273372:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468880576
00000100:00100000:0.0:1651532174.273380:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5962
00000100:00100000:0.0:1651532174.273382:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468880512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.273385:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532174.273386:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5963
00000100:00100000:1.0:1651532174.273388:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468880576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.273389:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415547 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e401 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.273391:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.273395:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41554e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e408 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.273396:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415547 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e401 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.273402:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41554e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e408 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.273403:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f415547 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e401 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.273406:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41554e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e408 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.273406:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:1.0:1651532174.273409:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532174.273419:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468880512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.273421:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5962
00000100:00100000:1.0:1651532174.273425:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468880576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.273427:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5963
00000100:00100000:0.0:1651532174.273663:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.273677:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.273688:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468880768
00000100:00100000:1.0:1651532174.273696:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468880832
00000100:00100000:1.0:1651532174.273706:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5964
00000100:00100000:1.0:1651532174.273707:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468880768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.273711:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.273714:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415555 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e40f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.273715:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5965
00000100:00100000:0.0:1651532174.273717:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468880832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.273721:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.273722:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415555 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e40f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.273724:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41555c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e416 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.273726:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415555 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e40f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.273729:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532174.273731:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41555c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e416 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.273735:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41555c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e416 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532174.273739:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468880768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (77us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532174.273739:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532174.273741:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5964
00000100:00100000:0.0:1651532174.273746:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468880832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.273750:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5965
00000100:00100000:0.0:1651532174.274008:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.274015:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.274028:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468881024
00000100:00100000:0.0:1651532174.274038:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5966
00000100:00100000:1.0:1651532174.274039:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468881088
00000100:00100000:0.0:1651532174.274039:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468881024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.274043:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.274046:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f415563 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e41d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.274048:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5967
00000100:00100000:1.0:1651532174.274050:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468881088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.274053:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.274053:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f415563 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e41d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.274057:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41556a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e424 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.274057:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f415563 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e41d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.274060:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:1.0:1651532174.274064:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41556a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e424 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.274068:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41556a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e424 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532174.274072:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468881024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.274075:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5966
00010000:00010000:1.0:1651532174.274080:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532174.274089:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468881088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.274092:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5967
00000001:00080000:0.0:1651532174.366746:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794222 is committed
00010000:00010000:0.0:1651532174.366761:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.366765:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.366783:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042a29227 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468875456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 444510us (444550us total) trans 158913794222 rc 0/0
00000100:00100000:0.0:1651532174.366787:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5113
00010000:00010000:0.0:1651532174.366793:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.366797:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.366798:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.366801:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.366823:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.366823:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.366824:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.366827:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.366835:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.366838:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f415452 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->7983103] (req 991232->7983103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.366843:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.366846:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.367179:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.367199:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.367206:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468881344
00000100:00100000:1.0:1651532174.367213:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468881408
00000100:00100000:1.0:1651532174.367220:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5968
00000100:00100000:1.0:1651532174.367222:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468881344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.367226:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532174.367226:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5969
00000100:00100000:0.0:1651532174.367228:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468881408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.367229:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415571 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e42b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.367232:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.367236:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f415578 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e432 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.367237:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415571 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e42b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.367241:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415571 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e42b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.367243:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f415578 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e432 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.367245:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532174.367248:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f415578 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e432 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.367251:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532174.367255:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468881344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.367257:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5968
00000100:00100000:0.0:1651532174.367260:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468881408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.367262:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5969
00000100:00100000:1.0:1651532174.367551:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.367569:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468881536
00000100:00100000:0.0:1651532174.367582:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5970
00000100:00100000:0.0:1651532174.367584:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468881536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.367587:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.367590:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41557f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e439 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.367600:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41557f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e439 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.367604:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41557f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e439 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.367607:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532174.367621:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468881536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.367624:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5970
00000001:00080000:0.0:1651532174.425136:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794223 is committed
00010000:00010000:0.0:1651532174.425150:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425154:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.425175:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f815501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468875840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 452405us (452440us total) trans 158913794223 rc 0/0
00000100:00100000:0.0:1651532174.425179:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5114
00010000:00010000:0.0:1651532174.425186:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425189:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.425190:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425196:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425201:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.425201:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.425202:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425205:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425209:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.425209:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.425210:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425212:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425220:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425222:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f415459 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [86016->8953855] (req 86016->8953855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425227:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425230:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425255:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425259:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425269:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425288:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.425308:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000440fc8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468876352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 451909us (451962us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532174.425311:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5115
00010000:00010000:1.0:1651532174.425315:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.425319:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532174.425321:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.425324:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.425330:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.425333:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41547c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4423680->4427775] (req 4423680->4427775) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.425599:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.425609:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.425617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.425627:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.425636:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468881920
00000100:00100000:1.0:1651532174.425643:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468882048
00000100:00100000:1.0:1651532174.425647:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5971
00000100:00100000:1.0:1651532174.425649:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468881920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.425657:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.425661:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415586 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e440 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.425661:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468881792
00000100:00100000:0.0:1651532174.425671:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468881728
00010000:00010000:1.0:1651532174.425672:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415586 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e440 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532174.425677:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5123
00010000:00010000:1.0:1651532174.425679:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415586 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e440 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532174.425679:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468881792:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532174.425685:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532174.425697:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468881920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.425700:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5971
00010000:00010000:0.0:1651532174.425701:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.425706:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5972
00010000:00010000:0.0:1651532174.425706:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532174.425707:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468882048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.425707:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.425710:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.425710:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532174.425711:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.425713:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415594 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e447 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425716:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425719:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.425733:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415594 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e447 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.425737:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415594 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e447 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532174.425738:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5124
00010000:00010000:1.0:1651532174.425740:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532174.425740:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468881728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532174.425745:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.425746:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468882048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.425749:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5972
00010000:00010000:0.0:1651532174.425749:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532174.425750:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425752:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425755:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532174.425755:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425759:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425762:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.425765:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532174.425765:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.425774:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468882112
00000100:00100000:0.0:1651532174.425785:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5973
00000100:00100000:0.0:1651532174.425787:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468882112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.425789:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.425792:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e44e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.425799:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e44e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.425818:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e44e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.425822:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532174.425835:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468882112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.425838:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5973
00000001:00080000:0.0:1651532174.508515:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794224 is committed
00010000:00010000:0.0:1651532174.508537:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.508541:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.508570:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b823d8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468876288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 535128us (535206us total) trans 158913794224 rc 0/0
00000100:00100000:0.0:1651532174.508573:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5116
00010000:00010000:0.0:1651532174.508580:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.508583:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.508584:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.508587:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.508592:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.508593:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.508593:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.508596:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.508605:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.508609:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41548a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4534272->9629695] (req 4534272->9629695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.508629:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.508635:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.508957:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.508976:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468882368
00000100:00100000:1.0:1651532174.508979:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.508991:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468882432
00000100:00100000:0.0:1651532174.509001:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5125
00000100:00100000:0.0:1651532174.509003:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468882368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532174.509009:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.509013:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532174.509014:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.509017:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532174.509018:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.509022:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.509025:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.509033:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5126
00000100:00100000:0.0:1651532174.509034:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468882432:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532174.509038:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.509042:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532174.509050:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.509053:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532174.509053:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.509057:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.509060:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532174.600170:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794225 is committed
00010000:00010000:1.0:1651532174.600200:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.600205:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.600228:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468877952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 394601us (394654us total) trans 158913794225 rc 0/0
00010000:00010000:0.0:1651532174.600228:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.600231:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5117
00010000:00010000:0.0:1651532174.600232:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.600233:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.600236:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.600242:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.600242:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.600243:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.600246:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.600261:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.600264:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4154c2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->10276863] (req 102400->10276863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.600270:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.600273:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.600579:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.600591:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468882688
00000100:00100000:0.0:1651532174.600603:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5974
00000100:00100000:0.0:1651532174.600610:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468882688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.600613:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.600617:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4155b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e455 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.600623:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.600625:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4155b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e455 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.600630:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4155b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e455 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.600633:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532174.600647:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468882688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.600650:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5974
00010000:00010000:0.0:1651532174.600663:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.600666:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.600682:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef895c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468878016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 395008us (395099us total) trans 0 rc 45056/45056
00000100:00100000:0.0:1651532174.600685:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5118
00010000:00010000:1.0:1651532174.600693:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.600698:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532174.600699:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.600702:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.600708:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532174.600709:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532174.600710:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.600713:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.600721:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.600724:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4154c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->9994239] (req 266240->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.600729:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.600732:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.600942:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.600979:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468882880
00000100:00100000:0.0:1651532174.600990:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5975
00000100:00100000:0.0:1651532174.600991:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000262e29b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468882880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.600995:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.600998:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4155be lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e45c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601005:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4155be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e45c expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.601010:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4155be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e45c expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.601013:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532174.601025:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000262e29b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468882880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.601028:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5975
00000100:00100000:1.0:1651532174.601121:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.601132:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468883008
00000100:00100000:0.0:1651532174.601145:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5127
00000100:00100000:0.0:1651532174.601147:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036ea9a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468883008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532174.601153:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601157:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532174.601158:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601175:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532174.601176:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.601179:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532174.601181:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601184:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.601188:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.601197:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.601203:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468883072
00000100:00100000:1.0:1651532174.601204:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.601215:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5128
00000100:00100000:0.0:1651532174.601217:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67c125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468883072:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532174.601223:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601229:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532174.601230:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.601232:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468883136
00010000:00010000:0.0:1651532174.601233:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532174.601233:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601237:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601240:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.601241:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468883264
00000100:00100000:1.0:1651532174.601243:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468883328
00000100:00100000:1.0:1651532174.601246:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5976
00000100:00100000:1.0:1651532174.601248:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029ec6cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468883136:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532174.601248:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5977
00000100:00100000:0.0:1651532174.601250:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468883264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.601252:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.601252:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.601255:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4155d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e46a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.601256:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4155da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e463 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601262:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4155d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e46a expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.601265:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4155da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e463 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.601266:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4155d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e46a expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.601269:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4155da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e463 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.601270:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:1.0:1651532174.601272:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532174.601283:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468883264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.601286:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5977
00000100:00100000:1.0:1651532174.601291:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029ec6cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468883136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.601291:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5978
00000100:00100000:0.0:1651532174.601293:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468883328:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532174.601295:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5976
00010000:00010000:0.0:1651532174.601295:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.601298:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4155e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e471 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601303:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4155e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e471 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.601335:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4155e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e471 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.601338:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532174.601347:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468883328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (142us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.601350:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5978
00000100:00100000:1.0:1651532174.601353:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.601375:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468883456
00000100:00100000:0.0:1651532174.601385:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5979
00000100:00100000:0.0:1651532174.601387:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468883456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.601390:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.601393:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4155e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e478 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601402:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4155e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e478 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.601406:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4155e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e478 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.601409:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532174.601420:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468883456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.601422:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5979
00000100:00100000:1.0:1651532174.601784:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.601802:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468883904
00000100:00100000:0.0:1651532174.601821:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5980
00000100:00100000:0.0:1651532174.601823:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468883904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.601826:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.601830:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4155ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e47f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.601836:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4155ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e47f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.601840:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4155ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e47f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.601844:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532174.601858:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468883904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.601860:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5980
00000001:00080000:0.0:1651532174.700187:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794226 is committed
00002000:00010000:1.0:1651532174.700216:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532173 -> 1651532174
00010000:00010000:1.0:1651532174.700220:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.700224:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.700245:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094660c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468879488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 428025us (428070us total) trans 158913794226 rc 0/0
00010000:00010000:0.0:1651532174.700246:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.700249:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5119
00010000:00010000:0.0:1651532174.700251:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.700252:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700255:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700261:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.700261:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.700262:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700265:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700272:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700276:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41550f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [520192->10149887] (req 520192->10149887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.700292:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.700298:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.700567:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.700577:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.700579:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468884224
00000100:00100000:0.0:1651532174.700590:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468884288
00000100:00100000:0.0:1651532174.700597:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5981
00000100:00100000:0.0:1651532174.700599:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468884224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.700602:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700602:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.700605:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4155f6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e486 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.700606:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700610:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.700619:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4155f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e486 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.700623:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4155f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e486 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532174.700624:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055a2fcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468879552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 428397us (428468us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532174.700627:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5120
00010000:00010000:0.0:1651532174.700627:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532174.700636:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5982
00000100:00100000:0.0:1651532174.700636:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468884224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.700638:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468884288:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532174.700638:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5981
00010000:00010000:1.0:1651532174.700641:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.700644:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4155fd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e48d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700645:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700648:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.700649:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.700650:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.700652:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.700653:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4155fd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e48d expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.700657:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4155fd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e48d expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.700657:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.700658:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.700659:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700662:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.700664:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532174.700665:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.700665:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.700666:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700668:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.700670:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468884288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.700673:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5982
00010000:00010000:0.0:1651532174.700680:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700683:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f415516 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20480->7929855] (req 20480->7929855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.700688:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700688:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700691:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.700692:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700706:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700709:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.700728:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001015b0af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468879936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 427710us (427807us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532174.700731:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5122
00010000:00010000:0.0:1651532174.700742:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700745:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.700746:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700749:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700754:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.700757:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f415532 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8011776->8015871] (req 8011776->8015871) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.701052:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.701063:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468884608
00000100:00100000:1.0:1651532174.701064:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.701072:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468884544
00000100:00100000:0.0:1651532174.701077:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5129
00000100:00100000:0.0:1651532174.701079:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468884608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532174.701085:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.701088:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5130
00010000:00010000:0.0:1651532174.701089:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532174.701090:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468884544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532174.701091:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532174.701091:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.701095:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.701098:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.701102:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532174.701103:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.701106:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.701109:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532174.701110:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.701115:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.701118:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.701121:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.701246:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.701256:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468884864
00000100:00100000:1.0:1651532174.701257:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.701266:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468884992
00000100:00100000:0.0:1651532174.701272:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5983
00000100:00100000:0.0:1651532174.701273:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468884864:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532174.701274:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5984
00000100:00100000:1.0:1651532174.701276:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468884992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.701277:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.701280:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.701280:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415612 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e494 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.701284:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415619 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e49b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.701287:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415612 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e494 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.701291:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415612 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e494 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.701292:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415619 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e49b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.701295:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532174.701296:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415619 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e49b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.701299:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532174.701308:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468884864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.701311:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5983
00000100:00100000:1.0:1651532174.701315:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468884992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.701318:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5984
00000100:00100000:1.0:1651532174.701570:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.701578:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468885312
00000100:00100000:1.0:1651532174.701592:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5985
00000100:00100000:1.0:1651532174.701594:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468885312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.701597:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.701601:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415620 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4a2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.701609:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415620 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4a2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.701613:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415620 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4a2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.701616:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532174.701626:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468885312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.701628:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5985
00000100:00100000:1.0:1651532174.701877:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.701884:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468885440
00000100:00100000:1.0:1651532174.701898:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5986
00000100:00100000:1.0:1651532174.701900:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468885440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.701903:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.701907:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415627 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4a9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.701914:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415627 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4a9 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.701918:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415627 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4a9 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.701922:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532174.701931:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468885440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.701934:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5986
00000001:00080000:0.0:1651532174.775481:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794227 is committed
00010000:00010000:1.0:1651532174.775512:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.775517:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.775536:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.775537:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006ef6773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468879872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 502556us (502626us total) trans 158913794227 rc 0/0
00000100:00100000:1.0:1651532174.775541:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5121
00010000:00010000:0.0:1651532174.775543:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.775544:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.775547:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.775552:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.775553:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.775553:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.775557:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.775564:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.775566:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41552b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6135808->6139903] (req 6135808->6139903) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.775585:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.775590:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.775881:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.775911:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.775924:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468885632
00000100:00100000:1.0:1651532174.775926:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.775934:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468885696
00000100:00100000:0.0:1651532174.775940:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5131
00000100:00100000:0.0:1651532174.775942:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468885632:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532174.775943:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5132
00000100:00100000:1.0:1651532174.775945:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468885696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532174.775948:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.775954:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.775955:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532174.775956:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.775959:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532174.775960:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.775965:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532174.775967:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.775970:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532174.775970:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.775974:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.775975:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.775978:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.775979:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.775989:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.775990:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468885760
00010000:00010000:1.0:1651532174.775992:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.775997:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5987
00000100:00100000:0.0:1651532174.776004:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f672076b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468885760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.776007:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532174.776010:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f21a14fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468881792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350330us (350412us total) trans 0 rc 49152/49152
00010000:00010000:0.0:1651532174.776010:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41563c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4b0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.776015:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5123
00010000:00010000:0.0:1651532174.776015:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.776017:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41563c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4b0 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.776021:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41563c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4b0 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.776027:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532174.776036:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f672076b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468885760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.776039:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5987
00010000:00010000:0.0:1651532174.776066:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.776070:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.776071:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.776074:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.776079:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.776079:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.776080:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.776083:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.776090:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.776093:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41558d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [188416->7540735] (req 188416->7540735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.776100:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.776103:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.776541:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.776548:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.776557:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.776566:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468885824
00000100:00100000:1.0:1651532174.776576:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468885952
00000100:00100000:1.0:1651532174.776578:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468886144
00000100:00100000:1.0:1651532174.776581:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5988
00000100:00100000:1.0:1651532174.776583:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468885824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.776587:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.776591:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415643 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4b7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.776599:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415643 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4b7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.776603:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415643 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4b7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.776606:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532174.776616:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468885824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.776619:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5988
00000100:00100000:0.0:1651532174.776622:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5989
00000100:00100000:1.0:1651532174.776624:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5990
00000100:00100000:0.0:1651532174.776624:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468885952:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532174.776625:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468886144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.776628:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.776628:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532174.776631:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41564a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4c5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.776632:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415651 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4be expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.776637:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41564a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4c5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.776640:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415651 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4be expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.776641:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41564a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4c5 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.776644:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:0.0:1651532174.776644:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415651 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4be expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.776648:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532174.776649:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468886144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532174.776651:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5990
00000100:00100000:0.0:1651532174.776657:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468885952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.776659:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5989
00000001:00080000:0.0:1651532174.941911:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794228 is committed
00010000:00010000:0.0:1651532174.941926:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.941932:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.941955:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b29424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468881728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516214us (516345us total) trans 158913794228 rc 0/0
00000100:00100000:0.0:1651532174.941958:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5124
00010000:00010000:0.0:1651532174.941965:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.941968:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532174.941969:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.941972:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.941977:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.941978:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532174.941978:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.941981:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.941988:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.941991:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41559b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->10006527] (req 933888->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.942006:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532174.942012:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.942330:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.942345:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.942365:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468886656
00000100:00100000:1.0:1651532174.942371:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532174.942380:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.942380:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468886784
00000100:00100000:1.0:1651532174.942390:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.942391:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5133
00000100:00100000:0.0:1651532174.942397:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468886656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532174.942404:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942408:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532174.942409:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942412:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532174.942413:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942417:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942420:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.942428:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5134
00000100:00100000:0.0:1651532174.942430:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468886784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532174.942434:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942437:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532174.942438:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942441:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532174.942441:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942445:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942448:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532174.942454:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468886720
00000100:00100000:1.0:1651532174.942459:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468886848
00000100:00100000:0.0:1651532174.942464:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468886912
00000100:00100000:0.0:1651532174.942468:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5991
00000100:00100000:0.0:1651532174.942469:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468886720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.942472:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532174.942474:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5992
00010000:00010000:0.0:1651532174.942475:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415666 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4cc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532174.942476:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468886912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532174.942480:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.942481:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415666 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4cc expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.942484:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41566d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4da expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942485:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415666 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4cc expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.942489:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532174.942493:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41566d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4da expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532174.942497:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41566d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4da expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532174.942502:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468886720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (157us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.942505:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5991
00010000:00010000:1.0:1651532174.942507:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532174.942510:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5993
00000100:00100000:0.0:1651532174.942512:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468886848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.942514:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.942517:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415674 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4d3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942523:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415674 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4d3 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.942527:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415674 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4d3 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532174.942528:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468886912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (138us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532174.942530:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532174.942531:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5992
00000100:00100000:0.0:1651532174.942535:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468886848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (155us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.942538:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5993
00000100:00100000:1.0:1651532174.942881:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532174.942892:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468887232
00000100:00100000:0.0:1651532174.942899:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5994
00000100:00100000:0.0:1651532174.942901:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468887232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532174.942904:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532174.942907:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41567b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4e1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532174.942917:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41567b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4e1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.942921:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41567b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4e1 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532174.942924:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532174.942939:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468887232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532174.942942:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5994
00000001:00080000:0.0:1651532175.008582:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794229 is committed
00010000:00010000:1.0:1651532175.008613:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.008618:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008637:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.008639:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468882368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499636us (499683us total) trans 158913794229 rc 0/0
00010000:00010000:0.0:1651532175.008641:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.008642:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.008643:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5125
00010000:00010000:0.0:1651532175.008645:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008651:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.008651:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.008652:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008655:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008662:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008665:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4155a9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1327104->5361663] (req 1327104->5361663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008671:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008673:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008862:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008866:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.008888:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468882432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499853us (499909us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532175.008892:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5126
00010000:00010000:0.0:1651532175.008926:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008930:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.008931:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008937:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008942:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.008943:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.008944:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008947:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008954:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008957:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4155b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->4886527] (req 528384->4886527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008963:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.008966:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.008967:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.008986:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468887424
00000100:00100000:1.0:1651532175.009011:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5995
00000100:00100000:1.0:1651532175.009013:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468887424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.009018:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.009022:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415682 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4e8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.009030:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415682 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4e8 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.009034:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415682 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4e8 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.009038:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532175.009046:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468887424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.009048:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5995
00000100:00100000:1.0:1651532175.009339:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.009348:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.009365:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.009373:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.009386:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468887552
00000100:00100000:1.0:1651532175.009402:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468887488
00000100:00100000:1.0:1651532175.009415:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5135
00000100:00100000:1.0:1651532175.009417:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468887552:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532175.009424:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.009429:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532175.009430:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.009434:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.009441:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5136
00000100:00100000:1.0:1651532175.009443:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468887488:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532175.009446:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468887616
00010000:00010000:1.0:1651532175.009447:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.009450:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532175.009451:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.009454:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.009457:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468887680
00000100:00100000:0.0:1651532175.009464:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5996
00010000:00010000:1.0:1651532175.009466:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00000100:00100000:0.0:1651532175.009466:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468887616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.009467:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.009469:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.009472:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.009473:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415697 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4ef expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.009475:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.009478:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.009481:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415697 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4ef expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.009485:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415697 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4ef expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532175.009488:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5997
00010000:00010000:0.0:1651532175.009489:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532175.009490:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468887680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.009492:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.009495:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41569e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4f6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.009497:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468887616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (141us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.009500:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5996
00010000:00010000:1.0:1651532175.009502:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41569e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4f6 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.009506:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41569e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4f6 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.009509:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532175.009518:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468887680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (145us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.009520:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5997
00000100:00100000:0.0:1651532175.009523:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.009526:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468887872
00000100:00100000:1.0:1651532175.009537:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5998
00000100:00100000:1.0:1651532175.009538:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468887872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.009541:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.009544:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4156a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e4fd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.009571:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4156a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4fd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.009580:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4156a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e4fd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.009584:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532175.009598:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468887872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.009601:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5998
00000001:00080000:0.0:1651532175.086908:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794230 is committed
00002000:00010000:0.0:1651532175.086923:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532173 -> 1651532174
00010000:00010000:0.0:1651532175.086926:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.086929:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.086952:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036ea9a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468883008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 485804us (485832us total) trans 158913794230 rc 0/0
00000100:00100000:0.0:1651532175.086955:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5127
00010000:00010000:0.0:1651532175.086963:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.086969:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.086970:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.086973:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.086978:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.086978:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.086979:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.086982:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.086985:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.086986:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.086986:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.086989:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.086996:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.086999:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4155c5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [536576->9592831] (req 536576->9592831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087007:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087010:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087029:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087033:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087043:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087046:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.087056:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67c125b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468883072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 485839us (485878us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532175.087059:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5128
00010000:00010000:0.0:1651532175.087065:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087068:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.087069:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087075:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087079:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087082:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4155cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7720960->7725055] (req 7720960->7725055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.087395:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.087410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.087433:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468888256
00010000:00010000:0.0:1651532175.087434:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087438:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.087448:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468888448
00000100:00100000:1.0:1651532175.087457:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5999
00000100:00100000:1.0:1651532175.087458:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468888256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.087462:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.087466:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4156ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e504 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.087471:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.087474:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4156ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e504 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.087478:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4156ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e504 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.087482:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532175.087490:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000044c16d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468884608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 386410us (386438us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532175.087493:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5129
00010000:00010000:0.0:1651532175.087501:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087505:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.087506:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087508:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.087512:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468888256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.087515:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5999
00010000:00010000:0.0:1651532175.087516:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.087517:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.087517:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.087521:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6000
00010000:00010000:0.0:1651532175.087521:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.087522:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468888448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.087525:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.087530:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087533:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415604 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [692224->9998335] (req 692224->9998335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.087535:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4156b3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e50b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.087542:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4156b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e50b expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.087546:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4156b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e50b expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532175.087549:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532175.087550:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532175.087556:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468888448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (147us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.087559:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6000
00000100:00100000:0.0:1651532175.087564:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532175.087565:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.087568:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.087588:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468888576
00000100:00100000:0.0:1651532175.087606:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468888512
00000100:00100000:0.0:1651532175.087612:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5137
00000100:00100000:0.0:1651532175.087614:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468888576:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532175.087620:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087625:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532175.087626:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087628:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532175.087629:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087634:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.087652:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.087654:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5138
00000100:00100000:1.0:1651532175.087656:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468888512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532175.087664:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.087668:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532175.087670:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.087673:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532175.087673:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.087678:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.087683:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.087969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.087982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.087988:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.087995:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468888768
00000100:00100000:0.0:1651532175.087996:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468888832
00000100:00100000:0.0:1651532175.088002:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468888896
00000100:00100000:1.0:1651532175.088004:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6001
00000100:00100000:1.0:1651532175.088006:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468888832:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532175.088007:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6002
00000100:00100000:0.0:1651532175.088008:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468888768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.088009:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.088012:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.088013:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4156c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e519 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.088016:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e512 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.088021:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4156c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e519 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.088024:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e512 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.088025:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4156c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e519 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.088028:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e512 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.088029:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532175.088031:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532175.088041:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468888832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.088041:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468888768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.088043:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6001
00000100:00100000:0.0:1651532175.088045:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6002
00000100:00100000:1.0:1651532175.088049:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6003
00000100:00100000:1.0:1651532175.088051:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468888896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.088053:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.088055:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4156d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e520 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.088061:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4156d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e520 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.088065:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4156d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e520 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.088068:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532175.088073:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468888896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.088076:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6003
00000100:00100000:0.0:1651532175.088434:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.088455:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468889152
00000100:00100000:1.0:1651532175.088464:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6004
00000100:00100000:1.0:1651532175.088466:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468889152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.088470:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.088473:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4156dd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e527 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.088481:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4156dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e527 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.088485:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4156dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e527 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.088488:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532175.088498:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468889152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.088501:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6004
00000001:00080000:0.0:1651532175.258783:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794231 is committed
00010000:00010000:1.0:1651532175.258819:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.258824:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.258843:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d27a5e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468884544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557752us (557779us total) trans 158913794231 rc 0/0
00000100:00100000:1.0:1651532175.258847:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5130
00010000:00010000:0.0:1651532175.258847:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.258852:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.258853:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.258856:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.258862:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.258862:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.258863:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.258866:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.258874:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.258877:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f41560b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [90112->8175615] (req 90112->8175615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.258891:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.258897:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.259306:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.259312:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.259326:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.259332:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468889408
00000100:00100000:1.0:1651532175.259333:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.259340:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.259348:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468889472
00000100:00100000:0.0:1651532175.259368:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5139
00000100:00100000:0.0:1651532175.259370:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000937d196b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468889408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532175.259377:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.259382:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532175.259383:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.259385:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532175.259386:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.259390:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.259394:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.259402:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5140
00000100:00100000:0.0:1651532175.259403:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468889472:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532175.259408:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.259411:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532175.259412:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.259415:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532175.259415:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.259419:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.259420:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468889536
00010000:00010000:0.0:1651532175.259422:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.259432:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468889728
00000100:00100000:1.0:1651532175.259434:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468889792
00000100:00100000:1.0:1651532175.259438:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6005
00000100:00100000:1.0:1651532175.259440:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468889536:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532175.259442:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6006
00010000:00010000:1.0:1651532175.259444:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532175.259444:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468889728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.259447:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4156f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e52e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.259447:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.259450:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4156f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e535 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.259456:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4156f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e52e expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.259457:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4156f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e535 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.259460:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4156f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e52e expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.259462:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4156f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e535 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.259463:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532175.259465:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532175.259475:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468889536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (148us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.259475:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468889728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (142us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.259477:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6005
00000100:00100000:0.0:1651532175.259479:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6006
00000100:00100000:1.0:1651532175.259482:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6007
00000100:00100000:1.0:1651532175.259483:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468889792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.259486:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.259489:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415700 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e53c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.259494:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415700 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e53c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.259498:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415700 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e53c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.259500:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532175.259506:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468889792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (166us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.259551:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6007
00000100:00100000:0.0:1651532175.259845:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.259859:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.259866:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468889920
00000100:00100000:0.0:1651532175.259866:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468890112
00000100:00100000:0.0:1651532175.259874:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6008
00000100:00100000:0.0:1651532175.259882:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468890112:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532175.259883:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6009
00000100:00100000:1.0:1651532175.259885:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468889920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.259885:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.259888:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.259889:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415707 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e54a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.259892:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41570e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e543 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.259897:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415707 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e54a expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.259900:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41570e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e543 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.259901:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415707 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e54a expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.259904:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41570e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e543 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.259904:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532175.259910:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532175.259918:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468890112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.259921:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6008
00000100:00100000:1.0:1651532175.259926:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468889920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.259928:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6009
00000001:00080000:0.0:1651532175.325498:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794232 is committed
00010000:00010000:1.0:1651532175.325528:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.325532:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.325552:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7cd268 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468885632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549609us (549672us total) trans 158913794232 rc 0/0
00010000:00010000:0.0:1651532175.325554:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.325556:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5131
00010000:00010000:0.0:1651532175.325559:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.325560:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.325563:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.325571:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.325572:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.325573:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.325576:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.325585:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.325588:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41562e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->9240575] (req 102400->9240575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.325597:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.325600:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.325929:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.325937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.325952:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468890368
00000100:00100000:1.0:1651532175.325954:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468890496
00000100:00100000:0.0:1651532175.325966:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6010
00000100:00100000:0.0:1651532175.325968:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468890368:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532175.325969:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6011
00000100:00100000:1.0:1651532175.325970:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468890496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.325972:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.325974:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.325975:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415715 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e551 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.325978:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41571c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e558 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.325981:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.325983:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.325984:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415715 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e551 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.325986:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41571c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e558 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.325988:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415715 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e551 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.325991:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532175.325993:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41571c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e558 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.325997:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532175.326005:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468890368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.326008:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6010
00000100:00100000:1.0:1651532175.326012:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468890496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.326015:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6011
00010000:00010000:0.0:1651532175.326022:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326025:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.326038:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bbdf2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468885696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 550093us (550138us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532175.326041:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5132
00010000:00010000:0.0:1651532175.326046:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326049:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.326050:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326053:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326060:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.326061:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.326062:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326065:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326072:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326074:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415635 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [606208->9052159] (req 606208->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326079:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326082:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.326543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.326554:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.326562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.326568:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.326576:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.326584:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468890688
00000100:00100000:1.0:1651532175.326596:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468890752
00000100:00100000:1.0:1651532175.326602:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5141
00000100:00100000:1.0:1651532175.326604:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468890688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532175.326611:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.326615:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532175.326616:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.326619:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532175.326620:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.326621:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5142
00000100:00100000:0.0:1651532175.326623:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468890752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532175.326627:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.326631:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326631:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.326635:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532175.326637:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.326638:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468890816
00010000:00010000:0.0:1651532175.326640:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532175.326640:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.326647:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468890944
00000100:00100000:1.0:1651532175.326649:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468891008
00000100:00100000:1.0:1651532175.326652:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6012
00010000:00010000:0.0:1651532175.326652:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.326653:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468890816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.326656:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.326656:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.326659:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415731 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e55f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.326663:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6013
00000100:00100000:0.0:1651532175.326665:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468890944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.326666:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415731 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e55f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.326668:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.326670:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415731 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e55f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.326670:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415738 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e566 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.326673:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532175.326678:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415738 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e566 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.326682:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415738 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e566 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532175.326683:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468890816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (121us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532175.326685:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532175.326686:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6012
00000100:00100000:1.0:1651532175.326691:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6014
00000100:00100000:1.0:1651532175.326692:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468891008:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532175.326694:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468890944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (126us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532175.326695:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.326697:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41573f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e56d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.326697:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6013
00010000:00010000:1.0:1651532175.326702:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41573f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e56d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.326706:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41573f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e56d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.326709:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532175.326714:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468891008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (138us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.326717:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6014
00000001:00080000:0.0:1651532175.433835:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794233 is committed
00010000:00010000:0.0:1651532175.433851:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433855:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.433879:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c0cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468886656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491484us (491549us total) trans 158913794233 rc 0/0
00000100:00100000:0.0:1651532175.433882:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5133
00010000:00010000:0.0:1651532175.433890:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433893:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.433894:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433897:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433903:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.433903:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.433904:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433907:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433910:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.433911:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.433911:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433914:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433925:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433928:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415658 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2035712->10006527] (req 2035712->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.433933:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433933:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.433936:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.433938:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.434216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.434224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532175.434262:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.434266:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.434270:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468891456
00000100:00100000:0.0:1651532175.434286:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468891584
00000100:00100000:0.0:1651532175.434291:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6015
00000100:00100000:0.0:1651532175.434293:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468891456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.434296:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532175.434299:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df95d8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468887552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424881us (424960us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532175.434300:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415746 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e574 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.434303:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5135
00010000:00010000:0.0:1651532175.434306:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.434309:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415746 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e574 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532175.434311:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6016
00000100:00100000:1.0:1651532175.434313:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468891584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.434316:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.434316:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415746 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e574 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.434319:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532175.434320:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41574d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e57b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.434325:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532175.434327:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468891456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (113us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532175.434328:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41574d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e57b expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532175.434330:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6015
00010000:00010000:1.0:1651532175.434332:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41574d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e57b expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.434335:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532175.434341:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468891584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (118us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532175.434341:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.434344:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6016
00010000:00010000:0.0:1651532175.434345:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.434371:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e7587d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468886784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491940us (491999us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532175.434372:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.434374:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5134
00010000:00010000:0.0:1651532175.434380:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434384:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.434385:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434388:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434396:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434399:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415689 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2056192->7999487] (req 2056192->7999487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434402:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434404:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.434405:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434408:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434411:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.434411:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.434412:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434415:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434425:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434428:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41565f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1404928->10002431] (req 1404928->10002431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.434436:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468891776
00000100:00100000:0.0:1651532175.434442:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6017
00010000:00010000:1.0:1651532175.434444:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.434444:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000262e29b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468891776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.434447:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.434448:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434449:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415754 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e582 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434456:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415754 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e582 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.434460:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415754 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e582 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.434463:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532175.434487:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000262e29b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468891776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (115us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.434490:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6017
00000100:00100000:1.0:1651532175.434834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.434844:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.434846:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468891904
00000100:00100000:1.0:1651532175.434851:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.434860:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.434866:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468891840
00000100:00100000:0.0:1651532175.434873:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5143
00000100:00100000:0.0:1651532175.434875:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468891904:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532175.434881:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434886:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532175.434887:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434890:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.434897:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5144
00000100:00100000:0.0:1651532175.434898:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029ec6cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468891840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532175.434919:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434924:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532175.434924:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434927:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434930:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532175.434930:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434934:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434937:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434940:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.434948:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468892032
00000100:00100000:0.0:1651532175.434953:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468892160
00000100:00100000:0.0:1651532175.434964:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6018
00000100:00100000:0.0:1651532175.434966:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468892032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.434969:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.434971:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415769 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e589 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.434976:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6019
00000100:00100000:1.0:1651532175.434978:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468892160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.434978:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415769 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e589 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.434982:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.434982:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415769 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e589 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.434986:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415770 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e590 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.434986:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532175.434998:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468892032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.435001:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6018
00010000:00010000:1.0:1651532175.435013:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415770 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e590 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.435017:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415770 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e590 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532175.435018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532175.435021:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532175.435030:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468892160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (170us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.435033:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6019
00000100:00100000:1.0:1651532175.435038:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468892352
00000100:00100000:0.0:1651532175.435057:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6020
00000100:00100000:0.0:1651532175.435059:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468892352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.435063:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.435066:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415777 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e597 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.435075:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415777 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e597 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.435079:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415777 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e597 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.435082:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532175.435092:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468892352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.435094:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6020
00000100:00100000:1.0:1651532175.435321:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.435339:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468892480
00000100:00100000:0.0:1651532175.435348:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6021
00000100:00100000:0.0:1651532175.435350:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468892480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.435353:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.435375:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41577e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e59e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.435384:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41577e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e59e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.435388:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41577e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e59e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.435391:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532175.435407:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468892480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.435410:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6021
00000100:00100000:1.0:1651532175.435458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.435470:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468892672
00000100:00100000:0.0:1651532175.435477:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6022
00000100:00100000:0.0:1651532175.435478:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468892672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.435482:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.435485:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415785 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5a5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.435491:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415785 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5a5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.435495:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415785 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5a5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.435499:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532175.435507:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468892672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.435510:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6022
00000100:00100000:1.0:1651532175.435683:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.435695:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468892800
00000100:00100000:0.0:1651532175.435703:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6023
00000100:00100000:0.0:1651532175.435704:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468892800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.435707:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.435711:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41578c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5ac expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.435718:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41578c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5ac expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.435722:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41578c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5ac expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.435725:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5e80ae9, rc 0)
00000100:00100000:0.0:1651532175.435735:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468892800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.435737:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6023
00000100:00100000:1.0:1651532175.435813:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.435824:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468892928
00000100:00100000:0.0:1651532175.435831:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6024
00000100:00100000:0.0:1651532175.435833:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468892928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.435836:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.435839:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415793 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5b3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.435846:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415793 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5b3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.435850:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415793 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5b3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.435853:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ffdbbad6, rc 0)
00000100:00100000:0.0:1651532175.435863:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468892928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.435865:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6024
00000001:00080000:0.0:1651532175.558815:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794234 is committed
00010000:00010000:1.0:1651532175.558849:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.558854:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.558878:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be387478 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468887488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549434us (549529us total) trans 158913794234 rc 0/0
00010000:00010000:0.0:1651532175.558878:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.558881:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5136
00010000:00010000:0.0:1651532175.558882:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.558884:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.558887:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.558892:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.558893:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.558894:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.558897:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.558905:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.558908:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415690 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1167360->3395583] (req 1167360->3395583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.558928:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.558934:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.559249:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.559259:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.559266:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.559278:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468893312
00000100:00100000:1.0:1651532175.559282:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468893184
00000100:00100000:0.0:1651532175.559287:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6025
00000100:00100000:0.0:1651532175.559289:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468893312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.559292:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532175.559293:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468893248
00010000:00010000:0.0:1651532175.559296:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f41579a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5ba expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.559298:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5145
00000100:00100000:1.0:1651532175.559300:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468893184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532175.559301:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.559304:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f41579a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5ba expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.559307:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.559308:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f41579a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5ba expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.559311:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ffdbbad6, rc 0)
00010000:00010000:1.0:1651532175.559312:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532175.559313:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.559319:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532175.559320:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.559322:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468893312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532175.559324:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.559324:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6025
00010000:00010000:1.0:1651532175.559328:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.559335:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5146
00000100:00100000:1.0:1651532175.559336:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468893248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532175.559341:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.559344:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.559345:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.559348:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532175.559348:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.559380:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.559384:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.559397:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.559400:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.559412:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.559416:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.559417:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.559420:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d391d28a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468888576:12345-10.240.43.64@tcp:3:fio.0 Request processed in 471805us (471870us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532175.559420:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.559423:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5137
00010000:00010000:0.0:1651532175.559426:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.559426:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.559427:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.559433:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.559443:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.559446:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4156ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9596927] (req 540672->9596927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.559454:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.559457:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.559772:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.559780:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.559787:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468893568
00000100:00100000:0.0:1651532175.559800:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468893696
00000100:00100000:0.0:1651532175.559819:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6026
00000100:00100000:0.0:1651532175.559821:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468893568:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532175.559828:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6027
00000100:00100000:1.0:1651532175.559831:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468893696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.559835:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.559838:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.559839:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4157af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5c8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.559841:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5c1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.559847:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4157af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5c8 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.559849:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5c1 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.559852:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4157af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5c8 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.559855:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532175.559856:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5c1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.559860:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5e80ae9, rc 0)
00000100:00100000:1.0:1651532175.559866:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468893696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.559868:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468893568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.559869:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6027
00000100:00100000:0.0:1651532175.559871:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6026
00000001:00080000:0.0:1651532175.658772:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794235 is committed
00002000:00010000:0.0:1651532175.658785:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532174 -> 1651532175
00002000:00010000:0.0:1651532175.658787:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532174 -> 1651532175
00010000:00010000:0.0:1651532175.658789:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.658793:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.658826:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000839f0c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468888512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 571169us (571261us total) trans 158913794235 rc 0/0
00000100:00100000:0.0:1651532175.658830:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5138
00010000:00010000:1.0:1651532175.658832:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.658837:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532175.658838:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.658841:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.658847:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.658847:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.658848:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.658851:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.658871:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.658876:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4156c1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1671168->7819263] (req 1671168->7819263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.658878:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.658882:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.659200:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.659215:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468894016
00000100:00100000:1.0:1651532175.659224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.659249:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.659250:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468893952
00000100:00100000:1.0:1651532175.659261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.659264:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5147
00000100:00100000:0.0:1651532175.659271:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468894016:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532175.659288:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.659293:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532175.659294:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.659298:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.659302:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.659305:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5148
00000100:00100000:0.0:1651532175.659313:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468893952:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532175.659317:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532175.659318:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.659321:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532175.659322:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.659324:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.659327:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00000100:00100000:1.0:1651532175.659328:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468894080
00010000:00010000:0.0:1651532175.659328:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.659334:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.659335:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468894144
00000100:00100000:1.0:1651532175.659337:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468894272
00010000:00010000:0.0:1651532175.659338:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.659339:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468894336
00010000:00010000:0.0:1651532175.659341:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.659342:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6028
00000100:00100000:1.0:1651532175.659343:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468894080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.659347:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532175.659348:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6029
00000100:00100000:0.0:1651532175.659349:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468894144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.659351:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4157cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5cf expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.659352:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.659354:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5d6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.659370:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4157cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5cf expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.659374:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5d6 expref: 23 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.659375:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4157cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5cf expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.659378:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532175.659378:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5d6 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.659382:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e1e35d6a, rc 0)
00000100:00100000:1.0:1651532175.659392:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468894080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (142us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.659395:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6028
00000100:00100000:0.0:1651532175.659397:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468894144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (136us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.659400:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6030
00000100:00100000:1.0:1651532175.659401:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468894272:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532175.659402:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6029
00010000:00010000:1.0:1651532175.659404:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.659407:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4157d9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5dd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.659408:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6031
00000100:00100000:0.0:1651532175.659410:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468894336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.659412:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.659413:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4157d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5dd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.659415:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4157e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5e4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.659417:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4157d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5dd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.659420:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532175.659422:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4157e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5e4 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532175.659426:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468894272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (134us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532175.659426:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4157e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5e4 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532175.659428:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6030
00010000:00010000:0.0:1651532175.659429:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00000100:00100000:0.0:1651532175.659435:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468894336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.659437:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6031
00000001:00080000:0.0:1651532175.767114:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794236 is committed
00010000:00010000:0.0:1651532175.767129:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767133:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.767155:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000937d196b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468889408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507784us (507849us total) trans 158913794236 rc 0/0
00000100:00100000:0.0:1651532175.767158:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5139
00010000:00010000:0.0:1651532175.767165:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767168:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.767170:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767173:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767178:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.767178:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.767179:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767182:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767189:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767192:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4156e4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->8953855] (req 552960->8953855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767197:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767200:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.767458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532175.767484:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767489:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.767505:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468889472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508100us (508192us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532175.767508:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5140
00010000:00010000:0.0:1651532175.767514:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767517:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.767518:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767521:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767525:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.767526:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.767527:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767530:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767542:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767546:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4156eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4005888->9789439] (req 4005888->9789439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.767554:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468894848
00010000:00010000:1.0:1651532175.767555:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.767560:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.767564:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6032
00000100:00100000:0.0:1651532175.767565:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468894848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.767569:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.767572:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4157e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5eb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.767579:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4157e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5eb expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.767583:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4157e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5eb expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.767586:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00000100:00100000:0.0:1651532175.767593:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468894848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.767596:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6032
00000100:00100000:0.0:1651532175.768034:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.768046:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.768052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.768060:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.768066:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468894976
00000100:00100000:1.0:1651532175.768072:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468895232
00000100:00100000:0.0:1651532175.768079:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468895040
00000100:00100000:0.0:1651532175.768087:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5149
00000100:00100000:0.0:1651532175.768089:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468894976:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532175.768092:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468895296
00000100:00100000:1.0:1651532175.768097:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6033
00010000:00010000:0.0:1651532175.768097:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.768099:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468895232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.768101:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532175.768102:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.768103:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.768105:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532175.768106:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.768107:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4157f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5f2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.768110:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.768114:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.768115:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4157f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5f2 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.768122:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4157f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5f2 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532175.768122:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5150
00000100:00100000:0.0:1651532175.768123:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468895040:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532175.768126:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532175.768128:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.768131:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532175.768132:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.768135:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532175.768135:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.768136:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468895232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.768139:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6033
00010000:00010000:0.0:1651532175.768142:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.768144:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6034
00000100:00100000:1.0:1651532175.768145:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000343d5776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468895296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.768145:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.768148:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.768150:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415803 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e5f9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.768155:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415803 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5f9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.768159:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415803 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e5f9 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.768162:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532175.768167:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000343d5776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468895296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.768169:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6034
00000001:00080000:0.0:1651532175.875452:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794237 is committed
00010000:00010000:1.0:1651532175.875483:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875487:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.875510:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b13ff56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468890688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 548905us (548967us total) trans 158913794237 rc 0/0
00000100:00100000:1.0:1651532175.875513:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5141
00010000:00010000:1.0:1651532175.875520:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875524:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532175.875525:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875528:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875533:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.875533:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.875534:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875537:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875540:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.875541:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.875542:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875561:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875575:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875579:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415723 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [65536->10166271] (req 65536->10166271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875589:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.875589:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875592:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.875594:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.875918:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.875929:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.875936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.875941:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468895616
00000100:00100000:0.0:1651532175.875942:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.875955:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468895680
00000100:00100000:1.0:1651532175.875958:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468895744
00000100:00100000:1.0:1651532175.875960:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468895808
00000100:00100000:1.0:1651532175.875963:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6035
00010000:00010000:0.0:1651532175.875963:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.875965:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468895616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.875967:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875969:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.875973:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41580a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e600 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875978:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.875981:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41580a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e600 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532175.875985:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046c2ce01 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468891904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441109us (441152us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532175.875988:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5143
00010000:00010000:1.0:1651532175.875995:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41580a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e600 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.875996:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.875999:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532175.875999:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.876001:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876003:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.876007:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468895616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (90us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532175.876009:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.876010:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6035
00010000:00010000:0.0:1651532175.876011:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41575b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1761280->9666559] (req 1761280->9666559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.876015:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6036
00000100:00100000:1.0:1651532175.876017:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468895680:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532175.876018:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6037
00010000:00010000:1.0:1651532175.876019:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532175.876020:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468895744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.876021:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415811 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e607 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876023:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.876025:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.876026:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415818 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e60e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.876027:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415811 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e607 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.876031:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415811 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e607 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.876032:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532175.876034:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00010000:00010000:0.0:1651532175.876034:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415818 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e60e expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532175.876039:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468895680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (110us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532175.876039:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415818 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e60e expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532175.876041:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6036
00010000:00010000:0.0:1651532175.876044:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00000100:00100000:1.0:1651532175.876045:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6038
00000100:00100000:1.0:1651532175.876046:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468895808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.876049:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.876051:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41581f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e615 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.876052:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468895744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (116us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532175.876054:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532175.876055:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6037
00010000:00010000:1.0:1651532175.876056:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41581f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e615 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.876059:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f41581f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e615 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.876062:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532175.876067:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468895808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (126us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.876070:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6038
00010000:00010000:1.0:1651532175.876081:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.876084:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876097:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.876100:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cfc9158 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468890752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 549476us (549546us total) trans 0 rc 24576/24576
00010000:00010000:0.0:1651532175.876101:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532175.876102:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.876103:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5142
00010000:00010000:0.0:1651532175.876105:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876110:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.876110:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532175.876111:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876114:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876121:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876123:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41572a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1380352->9945087] (req 1380352->9945087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876131:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876134:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.876559:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.876569:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.876580:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.876582:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468895872
00000100:00100000:1.0:1651532175.876586:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.876595:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.876603:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468895936
00000100:00100000:1.0:1651532175.876608:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532175.876610:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5151
00000100:00100000:0.0:1651532175.876616:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468895872:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532175.876619:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5152
00000100:00100000:1.0:1651532175.876621:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468895936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532175.876624:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876628:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532175.876629:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876629:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876632:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532175.876633:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.876637:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532175.876638:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.876641:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532175.876642:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876645:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.876646:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876649:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.876650:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532175.876657:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468896064
00000100:00100000:0.0:1651532175.876660:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468896128
00000100:00100000:1.0:1651532175.876663:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468896320
00000100:00100000:0.0:1651532175.876665:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468896448
00000100:00100000:1.0:1651532175.876666:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6039
00000100:00100000:1.0:1651532175.876667:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468896064:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532175.876668:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6040
00000100:00100000:0.0:1651532175.876670:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468896128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.876671:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.876673:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.876674:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415834 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e61c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.876675:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41583b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e623 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.876681:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415834 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e61c expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.876682:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41583b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e623 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.876685:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415834 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e61c expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.876687:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41583b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e623 expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.876688:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532175.876690:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000413f87ac, rc 0)
00000100:00100000:1.0:1651532175.876701:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468896064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (121us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.876704:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6039
00000100:00100000:0.0:1651532175.876707:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468896128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.876709:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6041
00000100:00100000:1.0:1651532175.876710:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468896320:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532175.876710:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6040
00010000:00010000:1.0:1651532175.876712:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.876715:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415842 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e62a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.876715:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6042
00000100:00100000:0.0:1651532175.876717:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468896448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.876720:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415842 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e62a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.876720:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.876722:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415849 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e631 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.876724:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415842 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e62a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.876728:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415849 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e631 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.876730:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532175.876732:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415849 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e631 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.876735:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9816573, rc 0)
00000100:00100000:1.0:1651532175.876736:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468896320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (141us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.876738:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6041
00000100:00100000:0.0:1651532175.876741:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468896448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (133us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.876744:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6042
00000100:00100000:1.0:1651532175.877083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.877090:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.877097:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.877108:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468896576
00000100:00100000:0.0:1651532175.877108:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468896640
00000100:00100000:0.0:1651532175.877115:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468896832
00000100:00100000:1.0:1651532175.877116:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6043
00000100:00100000:1.0:1651532175.877118:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468896576:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532175.877119:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6044
00000100:00100000:0.0:1651532175.877120:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468896640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.877121:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532175.877124:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.877125:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415850 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e638 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532175.877127:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415857 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e63f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.877132:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415850 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e638 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.877134:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415857 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e63f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.877136:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415850 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e638 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.877138:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415857 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e63f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.877140:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532175.877142:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00000100:00100000:1.0:1651532175.877152:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468896576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.877155:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6043
00000100:00100000:0.0:1651532175.877158:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468896640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.877160:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6045
00000100:00100000:1.0:1651532175.877162:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468896832:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532175.877162:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6044
00010000:00010000:1.0:1651532175.877164:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.877167:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41585e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e646 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.877172:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41585e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e646 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.877176:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41585e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e646 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.877179:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532175.877185:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468896832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.877187:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6045
00000100:00100000:1.0:1651532175.877593:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.877602:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532175.877608:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468897024
00000100:00100000:1.0:1651532175.877615:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468897152
00000100:00100000:1.0:1651532175.877626:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6046
00000100:00100000:1.0:1651532175.877627:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468897024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532175.877631:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.877634:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415865 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e64d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532175.877635:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6047
00000100:00100000:0.0:1651532175.877637:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468897152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532175.877641:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532175.877642:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415865 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e64d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.877645:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41586c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e654 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532175.877649:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415865 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e64d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532175.877652:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532175.877652:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41586c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e654 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.877656:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41586c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e654 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532175.877659:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002ac5e3f4, rc 0)
00000100:00100000:1.0:1651532175.877664:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468897024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532175.877667:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6046
00000100:00100000:0.0:1651532175.877674:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468897152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532175.877677:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6047
00000001:00080000:0.0:1651532176.000494:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794238 is committed
00010000:00010000:0.0:1651532176.000510:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.000514:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.000536:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029ec6cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468891840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565636us (565691us total) trans 158913794238 rc 0/0
00010000:00010000:1.0:1651532176.000539:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.000539:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5144
00010000:00010000:1.0:1651532176.000544:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532176.000545:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.000548:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.000554:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.000555:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.000556:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.000559:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.000567:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.000573:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415762 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [573440->9916415] (req 573440->9916415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.000574:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.000578:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.000900:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.000907:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.000914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.000922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.000932:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468897472
00000100:00100000:1.0:1651532176.000935:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468897600
00000100:00100000:0.0:1651532176.000945:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468897536
00000100:00100000:1.0:1651532176.000951:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468897664
00000100:00100000:0.0:1651532176.000951:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5153
00000100:00100000:0.0:1651532176.000953:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468897472:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532176.000956:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6048
00000100:00100000:1.0:1651532176.000958:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468897600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.000960:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.000963:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.000965:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532176.000966:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.000968:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41587a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e65b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.000968:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532176.000969:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.000979:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41587a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e65b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.000984:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41587a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e65b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.000987:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532176.000989:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.000993:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.001003:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468897600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.001006:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6048
00000100:00100000:0.0:1651532176.001010:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5154
00000100:00100000:1.0:1651532176.001012:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6049
00000100:00100000:0.0:1651532176.001012:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468897536:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532176.001013:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468897664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.001016:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.001018:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.001019:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415888 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e662 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.001022:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532176.001023:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.001026:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532176.001026:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.001031:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415888 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e662 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.001031:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.001034:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.001035:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415888 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e662 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.001038:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532176.001044:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468897664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.001046:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6049
00000100:00100000:0.0:1651532176.001050:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.001063:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468897792
00000100:00100000:1.0:1651532176.001073:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6050
00000100:00100000:1.0:1651532176.001074:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468897792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.001077:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.001090:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41588f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e669 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.001100:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41588f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e669 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.001104:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41588f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e669 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.001107:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532176.001121:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468897792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.001124:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6050
00000100:00100000:0.0:1651532176.001285:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.001304:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468897920
00000100:00100000:1.0:1651532176.001312:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6051
00000100:00100000:1.0:1651532176.001313:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468897920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.001316:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.001320:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415896 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e670 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.001327:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415896 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e670 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.001331:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415896 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e670 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.001334:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532176.001348:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468897920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.001351:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6051
00000100:00100000:0.0:1651532176.060861:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1651532176.060868:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0d4cada pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966863872:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532176.061130:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0d4cada pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966863872:10.240.43.61@tcp:400:kworker/u4:0.0
00000001:00080000:0.0:1651532176.067175:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794239 is committed
00010000:00010000:0.0:1651532176.067197:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067201:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.067217:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468893184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507916us (507968us total) trans 158913794239 rc 0/0
00000100:00100000:0.0:1651532176.067220:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5145
00010000:00010000:0.0:1651532176.067227:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067230:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532176.067231:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067234:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067239:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.067239:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.067240:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067243:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067246:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.067247:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.067248:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067251:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067264:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067267:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f4157a1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4612096->9531391] (req 4612096->9531391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067273:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067276:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067276:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067280:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.067624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.067643:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.067655:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468898368
00010000:00010000:0.0:1651532176.067659:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067663:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.067667:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468898432
00000100:00100000:1.0:1651532176.067675:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6052
00000100:00100000:1.0:1651532176.067676:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468898368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.067680:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.067684:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41589d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e677 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.067690:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468894016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408418us (408491us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532176.067693:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5147
00010000:00010000:1.0:1651532176.067695:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.067698:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41589d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e677 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.067700:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067702:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41589d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e677 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.067704:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5e80ae9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532176.067705:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532176.067705:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067708:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067713:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.067714:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468898368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (91us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532176.067716:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4157bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4435968->9285631] (req 4435968->9285631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.067717:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6052
00000100:00100000:1.0:1651532176.067721:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6053
00000100:00100000:1.0:1651532176.067723:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468898432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.067725:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.067727:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4158a4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e67e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067732:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.067733:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4158a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e67e expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.067740:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4158a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e67e expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.067743:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532176.067747:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468898432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.067750:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6053
00010000:00010000:1.0:1651532176.067760:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067764:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.067774:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468893248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508438us (508515us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532176.067777:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5146
00010000:00010000:1.0:1651532176.067783:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067786:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532176.067787:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067790:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067797:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.067798:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.067799:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067821:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067830:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.067834:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f4157a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1388544->10035199] (req 1388544->10035199) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067835:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.067839:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.068201:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.068219:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.068230:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468898496
00000100:00100000:1.0:1651532176.068232:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.068241:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468898624
00000100:00100000:1.0:1651532176.068247:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.068269:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5155
00000100:00100000:0.0:1651532176.068270:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468898496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532176.068278:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.068280:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532176.068282:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532176.068284:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.068286:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532176.068287:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.068297:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.068301:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.068305:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5156
00000100:00100000:1.0:1651532176.068308:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468898624:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532176.068309:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468898688
00000100:00100000:0.0:1651532176.068315:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468898752
00010000:00010000:1.0:1651532176.068316:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.068318:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468898880
00010000:00010000:1.0:1651532176.068321:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532176.068321:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6054
00010000:00010000:1.0:1651532176.068322:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.068322:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468898688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.068325:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.068328:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532176.068328:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.068328:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4158b9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e685 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.068333:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.068335:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4158b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e685 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.068336:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.068340:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4158b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e685 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.068344:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000413f87ac, rc 0)
00000100:00100000:1.0:1651532176.068345:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6055
00000100:00100000:1.0:1651532176.068346:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468898752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.068349:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.068351:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4158c0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e68c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.068355:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468898688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (123us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532176.068368:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4158c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e68c expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532176.068369:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6054
00010000:00010000:1.0:1651532176.068373:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4158c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e68c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532176.068375:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6056
00010000:00010000:1.0:1651532176.068376:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532176.068376:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468898880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.068379:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.068382:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4158c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e693 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.068385:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468898752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.068387:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6055
00010000:00010000:0.0:1651532176.068389:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4158c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e693 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.068393:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4158c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e693 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.068396:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00000100:00100000:0.0:1651532176.068403:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468898880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.068405:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6056
00000100:00100000:1.0:1651532176.068716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.068729:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468899008
00000100:00100000:0.0:1651532176.068740:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6057
00000100:00100000:0.0:1651532176.068742:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468899008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.068745:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.068749:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e69a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.068755:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532176.068759:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e69a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.068762:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e69a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532176.068765:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468899136
00010000:00010000:0.0:1651532176.068766:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036ef374e, rc 0)
00000100:00100000:1.0:1651532176.068773:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6058
00000100:00100000:1.0:1651532176.068775:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468899136:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532176.068776:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468899008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (61us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532176.068778:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532176.068778:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6057
00010000:00010000:1.0:1651532176.068782:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4158d5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6a1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.068789:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4158d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6a1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.068793:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4158d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6a1 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.068797:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532176.068833:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468899136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.068836:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6058
00000100:00100000:0.0:1651532176.069091:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.069111:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468899328
00000100:00100000:1.0:1651532176.069119:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6059
00000100:00100000:1.0:1651532176.069121:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468899328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.069124:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.069128:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158dc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6a8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.069135:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158dc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6a8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.069139:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158dc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6a8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.069143:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532176.069152:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468899328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.069155:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6059
00000001:00080000:0.0:1651532176.242117:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794240 is committed
00010000:00010000:0.0:1651532176.242133:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242137:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.242154:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468893952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582846us (582931us total) trans 158913794240 rc 0/0
00000100:00100000:0.0:1651532176.242157:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5148
00010000:00010000:0.0:1651532176.242164:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242167:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532176.242168:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242172:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242177:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.242178:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.242178:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242181:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242188:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242191:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4157c4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [581632->9973759] (req 581632->9973759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242196:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242199:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.242532:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.242541:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.242552:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.242561:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468899584
00000100:00100000:0.0:1651532176.242562:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468899520
00000100:00100000:0.0:1651532176.242592:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5157
00000100:00100000:0.0:1651532176.242594:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468899520:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532176.242596:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5158
00000100:00100000:1.0:1651532176.242599:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468899584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532176.242615:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242619:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.242620:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532176.242621:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532176.242622:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242627:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532176.242628:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242631:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242634:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532176.242634:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.242637:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242639:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.242642:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.242645:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468899648
00010000:00010000:0.0:1651532176.242645:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.242652:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6060
00000100:00100000:1.0:1651532176.242653:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468899648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.242656:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.242659:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4158f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6af expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.242665:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4158f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6af expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.242669:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4158f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6af expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.242673:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532176.242692:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468899648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.242695:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6060
00000100:00100000:0.0:1651532176.242730:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.242746:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468899712
00000100:00100000:1.0:1651532176.242757:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6061
00000100:00100000:1.0:1651532176.242759:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468899712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.242762:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.242765:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4158f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6b6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.242772:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4158f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6b6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.242776:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4158f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6b6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.242779:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532176.242791:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468899712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.242794:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6061
00000001:00080000:0.0:1651532176.367107:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794241 is committed
00010000:00010000:0.0:1651532176.367122:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.367129:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.367152:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8b70a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468894976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599062us (599138us total) trans 158913794241 rc 0/0
00010000:00010000:1.0:1651532176.367155:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.367156:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5149
00010000:00010000:1.0:1651532176.367160:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532176.367161:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.367164:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.367170:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.367171:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.367171:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.367174:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.367185:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.367188:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4157ee lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [540672->9215999] (req 540672->9215999) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.367193:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.367198:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.367493:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.367505:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.367512:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468900032
00000100:00100000:1.0:1651532176.367520:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468900224
00010000:00010000:0.0:1651532176.367520:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.367524:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.367529:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6062
00000100:00100000:1.0:1651532176.367531:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468900032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.367535:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.367538:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4158ff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6bd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.367544:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532176.367544:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000baae7a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468895040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 599420us (599498us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532176.367546:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4158ff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6bd expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532176.367548:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5150
00010000:00010000:1.0:1651532176.367550:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4158ff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6bd expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.367553:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532176.367554:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.367557:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532176.367559:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.367562:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468900032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (70us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532176.367562:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.367565:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6062
00010000:00010000:0.0:1651532176.367567:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.367567:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.367568:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.367569:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6063
00000100:00100000:1.0:1651532176.367570:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468900224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.367571:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.367573:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.367575:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415906 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6c4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.367578:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.367580:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415906 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6c4 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.367581:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4157fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5079040->10432511] (req 5079040->10432511) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.367584:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415906 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6c4 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.367586:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.367588:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532176.367589:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.367592:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468900224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.367594:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6063
00000100:00100000:0.0:1651532176.368100:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.368111:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.368117:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.368127:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.368128:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468900608
00000100:00100000:0.0:1651532176.368137:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468900416
00000100:00100000:1.0:1651532176.368141:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468900736
00000100:00100000:1.0:1651532176.368146:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6064
00000100:00100000:1.0:1651532176.368147:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468900608:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532176.368147:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468900288
00010000:00010000:1.0:1651532176.368151:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532176.368153:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5159
00010000:00010000:1.0:1651532176.368154:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41590d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6cb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.368155:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468900416:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532176.368161:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41590d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6cb expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.368162:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.368165:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41590d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6cb expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.368167:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532176.368168:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532176.368169:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532176.368169:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.368172:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.368178:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5160
00000100:00100000:1.0:1651532176.368183:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468900608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.368186:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6064
00000100:00100000:0.0:1651532176.368187:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468900288:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532176.368191:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6065
00010000:00010000:0.0:1651532176.368191:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.368193:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468900736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.368195:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532176.368196:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.368196:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.368198:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.368199:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415922 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6d2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.368201:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532176.368201:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.368206:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415922 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6d2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.368206:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.368209:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.368210:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415922 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6d2 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.368213:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532176.368213:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.368218:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468900736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.368221:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6065
00000001:00080000:0.0:1651532176.458777:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794242 is committed
00010000:00010000:0.0:1651532176.458791:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.458795:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.458827:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468895872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582214us (582268us total) trans 158913794242 rc 0/0
00010000:00010000:1.0:1651532176.458829:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.458830:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5151
00010000:00010000:1.0:1651532176.458834:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532176.458835:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.458838:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.458844:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.458844:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.458845:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.458851:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.458858:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.458863:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.458867:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.458872:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415826 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2113536->6098943] (req 2113536->6098943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.459040:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.459048:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459067:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.459068:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468895936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 582446us (582498us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532176.459071:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532176.459071:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5152
00010000:00010000:1.0:1651532176.459072:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459076:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459080:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.459081:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.459082:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459085:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.459102:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459103:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.459106:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459109:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41582d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [622592->9977855] (req 622592->9977855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.459376:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.459388:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.459394:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.459404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.459406:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468901248
00000100:00100000:0.0:1651532176.459414:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468901120
00000100:00100000:1.0:1651532176.459419:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468901312
00000100:00100000:1.0:1651532176.459424:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6066
00000100:00100000:0.0:1651532176.459424:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468901184
00000100:00100000:1.0:1651532176.459426:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468901248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.459429:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532176.459430:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5161
00000100:00100000:0.0:1651532176.459432:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468901120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532176.459433:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415929 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6d9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.459439:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.459443:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532176.459444:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.459450:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532176.459451:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459458:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415929 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6d9 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.459483:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415929 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6d9 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.459485:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459488:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532176.459489:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.459497:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5162
00000100:00100000:0.0:1651532176.459498:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000262e29b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468901184:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532176.459502:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468901248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 75us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.459504:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6066
00000100:00100000:1.0:1651532176.459510:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6067
00010000:00010000:0.0:1651532176.459510:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.459512:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468901312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.459514:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.459514:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532176.459515:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459517:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41593e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6e0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.459518:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532176.459518:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.459522:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459524:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41593e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6e0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.459525:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459528:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41593e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6e0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.459531:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532176.459536:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468901312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (132us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.459538:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6067
00000100:00100000:0.0:1651532176.459542:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.459556:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468901376
00000100:00100000:1.0:1651532176.459561:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6068
00000100:00100000:1.0:1651532176.459562:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468901376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.459565:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.459568:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415945 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6e7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.459587:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415945 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6e7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.459591:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415945 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6e7 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.459594:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532176.459608:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468901376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.459612:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6068
00000001:00080000:0.0:1651532176.583631:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794243 is committed
00010000:00010000:0.0:1651532176.583646:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.583650:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.583666:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb53a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468897472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582712us (582767us total) trans 158913794243 rc 0/0
00000100:00100000:0.0:1651532176.583669:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5153
00010000:00010000:0.0:1651532176.583676:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.583679:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532176.583680:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.583683:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.583688:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.583689:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.583689:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.583692:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.583699:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.583703:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415873 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3903488->9953279] (req 3903488->9953279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.583707:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.583710:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.583985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532176.584008:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.584010:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468901696
00010000:00010000:0.0:1651532176.584012:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.584027:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6069
00000100:00100000:1.0:1651532176.584029:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468901696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532176.584031:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079fa5511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468897536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 583017us (583123us total) trans 0 rc 53248/53248
00010000:00010000:1.0:1651532176.584032:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532176.584034:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5154
00010000:00010000:1.0:1651532176.584036:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41594c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6ee expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.584041:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.584044:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41594c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6ee expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584048:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41594c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6ee expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584053:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532176.584082:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468901696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.584085:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6069
00010000:00010000:0.0:1651532176.584085:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584089:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a925ecb already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532176.584090:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584094:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584099:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.584099:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532176.584100:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584103:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584110:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584113:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415881 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [24576->10366975] (req 24576->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584119:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584122:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.584150:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.584170:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468901824
00000100:00100000:1.0:1651532176.584189:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6070
00000100:00100000:1.0:1651532176.584193:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468901824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.584196:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.584200:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415953 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6f5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.584210:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415953 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6f5 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584214:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415953 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6f5 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584217:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532176.584231:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468901824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.584233:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6070
00000100:00100000:0.0:1651532176.584393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.584401:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.584407:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.584416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.584420:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468902016
00000100:00100000:1.0:1651532176.584431:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468902080
00000100:00100000:1.0:1651532176.584438:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6071
00000100:00100000:1.0:1651532176.584440:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468902016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.584443:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.584447:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41595a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e6fc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.584454:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41595a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6fc expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584459:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41595a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e6fc expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584465:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532176.584483:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468902016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.584486:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6071
00000100:00100000:1.0:1651532176.584491:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6072
00000100:00100000:1.0:1651532176.584493:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468902080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.584495:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.584499:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415961 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e703 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.584506:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415961 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e703 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532176.584509:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468901888
00010000:00010000:1.0:1651532176.584510:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415961 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e703 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584513:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532176.584519:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468902080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.584520:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468901952
00000100:00100000:1.0:1651532176.584521:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6072
00000100:00100000:0.0:1651532176.584526:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5163
00000100:00100000:0.0:1651532176.584528:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468901888:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532176.584535:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5164
00010000:00010000:0.0:1651532176.584535:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.584537:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468901952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532176.584539:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532176.584540:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.584543:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584543:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532176.584544:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.584548:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532176.584549:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.584554:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532176.584555:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584561:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.584563:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584577:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.584581:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.584606:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.584636:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.584656:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468902208
00000100:00100000:0.0:1651532176.584660:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468902400
00000100:00100000:0.0:1651532176.584670:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6073
00000100:00100000:0.0:1651532176.584672:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ebfb7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468902400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.584675:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.584679:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415976 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e711 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.584680:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6074
00000100:00100000:1.0:1651532176.584682:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468902208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.584685:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.584687:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415976 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e711 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584688:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41597d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e70a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.584692:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415976 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e711 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584695:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41597d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e70a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.584695:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001aae7bfe, rc 0)
00010000:00010000:1.0:1651532176.584699:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f41597d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e70a expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584703:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532176.584706:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ebfb7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468902400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.584709:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6073
00000100:00100000:1.0:1651532176.584711:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468902208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (105us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.584715:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6074
00000100:00100000:0.0:1651532176.584888:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.584900:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468902528
00000100:00100000:1.0:1651532176.584909:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6075
00000100:00100000:1.0:1651532176.584910:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000923e9c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468902528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.584914:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.584917:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415984 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e718 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.584924:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415984 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e718 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584928:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415984 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e718 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.584932:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532176.584945:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000923e9c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468902528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.584948:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6075
00000100:00100000:0.0:1651532176.585003:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.585015:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468902720
00000100:00100000:1.0:1651532176.585023:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6076
00000100:00100000:1.0:1651532176.585025:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068d4eb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468902720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.585028:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.585031:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41598b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e71f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.585038:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41598b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e71f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.585042:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41598b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e71f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.585045:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532176.585059:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068d4eb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468902720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.585061:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6076
00000100:00100000:0.0:1651532176.585165:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.585179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.585190:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468902848
00000100:00100000:1.0:1651532176.585198:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468902976
00000100:00100000:1.0:1651532176.585205:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6077
00000100:00100000:1.0:1651532176.585207:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058137681 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468902848:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532176.585209:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6078
00010000:00010000:1.0:1651532176.585210:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532176.585211:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d34441ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468902976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.585213:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415992 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e726 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.585215:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.585219:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f415999 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e72d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.585221:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415992 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e726 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.585226:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415992 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e726 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.585227:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f415999 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e72d expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.585229:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532176.585231:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f415999 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e72d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.585237:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b80df6d8, rc 0)
00000100:00100000:1.0:1651532176.585242:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058137681 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468902848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.585244:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6077
00000100:00100000:0.0:1651532176.585252:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d34441ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468902976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.585255:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6078
00000100:00100000:0.0:1651532176.585302:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.585309:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468903104
00000100:00100000:0.0:1651532176.585320:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6079
00000100:00100000:0.0:1651532176.585322:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087214ada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468903104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.585325:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.585328:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4159a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e734 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.585336:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4159a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e734 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.585340:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4159a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e734 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.585343:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b7f071c, rc 0)
00000100:00100000:0.0:1651532176.585352:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087214ada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468903104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.585355:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6079
00000100:00100000:0.0:1651532176.608134:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532176.608143:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233664
00000100:00100000:0.0:1651532176.608157:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 71
00000100:00100000:0.0:1651532176.608159:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fca33779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233664:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532176.608164:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 573440 granted 353387072 pending 143360 free 81138851840 avail 76966592512
00000100:00100000:0.0:1651532176.608176:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fca33779 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233664:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 17us (43us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532176.608179:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 71
00000001:00080000:0.0:1651532176.692117:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794244 is committed
00010000:00010000:0.0:1651532176.692132:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.692136:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.692158:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000388742f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468898496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 623887us (623957us total) trans 158913794244 rc 0/0
00010000:00010000:1.0:1651532176.692159:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.692161:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5155
00010000:00010000:1.0:1651532176.692164:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532176.692165:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692168:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692174:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.692174:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.692175:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692178:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692182:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.692182:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.692183:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692185:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692206:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692209:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4158ab lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [548864->7331839] (req 548864->7331839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692216:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692219:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692249:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692253:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.692477:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.692495:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.692510:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468903488
00010000:00010000:1.0:1651532176.692515:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.692519:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468903552
00000100:00100000:0.0:1651532176.692525:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6080
00000100:00100000:0.0:1651532176.692527:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e4ba846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468903488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.692528:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.692531:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.692541:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4159a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e73b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.692549:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a12bce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468898624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 624241us (624330us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532176.692551:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532176.692553:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5156
00010000:00010000:0.0:1651532176.692554:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4159a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e73b expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.692559:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4159a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e73b expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.692562:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b7f071c, rc 0)
00010000:00010000:1.0:1651532176.692563:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692567:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.692571:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e4ba846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468903488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.692574:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6080
00000100:00100000:1.0:1651532176.692583:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d14e8621 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468899584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449984us (450052us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532176.692585:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6081
00000100:00100000:1.0:1651532176.692586:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5158
00000100:00100000:0.0:1651532176.692587:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c387898 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468903552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.692589:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.692592:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4159ae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e742 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.692596:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.692598:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.692599:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4159ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e742 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.692602:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532176.692602:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4159ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e742 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.692603:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.692605:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b80df6d8, rc 0)
00010000:00010000:1.0:1651532176.692606:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692611:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.692611:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c387898 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468903552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (117us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532176.692614:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4158b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [483328->9261055] (req 483328->9261055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.692614:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6081
00010000:00010000:1.0:1651532176.692617:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692620:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532176.692621:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692623:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692627:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.692627:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.692628:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692631:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692634:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.692635:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.692635:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692638:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692647:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692650:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4158e3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1720320->10399743] (req 1720320->10399743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692658:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692661:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.692677:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.692682:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.692847:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.692851:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692866:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692871:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532176.692872:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692875:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692881:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.692884:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415914 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2564096->2650111] (req 2564096->2650111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.692884:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000103797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754468900416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 324727us (324806us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532176.692887:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5159
00000100:00100000:0.0:1651532176.693111:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.693118:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.693129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.693135:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.693143:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.693162:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.693164:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468903680
00000100:00100000:0.0:1651532176.693173:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.693183:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468903616
00000100:00100000:1.0:1651532176.693189:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468904128
00000100:00100000:1.0:1651532176.693196:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5165
00000100:00100000:1.0:1651532176.693203:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ebfb7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468903680:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532176.693204:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5166
00000100:00100000:0.0:1651532176.693206:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e4ba846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468904128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532176.693210:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.693213:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.693215:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532176.693216:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532176.693216:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.693221:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532176.693222:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532176.693223:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.693226:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.693226:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.693233:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5167
00000100:00100000:0.0:1651532176.693234:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000923e9c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468903616:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532176.693239:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468903744
00010000:00010000:0.0:1651532176.693239:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.693242:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532176.693243:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468903808
00010000:00010000:0.0:1651532176.693243:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.693246:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468903936
00010000:00010000:0.0:1651532176.693246:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.693248:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468904000
00010000:00010000:0.0:1651532176.693248:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.693250:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6082
00010000:00010000:0.0:1651532176.693251:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532176.693251:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.693252:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068d4eb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468903744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.693254:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.693255:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.693257:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4159ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e749 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.693258:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.693261:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.693264:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4159ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e749 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.693264:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.693268:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4159ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e749 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.693271:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532176.693271:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6083
00000100:00100000:0.0:1651532176.693272:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058137681 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468903808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.693275:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.693277:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4159d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e750 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.693285:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068d4eb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468903744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (156us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.693288:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6082
00010000:00010000:0.0:1651532176.693290:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4159d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e750 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532176.693293:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6084
00010000:00010000:0.0:1651532176.693294:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4159d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e750 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532176.693295:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d34441ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468903936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.693297:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.693298:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002ac5e3f4, rc 0)
00010000:00010000:1.0:1651532176.693300:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4159d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e757 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.693307:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058137681 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468903808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (172us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532176.693308:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4159d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e757 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532176.693309:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6083
00010000:00010000:1.0:1651532176.693312:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f4159d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e757 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.693315:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532176.693315:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6085
00000100:00100000:0.0:1651532176.693316:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087214ada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468904000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.693319:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532176.693321:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d34441ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468903936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (178us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532176.693321:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4159df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e75e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.693323:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6084
00010000:00010000:0.0:1651532176.693327:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4159df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e75e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.693331:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4159df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e75e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.693334:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000601104c8, rc 0)
00000100:00100000:0.0:1651532176.693339:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087214ada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468904000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (177us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.693341:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6085
00000100:00100000:0.0:1651532176.693687:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.693694:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.693707:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468904256
00000100:00100000:0.0:1651532176.693716:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468904448
00000100:00100000:0.0:1651532176.693723:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6086
00000100:00100000:0.0:1651532176.693725:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3487fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468904256:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532176.693726:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6087
00000100:00100000:1.0:1651532176.693728:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd4c4f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468904448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.693728:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.693731:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4159e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e765 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.693732:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.693736:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4159ed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e76c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.693738:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4159e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e765 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.693743:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4159e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e765 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.693744:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4159ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e76c expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.693746:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e1e35d6a, rc 0)
00010000:00010000:1.0:1651532176.693748:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f4159ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e76c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.693751:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:0.0:1651532176.693756:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3487fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468904256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.693759:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd4c4f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468904448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.693759:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6086
00000100:00100000:1.0:1651532176.693762:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6087
00000100:00100000:0.0:1651532176.694030:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.694045:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.694056:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468904640
00000100:00100000:1.0:1651532176.694064:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468904704
00000100:00100000:1.0:1651532176.694072:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6088
00000100:00100000:1.0:1651532176.694073:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468904640:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532176.694075:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6089
00010000:00010000:1.0:1651532176.694077:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532176.694077:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468904704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.694080:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4159f4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e773 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.694081:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.694085:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4159fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e77a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.694087:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4159f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e773 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.694092:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f4159f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e773 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.694092:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4159fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e77a expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.694095:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532176.694096:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4159fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e77a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.694099:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532176.694108:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468904640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.694111:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6088
00000100:00100000:0.0:1651532176.694114:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468904704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.694118:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6089
00000100:00100000:0.0:1651532176.694339:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.694345:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468904960
00000100:00100000:0.0:1651532176.694366:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6090
00000100:00100000:0.0:1651532176.694368:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e7181f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468904960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.694372:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.694375:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a02 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e781 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.694382:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a02 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e781 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.694386:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a02 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e781 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.694389:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532176.694399:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e7181f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468904960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.694402:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6090
00000100:00100000:0.0:1651532176.694604:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.694611:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468905088
00000100:00100000:0.0:1651532176.694625:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6091
00000100:00100000:0.0:1651532176.694626:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a43237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468905088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.694630:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.694633:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a09 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e788 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.694640:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a09 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e788 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.694644:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a09 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e788 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.694647:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532176.694657:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a43237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468905088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.694659:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6091
00000001:00080000:0.0:1651532176.817102:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794245 is committed
00010000:00010000:1.0:1651532176.817131:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817135:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532176.817157:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b571d6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468899520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574562us (574615us total) trans 158913794245 rc 0/0
00000100:00100000:1.0:1651532176.817160:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5157
00010000:00010000:1.0:1651532176.817168:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817171:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532176.817172:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817175:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817180:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.817181:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.817182:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817185:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.817201:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817205:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.817206:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817209:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4158ea lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3485696->9383935] (req 3485696->9383935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.817560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.817571:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.817579:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468905280
00000100:00100000:0.0:1651532176.817580:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.817587:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.817595:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468905216
00000100:00100000:0.0:1651532176.817596:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.817605:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468905344
00000100:00100000:1.0:1651532176.817608:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5168
00000100:00100000:1.0:1651532176.817609:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468905280:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532176.817614:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468905408
00000100:00100000:0.0:1651532176.817617:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468905472
00000100:00100000:0.0:1651532176.817620:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6092
00010000:00010000:1.0:1651532176.817621:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.817622:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468905344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.817626:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532176.817626:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.817627:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817630:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532176.817630:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a17 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e78f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817631:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817637:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.817638:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a17 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e78f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.817640:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.817642:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a17 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e78f expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.817645:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532176.817648:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5169
00000100:00100000:1.0:1651532176.817649:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468905216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532176.817654:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.817655:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468905344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (75us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532176.817657:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532176.817658:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.817658:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6092
00010000:00010000:1.0:1651532176.817661:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532176.817661:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.817663:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6093
00000100:00100000:0.0:1651532176.817664:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468905408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532176.817666:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532176.817667:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.817668:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a25 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e796 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.817670:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.817674:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a25 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e796 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.817678:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a25 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e796 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532176.817679:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6094
00000100:00100000:1.0:1651532176.817681:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468905472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.817683:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.817684:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532176.817685:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415a2c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e79d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.817689:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468905408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (102us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532176.817692:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415a2c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e79d expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532176.817692:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6093
00010000:00010000:1.0:1651532176.817696:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415a2c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e79d expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.817699:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532176.817708:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468905472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (112us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.817710:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6094
00000100:00100000:0.0:1651532176.817979:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532176.817993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532176.818005:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468905600
00000100:00100000:1.0:1651532176.818013:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468905728
00000100:00100000:1.0:1651532176.818021:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6095
00000100:00100000:1.0:1651532176.818023:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468905600:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532176.818024:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6096
00010000:00010000:1.0:1651532176.818026:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532176.818027:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468905728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532176.818030:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a33 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7a4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.818030:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532176.818034:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a3a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7ab expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.818037:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a33 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7a4 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.818041:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a33 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7a4 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.818041:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a3a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7ab expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532176.818045:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532176.818045:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a3a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7ab expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532176.818049:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532176.818058:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468905600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532176.818060:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6095
00000100:00100000:0.0:1651532176.818064:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468905728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532176.818066:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6096
00000001:00080000:0.0:1651532176.917129:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794246 is committed
00002000:00010000:0.0:1651532176.917142:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532175 -> 1651532176
00002000:00010000:0.0:1651532176.917144:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532175 -> 1651532176
00010000:00010000:0.0:1651532176.917147:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.917151:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.917172:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096218143 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468900288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 548991us (549061us total) trans 158913794246 rc 0/0
00010000:00010000:1.0:1651532176.917174:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532176.917176:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5160
00010000:00010000:1.0:1651532176.917178:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532176.917180:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.917183:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.917188:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.917189:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532176.917190:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.917196:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.917205:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.917213:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532176.917217:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532176.917220:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41591b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [278528->7065599] (req 278528->7065599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532177.017165:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794247 is committed
00010000:00010000:0.0:1651532177.017179:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017183:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.017205:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d3d464a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468901120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557772us (557859us total) trans 158913794247 rc 0/0
00010000:00010000:1.0:1651532177.017207:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.017208:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5161
00010000:00010000:1.0:1651532177.017211:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532177.017212:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017216:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017221:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.017222:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.017223:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017226:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017235:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017245:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017249:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415930 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2859008->9007103] (req 2859008->9007103) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017252:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.017566:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.017575:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.017582:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.017593:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468906176
00000100:00100000:0.0:1651532177.017608:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468906112
00000100:00100000:0.0:1651532177.017617:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5170
00000100:00100000:0.0:1651532177.017618:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468906176:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532177.017624:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5171
00010000:00010000:0.0:1651532177.017626:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.017627:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468906112:12345-10.240.43.64@tcp:4:fio.
00010000:00010000:0.0:1651532177.017630:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.017631:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017634:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532177.017635:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017635:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017640:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532177.017641:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017644:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532177.017644:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017648:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017649:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017652:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017652:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.017665:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468906240
00010000:00010000:0.0:1651532177.017666:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017669:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.017673:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6097
00000100:00100000:1.0:1651532177.017681:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468906240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.017684:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.017687:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415a4f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7b2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.017687:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000262e29b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468901184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 558188us (558299us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532177.017690:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5162
00010000:00010000:1.0:1651532177.017692:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.017695:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415a4f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7b2 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.017699:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415a4f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7b2 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.017702:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532177.017711:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468906240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.017714:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6097
00010000:00010000:0.0:1651532177.017726:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017730:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.017732:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017735:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017740:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.017740:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.017741:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017744:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017753:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.017756:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415937 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1867776->8904703] (req 1867776->8904703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017760:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.017765:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.018052:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.018072:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468906560
00000100:00100000:1.0:1651532177.018084:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6098
00000100:00100000:1.0:1651532177.018086:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468906560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.018089:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.018093:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a56 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7b9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.018100:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a56 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7b9 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.018105:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a56 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7b9 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.018108:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532177.018121:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468906560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.018123:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6098
00000001:00080000:0.0:1651532177.117147:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794248 is committed
00010000:00010000:1.0:1651532177.117177:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117182:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.117205:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468901888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532676us (532812us total) trans 158913794248 rc 0/0
00000100:00100000:1.0:1651532177.117208:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5163
00010000:00010000:1.0:1651532177.117216:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117219:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5e80ae9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532177.117220:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117223:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117231:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.117232:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.117233:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117236:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117250:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.117251:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.117252:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117257:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117261:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.117261:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.117262:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117265:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117281:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117284:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415968 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2129920->6594559] (req 2129920->6594559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117290:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117293:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117295:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117297:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117327:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117331:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.117620:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.117632:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.117638:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468906944
00000100:00100000:0.0:1651532177.117639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.117664:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468907008
00000100:00100000:0.0:1651532177.117669:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5172
00000100:00100000:1.0:1651532177.117671:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5173
00000100:00100000:0.0:1651532177.117671:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468906944:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532177.117673:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468907008:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532177.117680:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117680:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117685:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532177.117686:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117689:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532177.117690:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117694:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.117695:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117698:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532177.117699:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117702:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117703:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117706:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117707:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117718:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117721:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117724:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117727:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.117741:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468901952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 533203us (533339us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532177.117744:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5164
00000100:00100000:0.0:1651532177.117748:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e4ba846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468904128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424541us (424574us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532177.117751:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5166
00010000:00010000:1.0:1651532177.117755:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117759:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117759:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117762:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.117763:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117766:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.117770:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ebfb7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468903680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424566us (424659us total) trans 0 rc 36864/36864
00010000:00010000:0.0:1651532177.117771:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.117772:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5165
00010000:00010000:0.0:1651532177.117775:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f41596f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5984256->9256959] (req 5984256->9256959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117777:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117778:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117781:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.117781:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.117781:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117782:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117784:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117785:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117787:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117790:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.117790:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.117790:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4159b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2134016->9981951] (req 2134016->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117791:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117794:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117820:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117824:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4159bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1445888->10420223] (req 1445888->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.117832:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468907136
00000100:00100000:1.0:1651532177.117842:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6099
00010000:00010000:0.0:1651532177.117848:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.117852:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.117854:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468907136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.117859:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.117863:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415a6b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7c0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.117870:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415a6b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7c0 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.117878:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415a6b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7c0 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.117883:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532177.117904:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468907136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (255us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.117907:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6099
00000100:00100000:0.0:1651532177.118210:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.118222:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.118223:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468907200
00000100:00100000:0.0:1651532177.118253:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.118262:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468907392
00000100:00100000:0.0:1651532177.118263:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5174
00000100:00100000:0.0:1651532177.118266:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468907200:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532177.118269:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5175
00000100:00100000:1.0:1651532177.118271:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468907392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532177.118274:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.118279:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532177.118280:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.118280:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.118283:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532177.118283:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.118287:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532177.118289:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.118292:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532177.118293:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.118297:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.118298:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.118301:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.118302:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.118312:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468907328
00000100:00100000:1.0:1651532177.118323:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6100
00000100:00100000:1.0:1651532177.118325:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468907328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.118328:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.118331:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415a80 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7c7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.118339:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415a80 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7c7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.118343:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415a80 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7c7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.118347:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532177.118369:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468907328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (147us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.118372:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6100
00000100:00100000:0.0:1651532177.118393:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.118404:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468907584
00000100:00100000:1.0:1651532177.118413:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6101
00000100:00100000:1.0:1651532177.118415:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468907584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.118425:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532177.118426:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532177.118429:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415a87 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7ce expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.118438:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468907648
00010000:00010000:1.0:1651532177.118443:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415a87 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7ce expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.118448:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6102
00000100:00100000:0.0:1651532177.118450:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468907648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.118452:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415a87 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7ce expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.118454:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.118456:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532177.118458:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415a8e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7d5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.118469:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468907584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.118472:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6101
00010000:00010000:0.0:1651532177.118475:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415a8e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7d5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.118479:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415a8e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7d5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.118483:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532177.118492:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468907648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.118495:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6102
00000100:00100000:0.0:1651532177.118624:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.118631:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468907840
00000100:00100000:0.0:1651532177.118643:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6103
00000100:00100000:0.0:1651532177.118644:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468907840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.118648:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.118651:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415a95 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7dc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.118659:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415a95 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7dc expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.118662:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415a95 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7dc expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.118666:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532177.118676:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468907840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.118678:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6103
00000100:00100000:0.0:1651532177.118761:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.118768:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468907968
00000100:00100000:0.0:1651532177.118779:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6104
00000100:00100000:0.0:1651532177.118780:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468907968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.118783:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.118787:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415a9c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7e3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.118821:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415a9c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7e3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.118825:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415a9c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7e3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.118828:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532177.118838:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468907968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.118841:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6104
00000100:00100000:0.0:1651532177.118866:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.118887:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468908032
00000100:00100000:0.0:1651532177.118896:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6105
00000100:00100000:0.0:1651532177.118898:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468908032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.118901:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.118904:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415aa3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7ea expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.118912:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415aa3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7ea expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.118915:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415aa3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7ea expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.118919:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532177.118928:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468908032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.118930:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6105
00000100:00100000:0.0:1651532177.119128:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.119135:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468908352
00000100:00100000:0.0:1651532177.119148:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6106
00000100:00100000:0.0:1651532177.119150:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468908352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.119153:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.119157:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415aaa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7f1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.119164:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415aaa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7f1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.119168:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415aaa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7f1 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.119173:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532177.119183:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468908352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.119186:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6106
00000001:00080000:0.0:1651532177.183846:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794249 is committed
00010000:00010000:0.0:1651532177.183861:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.183865:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.183882:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000923e9c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468903616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490647us (490763us total) trans 158913794249 rc 0/0
00000100:00100000:0.0:1651532177.183885:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5167
00010000:00010000:0.0:1651532177.183892:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.183895:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a925ecb already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.183896:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.183899:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.183904:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.183905:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.183906:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.183909:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.183921:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.183924:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4159c3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [634880->10076159] (req 634880->10076159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.183936:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.183942:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.184220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.184230:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.184236:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.184242:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468908480
00000100:00100000:0.0:1651532177.184253:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468908544
00000100:00100000:1.0:1651532177.184260:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5176
00000100:00100000:1.0:1651532177.184262:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468908480:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532177.184265:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5177
00000100:00100000:0.0:1651532177.184267:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468908544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532177.184269:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184274:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532177.184274:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184275:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184278:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532177.184279:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.184286:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.184287:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.184290:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532177.184290:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184294:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.184295:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184298:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184311:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184314:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.184317:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.184326:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468908608
00000100:00100000:1.0:1651532177.184339:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc64bce6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468905280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366724us (366774us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651532177.184341:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6107
00000100:00100000:1.0:1651532177.184343:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5168
00000100:00100000:0.0:1651532177.184343:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468908608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.184345:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.184348:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415abf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7f8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184350:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184353:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.184354:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.184355:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.184356:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415abf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7f8 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.184369:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.184371:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415abf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7f8 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.184374:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532177.184375:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.184376:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.184377:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184380:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.184383:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468908608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.184386:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6107
00010000:00010000:1.0:1651532177.184387:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184390:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415a10 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [172032->10141695] (req 172032->10141695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184395:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184398:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.184401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.184421:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468908736
00000100:00100000:0.0:1651532177.184432:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6108
00000100:00100000:0.0:1651532177.184434:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468908736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.184437:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.184441:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ac6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e7ff expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.184449:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ac6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7ff expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.184453:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ac6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e7ff expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.184456:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532177.184465:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468908736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.184467:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6108
00000100:00100000:0.0:1651532177.184851:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.184857:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.184869:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468909056
00000100:00100000:0.0:1651532177.184869:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.184878:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468909184
00000100:00100000:1.0:1651532177.184883:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6109
00000100:00100000:1.0:1651532177.184885:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468909056:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532177.184887:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468909312
00010000:00010000:1.0:1651532177.184888:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532177.184890:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6110
00010000:00010000:1.0:1651532177.184892:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415acd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e806 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.184892:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468909184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.184895:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.184899:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415ad4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e80d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184901:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415acd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e806 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.184906:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415ad4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e80d expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.184909:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415acd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e806 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.184910:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415ad4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e80d expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.184912:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532177.184914:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532177.184928:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468909056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.184931:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6109
00000100:00100000:0.0:1651532177.184933:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468909184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.184936:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6110
00000100:00100000:1.0:1651532177.184938:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6111
00000100:00100000:1.0:1651532177.184939:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468909312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.184942:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.184945:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415adb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e814 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.184951:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415adb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e814 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.184955:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415adb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e814 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.184958:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532177.184976:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468909312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.184978:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6111
00000100:00100000:0.0:1651532177.185235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.185253:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468909568
00000100:00100000:1.0:1651532177.185261:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6112
00000100:00100000:1.0:1651532177.185263:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468909568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.185266:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.185269:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415ae2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e81b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.185276:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415ae2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e81b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.185279:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415ae2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e81b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.185283:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532177.185299:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468909568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.185302:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6112
00000100:00100000:0.0:1651532177.185508:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.185526:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468909824
00000100:00100000:1.0:1651532177.185533:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6113
00000100:00100000:1.0:1651532177.185534:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468909824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.185537:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.185540:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415ae9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e822 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.185547:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415ae9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e822 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.185551:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415ae9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e822 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.185555:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532177.185568:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468909824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.185571:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6113
00000100:00100000:0.0:1651532177.185757:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.185774:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468909952
00000100:00100000:1.0:1651532177.185781:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6114
00000100:00100000:1.0:1651532177.185783:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468909952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.185786:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.185789:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415af0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e829 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.185795:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415af0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e829 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.185799:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415af0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e829 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.185818:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532177.185829:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468909952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.185832:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6114
00000001:00080000:0.0:1651532177.292217:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794250 is committed
00010000:00010000:1.0:1651532177.292248:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.292253:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.292275:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3da161b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468905216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474625us (474704us total) trans 158913794250 rc 0/0
00010000:00010000:0.0:1651532177.292277:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.292279:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5169
00010000:00010000:0.0:1651532177.292282:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.292283:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292287:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292292:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.292293:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.292294:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292297:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292304:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292308:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415a1e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [610304->6148095] (req 610304->6148095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292313:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292316:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292500:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292504:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.292518:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.292523:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532177.292524:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.292524:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468906176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 274905us (274959us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532177.292528:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.292528:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5170
00010000:00010000:1.0:1651532177.292533:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.292534:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.292535:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.292538:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.292545:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.292548:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415a41 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2756608->5185535] (req 2756608->5185535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.292554:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.292564:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.292765:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.292776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.292777:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468910144
00000100:00100000:1.0:1651532177.292784:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.292790:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468910080
00000100:00100000:1.0:1651532177.292796:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.292797:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5178
00000100:00100000:0.0:1651532177.292799:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468910144:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532177.292816:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532177.292836:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292841:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532177.292843:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532177.292843:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292846:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.292854:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5179
00000100:00100000:0.0:1651532177.292856:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468910080:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532177.292861:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292864:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532177.292865:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292868:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292870:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532177.292871:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292875:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292878:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292881:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.292887:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468910272
00000100:00100000:0.0:1651532177.292889:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468910400
00000100:00100000:1.0:1651532177.292902:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468910464
00000100:00100000:0.0:1651532177.292904:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6115
00000100:00100000:0.0:1651532177.292906:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468910272:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532177.292909:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6116
00010000:00010000:0.0:1651532177.292909:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.292912:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415b05 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e830 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.292913:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468910400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.292919:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.292919:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415b05 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e830 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.292924:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415b0c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e837 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292924:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415b05 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e830 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.292927:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532177.292933:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415b0c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e837 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.292941:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468910272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (157us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.292944:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6115
00010000:00010000:1.0:1651532177.292950:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415b0c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e837 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.292950:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6117
00000100:00100000:0.0:1651532177.292951:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468910464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.292954:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532177.292954:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.292956:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b13 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e83e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.292962:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b13 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e83e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532177.292964:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468910400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (168us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.292967:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6116
00010000:00010000:0.0:1651532177.292969:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b13 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e83e expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.292972:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532177.292978:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468910464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (175us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.292980:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6117
00000100:00100000:0.0:1651532177.292996:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.293003:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468910528
00000100:00100000:0.0:1651532177.293008:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6118
00000100:00100000:0.0:1651532177.293010:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468910528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.293013:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.293015:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415b1a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e845 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.293021:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415b1a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e845 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.293025:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415b1a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e845 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.293028:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532177.293037:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468910528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (41us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.293041:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6118
00000100:00100000:1.0:1651532177.293303:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.293315:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.293332:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468910720
00000100:00100000:0.0:1651532177.293345:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468910656
00000100:00100000:0.0:1651532177.293349:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6119
00000100:00100000:0.0:1651532177.293351:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468910720:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532177.293354:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6120
00010000:00010000:0.0:1651532177.293354:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532177.293356:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468910656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.293364:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415b21 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e853 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.293369:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.293372:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415b21 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e853 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.293373:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b28 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e84c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.293376:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415b21 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e853 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.293379:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532177.293381:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b28 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e84c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.293385:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b28 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e84c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.293389:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532177.293392:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468910720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.293395:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6119
00000100:00100000:1.0:1651532177.293403:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468910656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.293406:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6120
00000100:00100000:0.0:1651532177.293430:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.293458:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468910912
00000100:00100000:1.0:1651532177.293466:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6121
00000100:00100000:1.0:1651532177.293467:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468910912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.293471:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.293473:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b2f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e85a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.293480:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b2f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e85a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.293487:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b2f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e85a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.293491:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532177.293497:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468910912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.293500:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6121
00000100:00100000:0.0:1651532177.293746:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.293765:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468911232
00000100:00100000:1.0:1651532177.293773:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6122
00000100:00100000:1.0:1651532177.293774:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468911232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.293778:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.293781:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b36 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e861 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.293787:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b36 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e861 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.293791:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b36 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e861 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.293794:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532177.293818:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468911232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.293820:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6122
00000001:00080000:0.0:1651532177.433880:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794251 is committed
00010000:00010000:1.0:1651532177.433914:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.433919:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.433943:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468906112:12345-10.240.43.64@tcp:4:fio. Request processed in 416316us (416367us total) trans 158913794251 rc 0/0
00000100:00100000:1.0:1651532177.433946:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5171
00010000:00010000:1.0:1651532177.433954:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.433957:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532177.433958:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.433961:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.433967:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.433967:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.433968:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.433971:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.433978:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.433980:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.433985:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.433993:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415a48 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4460544->9064447] (req 4460544->9064447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.434349:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.434375:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.434398:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.434404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.434411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.434421:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468911488
00000100:00100000:0.0:1651532177.434426:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468911616
00000100:00100000:1.0:1651532177.434431:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468911424
00000100:00100000:0.0:1651532177.434436:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468911680
00000100:00100000:1.0:1651532177.434437:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5180
00000100:00100000:1.0:1651532177.434439:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468911488:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532177.434439:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468911744
00000100:00100000:0.0:1651532177.434442:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6123
00000100:00100000:0.0:1651532177.434444:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468911616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.434446:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.434448:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.434451:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532177.434452:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.434452:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415b44 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e868 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.434455:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532177.434456:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.434461:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.434462:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415b44 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e868 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.434465:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.434466:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415b44 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e868 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.434470:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532177.434472:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5181
00000100:00100000:1.0:1651532177.434474:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468911424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532177.434478:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.434481:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468911616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (83us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532177.434482:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532177.434482:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.434484:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6123
00010000:00010000:1.0:1651532177.434485:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532177.434486:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.434489:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.434489:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6124
00000100:00100000:0.0:1651532177.434490:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468911680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.434492:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.434493:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.434495:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415b52 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e86f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.434500:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6125
00000100:00100000:1.0:1651532177.434501:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468911744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.434503:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415b52 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e86f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.434504:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.434506:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b59 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e876 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.434507:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415b52 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e86f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.434510:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532177.434513:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b59 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e876 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.434516:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468911680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (111us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532177.434518:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b59 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e876 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.434518:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6124
00010000:00010000:1.0:1651532177.434521:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:1.0:1651532177.434530:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468911744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.434533:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6125
00000100:00100000:1.0:1651532177.434857:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.434865:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468912000
00000100:00100000:1.0:1651532177.434871:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6126
00000100:00100000:1.0:1651532177.434873:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468912000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.434876:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.434880:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415b60 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e87d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.434887:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415b60 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e87d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.434891:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415b60 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e87d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.434894:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532177.434908:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468912000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.434912:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6126
00000001:00080000:0.0:1651532177.533848:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794252 is committed
00002000:00010000:0.0:1651532177.533862:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532176 -> 1651532177
00010000:00010000:0.0:1651532177.533865:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.533869:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.533891:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e34a4ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468906944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 416219us (416271us total) trans 158913794252 rc 0/0
00000100:00100000:0.0:1651532177.533894:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5172
00010000:00010000:0.0:1651532177.533902:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.533905:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.533906:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.533910:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.533915:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.533915:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.533916:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.533919:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.533929:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.533932:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415a5d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [638976->9129983] (req 638976->9129983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.533944:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.533949:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.534266:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.534275:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.534281:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.534292:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468912256
00010000:00010000:1.0:1651532177.534298:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.534300:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468912320
00010000:00010000:1.0:1651532177.534302:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.534303:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468912384
00000100:00100000:0.0:1651532177.534306:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6127
00000100:00100000:0.0:1651532177.534307:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468912256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.534311:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.534315:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415b67 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e884 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.534320:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001aad36f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468907008:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416646us (416688us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532177.534324:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5173
00010000:00010000:0.0:1651532177.534326:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.534329:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415b67 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e884 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.534331:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.534334:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.534334:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415b67 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e884 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.534335:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.534337:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532177.534338:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.534344:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.534344:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.534345:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.534346:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468912256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (81us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532177.534348:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.534349:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6127
00000100:00100000:0.0:1651532177.534354:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6128
00000100:00100000:0.0:1651532177.534355:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f253594 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468912320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.534366:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.534369:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415a64 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1445888->8835071] (req 1445888->8835071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.534373:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.534376:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415b6e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e88b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.534377:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6129
00000100:00100000:1.0:1651532177.534379:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468912384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.534382:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415b6e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e88b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.534383:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.534386:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415b75 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e892 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.534386:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415b6e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e88b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.534389:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532177.534393:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415b75 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e892 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.534396:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f253594 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468912320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (121us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532177.534398:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415b75 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e892 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.534398:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6128
00010000:00010000:1.0:1651532177.534401:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532177.534409:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468912384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (128us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.534412:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6129
00010000:00010000:1.0:1651532177.534424:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.534428:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.534769:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.534777:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.534792:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468912576
00000100:00100000:0.0:1651532177.534817:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5182
00000100:00100000:0.0:1651532177.534820:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468912576:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532177.534824:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468912448
00010000:00010000:0.0:1651532177.534828:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.534832:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532177.534833:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5183
00010000:00010000:0.0:1651532177.534833:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.534835:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468912448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532177.534836:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532177.534837:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.534841:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.534842:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.534845:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.534846:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.534848:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.534850:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532177.534851:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.534856:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.534862:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.534865:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.534875:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.534881:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468912640
00000100:00100000:0.0:1651532177.534891:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468912832
00000100:00100000:0.0:1651532177.534898:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6130
00000100:00100000:0.0:1651532177.534900:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468912640:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532177.534903:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6131
00010000:00010000:0.0:1651532177.534903:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532177.534905:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468912832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.534906:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415b8a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e899 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.534907:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.534910:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b91 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8a0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.534913:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415b8a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e899 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.534917:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415b8a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e899 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.534918:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b91 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8a0 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.534920:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532177.534922:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b91 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8a0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.534926:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532177.534933:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468912640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.534935:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6130
00000100:00100000:1.0:1651532177.534941:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468912832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.534944:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6131
00000001:00080000:0.0:1651532177.575603:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794253 is committed
00002000:00010000:1.0:1651532177.575634:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532176 -> 1651532177
00010000:00010000:1.0:1651532177.575638:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.575642:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.575666:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468907200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457400us (457457us total) trans 158913794253 rc 0/0
00000100:00100000:1.0:1651532177.575670:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5174
00010000:00010000:1.0:1651532177.575677:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.575681:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532177.575682:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.575685:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.575690:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.575690:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.575691:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.575694:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.575712:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.575715:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415a72 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2424832->2428927] (req 2424832->2428927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.575723:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.575726:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.575965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.575978:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468913216
00000100:00100000:1.0:1651532177.575990:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6132
00000100:00100000:1.0:1651532177.575992:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468913216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.575995:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.576000:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b98 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8a7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.576013:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b98 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8a7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.576020:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b98 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8a7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.576024:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532177.576043:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468913216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.576046:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6132
00000001:00080000:0.0:1651532177.642303:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794254 is committed
00010000:00010000:1.0:1651532177.642335:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.642340:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642371:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.642374:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096c68551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468907392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524101us (524120us total) trans 158913794254 rc 0/0
00010000:00010000:0.0:1651532177.642376:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532177.642377:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5175
00010000:00010000:0.0:1651532177.642377:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642380:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642386:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.642386:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.642387:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642390:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642403:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642406:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415a79 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1433600->9994239] (req 1433600->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.642419:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.642423:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.642696:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.642712:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468913344
00000100:00100000:0.0:1651532177.642716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.642725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.642733:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468913408
00000100:00100000:0.0:1651532177.642734:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.642748:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5184
00000100:00100000:1.0:1651532177.642750:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000431022e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468913344:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532177.642750:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5185
00000100:00100000:0.0:1651532177.642753:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ec46cac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468913408:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532177.642757:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642761:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.642762:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532177.642763:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.642766:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532177.642767:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642774:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532177.642775:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642778:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532177.642778:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.642782:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642783:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.642786:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.642786:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.642795:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468913472
00000100:00100000:0.0:1651532177.642797:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468913536
00000100:00100000:1.0:1651532177.642817:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6133
00000100:00100000:1.0:1651532177.642818:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468913472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.642821:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.642824:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415bad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8ae expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.642825:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6134
00000100:00100000:0.0:1651532177.642827:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001fd7cd0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468913536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.642831:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.642832:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415bad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8ae expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.642834:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415bb4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8b5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.642836:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415bad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8ae expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.642840:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532177.642841:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415bb4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8b5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.642846:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415bb4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8b5 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.642849:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532177.642851:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468913472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.642854:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6133
00000100:00100000:0.0:1651532177.642858:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001fd7cd0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468913536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.642861:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6134
00000100:00100000:0.0:1651532177.643127:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.643135:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.643141:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468913664
00000100:00100000:0.0:1651532177.643147:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468913728
00000100:00100000:0.0:1651532177.643158:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6135
00000100:00100000:0.0:1651532177.643160:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d8cd4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468913664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.643163:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.643167:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bbb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8bc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.643168:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6136
00000100:00100000:1.0:1651532177.643170:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468913728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.643174:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.643174:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bbb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8bc expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.643177:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bc2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8c3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.643178:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bbb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8bc expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.643181:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532177.643185:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bc2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8c3 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.643189:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bc2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8c3 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.643194:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d8cd4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468913664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.643197:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6135
00010000:00010000:1.0:1651532177.643199:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532177.643207:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468913728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.643210:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6136
00000001:00080000:0.0:1651532177.734044:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794255 is committed
00010000:00010000:1.0:1651532177.734075:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734080:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.734103:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468908480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 549840us (549903us total) trans 158913794255 rc 0/0
00000100:00100000:1.0:1651532177.734106:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5176
00010000:00010000:1.0:1651532177.734114:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734117:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532177.734119:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734122:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734127:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.734128:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.734129:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734131:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734135:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.734135:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.734136:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734148:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734160:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734163:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ab1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [651264->8826879] (req 651264->8826879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734171:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734174:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734176:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734179:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734494:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734506:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734511:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734516:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.734522:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039f4a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468910144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441722us (441758us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532177.734526:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5178
00000100:00100000:0.0:1651532177.734531:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee0194b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468908544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 550263us (550300us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532177.734533:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.734534:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5177
00010000:00010000:1.0:1651532177.734536:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532177.734537:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734540:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734542:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734545:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734546:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.734547:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.734548:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415af7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1454080->9191423] (req 1454080->9191423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734550:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734555:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.734555:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.734556:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734559:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734566:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734569:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415ab8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [647168->7438335] (req 647168->7438335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734574:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.734577:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.734937:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.734949:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.734959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.734967:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.734974:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.734975:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468914240
00000100:00100000:0.0:1651532177.734981:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468914176
00000100:00100000:1.0:1651532177.734988:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5186
00000100:00100000:1.0:1651532177.734990:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecf153d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468914240:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532177.734996:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5187
00000100:00100000:0.0:1651532177.734998:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000154c18e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468914176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532177.735015:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.735020:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532177.735021:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.735021:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.735024:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.735026:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532177.735027:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.735030:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.735033:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532177.735050:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.735055:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.735058:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.735059:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468914304
00010000:00010000:0.0:1651532177.735065:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.735068:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468914432
00000100:00100000:1.0:1651532177.735071:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468914560
00000100:00100000:1.0:1651532177.735074:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6137
00000100:00100000:1.0:1651532177.735076:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468914304:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532177.735078:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6138
00010000:00010000:1.0:1651532177.735079:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532177.735080:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085347479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468914432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.735081:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415bd7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8ca expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.735083:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.735086:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415bde lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8d1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.735089:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415bd7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8ca expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.735093:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415bd7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8ca expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.735093:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415bde lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8d1 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.735097:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532177.735098:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415bde lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8d1 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.735101:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532177.735111:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468914304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (151us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.735114:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6137
00000100:00100000:0.0:1651532177.735117:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085347479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468914432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (149us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.735119:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6139
00000100:00100000:1.0:1651532177.735120:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f92ef7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468914560:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532177.735120:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6138
00010000:00010000:1.0:1651532177.735123:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.735125:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415be5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8d8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.735131:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415be5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8d8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.735135:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415be5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8d8 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.735137:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532177.735138:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532177.735144:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f92ef7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468914560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (170us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.735147:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6139
00000100:00100000:1.0:1651532177.735150:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468914688
00000100:00100000:1.0:1651532177.735158:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6140
00000100:00100000:1.0:1651532177.735160:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468914688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.735162:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.735164:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415bec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8df expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.735180:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415bec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8df expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.735183:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415bec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8df expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.735187:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532177.735198:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468914688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.735200:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6140
00000100:00100000:1.0:1651532177.735467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.735476:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.735486:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468915008
00000100:00100000:0.0:1651532177.735487:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468915072
00000100:00100000:1.0:1651532177.735496:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6141
00000100:00100000:1.0:1651532177.735497:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468915008:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532177.735500:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6142
00010000:00010000:1.0:1651532177.735501:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532177.735502:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468915072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.735504:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415bf3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8e6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.735506:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.735510:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415bfa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8ed expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.735511:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415bf3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8e6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.735515:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415bf3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8e6 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.735517:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415bfa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8ed expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.735521:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532177.735521:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415bfa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8ed expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.735525:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532177.735533:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468915008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.735535:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6141
00000100:00100000:0.0:1651532177.735540:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468915072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.735542:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6142
00000100:00100000:1.0:1651532177.735754:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.735765:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468915264
00000100:00100000:0.0:1651532177.735773:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6143
00000100:00100000:0.0:1651532177.735774:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468915264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.735777:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.735781:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415c01 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8f4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.735788:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415c01 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8f4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.735791:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415c01 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8f4 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.735795:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532177.735821:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468915264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.735824:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6143
00000100:00100000:1.0:1651532177.736017:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.736028:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468915456
00000100:00100000:0.0:1651532177.736035:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6144
00000100:00100000:0.0:1651532177.736037:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468915456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.736040:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.736043:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c08 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e8fb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.736050:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c08 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8fb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.736054:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c08 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e8fb expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.736057:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532177.736066:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468915456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.736069:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6144
00000001:00080000:0.0:1651532177.800723:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794256 is committed
00010000:00010000:0.0:1651532177.800738:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.800742:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.800766:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000972d0d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468910080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507909us (507989us total) trans 158913794256 rc 0/0
00000100:00100000:0.0:1651532177.800769:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5179
00010000:00010000:1.0:1651532177.800770:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.800776:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532177.800777:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.800781:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.800787:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.800787:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.800788:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.800791:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.800800:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.800815:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.800820:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.800825:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415afe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->5795839] (req 872448->5795839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.801150:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.801158:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.801170:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.801176:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468915648
00000100:00100000:0.0:1651532177.801176:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.801182:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.801187:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468915712
00000100:00100000:0.0:1651532177.801188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.801203:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5188
00000100:00100000:1.0:1651532177.801205:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068d4eb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468915648:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532177.801209:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5189
00000100:00100000:0.0:1651532177.801211:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058137681 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468915712:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532177.801212:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801216:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532177.801217:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.801219:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801220:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532177.801221:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.801224:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.801226:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.801228:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532177.801229:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801233:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.801234:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801237:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.801238:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.801246:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468915776
00010000:00010000:0.0:1651532177.801248:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.801250:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468915840
00010000:00010000:0.0:1651532177.801251:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.801253:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468915904
00000100:00100000:1.0:1651532177.801255:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468915968
00000100:00100000:0.0:1651532177.801271:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b5fb18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468911488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366831us (366924us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532177.801273:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6145
00000100:00100000:0.0:1651532177.801274:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5180
00000100:00100000:1.0:1651532177.801275:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d34441ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468915776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.801278:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.801281:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415c1d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e902 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.801283:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6146
00000100:00100000:0.0:1651532177.801285:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087214ada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468915840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.801286:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.801288:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.801289:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415c1d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e902 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.801291:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415c24 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e909 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801293:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415c1d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e902 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.801296:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.801297:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532177.801299:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415c24 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e909 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.801303:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415c24 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e909 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532177.801306:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d34441ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468915776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (136us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.801309:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6145
00000100:00100000:1.0:1651532177.801314:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6147
00000100:00100000:1.0:1651532177.801315:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3487fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468915904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.801315:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532177.801317:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.801319:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415c2b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e910 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.801323:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087214ada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468915840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (147us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532177.801324:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.801325:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415c2b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e910 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.801326:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6146
00000100:00100000:0.0:1651532177.801331:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6148
00010000:00010000:1.0:1651532177.801332:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415c2b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e910 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.801333:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd4c4f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468915968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.801335:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00010000:00010000:0.0:1651532177.801335:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.801338:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415c32 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e917 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.801340:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3487fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468915904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (158us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532177.801342:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532177.801343:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6147
00010000:00010000:0.0:1651532177.801344:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415c32 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e917 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.801348:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415c32 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e917 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.801349:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.801351:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532177.801352:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532177.801353:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801356:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.801356:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd4c4f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468915968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (169us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.801371:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6148
00010000:00010000:1.0:1651532177.801373:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.801374:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.801375:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801378:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801385:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801391:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415b3d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->8728575] (req 1462272->8728575) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801396:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.801399:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.801773:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.801780:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.801786:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.801792:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.801823:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468916096
00000100:00100000:0.0:1651532177.801830:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468916160
00000100:00100000:0.0:1651532177.801832:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468916352
00000100:00100000:0.0:1651532177.801834:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468916544
00000100:00100000:0.0:1651532177.801837:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6149
00000100:00100000:0.0:1651532177.801838:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468916096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.801842:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532177.801845:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6150
00010000:00010000:0.0:1651532177.801845:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415c39 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e91e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.801847:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468916160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.801852:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.801853:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415c39 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e91e expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.801857:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415c40 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e925 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.801857:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415c39 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e91e expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.801860:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532177.801870:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415c40 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e925 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.801870:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468916096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.801872:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6149
00010000:00010000:1.0:1651532177.801877:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415c40 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e925 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.801877:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6151
00000100:00100000:0.0:1651532177.801879:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e7181f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468916352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.801881:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.801883:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00010000:00010000:0.0:1651532177.801883:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415c47 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e92c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.801889:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415c47 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e92c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532177.801894:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468916160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (113us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532177.801901:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415c47 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e92c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.801904:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532177.801911:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e7181f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468916352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.801912:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6150
00000100:00100000:0.0:1651532177.801914:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6151
00000100:00100000:0.0:1651532177.801918:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6152
00000100:00100000:0.0:1651532177.801920:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a43237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468916544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.801922:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.801925:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415c4e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e933 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.801930:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415c4e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e933 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.801934:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415c4e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e933 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.801937:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532177.801941:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a43237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468916544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (149us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.801943:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6152
00000100:00100000:0.0:1651532177.802325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.802343:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.802349:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468916672
00000100:00100000:0.0:1651532177.802355:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468916864
00000100:00100000:0.0:1651532177.802373:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6153
00000100:00100000:0.0:1651532177.802374:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468916672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.802378:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.802382:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c55 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e93a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.802383:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6154
00000100:00100000:1.0:1651532177.802385:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468916864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.802389:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.802389:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c55 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e93a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.802392:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415c5c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e941 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.802393:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c55 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e93a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.802396:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532177.802400:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415c5c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e941 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.802404:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415c5c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e941 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.802406:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468916672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (82us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532177.802407:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532177.802408:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6153
00000100:00100000:1.0:1651532177.802415:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468916864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.802418:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6154
00000100:00100000:0.0:1651532177.802660:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.802678:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468916992
00000100:00100000:1.0:1651532177.802694:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6155
00000100:00100000:1.0:1651532177.802696:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468916992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.802699:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.802702:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c63 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e948 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.802709:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c63 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e948 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.802715:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c63 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e948 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.802719:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532177.802732:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468916992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.802735:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6155
00000001:00080000:0.0:1651532177.909067:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794257 is committed
00010000:00010000:1.0:1651532177.909099:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.909104:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.909125:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b58db816 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468911424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474651us (474750us total) trans 158913794257 rc 0/0
00010000:00010000:0.0:1651532177.909128:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.909129:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5181
00010000:00010000:0.0:1651532177.909132:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532177.909134:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909140:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909146:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.909146:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532177.909147:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909150:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909158:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909161:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415b4b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1966080->8019967] (req 1966080->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.909175:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.909179:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.909456:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.909466:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.909476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.909477:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468917184
00000100:00100000:1.0:1651532177.909487:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.909488:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468917248
00000100:00100000:0.0:1651532177.909503:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5190
00010000:00010000:1.0:1651532177.909505:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.909505:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468917184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532177.909509:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909512:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909516:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532177.909517:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909523:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532177.909524:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.909527:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d571e3ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468912576:12345-10.240.43.64@tcp:3:fio.0 Request processed in 374707us (374758us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532177.909531:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5182
00010000:00010000:0.0:1651532177.909534:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.909537:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5191
00000100:00100000:1.0:1651532177.909538:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468917248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532177.909538:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.909545:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.909545:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468917312
00010000:00010000:1.0:1651532177.909549:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.909551:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.909551:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468917376
00010000:00010000:1.0:1651532177.909553:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532177.909554:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.909555:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6156
00000100:00100000:0.0:1651532177.909557:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468917312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532177.909558:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909560:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.909562:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909562:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415c78 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e94f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909567:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.909570:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909570:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415c78 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e94f expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.909573:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532177.909574:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909574:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415c78 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e94f expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.909577:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909577:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532177.909582:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.909582:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532177.909583:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.909586:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.909586:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468917312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.909589:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6156
00010000:00010000:1.0:1651532177.909592:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.909593:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6157
00010000:00010000:1.0:1651532177.909595:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415b7c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->10162175] (req 294912->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532177.909595:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468917376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.909597:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.909599:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415c7f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e956 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.909600:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.909602:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.909605:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415c7f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e956 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.909608:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415c7f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e956 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.909611:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532177.909616:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468917376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (129us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.909618:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6157
00000100:00100000:0.0:1651532177.910000:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.910011:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.910017:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532177.910028:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468917568
00000100:00100000:0.0:1651532177.910028:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532177.910035:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468917632
00000100:00100000:1.0:1651532177.910036:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468917760
00000100:00100000:1.0:1651532177.910039:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468917824
00000100:00100000:0.0:1651532177.910041:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6158
00000100:00100000:0.0:1651532177.910043:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468917568:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532177.910044:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6159
00000100:00100000:1.0:1651532177.910046:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468917760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.910048:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.910050:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.910051:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415c86 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e95d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532177.910054:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415c8d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e96b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.910059:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415c86 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e95d expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.910062:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415c8d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e96b expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.910062:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415c86 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e95d expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.910066:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532177.910067:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415c8d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e96b expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.910070:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:0.0:1651532177.910079:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468917568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.910081:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6158
00000100:00100000:1.0:1651532177.910087:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468917760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532177.910087:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6160
00000100:00100000:0.0:1651532177.910088:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468917632:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532177.910090:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6159
00010000:00010000:0.0:1651532177.910091:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532177.910093:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415c94 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e964 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532177.910096:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6161
00000100:00100000:1.0:1651532177.910098:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468917824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532177.910099:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415c94 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e964 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532177.910100:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532177.910103:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415c9b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e972 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532177.910103:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415c94 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e964 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532177.910108:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532177.910109:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415c9b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e972 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.910114:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468917632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (103us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532177.910116:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415c9b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e972 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532177.910117:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6160
00010000:00010000:1.0:1651532177.910119:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532177.910125:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468917824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532177.910127:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6161
00000001:00080000:0.0:1651532178.025777:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794258 is committed
00010000:00010000:1.0:1651532178.025822:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.025827:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.025851:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b42dbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468912448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491015us (491073us total) trans 158913794258 rc 0/0
00000100:00100000:1.0:1651532178.025854:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5183
00010000:00010000:1.0:1651532178.025862:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.025865:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.025867:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.025870:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.025878:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.025878:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.025879:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.025882:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.025898:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.025901:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415b83 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6496256->9994239] (req 6496256->9994239) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.025907:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.025910:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.026189:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.026208:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.026217:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468918208
00000100:00100000:1.0:1651532178.026229:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468918144
00000100:00100000:1.0:1651532178.026247:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5192
00000100:00100000:0.0:1651532178.026261:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5193
00000100:00100000:1.0:1651532178.026263:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468918208:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532178.026264:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468918144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532178.026272:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.026274:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.026277:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532178.026278:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.026284:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532178.026285:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.026288:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.026291:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532178.026291:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.026295:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.026296:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.026299:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.026305:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532178.147201:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794259 is committed
00010000:00010000:1.0:1651532178.147235:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147240:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.147261:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000431022e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468913344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 504511us (504566us total) trans 158913794259 rc 0/0
00010000:00010000:0.0:1651532178.147264:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.147265:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5184
00010000:00010000:0.0:1651532178.147268:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532178.147269:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147273:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147278:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.147279:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.147280:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147283:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147286:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.147287:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.147288:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147290:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147302:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147305:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415b9f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [659456->10403839] (req 659456->10403839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147310:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147313:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147314:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147319:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.147592:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.147613:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147618:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.147621:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.147644:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ec46cac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468913408:12345-10.240.43.64@tcp:3:fio.0 Request processed in 504890us (504928us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532178.147648:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5185
00000100:00100000:0.0:1651532178.147658:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468918528
00000100:00100000:0.0:1651532178.147665:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468918592
00000100:00100000:0.0:1651532178.147669:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6162
00010000:00010000:1.0:1651532178.147673:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147678:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.147688:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468918528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.147692:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.147696:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415cb0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e979 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.147697:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecf153d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468914240:12345-10.240.43.64@tcp:3:fio.0 Request processed in 412706us (412780us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532178.147700:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5186
00010000:00010000:0.0:1651532178.147702:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.147705:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415cb0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e979 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.147707:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147710:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415cb0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e979 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.147711:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.147712:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147713:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532178.147715:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147721:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.147721:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468918528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (130us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532178.147724:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415ba6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [630784->10170367] (req 630784->10170367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.147724:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6162
00010000:00010000:1.0:1651532178.147728:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.147729:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6163
00010000:00010000:1.0:1651532178.147730:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000730306b9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.147731:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.147731:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468918592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.147733:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.147734:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147735:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415cb7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e980 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147737:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.147738:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.147739:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147742:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147747:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415cb7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e980 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.147754:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147756:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415bd0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3108864->8925183] (req 3108864->8925183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147758:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415cb7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e980 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.147761:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532178.147768:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468918592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.147771:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6163
00000100:00100000:1.0:1651532178.147774:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.147787:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468918720
00000100:00100000:0.0:1651532178.147791:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6164
00000100:00100000:0.0:1651532178.147793:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468918720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.147796:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.147798:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cbe lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e987 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147822:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cbe lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e987 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.147826:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cbe lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e987 expref: 13 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.147829:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532178.147837:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468918720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.147839:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6164
00000100:00100000:1.0:1651532178.147846:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.147846:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.147849:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.147879:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468918784
00000100:00100000:1.0:1651532178.147902:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5194
00000100:00100000:1.0:1651532178.147904:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468918784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532178.147912:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147916:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532178.147917:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147920:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532178.147921:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147925:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.147929:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.148084:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.148122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.148132:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.148142:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468918912
00000100:00100000:1.0:1651532178.148151:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468918976
00000100:00100000:1.0:1651532178.148157:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6165
00000100:00100000:1.0:1651532178.148159:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468918912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.148163:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.148166:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ccc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e98e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.148174:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ccc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e98e expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.148179:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ccc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e98e expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.148182:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532178.148192:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468918912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.148197:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6165
00000100:00100000:0.0:1651532178.148199:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468919040
00000100:00100000:1.0:1651532178.148202:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6166
00000100:00100000:1.0:1651532178.148203:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468918976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.148207:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.148209:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415cd3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e995 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.148214:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5195
00000100:00100000:0.0:1651532178.148216:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468919040:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532178.148224:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.148230:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532178.148231:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532178.148231:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.148236:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.148237:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415cd3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e995 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.148245:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415cd3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e995 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.148250:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532178.148262:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468918976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.148267:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6166
00000100:00100000:1.0:1651532178.148321:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.148351:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468919296
00000100:00100000:1.0:1651532178.148369:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6167
00000100:00100000:1.0:1651532178.148371:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468919296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.148374:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.148378:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ce1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e99c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.148388:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ce1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e99c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.148392:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ce1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e99c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.148395:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532178.148405:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468919296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.148408:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6167
00000100:00100000:1.0:1651532178.148565:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.148572:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468919488
00000100:00100000:1.0:1651532178.148583:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6168
00000100:00100000:1.0:1651532178.148585:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468919488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.148588:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.148591:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415ce8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9a3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.148598:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415ce8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9a3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.148602:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415ce8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9a3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.148606:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532178.148615:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468919488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.148618:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6168
00000100:00100000:1.0:1651532178.148847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.148855:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468919744
00000100:00100000:1.0:1651532178.148868:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6169
00000100:00100000:1.0:1651532178.148870:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468919744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.148873:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.148876:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415cef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9aa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.148884:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415cef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9aa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.148888:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415cef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9aa expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.148891:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532178.148900:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468919744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.148903:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6169
00000100:00100000:1.0:1651532178.149091:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.149098:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468919872
00000100:00100000:1.0:1651532178.149111:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6170
00000100:00100000:1.0:1651532178.149113:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468919872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.149116:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.149119:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415cf6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9b1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.149126:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415cf6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9b1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.149130:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415cf6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9b1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.149133:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532178.149142:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468919872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.149145:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6170
00000001:00080000:0.0:1651532178.247181:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794260 is committed
00010000:00010000:0.0:1651532178.247196:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.247200:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.247223:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000154c18e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468914176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 512224us (512273us total) trans 158913794260 rc 0/0
00000100:00100000:0.0:1651532178.247226:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5187
00010000:00010000:0.0:1651532178.247233:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.247237:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532178.247238:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.247244:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.247249:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.247249:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.247250:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.247253:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.247262:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.247266:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415bc9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [663552->9261055] (req 663552->9261055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.247272:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.247277:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.247641:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.247653:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.247654:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468920064
00000100:00100000:1.0:1651532178.247662:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.247672:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468920000
00000100:00100000:0.0:1651532178.247681:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5196
00000100:00100000:0.0:1651532178.247683:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468920064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532178.247690:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.247694:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532178.247695:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.247696:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.247707:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532178.247707:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.247708:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5197
00000100:00100000:1.0:1651532178.247710:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468920000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532178.247712:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.247716:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.247719:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.247724:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468920192
00010000:00010000:1.0:1651532178.247727:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532178.247728:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532178.247729:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.247730:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468920256
00010000:00010000:1.0:1651532178.247732:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.247734:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6171
00000100:00100000:0.0:1651532178.247735:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468920192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.247738:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532178.247740:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6172
00000100:00100000:1.0:1651532178.247741:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468920256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.247741:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415d0b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9b8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.247744:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.247746:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415d12 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9bf expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.247748:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415d0b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9b8 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.247753:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415d12 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9bf expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.247753:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415d0b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9b8 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.247757:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415d12 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9bf expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.247757:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532178.247761:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532178.247772:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468920192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.247775:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6171
00000100:00100000:1.0:1651532178.247777:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468920256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.247780:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6172
00000100:00100000:1.0:1651532178.248028:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.248035:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468920512
00000100:00100000:1.0:1651532178.248047:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6173
00000100:00100000:1.0:1651532178.248049:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468920512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.248053:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.248056:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415d19 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9c6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.248063:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415d19 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9c6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.248067:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415d19 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9c6 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.248071:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532178.248080:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468920512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.248083:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6173
00000001:00080000:0.0:1651532178.313912:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794261 is committed
00010000:00010000:1.0:1651532178.313945:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.313949:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.313967:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068d4eb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468915648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 512761us (512817us total) trans 158913794261 rc 0/0
00000100:00100000:1.0:1651532178.313971:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5188
00010000:00010000:1.0:1651532178.313978:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.313984:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.313985:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.313988:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.313993:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.313993:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.313994:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.313997:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.314009:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.314013:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415c0f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [737280->6627327] (req 737280->6627327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314022:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314026:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314214:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314219:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.314240:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058137681 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468915712:12345-10.240.43.64@tcp:3:fio.0 Request processed in 513028us (513081us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532178.314244:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5189
00010000:00010000:0.0:1651532178.314252:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314255:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532178.314256:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314259:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314267:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.314268:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.314269:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314272:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314279:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314281:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415c16 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3518464->10178559] (req 3518464->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314286:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314289:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.314390:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.314398:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.314409:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.314419:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468920640
00000100:00100000:1.0:1651532178.314434:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468920832
00000100:00100000:1.0:1651532178.314437:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468920768
00000100:00100000:0.0:1651532178.314441:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6174
00000100:00100000:0.0:1651532178.314444:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468920640:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532178.314447:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6175
00010000:00010000:0.0:1651532178.314447:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532178.314449:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3508860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468920832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.314451:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415d20 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9cd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.314453:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.314457:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415d27 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9db expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314459:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415d20 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9cd expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.314464:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415d20 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9cd expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.314465:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415d27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9db expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.314470:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415d27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9db expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.314473:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532178.314483:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3508860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468920832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.314486:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6175
00000100:00100000:1.0:1651532178.314491:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6176
00010000:00010000:0.0:1651532178.314491:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532178.314501:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468920768:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532178.314501:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468920640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (112us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532178.314504:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532178.314504:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6174
00010000:00010000:1.0:1651532178.314507:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415d2e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9d4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.314513:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415d2e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9d4 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.314517:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415d2e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9d4 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.314523:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532178.314529:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468920768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.314532:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6176
00000100:00100000:1.0:1651532178.314572:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.314607:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.314617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.314623:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468920896
00000100:00100000:0.0:1651532178.314631:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468920960
00000100:00100000:1.0:1651532178.314633:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5198
00000100:00100000:1.0:1651532178.314634:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468920896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532178.314642:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.314649:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532178.314650:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.314655:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.314658:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5199
00010000:00010000:1.0:1651532178.314660:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00000100:00100000:0.0:1651532178.314660:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468920960:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532178.314661:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314668:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.314669:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314672:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532178.314674:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314677:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532178.314677:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.314683:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314683:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.314686:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.314689:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.314704:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468921024
00000100:00100000:1.0:1651532178.314716:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6177
00000100:00100000:1.0:1651532178.314718:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468921024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.314721:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.314724:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415d43 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9e2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.314731:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415d43 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9e2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.314735:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415d43 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9e2 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.314750:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532178.314762:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468921024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (145us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.314765:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6177
00000100:00100000:1.0:1651532178.314985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.314993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.315004:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468921152
00000100:00100000:0.0:1651532178.315004:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468921344
00000100:00100000:1.0:1651532178.315014:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6178
00000100:00100000:1.0:1651532178.315016:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468921152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.315019:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532178.315021:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6179
00010000:00010000:1.0:1651532178.315023:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d4a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9e9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.315023:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468921344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.315027:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.315030:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d4a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9e9 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.315030:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415d51 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9f0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.315034:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d4a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9e9 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.315038:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00010000:00010000:0.0:1651532178.315038:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415d51 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9f0 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.315043:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415d51 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9f0 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.315046:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532178.315047:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468921152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.315050:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6178
00000100:00100000:0.0:1651532178.315068:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468921344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.315071:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6179
00000100:00100000:1.0:1651532178.315092:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.315101:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468921536
00000100:00100000:0.0:1651532178.315108:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6180
00000100:00100000:0.0:1651532178.315110:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468921536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.315112:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.315116:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d58 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9f7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.315123:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d58 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9f7 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.315127:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d58 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9f7 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.315130:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532178.315143:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468921536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.315145:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6180
00000100:00100000:1.0:1651532178.315321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.315331:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468921664
00000100:00100000:1.0:1651532178.315332:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.315342:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468921792
00000100:00100000:0.0:1651532178.315349:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6181
00000100:00100000:0.0:1651532178.315351:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468921664:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532178.315353:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6182
00010000:00010000:0.0:1651532178.315354:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532178.315355:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468921792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.315357:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415d5f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44e9fe expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.315367:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.315371:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415d66 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea05 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.315372:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415d5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9fe expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.315377:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415d5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44e9fe expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.315378:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415d66 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea05 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.315381:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532178.315383:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415d66 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea05 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.315386:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:0.0:1651532178.315393:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468921664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.315396:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6181
00000100:00100000:1.0:1651532178.315401:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468921792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.315403:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6182
00000100:00100000:1.0:1651532178.315648:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.315655:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468922048
00000100:00100000:1.0:1651532178.315668:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6183
00000100:00100000:1.0:1651532178.315670:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468922048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.315673:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.315677:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415d6d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea0c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.315684:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415d6d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea0c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.315688:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415d6d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea0c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.315691:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532178.315700:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468922048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.315704:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6183
00000001:00080000:0.0:1651532178.413922:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794262 is committed
00010000:00010000:0.0:1651532178.413937:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.413941:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.413962:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d7cf1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468917184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 504456us (504506us total) trans 158913794262 rc 0/0
00000100:00100000:0.0:1651532178.413965:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5190
00010000:00010000:1.0:1651532178.413967:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.413972:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.413974:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.413977:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.413983:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.413984:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.413985:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.413988:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.413991:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.413992:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.413992:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.413995:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414012:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414019:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415c6a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [262144->8085503] (req 262144->8085503) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414025:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414028:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414053:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414056:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.414336:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.414347:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.414348:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468922240
00000100:00100000:1.0:1651532178.414373:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468922304
00000100:00100000:0.0:1651532178.414375:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.414378:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468922368
00000100:00100000:1.0:1651532178.414382:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6184
00000100:00100000:1.0:1651532178.414389:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468922240:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532178.414391:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6185
00010000:00010000:1.0:1651532178.414393:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532178.414393:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468922304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.414397:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415d74 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea13 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.414398:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.414401:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415d7b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea1a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414403:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.414406:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415d74 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea13 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.414407:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.414410:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415d7b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea1a expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.414413:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415d74 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea13 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.414414:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415d7b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea1a expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.414416:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00010000:00010000:0.0:1651532178.414418:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532178.414427:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468922240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.414427:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468922304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.414430:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6184
00000100:00100000:0.0:1651532178.414432:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6185
00000100:00100000:1.0:1651532178.414436:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6186
00000100:00100000:1.0:1651532178.414437:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468922368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.414440:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.414442:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415d82 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea21 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414446:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.414448:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415d82 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea21 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.414452:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415d82 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea21 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.414455:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532178.414460:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468922368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.414463:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6186
00010000:00010000:1.0:1651532178.414474:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414478:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.414488:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468918208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 388239us (388301us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532178.414491:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5192
00010000:00010000:1.0:1651532178.414498:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414502:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.414520:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004adde71e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468917248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 504981us (505054us total) trans 0 rc 45056/45056
00000100:00100000:1.0:1651532178.414522:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5191
00010000:00010000:0.0:1651532178.414523:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.414527:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.414529:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.414529:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414532:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532178.414532:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414533:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414537:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.414538:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.414541:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f415ca2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2015232->8552447] (req 2015232->8552447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414542:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.414543:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.414544:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414547:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414556:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414559:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415c71 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [790528->10350591] (req 790528->10350591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.414559:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.414562:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.414911:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.414923:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.414931:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.414938:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468922496
00000100:00100000:1.0:1651532178.414952:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468922432
00000100:00100000:0.0:1651532178.414957:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5200
00000100:00100000:0.0:1651532178.414959:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468922496:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532178.414963:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5201
00000100:00100000:1.0:1651532178.414965:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468922432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532178.414968:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414972:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.414975:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532178.414976:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532178.414977:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414981:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532178.414982:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414985:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414990:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414993:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532178.414993:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.414997:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.414998:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.415001:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.415003:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.415007:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.415014:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468922624
00000100:00100000:1.0:1651532178.415023:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6187
00000100:00100000:1.0:1651532178.415025:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468922624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.415027:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.415030:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415d97 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea28 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.415037:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415d97 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea28 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532178.415037:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532178.415041:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415d97 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea28 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.415044:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:0.0:1651532178.415045:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.415051:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468922816
00000100:00100000:1.0:1651532178.415055:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468922624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (124us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.415057:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6187
00000100:00100000:0.0:1651532178.415058:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468922944
00000100:00100000:0.0:1651532178.415061:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6188
00000100:00100000:1.0:1651532178.415063:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6189
00000100:00100000:0.0:1651532178.415063:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468922816:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532178.415065:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001fd7cd0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468922944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.415066:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.415067:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.415069:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415da5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea36 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.415069:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415d9e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea2f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.415075:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415da5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea36 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.415078:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415da5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea36 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.415081:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532178.415086:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001fd7cd0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468922944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (41us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.415088:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6189
00010000:00010000:0.0:1651532178.415092:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415d9e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea2f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.415096:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415d9e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea2f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.415099:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532178.415108:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468922816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.415113:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.415113:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6188
00000100:00100000:0.0:1651532178.415160:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468923072
00000100:00100000:0.0:1651532178.415168:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6190
00000100:00100000:0.0:1651532178.415169:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468923072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.415173:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.415176:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415dac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea3d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.415182:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415dac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea3d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.415186:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415dac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea3d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.415190:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532178.415217:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468923072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.415219:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6190
00000100:00100000:0.0:1651532178.415546:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.415553:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.415559:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.415565:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468923200
00000100:00100000:0.0:1651532178.415577:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468923392
00000100:00100000:0.0:1651532178.415580:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468923584
00000100:00100000:0.0:1651532178.415583:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6191
00000100:00100000:0.0:1651532178.415585:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d8cd4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468923200:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532178.415588:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6192
00010000:00010000:0.0:1651532178.415588:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532178.415590:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468923392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.415592:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415db3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea44 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.415594:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.415597:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415dba lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea4b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.415599:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415db3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea44 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.415603:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415db3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea44 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.415605:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415dba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea4b expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.415606:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532178.415609:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415dba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea4b expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.415612:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:0.0:1651532178.415618:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d8cd4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468923200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.415621:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6191
00000100:00100000:1.0:1651532178.415627:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468923392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.415629:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6192
00000100:00100000:1.0:1651532178.415635:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6193
00000100:00100000:1.0:1651532178.415636:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468923584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.415639:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.415641:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415dc1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea52 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.415647:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415dc1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea52 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.415659:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415dc1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea52 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.415663:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532178.415663:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.415669:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468923584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.415672:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6193
00000100:00100000:1.0:1651532178.415676:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468923712
00000100:00100000:1.0:1651532178.415687:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6194
00000100:00100000:1.0:1651532178.415688:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085347479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468923712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.415697:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.415700:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415dc8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea59 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.415706:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415dc8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea59 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.415710:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415dc8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea59 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.415713:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532178.415724:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085347479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468923712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.415727:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6194
00000100:00100000:0.0:1651532178.415960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.415974:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.415979:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468923840
00000100:00100000:0.0:1651532178.415981:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468923904
00000100:00100000:1.0:1651532178.415991:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6195
00000100:00100000:1.0:1651532178.415993:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f92ef7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468923840:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532178.415997:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6196
00010000:00010000:1.0:1651532178.415998:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532178.415999:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468923904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.416001:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415dcf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea60 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.416003:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.416007:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415dd6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea67 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.416008:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415dcf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea60 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.416012:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415dcf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea60 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.416014:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415dd6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea67 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.416015:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532178.416021:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415dd6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea67 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.416024:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532178.416025:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f92ef7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468923840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.416028:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6195
00000100:00100000:0.0:1651532178.416032:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468923904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.416035:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6196
00000001:00080000:0.0:1651532178.530572:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794263 is committed
00010000:00010000:0.0:1651532178.530587:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.530591:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.530613:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b308d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468918144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 504349us (504405us total) trans 158913794263 rc 0/0
00010000:00010000:1.0:1651532178.530616:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.530616:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5193
00010000:00010000:1.0:1651532178.530621:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.530622:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.530626:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.530632:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.530632:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.530633:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.530639:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.530643:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.530643:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.530644:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.530646:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.530667:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.530670:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415ca9 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->6836223] (req 1449984->6836223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.530676:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.530679:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.530679:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.530684:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.530698:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.530716:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.530732:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000216ac3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468919040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 382515us (382611us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532178.530735:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5195
00010000:00010000:0.0:1651532178.530742:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.530745:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532178.530747:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.530750:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.530755:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.530758:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415cda lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.530934:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.530982:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.530983:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468924416
00000100:00100000:1.0:1651532178.530994:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.531004:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468924480
00000100:00100000:0.0:1651532178.531014:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5202
00000100:00100000:0.0:1651532178.531016:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468924416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532178.531024:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.531028:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532178.531029:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.531032:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532178.531033:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.531037:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.531041:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.531049:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5203
00000100:00100000:0.0:1651532178.531050:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468924480:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532178.531054:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.531058:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532178.531059:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.531061:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532178.531062:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.531068:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.531071:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.531072:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468924544
00000100:00100000:1.0:1651532178.531091:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6197
00000100:00100000:1.0:1651532178.531094:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468924544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.531100:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.531105:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415deb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea6e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.531116:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415deb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea6e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.531120:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415deb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea6e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.531126:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532178.531161:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468924544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (167us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.531164:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6197
00000001:00080000:0.0:1651532178.597326:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794264 is committed
00002000:00010000:1.0:1651532178.597357:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532177 -> 1651532178
00002000:00010000:1.0:1651532178.597368:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532177 -> 1651532178
00010000:00010000:1.0:1651532178.597371:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597375:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.597393:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000986e2009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468918784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449488us (449548us total) trans 158913794264 rc 0/0
00000100:00100000:1.0:1651532178.597396:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5194
00010000:00010000:1.0:1651532178.597404:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597407:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.597408:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597411:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597416:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.597417:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.597417:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597420:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597423:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.597424:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.597425:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597428:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597441:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597444:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415cc5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [667648->6356991] (req 667648->6356991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597452:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.597453:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597455:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.597457:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.597657:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.597662:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.597682:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd50bbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468920064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 349998us (350042us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651532178.597685:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5196
00010000:00010000:0.0:1651532178.597716:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.597720:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532178.597721:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.597724:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.597730:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.597733:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415cfd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3760128->10362879] (req 3760128->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.597904:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.597915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.597924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.597926:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468924800
00000100:00100000:0.0:1651532178.597933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.597940:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468924864
00000100:00100000:1.0:1651532178.597947:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5204
00000100:00100000:1.0:1651532178.597949:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d34441ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468924800:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532178.597959:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5205
00010000:00010000:1.0:1651532178.597961:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.597961:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087214ada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468924864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532178.597966:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.597967:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597970:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532178.597971:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597980:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.597983:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.597984:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.597988:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.597989:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532178.597990:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.597992:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468924992
00010000:00010000:0.0:1651532178.597993:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.598001:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468925120
00000100:00100000:1.0:1651532178.598006:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6198
00000100:00100000:1.0:1651532178.598008:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3487fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468924992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.598010:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532178.598010:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6199
00000100:00100000:0.0:1651532178.598012:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd4c4f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468925120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.598013:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e00 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea75 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.598021:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e00 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea75 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.598025:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e00 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea75 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598026:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.598028:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00010000:00010000:0.0:1651532178.598029:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415e07 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea7c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.598037:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415e07 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea7c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532178.598041:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3487fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468924992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.598044:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6198
00010000:00010000:0.0:1651532178.598048:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415e07 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea7c expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598051:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532178.598060:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.598060:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd4c4f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468925120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.598063:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6199
00000100:00100000:0.0:1651532178.598069:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468925184
00000100:00100000:0.0:1651532178.598079:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6200
00000100:00100000:0.0:1651532178.598081:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468925184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.598084:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.598087:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415e0e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea83 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.598093:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415e0e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea83 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532178.598094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.598100:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415e0e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea83 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598103:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532178.598109:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468925184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.598112:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6200
00000100:00100000:0.0:1651532178.598116:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468925248
00000100:00100000:0.0:1651532178.598119:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6201
00000100:00100000:0.0:1651532178.598121:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468925248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.598123:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.598125:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415e15 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea8a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.598130:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415e15 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea8a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598134:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415e15 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea8a expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598136:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532178.598146:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468925248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.598149:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6201
00000100:00100000:0.0:1651532178.598422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.598435:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.598441:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468925504
00000100:00100000:0.0:1651532178.598442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.598451:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468925568
00000100:00100000:1.0:1651532178.598453:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468925696
00000100:00100000:0.0:1651532178.598457:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6202
00000100:00100000:0.0:1651532178.598459:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468925504:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532178.598462:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6203
00010000:00010000:0.0:1651532178.598462:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532178.598463:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468925568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.598466:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e1c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea91 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.598467:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.598471:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e23 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea98 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.598473:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e1c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea91 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598477:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e1c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea91 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598480:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532178.598481:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e23 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea98 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.598485:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e23 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea98 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.598488:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:0.0:1651532178.598493:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468925504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.598495:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6202
00000100:00100000:0.0:1651532178.598500:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6204
00000100:00100000:1.0:1651532178.598502:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468925568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.598502:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e7181f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468925696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532178.598505:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6203
00010000:00010000:0.0:1651532178.598505:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.598507:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415e2a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ea9f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.598513:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415e2a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea9f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598517:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415e2a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ea9f expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598520:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532178.598525:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e7181f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468925696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.598527:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6204
00000100:00100000:0.0:1651532178.598841:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.598848:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468926016
00000100:00100000:0.0:1651532178.598861:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6205
00000100:00100000:0.0:1651532178.598863:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a43237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468926016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.598867:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.598870:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e31 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eaa6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.598878:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e31 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eaa6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598882:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e31 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eaa6 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.598885:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532178.598898:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a43237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468926016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.598903:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6205
00000001:00080000:0.0:1651532178.680626:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794265 is committed
00010000:00010000:1.0:1651532178.680659:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.680664:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.680685:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000068d100a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468920000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432974us (433032us total) trans 158913794265 rc 0/0
00000100:00100000:1.0:1651532178.680688:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5197
00010000:00010000:0.0:1651532178.680688:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.680692:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0479e85 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532178.680693:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.680697:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.680702:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.680703:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.680704:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.680707:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.680716:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.680719:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415d04 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2285568->2297855] (req 2285568->2297855) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.680732:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.680736:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.681020:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.681038:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.681051:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.681061:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.681063:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468926208
00000100:00100000:1.0:1651532178.681069:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468926272
00000100:00100000:0.0:1651532178.681077:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5206
00000100:00100000:0.0:1651532178.681079:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468926208:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532178.681089:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5207
00000100:00100000:1.0:1651532178.681091:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468926272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532178.681091:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.681096:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532178.681096:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532178.681097:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.681098:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.681100:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.681103:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532178.681104:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.681107:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.681110:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532178.681111:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.681115:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.681118:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.681119:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468926336
00010000:00010000:1.0:1651532178.681121:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.681127:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468926400
00000100:00100000:0.0:1651532178.681133:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6206
00000100:00100000:0.0:1651532178.681134:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468926336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.681137:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.681140:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415e46 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eaad expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.681142:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6207
00000100:00100000:1.0:1651532178.681144:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468926400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.681147:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.681147:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415e46 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eaad expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.681150:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e4d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eab4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.681151:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415e46 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eaad expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.681154:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532178.681157:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e4d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eab4 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.681161:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e4d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eab4 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532178.681167:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468926336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (116us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532178.681172:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532178.681172:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6206
00000100:00100000:1.0:1651532178.681181:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468926400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (120us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.681184:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6207
00000001:00080000:0.0:1651532178.797336:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794266 is committed
00010000:00010000:1.0:1651532178.797378:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797383:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.797402:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468920896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482767us (482830us total) trans 158913794266 rc 0/0
00000100:00100000:1.0:1651532178.797406:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5198
00010000:00010000:1.0:1651532178.797413:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797417:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.797418:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797421:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797426:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.797426:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.797427:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797430:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797433:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.797434:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.797434:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797437:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797450:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797453:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415d35 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->6262783] (req 2064384->6262783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797462:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797467:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797485:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797502:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797697:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797702:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797713:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797718:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.797721:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468920960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483060us (483114us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532178.797724:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5199
00010000:00010000:0.0:1651532178.797739:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.797740:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca46ea6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468922496:12345-10.240.43.64@tcp:3:fio.0 Request processed in 382780us (382836us total) trans 0 rc 40960/40960
00010000:00010000:0.0:1651532178.797742:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532178.797744:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5200
00010000:00010000:0.0:1651532178.797744:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797746:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797752:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797755:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f415d3c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->8839167] (req 671744->8839167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797768:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797771:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532178.797772:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797775:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797779:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.797780:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.797780:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797784:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.797791:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.797794:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797797:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f415d89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [106496->9981951] (req 106496->9981951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797815:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.797819:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.797821:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468926656
00000100:00100000:0.0:1651532178.797829:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6208
00000100:00100000:0.0:1651532178.797831:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468926656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.797834:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.797837:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415e54 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eabb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.797845:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415e54 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eabb expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.797849:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f415e54 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eabb expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.797852:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532178.797860:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468926656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.797863:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6208
00000100:00100000:1.0:1651532178.798138:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.798157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.798168:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.798168:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468926784
00000100:00100000:0.0:1651532178.798186:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468926720
00000100:00100000:0.0:1651532178.798194:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5208
00000100:00100000:0.0:1651532178.798196:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468926784:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532178.798199:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.798207:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798212:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532178.798213:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.798213:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798221:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.798224:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5209
00000100:00100000:1.0:1651532178.798226:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468926720:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532178.798228:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468926848
00000100:00100000:0.0:1651532178.798233:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468926976
00010000:00010000:1.0:1651532178.798235:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.798236:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468927104
00000100:00100000:0.0:1651532178.798238:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6209
00010000:00010000:1.0:1651532178.798239:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532178.798240:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.798240:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468926848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.798242:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.798243:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532178.798244:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798245:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415e69 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eac2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.798248:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798251:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415e69 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eac2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.798252:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798255:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f415e69 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eac2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798275:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532178.798285:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468926848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.798288:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6209
00000100:00100000:0.0:1651532178.798292:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6210
00000100:00100000:0.0:1651532178.798294:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468926976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.798297:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.798300:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415e70 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eac9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798308:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415e70 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eac9 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798312:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f415e70 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eac9 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798315:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532178.798320:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468926976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (121us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.798322:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6210
00000100:00100000:0.0:1651532178.798326:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6211
00000100:00100000:0.0:1651532178.798327:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468927104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.798330:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.798331:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415e77 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ead0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798336:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415e77 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ead0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532178.798337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.798340:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f415e77 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ead0 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798343:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532178.798348:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468927104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (134us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.798350:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6211
00000100:00100000:0.0:1651532178.798354:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468927232
00000100:00100000:0.0:1651532178.798357:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6212
00000100:00100000:0.0:1651532178.798371:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468927232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.798373:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.798376:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415e7e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ead7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798382:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415e7e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ead7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798385:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f415e7e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ead7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798389:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532178.798399:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468927232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.798401:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6212
00000100:00100000:1.0:1651532178.798682:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.798694:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468927424
00000100:00100000:0.0:1651532178.798717:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6213
00000100:00100000:0.0:1651532178.798719:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468927424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.798722:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.798726:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415e85 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eade expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798733:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415e85 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eade expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798737:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f415e85 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eade expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798740:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532178.798741:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.798760:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468927424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.798762:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6213
00000100:00100000:0.0:1651532178.798768:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468927680
00000100:00100000:0.0:1651532178.798773:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6214
00000100:00100000:0.0:1651532178.798774:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468927680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.798777:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.798780:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415e8c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eae5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798786:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415e8c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eae5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798790:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f415e8c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eae5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798793:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532178.798819:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468927680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.798821:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6214
00000100:00100000:1.0:1651532178.798952:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.798962:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468927808
00000100:00100000:0.0:1651532178.798969:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6215
00000100:00100000:0.0:1651532178.798971:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468927808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.798974:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.798977:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415e93 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eaec expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.798984:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415e93 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eaec expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798988:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415e93 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eaec expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.798991:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00000100:00100000:0.0:1651532178.799004:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468927808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.799006:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6215
00000100:00100000:1.0:1651532178.799109:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.799119:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468927936
00000100:00100000:0.0:1651532178.799125:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6216
00000100:00100000:0.0:1651532178.799127:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468927936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.799130:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.799133:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415e9a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eaf3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.799139:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415e9a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eaf3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.799146:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415e9a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eaf3 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.799149:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001aae7bfe, rc 0)
00000100:00100000:0.0:1651532178.799162:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468927936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.799165:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6216
00000100:00100000:1.0:1651532178.799357:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.799375:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468928192
00000100:00100000:0.0:1651532178.799382:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6217
00000100:00100000:0.0:1651532178.799384:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468928192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.799387:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.799390:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415ea1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eafa expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.799397:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415ea1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eafa expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.799401:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415ea1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eafa expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.799404:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5e80ae9, rc 0)
00000100:00100000:0.0:1651532178.799417:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468928192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.799420:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6217
00000001:00080000:0.0:1651532178.916556:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794267 is committed
00010000:00010000:1.0:1651532178.916588:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.916593:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.916612:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468922432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 501646us (501689us total) trans 158913794267 rc 0/0
00000100:00100000:1.0:1651532178.916615:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5201
00010000:00010000:1.0:1651532178.916622:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.916626:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.916627:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.916630:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.916635:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.916636:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.916636:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.916639:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.916651:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.916655:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415d90 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [909312->10366975] (req 909312->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.916664:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.916669:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.917041:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.917054:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.917061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.917071:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.917081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.917088:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468928512
00000100:00100000:1.0:1651532178.917090:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468928384
00000100:00100000:0.0:1651532178.917097:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468928576
00000100:00100000:0.0:1651532178.917099:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468928704
00000100:00100000:1.0:1651532178.917113:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468928320
00000100:00100000:1.0:1651532178.917122:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5210
00000100:00100000:0.0:1651532178.917123:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6218
00000100:00100000:1.0:1651532178.917124:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008949cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468928384:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532178.917125:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468928512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.917129:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.917131:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.917133:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415eaf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb01 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.917136:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532178.917137:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.917140:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532178.917140:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.917146:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.917146:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415eaf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb01 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.917149:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.917150:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415eaf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb01 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.917154:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5e80ae9, rc 0)
00000100:00100000:1.0:1651532178.917157:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5211
00000100:00100000:1.0:1651532178.917158:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f9bc190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468928320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532178.917163:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.917167:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468928512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.917170:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6218
00010000:00010000:1.0:1651532178.917173:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532178.917174:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.917175:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6219
00000100:00100000:0.0:1651532178.917176:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468928576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.917177:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.917179:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532178.917179:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.917180:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.917181:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415ebd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb08 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.917183:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.917187:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.917187:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415ebd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb08 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.917190:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.917191:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415ebd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb08 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.917194:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001aae7bfe, rc 0)
00000100:00100000:0.0:1651532178.917199:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468928576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.917201:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6219
00000100:00100000:0.0:1651532178.917205:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6220
00000100:00100000:0.0:1651532178.917206:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468928704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.917208:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.917210:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415ec4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb0f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.917215:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415ec4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb0f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.917218:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415ec4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb0f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.917224:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00000100:00100000:0.0:1651532178.917234:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468928704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (153us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.917236:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6220
00000001:00080000:0.0:1651532178.983282:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794268 is committed
00010000:00010000:0.0:1651532178.983297:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983301:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.983322:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468924416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 452306us (452388us total) trans 158913794268 rc 0/0
00000100:00100000:0.0:1651532178.983326:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5202
00010000:00010000:0.0:1651532178.983333:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983336:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532178.983338:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983340:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983345:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.983346:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.983347:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983350:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983357:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983370:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f415ddd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->9261055] (req 299008->9261055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983379:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983384:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.983672:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.983690:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468929088
00010000:00010000:1.0:1651532178.983694:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.983702:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6221
00010000:00010000:1.0:1651532178.983704:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.983704:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468929088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.983707:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.983716:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415ecb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb16 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.983723:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a68ff009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468924480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 452672us (452741us total) trans 0 rc 53248/53248
00000100:00100000:1.0:1651532178.983727:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5203
00010000:00010000:0.0:1651532178.983737:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.983740:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415ecb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb16 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.983745:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f415ecb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb16 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532178.983748:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.983748:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00000100:00100000:0.0:1651532178.983756:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468929088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.983759:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6221
00000100:00100000:0.0:1651532178.983764:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468929152
00000100:00100000:0.0:1651532178.983771:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6222
00000100:00100000:0.0:1651532178.983772:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ee985a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468929152:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532178.983773:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.983775:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.983777:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415ed2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb1d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983783:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532178.983784:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415ed2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb1d expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.983788:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415ed2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb1d expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.983791:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001aae7bfe, rc 0)
00000100:00100000:0.0:1651532178.983797:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ee985a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468929152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.983799:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6222
00000100:00100000:0.0:1651532178.983840:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468929216
00000100:00100000:0.0:1651532178.983845:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6223
00000100:00100000:0.0:1651532178.983847:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468929216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.983850:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.983853:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415ed9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb24 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983860:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.983861:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983862:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415ed9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb24 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.983866:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532178.983866:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415ed9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb24 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.983867:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983869:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5e80ae9, rc 0)
00010000:00010000:1.0:1651532178.983870:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983876:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.983876:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.983877:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.983881:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468929216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (108us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532178.983886:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983889:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.983890:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.983891:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983894:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983896:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.983897:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532178.983897:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.983899:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6223
00010000:00010000:1.0:1651532178.983900:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983911:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983914:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f415de4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [823296->10387455] (req 823296->10387455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983920:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983924:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983950:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983953:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.983953:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983957:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983971:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.983974:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.983989:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087214ada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468924864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 386028us (386074us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532178.983993:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5205
00010000:00010000:1.0:1651532178.983999:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.984003:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532178.984004:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.984007:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.984011:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.984014:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f415df9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.984056:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.984088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.984107:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468929408
00000100:00100000:0.0:1651532178.984114:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6224
00000100:00100000:0.0:1651532178.984116:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468929408:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532178.984120:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532178.984120:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532178.984128:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468929344
00010000:00010000:0.0:1651532178.984137:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415ee0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb2b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.984142:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468929280
00000100:00100000:1.0:1651532178.984150:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5212
00000100:00100000:1.0:1651532178.984152:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468929344:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532178.984155:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415ee0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb2b expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.984159:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415ee0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb2b expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.984160:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.984162:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000413f87ac, rc 0)
00010000:00010000:1.0:1651532178.984165:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532178.984166:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.984168:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532178.984169:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.984176:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468929408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.984178:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6224
00010000:00010000:1.0:1651532178.984179:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.984183:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.984187:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5213
00000100:00100000:0.0:1651532178.984189:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468929280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532178.984195:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.984199:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532178.984200:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.984203:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532178.984204:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.984211:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.984248:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.984320:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.984329:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.984337:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.984345:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468929536
00000100:00100000:1.0:1651532178.984351:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468929664
00000100:00100000:1.0:1651532178.984354:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468929792
00000100:00100000:1.0:1651532178.984357:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6225
00000100:00100000:1.0:1651532178.984370:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468929536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.984376:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.984381:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415ef5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb32 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.984397:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415ef5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb32 expref: 23 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532178.984405:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6226
00000100:00100000:0.0:1651532178.984407:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754468929664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.984411:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.984415:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415ef5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb32 expref: 23 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.984419:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00010000:00010000:0.0:1651532178.984424:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415efc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb39 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532178.984431:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754468929536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 72us (112us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532178.984433:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415efc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb39 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532178.984434:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6225
00010000:00010000:0.0:1651532178.984437:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415efc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb39 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.984440:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00000100:00100000:1.0:1651532178.984441:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6227
00000100:00100000:1.0:1651532178.984444:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468929792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.984449:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.984453:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415f03 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb40 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.984460:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415f03 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb40 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.984464:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415f03 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb40 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.984467:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:0.0:1651532178.984473:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468929664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (144us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.984476:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6226
00000100:00100000:1.0:1651532178.984495:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468929792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (158us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.984499:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6227
00000100:00100000:1.0:1651532178.984516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.984552:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468929984
00000100:00100000:1.0:1651532178.984563:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6228
00000100:00100000:1.0:1651532178.984564:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468929984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.984568:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.984571:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f0a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb47 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.984579:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f0a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb47 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.984583:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f0a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb47 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.984586:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532178.984595:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468929984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.984598:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6228
00000100:00100000:1.0:1651532178.984839:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.984847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532178.984859:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468930176
00000100:00100000:0.0:1651532178.984864:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468930240
00000100:00100000:1.0:1651532178.984869:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6229
00000100:00100000:1.0:1651532178.984871:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468930176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532178.984874:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.984878:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f11 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb4e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532178.984878:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6230
00000100:00100000:0.0:1651532178.984879:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754468930240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.984883:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532178.984886:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f11 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb4e expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.984886:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f415f18 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb55 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532178.984890:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f11 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb4e expref: 23 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532178.984893:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00010000:00010000:0.0:1651532178.984894:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f415f18 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb55 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.984898:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f415f18 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb55 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532178.984902:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754468930176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532178.984905:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6229
00010000:00010000:0.0:1651532178.984918:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036ef374e, rc 0)
00000100:00100000:0.0:1651532178.984927:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468930240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.984930:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6230
00000100:00100000:1.0:1651532178.984950:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.984970:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468930432
00000100:00100000:0.0:1651532178.984977:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6231
00000100:00100000:0.0:1651532178.984978:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468930432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.984982:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.984985:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f1f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb5c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.984992:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f1f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb5c expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.984995:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f1f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb5c expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.985001:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e1e35d6a, rc 0)
00000100:00100000:0.0:1651532178.985014:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468930432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.985017:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6231
00000100:00100000:1.0:1651532178.985179:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.985190:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468930688
00000100:00100000:0.0:1651532178.985197:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6232
00000100:00100000:0.0:1651532178.985199:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468930688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.985202:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.985205:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415f26 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb63 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.985212:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415f26 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb63 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.985216:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415f26 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb63 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.985219:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000601104c8, rc 0)
00000100:00100000:0.0:1651532178.985233:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468930688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.985235:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6232
00000100:00100000:1.0:1651532178.985469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.985480:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468931008
00000100:00100000:0.0:1651532178.985487:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6233
00000100:00100000:0.0:1651532178.985489:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468931008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.985493:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.985497:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415f2d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb6a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.985504:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415f2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb6a expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.985508:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415f2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb6a expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.985511:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002ac5e3f4, rc 0)
00000100:00100000:0.0:1651532178.985524:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468931008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.985526:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6233
00000100:00100000:1.0:1651532178.985738:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.985749:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468931136
00000100:00100000:0.0:1651532178.985756:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6234
00000100:00100000:0.0:1651532178.985758:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468931136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.985761:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.985764:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415f34 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb71 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.985771:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415f34 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb71 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.985775:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415f34 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb71 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.985781:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ffdbbad6, rc 0)
00000100:00100000:0.0:1651532178.985794:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468931136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.985796:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6234
00000100:00100000:1.0:1651532178.986023:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532178.986032:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468931264
00000100:00100000:0.0:1651532178.986040:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6235
00000100:00100000:0.0:1651532178.986041:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001fd7cd0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468931264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532178.986044:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532178.986048:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f3b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb78 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532178.986054:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f3b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb78 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.986058:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f3b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb78 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532178.986062:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9816573, rc 0)
00000100:00100000:0.0:1651532178.986075:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001fd7cd0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468931264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532178.986077:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6235
00000001:00080000:0.0:1651532179.116576:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794270 is committed
00010000:00010000:0.0:1651532179.116593:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.116600:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.116622:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d34441ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468924800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 518672us (518718us total) trans 158913794269 rc 0/0
00000100:00100000:0.0:1651532179.116625:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5204
00010000:00010000:0.0:1651532179.116633:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.116636:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005aeb1805 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532179.116638:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.116640:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.116646:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.116649:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f415df2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2928640->3215359] (req 2928640->3215359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.116660:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.116663:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.116680:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.116684:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c3636b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468926208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 435604us (435665us total) trans 158913794270 rc 0/0
00000100:00100000:0.0:1651532179.116687:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5206
00010000:00010000:1.0:1651532179.116690:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.116691:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.116695:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.116703:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.116704:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.116705:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.116708:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.116711:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.116712:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.116712:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.116715:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.116732:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.116735:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f415e38 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4050944->9293823] (req 4050944->9293823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.116739:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.116741:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.116744:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.116744:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.117028:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.117039:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.117046:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.117055:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.117073:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468931520
00010000:00010000:1.0:1651532179.117081:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117091:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.117100:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468931456
00000100:00100000:0.0:1651532179.117109:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5214
00000100:00100000:0.0:1651532179.117111:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3487fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468931520:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532179.117121:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665302f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468926272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 436028us (436082us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532179.117124:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5207
00010000:00010000:0.0:1651532179.117124:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117128:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.117130:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.117131:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5215
00000100:00100000:1.0:1651532179.117133:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd4c4f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468931456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532179.117133:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532179.117133:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117140:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117140:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117144:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532179.117145:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117148:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532179.117149:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117152:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117153:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117156:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117164:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117164:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117167:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117172:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ea1eb9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.117173:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117176:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117180:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.117181:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532179.117181:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059b27d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468926784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 318985us (319044us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532179.117182:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117184:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.117184:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5208
00010000:00010000:1.0:1651532179.117191:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117191:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117194:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f415e3f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [102400->8052735] (req 102400->8052735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117194:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532179.117195:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117198:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117200:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117203:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117203:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117208:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f415e5b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4329472->4661247] (req 4329472->4661247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.117216:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468931584
00000100:00100000:0.0:1651532179.117222:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468931648
00000100:00100000:0.0:1651532179.117230:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6236
00000100:00100000:0.0:1651532179.117231:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468931584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.117234:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.117237:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415f50 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb7f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117244:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415f50 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb7f expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.117248:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415f50 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb7f expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.117251:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ffdbbad6, rc 0)
00000100:00100000:0.0:1651532179.117258:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468931584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (212us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.117261:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6236
00000100:00100000:0.0:1651532179.117264:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6237
00000100:00100000:0.0:1651532179.117266:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468931648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.117268:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.117270:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415f57 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb86 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117275:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415f57 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb86 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.117279:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415f57 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb86 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.117282:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002ac5e3f4, rc 0)
00000100:00100000:1.0:1651532179.117285:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.117286:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468931648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (231us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.117289:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6237
00000100:00100000:0.0:1651532179.117292:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468931712
00000100:00100000:0.0:1651532179.117296:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6238
00000100:00100000:0.0:1651532179.117297:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468931712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.117299:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.117301:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415f5e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb8d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117307:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415f5e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb8d expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.117310:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415f5e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb8d expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.117313:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000601104c8, rc 0)
00000100:00100000:0.0:1651532179.117318:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468931712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (34us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.117320:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6238
00000100:00100000:1.0:1651532179.117723:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.117741:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.117751:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.117754:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468931968
00000100:00100000:1.0:1651532179.117758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.117768:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.117770:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468931840
00000100:00100000:1.0:1651532179.117778:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5216
00000100:00100000:1.0:1651532179.117780:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d8cd4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468931968:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532179.117786:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5217
00000100:00100000:0.0:1651532179.117788:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e7181f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468931840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532179.117794:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117795:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f6c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117799:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.117800:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117813:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532179.117814:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117818:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.117819:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.117820:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10252288->10256383] (req 10252288->10256383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117825:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10252288->10256383] (req 10252288->10256383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117825:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117829:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117837:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f6c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10252288->10256383] (req 10252288->10256383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.117837:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468932032
00010000:00010000:1.0:1651532179.117841:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f6c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10252288->10256383] (req 10252288->10256383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.117843:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468932224
00000100:00100000:0.0:1651532179.117845:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468932352
00000100:00100000:0.0:1651532179.117848:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6239
00000100:00100000:0.0:1651532179.117849:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468932032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.117852:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.117855:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f415f73 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb94 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.117860:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d8cd4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468931968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 79us (137us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532179.117863:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5216
00010000:00010000:0.0:1651532179.117868:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f415f73 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb94 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.117871:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f415f73 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb94 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.117872:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f6c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [10252288->10256383] (req 10252288->10256383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117875:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036ef374e, rc 0)
00010000:00010000:1.0:1651532179.117878:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.117879:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f6c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10252288->10256383] (req 10252288->10256383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.117882:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f6c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10252288->10256383] (req 10252288->10256383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.117888:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468932032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.117891:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6239
00010000:00010000:1.0:1651532179.117895:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f6c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10252288->10256383] (req 10252288->10256383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.117896:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6240
00010000:00010000:1.0:1651532179.117898:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415f6c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [10252288->10256383] (req 10252288->10256383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.117898:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468932224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.117900:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.117903:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415f7a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eb9b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.117905:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6241
00000100:00100000:1.0:1651532179.117907:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085347479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468932352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.117908:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415f7a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb9b expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.117910:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.117912:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415f7a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eb9b expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.117913:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415f81 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eba2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.117918:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00010000:00010000:1.0:1651532179.117920:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415f81 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eba2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532179.117923:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468932224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (166us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532179.117925:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415f81 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eba2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532179.117926:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6240
00010000:00010000:1.0:1651532179.117928:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532179.117936:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085347479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468932352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (167us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.117938:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6241
00000100:00100000:0.0:1651532179.118211:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.118222:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.118228:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.118248:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468932416
00000100:00100000:1.0:1651532179.118265:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468932480
00000100:00100000:0.0:1651532179.118269:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5218
00000100:00100000:0.0:1651532179.118271:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a43237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468932416:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532179.118276:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5219
00000100:00100000:1.0:1651532179.118278:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468932480:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532179.118279:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.118283:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532179.118284:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.118286:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.118287:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532179.118287:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.118292:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.118293:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.118297:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532179.118297:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.118314:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.118316:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.118318:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.118321:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.118331:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468932608
00000100:00100000:1.0:1651532179.118341:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6242
00000100:00100000:1.0:1651532179.118343:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468932608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.118346:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.118350:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415f96 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eba9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.118358:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415f96 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eba9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.118371:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415f96 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eba9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.118375:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532179.118390:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468932608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (161us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.118393:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6242
00000100:00100000:0.0:1651532179.118401:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.118444:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468932800
00000100:00100000:1.0:1651532179.118454:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6243
00000100:00100000:1.0:1651532179.118456:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468932800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.118460:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.118463:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415f9d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebb0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.118470:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415f9d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebb0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.118474:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415f9d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebb0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.118478:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9f5225e, rc 0)
00000100:00100000:1.0:1651532179.118490:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468932800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.118493:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6243
00000100:00100000:1.0:1651532179.118697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.118705:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468932992
00000100:00100000:1.0:1651532179.118716:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6244
00000100:00100000:1.0:1651532179.118717:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f92ef7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468932992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.118721:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.118724:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415fa4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebb7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.118732:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415fa4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebb7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.118736:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415fa4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebb7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.118739:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532179.118750:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f92ef7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468932992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.118753:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6244
00000001:00080000:0.0:1651532179.258929:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794271 is committed
00010000:00010000:1.0:1651532179.258962:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.258969:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.258992:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a39c0ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468926720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 460764us (460834us total) trans 158913794271 rc 0/0
00000100:00100000:1.0:1651532179.258996:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5209
00010000:00010000:1.0:1651532179.259003:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259007:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c4fc519 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.259008:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259012:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259017:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.259017:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.259018:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259021:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259028:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259031:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f415e62 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2916352->2920447] (req 2916352->2920447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259039:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259042:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259254:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259258:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.259275:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.259280:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008949cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468928384:12345-10.240.43.64@tcp:3:fio.0 Request processed in 342155us (342250us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532179.259283:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5210
00010000:00010000:0.0:1651532179.259284:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532179.259286:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.259289:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.259295:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.259295:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.259296:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.259299:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.259309:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259312:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.259312:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f415ea8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1449984->9445375] (req 1449984->9445375) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259316:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.259393:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.259403:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468933312
00000100:00100000:1.0:1651532179.259416:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6245
00000100:00100000:1.0:1651532179.259418:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468933312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.259422:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.259426:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415fab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebbe expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259435:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415fab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebbe expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.259439:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f415fab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebbe expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.259443:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532179.259453:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468933312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.259456:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6245
00000100:00100000:0.0:1651532179.259690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.259702:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468933376
00000100:00100000:0.0:1651532179.259708:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.259718:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.259725:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468933440
00000100:00100000:1.0:1651532179.259733:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5220
00000100:00100000:1.0:1651532179.259734:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468933376:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532179.259735:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5221
00000100:00100000:0.0:1651532179.259737:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468933440:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532179.259742:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259746:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532179.259746:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259748:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259750:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532179.259751:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.259756:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532179.259757:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.259760:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532179.259761:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259764:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.259765:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.259768:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259769:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.259777:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468933632
00000100:00100000:1.0:1651532179.259786:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6246
00000100:00100000:1.0:1651532179.259788:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468933632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.259791:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.259793:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415fc0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebc5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259801:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415fc0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebc5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.259818:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f415fc0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebc5 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.259822:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532179.259833:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468933632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.259836:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6246
00000100:00100000:0.0:1651532179.259888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.259897:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468933760
00000100:00100000:1.0:1651532179.259908:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6247
00000100:00100000:1.0:1651532179.259910:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468933760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.259913:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.259916:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415fc7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebcc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.259924:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415fc7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebcc expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.259928:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f415fc7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebcc expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.259931:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532179.259941:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468933760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.259943:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6247
00000100:00100000:0.0:1651532179.260097:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.260116:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468933952
00000100:00100000:1.0:1651532179.260127:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6248
00000100:00100000:1.0:1651532179.260129:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468933952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.260132:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.260135:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415fce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebd3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.260142:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415fce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebd3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.260146:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f415fce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebd3 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.260149:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532179.260159:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468933952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.260162:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6248
00000001:00080000:0.0:1651532179.391560:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794272 is committed
00010000:00010000:1.0:1651532179.391592:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391597:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.391619:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f9bc190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468928320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474460us (474564us total) trans 158913794272 rc 0/0
00000100:00100000:1.0:1651532179.391622:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5211
00010000:00010000:1.0:1651532179.391630:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391633:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.391634:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391637:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391642:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.391643:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.391644:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391647:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391667:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391671:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f415eb6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2375680->6762495] (req 2375680->6762495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391676:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391679:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391870:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391875:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.391890:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.391894:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468929344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 407741us (407838us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532179.391895:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532179.391896:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.391897:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5212
00010000:00010000:0.0:1651532179.391899:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.391905:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.391906:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.391906:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.391910:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.391917:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.391920:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f415ee7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->10391551] (req 2224128->10391551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391934:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.391939:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.391950:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.391966:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468934336
00000100:00100000:0.0:1651532179.391975:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6249
00000100:00100000:0.0:1651532179.391976:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468934336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.391980:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.391984:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f415fd5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebda expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392010:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f415fd5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebda expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.392018:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f415fd5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebda expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.392021:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036ef374e, rc 0)
00000100:00100000:0.0:1651532179.392035:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468934336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.392039:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6249
00000100:00100000:1.0:1651532179.392047:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.392076:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468934464
00000100:00100000:0.0:1651532179.392086:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6250
00000100:00100000:0.0:1651532179.392087:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468934464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.392091:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.392094:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415fdc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebe1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392101:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415fdc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebe1 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.392105:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f415fdc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebe1 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.392109:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000601104c8, rc 0)
00000100:00100000:0.0:1651532179.392154:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468934464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.392157:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6250
00000100:00100000:0.0:1651532179.392173:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.392209:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.392222:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468934592
00000100:00100000:0.0:1651532179.392234:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468934528
00000100:00100000:0.0:1651532179.392240:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5222
00000100:00100000:0.0:1651532179.392242:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468934592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532179.392248:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392253:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532179.392254:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532179.392254:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392258:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.392264:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5223
00000100:00100000:0.0:1651532179.392266:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468934528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532179.392272:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392275:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532179.392276:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392279:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392284:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532179.392285:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392289:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392292:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392295:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.392432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.392444:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468934912
00000100:00100000:0.0:1651532179.392454:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6251
00000100:00100000:0.0:1651532179.392456:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468934912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.392459:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.392462:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415ff1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebe8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392469:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415ff1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebe8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.392473:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f415ff1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebe8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.392479:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5e80ae9, rc 0)
00000100:00100000:0.0:1651532179.392490:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468934912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.392493:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6251
00000100:00100000:1.0:1651532179.392741:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.392752:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468935040
00000100:00100000:0.0:1651532179.392762:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6252
00000100:00100000:0.0:1651532179.392764:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468935040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.392767:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.392771:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415ff8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebef expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.392778:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415ff8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebef expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.392782:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415ff8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebef expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.392785:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001aae7bfe, rc 0)
00000100:00100000:0.0:1651532179.392795:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468935040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.392798:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6252
00000001:00080000:0.0:1651532179.508206:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794273 is committed
00010000:00010000:1.0:1651532179.508236:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508241:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.508258:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468929280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524069us (524138us total) trans 158913794273 rc 0/0
00000100:00100000:1.0:1651532179.508261:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5213
00010000:00010000:1.0:1651532179.508268:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508271:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.508272:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508275:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508280:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.508281:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.508282:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508287:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508299:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508302:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f415eee lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1138688->8749055] (req 1138688->8749055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.508312:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.508319:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.508626:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.508638:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.508643:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468935168
00000100:00100000:1.0:1651532179.508653:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468935232
00000100:00100000:0.0:1651532179.508657:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6253
00000100:00100000:0.0:1651532179.508659:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468935168:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532179.508664:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6254
00000100:00100000:1.0:1651532179.508666:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468935232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.508668:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.508670:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.508671:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415fff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebf6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508674:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416006 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ebfd expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.508677:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.508680:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415fff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebf6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.508681:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.508683:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416006 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebfd expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.508684:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f415fff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebf6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.508687:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001aae7bfe, rc 0)
00010000:00010000:1.0:1651532179.508688:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416006 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ebfd expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.508691:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a5d6617, rc 0)
00000100:00100000:0.0:1651532179.508698:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468935168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.508700:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468935232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.508701:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6253
00000100:00100000:1.0:1651532179.508702:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6254
00010000:00010000:0.0:1651532179.508713:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.508717:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508733:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.508736:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3487fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468931520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391624us (391709us total) trans 0 rc 61440/61440
00010000:00010000:1.0:1651532179.508737:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.508738:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.508739:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5214
00010000:00010000:1.0:1651532179.508741:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508745:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.508746:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.508747:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508750:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508757:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508760:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f415f42 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1462272->10022911] (req 1462272->10022911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508765:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.508771:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.509068:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.509077:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.509087:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.509095:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468935360
00000100:00100000:0.0:1651532179.509107:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468935424
00000100:00100000:0.0:1651532179.509114:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5224
00000100:00100000:0.0:1651532179.509116:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468935360:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532179.509122:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5225
00010000:00010000:0.0:1651532179.509123:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.509124:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468935424:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532179.509128:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532179.509129:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.509131:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532179.509132:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.509132:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.509137:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532179.509138:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532179.509138:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.509143:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.509143:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.509162:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.509178:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.509193:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.509227:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468935488
00000100:00100000:1.0:1651532179.509239:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468935552
00000100:00100000:0.0:1651532179.509242:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468935680
00000100:00100000:1.0:1651532179.509243:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6255
00000100:00100000:1.0:1651532179.509244:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468935488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.509248:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532179.509249:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6256
00000100:00100000:0.0:1651532179.509250:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468935552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.509251:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41601b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec04 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.509254:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.509257:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416022 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec0b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.509259:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41601b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec04 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.509264:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416022 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec0b expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509266:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f41601b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec04 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509270:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00010000:00010000:0.0:1651532179.509286:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416022 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec0b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532179.509292:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468935488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (205us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.509295:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6255
00010000:00010000:0.0:1651532179.509295:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000601104c8, rc 0)
00000100:00100000:1.0:1651532179.509300:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6257
00000100:00100000:1.0:1651532179.509301:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468935680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.509304:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532179.509304:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468935552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (127us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532179.509307:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f416029 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec12 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.509307:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6256
00010000:00010000:1.0:1651532179.509313:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f416029 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec12 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509317:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f416029 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec12 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509320:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532179.509326:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468935680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (133us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.509328:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6257
00000100:00100000:0.0:1651532179.509335:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.509412:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468935872
00000100:00100000:1.0:1651532179.509421:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6258
00000100:00100000:1.0:1651532179.509422:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468935872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.509425:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.509429:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f416030 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec19 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.509436:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f416030 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec19 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509439:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f416030 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec19 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509443:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532179.509456:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468935872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.509459:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6258
00000100:00100000:1.0:1651532179.509666:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.509673:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468936064
00000100:00100000:1.0:1651532179.509680:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6259
00000100:00100000:1.0:1651532179.509681:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468936064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.509684:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.509687:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f416037 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec20 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.509694:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f416037 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec20 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509701:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f416037 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec20 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509704:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532179.509713:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468936064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.509716:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6259
00000100:00100000:0.0:1651532179.509717:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.509732:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468936192
00000100:00100000:1.0:1651532179.509748:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6260
00000100:00100000:1.0:1651532179.509749:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468936192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.509752:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.509755:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41603e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec27 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.509761:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41603e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec27 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509765:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f41603e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec27 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509768:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532179.509780:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468936192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.509782:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6260
00000100:00100000:1.0:1651532179.509844:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.509851:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468936384
00000100:00100000:1.0:1651532179.509857:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6261
00000100:00100000:1.0:1651532179.509858:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468936384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.509861:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.509864:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f416045 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec2e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.509871:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f416045 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec2e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509875:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f416045 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec2e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.509879:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005fc71772, rc 0)
00000100:00100000:1.0:1651532179.509891:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468936384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.509894:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6261
00000100:00100000:1.0:1651532179.510123:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.510130:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468936640
00000100:00100000:1.0:1651532179.510136:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6262
00000100:00100000:1.0:1651532179.510138:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468936640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.510141:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.510144:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41604c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec35 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.510151:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41604c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec35 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.510155:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41604c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec35 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.510158:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532179.510171:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468936640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (48us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.510173:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6262
00000100:00100000:1.0:1651532179.510378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.510385:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468936832
00000100:00100000:1.0:1651532179.510391:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6263
00000100:00100000:1.0:1651532179.510392:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468936832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.510395:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.510398:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f416053 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec3c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.510405:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f416053 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec3c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.510409:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f416053 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec3c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.510412:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532179.510423:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468936832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (46us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.510428:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6263
00000100:00100000:1.0:1651532179.510644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.510651:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468936960
00000100:00100000:1.0:1651532179.510656:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6264
00000100:00100000:1.0:1651532179.510658:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468936960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.510661:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.510663:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41605a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec43 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.510670:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41605a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec43 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.510674:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41605a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec43 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.510677:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532179.510689:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468936960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (45us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.510691:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6264
00000001:00080000:0.0:1651532179.608217:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794274 is committed
00010000:00010000:1.0:1651532179.608246:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.608251:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.608271:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd4c4f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468931456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491137us (491231us total) trans 158913794274 rc 0/0
00010000:00010000:0.0:1651532179.608273:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.608275:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5215
00010000:00010000:0.0:1651532179.608278:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079a412a7 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532179.608280:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.608283:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.608289:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.608290:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.608291:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.608293:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.608301:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.608304:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f415f49 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1470464->10043391] (req 1470464->10043391) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.608307:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.608319:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.608641:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.608655:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.608661:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.608663:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468937216
00000100:00100000:0.0:1651532179.608674:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468937280
00000100:00100000:1.0:1651532179.608679:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6265
00000100:00100000:1.0:1651532179.608680:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468937216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.608684:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.608687:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f416061 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec4a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.608687:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468937408
00000100:00100000:0.0:1651532179.608690:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6266
00000100:00100000:0.0:1651532179.608692:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468937280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.608695:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f416061 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec4a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.608696:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.608699:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f416061 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec4a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.608700:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416068 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec51 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.608702:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00010000:00010000:0.0:1651532179.608708:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416068 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec51 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.608712:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416068 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec51 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532179.608713:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468937216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.608716:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6265
00010000:00010000:0.0:1651532179.608716:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000601104c8, rc 0)
00000100:00100000:1.0:1651532179.608721:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6267
00000100:00100000:1.0:1651532179.608722:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468937408:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532179.608724:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468937280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (70us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532179.608725:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.608727:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41606f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec58 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.608727:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6266
00010000:00010000:1.0:1651532179.608733:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41606f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec58 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.608736:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f41606f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec58 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.608739:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a079e72, rc 0)
00000100:00100000:1.0:1651532179.608745:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468937408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.608747:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6267
00000100:00100000:0.0:1651532179.609088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.609105:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468937664
00000100:00100000:1.0:1651532179.609118:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6268
00000100:00100000:1.0:1651532179.609120:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468937664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.609123:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.609126:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f416076 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec5f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.609134:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f416076 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec5f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.609137:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f416076 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec5f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.609144:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a395d59c, rc 0)
00000100:00100000:1.0:1651532179.609154:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468937664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.609156:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6268
00000001:00080000:0.0:1651532179.675166:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794275 is committed
00010000:00010000:1.0:1651532179.675194:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675198:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.675218:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e7181f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468931840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557429us (557477us total) trans 158913794275 rc 0/0
00000100:00100000:1.0:1651532179.675221:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5217
00010000:00010000:1.0:1651532179.675228:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675232:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.675233:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675236:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675241:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.675242:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.675242:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675246:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675252:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.675255:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.675259:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675263:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f415f65 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7151616->7155711] (req 7151616->7155711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.675533:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.675562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.675572:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.675579:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468937856
00000100:00100000:1.0:1651532179.675591:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468937920
00000100:00100000:1.0:1651532179.675600:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5226
00000100:00100000:1.0:1651532179.675601:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468937856:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532179.675607:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5227
00010000:00010000:1.0:1651532179.675608:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.675609:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468937920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532179.675613:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532179.675614:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675617:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.675618:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675619:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532179.675620:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.675627:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532179.675628:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.675634:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532179.675634:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675638:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.675639:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675641:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.675642:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.675645:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.675655:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468937984
00000100:00100000:0.0:1651532179.675663:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6269
00000100:00100000:0.0:1651532179.675665:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0c2aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468937984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.675668:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.675671:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41608b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec66 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.675678:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41608b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec66 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.675682:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41608b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec66 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.675686:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001aae7bfe, rc 0)
00000100:00100000:0.0:1651532179.675697:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0c2aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468937984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.675701:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6269
00000001:00080000:0.0:1651532179.766602:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794276 is committed
00010000:00010000:0.0:1651532179.766617:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766621:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.766642:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a43237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468932416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 648370us (648431us total) trans 158913794276 rc 0/0
00010000:00010000:1.0:1651532179.766645:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.766645:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5218
00010000:00010000:1.0:1651532179.766650:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.766651:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.766654:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.766659:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.766660:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.766660:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.766664:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.766674:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.766677:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f415f88 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [303104->10399743] (req 303104->10399743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766680:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766685:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766853:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766858:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.766872:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468932480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 648594us (648650us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532179.766875:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5219
00010000:00010000:0.0:1651532179.766882:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766885:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007e5f6d48 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532179.766887:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766889:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766894:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.766895:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.766896:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766899:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766911:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.766914:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f415f8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6742016->8089599] (req 6742016->8089599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.766918:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.766922:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.766960:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.766984:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468938176
00000100:00100000:0.0:1651532179.766992:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6270
00000100:00100000:0.0:1651532179.766994:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468938176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.766997:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.767001:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f416092 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec6d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.767009:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f416092 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec6d expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.767013:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f416092 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec6d expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.767017:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001aae7bfe, rc 0)
00000100:00100000:0.0:1651532179.767042:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468938176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.767066:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6270
00000100:00100000:0.0:1651532179.767168:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.767186:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.767193:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468938304
00000100:00100000:0.0:1651532179.767205:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468938368
00000100:00100000:0.0:1651532179.767212:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5228
00000100:00100000:0.0:1651532179.767213:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468938304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532179.767220:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.767223:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5229
00010000:00010000:0.0:1651532179.767225:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532179.767226:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468938368:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532179.767226:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.767229:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532179.767229:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.767235:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.767236:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.767239:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.767241:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532179.767241:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.767245:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.767245:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532179.899899:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794277 is committed
00010000:00010000:1.0:1651532179.899927:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.899934:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.899956:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fed9e90a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468933376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 640221us (640266us total) trans 158913794277 rc 0/0
00000100:00100000:1.0:1651532179.899960:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5220
00010000:00010000:1.0:1651532179.899967:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.899971:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.899972:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.899975:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.899980:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.899980:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.899981:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.899984:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.899987:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.899988:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.899988:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900003:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900015:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900018:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f415fb2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [430080->6889471] (req 430080->6889471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900023:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900027:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900028:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900031:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.900297:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532179.900322:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900333:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900336:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900341:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.900352:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468934592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508109us (508178us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532179.900356:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5222
00010000:00010000:1.0:1651532179.900372:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.900372:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008647acb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468933440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 640634us (640663us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532179.900375:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5221
00010000:00010000:1.0:1651532179.900378:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.900379:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900382:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900383:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900387:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900387:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532179.900389:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900390:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f415fe3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1548288->10412031] (req 1548288->10412031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900392:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900397:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.900398:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532179.900399:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.900401:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468938688
00010000:00010000:0.0:1651532179.900402:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.900411:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6271
00000100:00100000:1.0:1651532179.900413:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468938688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.900416:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900417:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.900420:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4160a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec74 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900420:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f415fb9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1351680->5545983] (req 1351680->5545983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900426:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900427:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4160a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec74 expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.900429:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900432:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f4160a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec74 expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.900438:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:1.0:1651532179.900445:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468938688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (149us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.900448:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6271
00000100:00100000:0.0:1651532179.900929:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.900940:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.900949:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468938944
00000100:00100000:0.0:1651532179.900950:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.900959:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.900965:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468938880
00000100:00100000:0.0:1651532179.900966:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.900975:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5230
00000100:00100000:1.0:1651532179.900977:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468938944:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532179.900981:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5231
00010000:00010000:1.0:1651532179.900983:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.900983:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468938880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532179.900988:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532179.900989:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532179.900990:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.900992:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.900993:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.901010:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532179.901011:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.901014:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.901017:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532179.901018:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.901022:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.901025:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468939008
00010000:00010000:0.0:1651532179.901025:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.901028:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.901033:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468939136
00000100:00100000:1.0:1651532179.901036:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468939264
00000100:00100000:1.0:1651532179.901038:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6272
00000100:00100000:1.0:1651532179.901040:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468939008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.901042:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532179.901042:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6273
00000100:00100000:0.0:1651532179.901044:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468939136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.901045:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4160bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec7b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.901049:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.901052:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4160bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec7b expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.901052:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec82 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.901056:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f4160bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec7b expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.901059:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec82 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.901060:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00010000:00010000:0.0:1651532179.901064:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec82 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.901067:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00000100:00100000:1.0:1651532179.901072:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468939008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.901075:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6272
00000100:00100000:1.0:1651532179.901080:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6274
00000100:00100000:1.0:1651532179.901082:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468939264:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532179.901082:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468939136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (123us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532179.901084:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532179.901085:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6273
00010000:00010000:1.0:1651532179.901086:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4160ca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec89 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.901093:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4160ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec89 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.901097:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f4160ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec89 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.901100:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532179.901102:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.901105:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468939264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.901108:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6274
00000100:00100000:1.0:1651532179.901112:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468939392
00000100:00100000:1.0:1651532179.901120:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6275
00000100:00100000:1.0:1651532179.901122:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468939392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.901124:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.901126:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4160d1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec90 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.901131:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4160d1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec90 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.901135:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f4160d1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec90 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.901147:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:1.0:1651532179.901158:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468939392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.901161:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6275
00000100:00100000:0.0:1651532179.901373:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.901391:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468939648
00000100:00100000:1.0:1651532179.901401:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6276
00000100:00100000:1.0:1651532179.901403:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468939648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.901406:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.901409:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4160d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec97 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.901416:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4160d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec97 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.901420:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4160d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec97 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.901423:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532179.901434:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468939648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.901437:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6276
00000100:00100000:0.0:1651532179.901459:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.901479:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468939776
00000100:00100000:1.0:1651532179.901493:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6277
00000100:00100000:1.0:1651532179.901495:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468939776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.901498:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.901501:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ec9e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.901507:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec9e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.901511:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ec9e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.901514:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000043b71480, rc 0)
00000100:00100000:1.0:1651532179.901525:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468939776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.901527:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6277
00000001:00080000:0.0:1651532179.983271:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794278 is committed
00002000:00010000:0.0:1651532179.983285:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532178 -> 1651532179
00002000:00010000:0.0:1651532179.983286:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532178 -> 1651532179
00010000:00010000:0.0:1651532179.983289:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.983293:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983315:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.983315:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000561933df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468934528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 591048us (591105us total) trans 158913794278 rc 0/0
00000100:00100000:0.0:1651532179.983318:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5223
00010000:00010000:1.0:1651532179.983320:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532179.983321:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983325:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983331:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.983331:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.983332:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983335:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983339:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.983339:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532179.983340:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983342:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983350:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.983357:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983369:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f415fea lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1474560->10149887] (req 1474560->10149887) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.983370:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983376:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983379:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.983700:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.983709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.983715:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.983730:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532179.983734:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983739:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.983758:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e44c6c91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468935424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474634us (474681us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532179.983762:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5225
00000100:00100000:1.0:1651532179.983768:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468940160
00000100:00100000:1.0:1651532179.983778:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468940032
00000100:00100000:1.0:1651532179.983783:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5232
00000100:00100000:1.0:1651532179.983785:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468940160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532179.983791:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983795:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532179.983796:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983799:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983816:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532179.983817:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 5/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983822:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983825:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.983827:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5233
00010000:00010000:1.0:1651532179.983828:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.983830:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468940032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532179.983835:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983838:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000363aea6e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532179.983838:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983839:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.983843:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532179.983844:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.983847:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532179.983847:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983858:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983864:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.983866:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983867:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f416014 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2854912->7979007] (req 2854912->7979007) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.983870:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532179.983875:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468940224
00000100:00100000:0.0:1651532179.983880:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468940288
00000100:00100000:1.0:1651532179.983885:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6278
00000100:00100000:1.0:1651532179.983886:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468940224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.983889:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.983892:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4160f4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eca5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532179.983894:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6279
00000100:00100000:0.0:1651532179.983896:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468940288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.983899:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4160f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eca5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.983899:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.983902:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4160fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ecac expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.983903:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f4160f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eca5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.983907:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00010000:00010000:0.0:1651532179.983910:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4160fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecac expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532179.983914:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468940224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (199us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532179.983915:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4160fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecac expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532179.983917:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6278
00010000:00010000:0.0:1651532179.983918:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00000100:00100000:0.0:1651532179.983927:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468940288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (197us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.983930:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6279
00000100:00100000:0.0:1651532179.983946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.983977:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468940480
00000100:00100000:0.0:1651532179.983988:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6280
00000100:00100000:0.0:1651532179.983990:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468940480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.983993:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532179.983996:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416102 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ecb3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.984007:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416102 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecb3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.984011:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416102 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecb3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.984014:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b80df6d8, rc 0)
00000100:00100000:0.0:1651532179.984023:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468940480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (78us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.984026:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6280
00000100:00100000:0.0:1651532179.984274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.984282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532179.984295:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468940736
00000100:00100000:1.0:1651532179.984299:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468940864
00000100:00100000:0.0:1651532179.984305:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6281
00000100:00100000:0.0:1651532179.984307:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468940736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.984310:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532179.984311:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6282
00000100:00100000:1.0:1651532179.984313:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468940864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532179.984314:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f416109 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ecba expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.984316:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.984319:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f416110 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ecc1 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532179.984321:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f416109 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecba expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.984325:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f416109 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecba expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.984327:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f416110 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecc1 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.984331:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f416110 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecc1 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532179.984331:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b7f071c, rc 0)
00010000:00010000:1.0:1651532179.984335:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00000100:00100000:0.0:1651532179.984341:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468940736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.984342:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468940864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532179.984344:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6281
00000100:00100000:1.0:1651532179.984345:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6282
00000100:00100000:0.0:1651532179.984584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532179.984601:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468940992
00000100:00100000:1.0:1651532179.984609:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6283
00000100:00100000:1.0:1651532179.984610:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468940992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532179.984614:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532179.984616:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f416117 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ecc8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532179.984623:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f416117 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecc8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.984627:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f416117 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecc8 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532179.984630:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532179.984644:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468940992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532179.984646:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6283
00000001:00080000:0.0:1651532180.074998:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794279 is committed
00010000:00010000:0.0:1651532180.075013:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075017:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.075033:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d45551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468935360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 565916us (565965us total) trans 158913794279 rc 0/0
00000100:00100000:0.0:1651532180.075037:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5224
00010000:00010000:0.0:1651532180.075043:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075047:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5e80ae9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532180.075048:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075051:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075055:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.075056:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.075057:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075060:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075073:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075076:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41600d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8192000->9379839] (req 8192000->9379839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.075085:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.075089:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.075353:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.075371:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.075379:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468941248
00000100:00100000:0.0:1651532180.075389:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468941184
00000100:00100000:0.0:1651532180.075394:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5234
00000100:00100000:0.0:1651532180.075396:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468941248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532180.075403:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075408:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532180.075409:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075437:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532180.075438:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075446:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075450:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.075458:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5235
00000100:00100000:0.0:1651532180.075460:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468941184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532180.075465:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075469:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532180.075470:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075472:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532180.075473:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075476:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.075479:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.075495:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.075509:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468941376
00000100:00100000:1.0:1651532180.075535:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6284
00000100:00100000:1.0:1651532180.075537:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468941376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.075541:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.075544:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41612c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eccf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.075552:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41612c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eccf expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.075556:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f41612c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eccf expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.075559:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:1.0:1651532180.075576:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468941376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.075579:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6284
00000001:00080000:0.0:1651532180.141690:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794280 is committed
00010000:00010000:1.0:1651532180.141719:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.141724:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.141746:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468937856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466143us (466213us total) trans 158913794280 rc 0/0
00000100:00100000:1.0:1651532180.141749:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5226
00010000:00010000:1.0:1651532180.141757:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.141760:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a395d59c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.141761:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.141764:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.141769:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.141769:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.141770:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.141773:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.141780:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.141782:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.141787:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.141791:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a395d59c/0xa29a79078f41607d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->10104831] (req 339968->10104831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.142146:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.142174:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468941504
00000100:00100000:0.0:1651532180.142181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.142190:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.142195:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468941632
00000100:00100000:1.0:1651532180.142198:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468941568
00000100:00100000:0.0:1651532180.142198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.142200:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468941696
00000100:00100000:1.0:1651532180.142203:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6285
00000100:00100000:1.0:1651532180.142205:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468941504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.142208:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.142212:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f416133 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ecd6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142214:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142218:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142221:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.142224:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f416133 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecd6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142235:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4fc519/0xa29a79078f416133 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecd6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532180.142237:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468937920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466627us (466690us total) trans 0 rc 73728/73728
00010000:00010000:1.0:1651532180.142238:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c4fc519, rc 0)
00000100:00100000:0.0:1651532180.142240:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5227
00000100:00100000:1.0:1651532180.142247:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468941504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.142249:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6286
00000100:00100000:0.0:1651532180.142250:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468941632:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532180.142251:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6285
00010000:00010000:0.0:1651532180.142254:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532180.142256:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6287
00000100:00100000:1.0:1651532180.142257:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468941568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.142257:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41613a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ece4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142260:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.142262:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f416141 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ecdd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142263:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.142266:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41613a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ece4 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142267:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.142269:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f416141 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecdd expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142273:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0479e85/0xa29a79078f416141 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecdd expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.142274:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41613a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ece4 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142276:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0479e85, rc 0)
00010000:00010000:0.0:1651532180.142277:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5e80ae9, rc 0)
00000100:00100000:1.0:1651532180.142280:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468941568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.142283:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6287
00000100:00100000:0.0:1651532180.142283:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468941632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (103us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.142286:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6286
00000100:00100000:1.0:1651532180.142288:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6288
00000100:00100000:1.0:1651532180.142289:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468941696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.142291:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.142293:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f416148 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eceb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142297:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.142298:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f416148 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eceb expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142302:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000730306b9/0xa29a79078f416148 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eceb expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142305:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000730306b9, rc 0)
00000100:00100000:1.0:1651532180.142310:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468941696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.142312:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6288
00010000:00010000:1.0:1651532180.142340:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142349:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.142350:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142353:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142358:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.142370:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.142371:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142375:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142378:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.142378:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.142379:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142382:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142385:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.142386:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.142386:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142389:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142400:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142403:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f416084 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [110592->10334207] (req 110592->10334207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142405:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142409:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142410:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142412:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142426:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142429:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.142448:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ed7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468938368:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375221us (375262us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532180.142451:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5229
00010000:00010000:1.0:1651532180.142471:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142474:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142478:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a079e72 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532180.142480:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142481:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142483:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142489:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142494:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a079e72/0xa29a79078f4160a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8015872->8019967] (req 8015872->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.142749:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.142780:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.142787:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.142797:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468941888
00000100:00100000:1.0:1651532180.142818:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468941824
00000100:00100000:1.0:1651532180.142821:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468942016
00000100:00100000:0.0:1651532180.142821:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.142830:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6289
00000100:00100000:1.0:1651532180.142832:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468941888:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532180.142832:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532180.142835:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.142838:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41614f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ecf9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142851:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41614f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecf9 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142855:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363aea6e/0xa29a79078f41614f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecf9 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142858:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000363aea6e, rc 0)
00000100:00100000:1.0:1651532180.142866:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468941888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.142869:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6289
00000100:00100000:1.0:1651532180.142874:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6290
00000100:00100000:1.0:1651532180.142876:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468941824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.142878:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.142880:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f416156 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ecf2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142886:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f416156 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecf2 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142889:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ea1eb9/0xa29a79078f416156 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ecf2 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142892:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ea1eb9, rc 0)
00000100:00100000:1.0:1651532180.142897:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468941824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (118us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.142899:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6290
00000100:00100000:1.0:1651532180.142902:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6291
00000100:00100000:1.0:1651532180.142904:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468942016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.142906:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.142908:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41615d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed00 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.142912:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468942144
00010000:00010000:1.0:1651532180.142914:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41615d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed00 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142917:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aeb1805/0xa29a79078f41615d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed00 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.142920:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005aeb1805, rc 0)
00000100:00100000:0.0:1651532180.142926:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468942080
00000100:00100000:1.0:1651532180.142932:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468942016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (145us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.142933:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5236
00000100:00100000:1.0:1651532180.142935:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6291
00000100:00100000:0.0:1651532180.142935:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468942144:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532180.142942:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5237
00010000:00010000:0.0:1651532180.142942:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.142944:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468942080:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532180.142946:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532180.142947:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142950:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532180.142951:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142955:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142962:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142967:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532180.142968:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142970:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532180.142971:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.142975:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142976:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142979:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142989:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.142992:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.142996:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.143005:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000610454df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468938944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 242028us (242098us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532180.143010:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5230
00010000:00010000:1.0:1651532180.143016:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.143019:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005fc71772 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.143020:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.143023:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.143029:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468942208
00000100:00100000:0.0:1651532180.143037:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6292
00000100:00100000:0.0:1651532180.143038:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468942208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.143042:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.143045:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416172 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed07 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.143049:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.143050:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.143055:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.143059:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.143065:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416172 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed07 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.143069:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.143072:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fc71772/0xa29a79078f4160ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2023424->2682879] (req 2023424->2682879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.143076:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416172 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed07 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.143080:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ffdbbad6, rc 0)
00010000:00010000:1.0:1651532180.143083:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.143086:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.143105:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468942208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.143108:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6292
00000100:00100000:0.0:1651532180.143448:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.143456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.143462:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.143471:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.143478:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468942336
00000100:00100000:0.0:1651532180.143486:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468942400
00000100:00100000:0.0:1651532180.143489:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468942656
00000100:00100000:0.0:1651532180.143492:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6293
00000100:00100000:0.0:1651532180.143494:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468942336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.143497:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.143501:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416179 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed0e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.143509:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416179 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed0e expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.143513:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416179 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed0e expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.143516:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002ac5e3f4, rc 0)
00000100:00100000:1.0:1651532180.143518:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468942528
00000100:00100000:1.0:1651532180.143529:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5238
00000100:00100000:1.0:1651532180.143531:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001fd7cd0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754468942528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532180.143538:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.143539:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754468942336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (78us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532180.143542:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532180.143543:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.143543:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6293
00010000:00010000:1.0:1651532180.143546:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532180.143547:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.143548:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6294
00000100:00100000:0.0:1651532180.143549:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468942400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.143551:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.143552:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.143554:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.143555:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416187 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed15 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.143561:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416187 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed15 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532180.143562:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6295
00000100:00100000:1.0:1651532180.143564:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754468942656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.143565:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416187 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed15 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.143566:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.143569:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41618e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed1c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.143571:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000413f87ac, rc 0)
00000100:00100000:0.0:1651532180.143577:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754468942400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (121us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532180.143578:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41618e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed1c expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532180.143580:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6294
00010000:00010000:1.0:1651532180.143582:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5f6d48/0xa29a79078f41618e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed1c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.143586:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e5f6d48, rc 0)
00000100:00100000:1.0:1651532180.143611:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468942656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (139us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.143613:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6295
00000100:00100000:0.0:1651532180.143613:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.143619:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468942784
00000100:00100000:1.0:1651532180.143630:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6296
00000100:00100000:1.0:1651532180.143631:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468942784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.143634:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.143637:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f416195 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed23 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.143644:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f416195 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed23 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.143656:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a412a7/0xa29a79078f416195 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed23 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.143659:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000079a412a7, rc 0)
00000100:00100000:1.0:1651532180.143674:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468942784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.143677:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6296
00000100:00100000:0.0:1651532180.144025:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.144035:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.144040:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468943040
00000100:00100000:0.0:1651532180.144042:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.144051:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468942976
00000100:00100000:1.0:1651532180.144053:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468943104
00000100:00100000:0.0:1651532180.144053:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.144056:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468943232
00000100:00100000:1.0:1651532180.144060:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6297
00000100:00100000:1.0:1651532180.144062:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438149:x1731754468943040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532180.144062:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6298
00000100:00100000:0.0:1651532180.144064:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085347479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754468942976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.144065:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.144068:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41619c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed31 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.144068:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.144071:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed2a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.144076:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41619c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed31 expref: 25 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.144079:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed2a expref: 25 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144080:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41619c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed31 expref: 25 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144083:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532180.144083:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed2a expref: 24 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.144086:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e1e35d6a, rc 0)
00000100:00100000:1.0:1651532180.144095:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438149:x1731754468943040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.144098:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6297
00000100:00100000:0.0:1651532180.144101:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085347479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754468942976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.144103:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6299
00000100:00100000:1.0:1651532180.144104:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f92ef7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754468943104:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532180.144105:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6298
00010000:00010000:1.0:1651532180.144107:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.144109:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4161aa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed38 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.144111:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6300
00000100:00100000:0.0:1651532180.144112:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468943232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.144115:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.144117:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4161b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed3f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.144118:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4161aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed38 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144122:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4161aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed38 expref: 23 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.144123:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4161b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed3f expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144125:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532180.144127:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4161b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed3f expref: 22 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532180.144130:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f92ef7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468943104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (89us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532180.144130:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9816573, rc 0)
00000100:00100000:1.0:1651532180.144133:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6299
00000100:00100000:0.0:1651532180.144136:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468943232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.144139:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6300
00000100:00100000:0.0:1651532180.144479:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.144487:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.144505:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468943424
00000100:00100000:0.0:1651532180.144509:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.144526:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468943488
00000100:00100000:0.0:1651532180.144529:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468943360
00000100:00100000:1.0:1651532180.144530:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6301
00000100:00100000:1.0:1651532180.144531:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754468943424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.144534:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532180.144535:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6302
00000100:00100000:0.0:1651532180.144536:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754468943488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.144537:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4161b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed4d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.144540:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.144543:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed54 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.144544:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4161b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed4d expref: 23 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144548:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4161b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed4d expref: 24 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144551:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532180.144551:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed54 expref: 24 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.144555:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed54 expref: 23 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.144558:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000e522113, rc 0)
00000100:00100000:1.0:1651532180.144565:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754468943424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.144568:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6301
00000100:00100000:1.0:1651532180.144573:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6303
00000100:00100000:0.0:1651532180.144573:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468943488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.144575:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754468943360:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532180.144576:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6302
00010000:00010000:1.0:1651532180.144577:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.144580:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4161c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed46 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.144586:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4161c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed46 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144590:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4161c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed46 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144593:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532180.144598:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468943360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.144600:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6303
00000100:00100000:0.0:1651532180.144822:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.144832:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468943680
00000100:00100000:1.0:1651532180.144840:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6304
00000100:00100000:1.0:1651532180.144842:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468943680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.144845:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.144848:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4161cd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed5b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.144857:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4161cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed5b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144861:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4161cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed5b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144864:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532180.144878:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468943680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.144880:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6304
00000100:00100000:0.0:1651532180.144902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.144923:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468943808
00000100:00100000:1.0:1651532180.144937:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6305
00000100:00100000:1.0:1651532180.144938:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468943808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.144941:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.144944:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161d4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed62 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.144951:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161d4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed62 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144955:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161d4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed62 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.144958:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532180.144970:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468943808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.144973:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6305
00000001:00080000:0.0:1651532180.318028:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794282 is committed
00010000:00010000:0.0:1651532180.318048:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.318053:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318059:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318068:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.318072:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b743e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468938304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 550858us (550904us total) trans 158913794281 rc 0/0
00000100:00100000:0.0:1651532180.318082:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5228
00000100:00100000:1.0:1651532180.318087:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006328a2a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468938880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 417103us (417146us total) trans 158913794282 rc 0/0
00010000:00010000:0.0:1651532180.318089:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.318090:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5231
00010000:00010000:0.0:1651532180.318092:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532180.318093:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318098:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.318099:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318101:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.318104:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.318105:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318107:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.318108:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416099 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->2023423] (req 856064->2023423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318112:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.318113:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.318114:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318117:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318126:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318129:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4160b5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2568192->10006527] (req 2568192->10006527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318134:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318137:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.318482:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.318501:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468944128
00000100:00100000:0.0:1651532180.318523:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.318524:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5239
00000100:00100000:1.0:1651532180.318526:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468944128:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532180.318537:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532180.318538:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318551:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532180.318552:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.318553:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532180.318555:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532180.318560:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.318563:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468944192
00010000:00010000:1.0:1651532180.318565:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318569:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.318574:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5240
00000100:00100000:0.0:1651532180.318575:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468944192:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532180.318579:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318582:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.318582:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.318586:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.318588:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.318591:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532180.318591:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.318596:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.318602:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e618c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468940160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 334816us (334902us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532180.318605:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5232
00010000:00010000:0.0:1651532180.318607:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318612:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318615:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043b71480 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.318616:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318619:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318624:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.318624:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.318625:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318630:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.318642:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468944448
00010000:00010000:1.0:1651532180.318647:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318650:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b71480/0xa29a79078f4160e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1757184->10158079] (req 1757184->10158079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.318654:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468944512
00000100:00100000:0.0:1651532180.318659:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6306
00000100:00100000:1.0:1651532180.318661:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6307
00000100:00100000:0.0:1651532180.318661:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468944448:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532180.318663:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468944512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.318664:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.318666:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.318667:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4161e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed69 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318669:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4161f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed70 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.318675:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4161e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed69 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.318676:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4161f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed70 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.318679:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4161e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed69 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.318680:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4161f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed70 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.318683:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9816573, rc 0)
00010000:00010000:1.0:1651532180.318684:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532180.318693:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468944512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (140us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.318693:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468944448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (156us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.318695:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6307
00000100:00100000:0.0:1651532180.318697:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6306
00010000:00010000:0.0:1651532180.318704:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.318707:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.318868:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.318877:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.318906:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468944704
00000100:00100000:1.0:1651532180.318922:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6308
00000100:00100000:1.0:1651532180.318923:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468944704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.318927:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.318930:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4161f7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed77 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.318937:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4161f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed77 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.318941:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4161f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed77 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.318944:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532180.318958:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468944704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.318961:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6308
00000100:00100000:0.0:1651532180.318985:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468944640
00000100:00100000:0.0:1651532180.318996:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5241
00000100:00100000:0.0:1651532180.318998:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468944640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532180.319005:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.319009:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532180.319010:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.319013:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532180.319014:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.319018:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.319022:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.319093:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.319103:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468945152
00000100:00100000:1.0:1651532180.319110:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6309
00000100:00100000:1.0:1651532180.319112:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468945152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.319115:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.319118:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416205 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed7e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.319125:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416205 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed7e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.319132:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416205 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed7e expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.319135:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532180.319148:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468945152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.319151:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6309
00000001:00080000:0.0:1651532180.424960:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794283 is committed
00010000:00010000:0.0:1651532180.424975:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.424982:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425004:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.425004:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a50c9f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468940032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 441173us (441294us total) trans 158913794283 rc 0/0
00000100:00100000:0.0:1651532180.425007:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5233
00010000:00010000:1.0:1651532180.425009:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a925ecb already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.425010:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425013:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425019:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.425020:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.425020:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425023:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425033:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425038:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4160ed lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2441216->9023487] (req 2441216->9023487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425040:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425044:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.425353:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.425383:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.425395:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.425407:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468945472
00000100:00100000:1.0:1651532180.425412:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468945600
00000100:00100000:0.0:1651532180.425419:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468945408
00000100:00100000:0.0:1651532180.425426:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5242
00000100:00100000:1.0:1651532180.425427:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6310
00000100:00100000:0.0:1651532180.425428:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8c71a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468945472:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532180.425429:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468945600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.425433:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.425435:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425436:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416213 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed85 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425439:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.425440:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425443:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532180.425444:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425448:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.425450:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425451:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416213 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed85 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.425454:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425455:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416213 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed85 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.425458:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532180.425461:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5243
00000100:00100000:0.0:1651532180.425462:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468945408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532180.425467:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.425471:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468945600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.425474:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6310
00010000:00010000:0.0:1651532180.425477:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532180.425478:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425481:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532180.425482:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425485:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425488:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425498:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425502:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425521:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.425522:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468941248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 350125us (350170us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532180.425525:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b7f071c already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532180.425525:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5234
00010000:00010000:1.0:1651532180.425527:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425530:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425535:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.425535:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.425536:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425539:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425549:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425552:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41611e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->9195519] (req 552960->9195519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425558:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425562:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.425908:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.425917:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468945856
00000100:00100000:0.0:1651532180.425919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.425929:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468946048
00000100:00100000:1.0:1651532180.425934:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6311
00000100:00100000:1.0:1651532180.425936:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070f9d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468945856:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532180.425938:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6312
00010000:00010000:1.0:1651532180.425939:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532180.425940:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006388808e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468946048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.425942:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416221 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed8c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.425944:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.425949:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416221 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed8c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.425949:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416228 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed93 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.425957:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416221 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed8c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.425957:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416228 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed93 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.425960:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532180.425961:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416228 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed93 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.425968:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000413f87ac, rc 0)
00000100:00100000:1.0:1651532180.425974:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070f9d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468945856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.425977:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6311
00000100:00100000:0.0:1651532180.425983:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006388808e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468946048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.425986:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6312
00000100:00100000:0.0:1651532180.426228:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.426235:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468946240
00000100:00100000:0.0:1651532180.426249:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6313
00000100:00100000:0.0:1651532180.426251:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468946240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.426254:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.426258:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41622f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ed9a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.426265:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41622f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed9a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.426269:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41622f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ed9a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.426272:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002ac5e3f4, rc 0)
00000100:00100000:0.0:1651532180.426282:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468946240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.426285:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6313
00000100:00100000:0.0:1651532180.426518:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.426525:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468946368
00000100:00100000:0.0:1651532180.426538:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6314
00000100:00100000:0.0:1651532180.426540:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468946368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.426544:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.426547:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416236 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eda1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.426554:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416236 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eda1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.426558:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416236 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eda1 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.426561:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ffdbbad6, rc 0)
00000100:00100000:0.0:1651532180.426570:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468946368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.426573:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6314
00000001:00080000:0.0:1651532180.541629:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794284 is committed
00010000:00010000:0.0:1651532180.541644:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541648:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.541664:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468941184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466204us (466303us total) trans 158913794284 rc 0/0
00000100:00100000:0.0:1651532180.541667:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5235
00010000:00010000:0.0:1651532180.541674:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541680:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532180.541681:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541684:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541689:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.541689:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.541690:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541693:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541700:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541703:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f416125 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1576960->8855551] (req 1576960->8855551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541708:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541710:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541887:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541892:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.541913:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ec8d520 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468942144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 398978us (399093us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532180.541914:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.541917:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5236
00010000:00010000:1.0:1651532180.541919:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.541920:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.541923:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.541928:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.541929:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.541929:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.541932:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.541940:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541946:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.541950:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.541953:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f416164 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [212992->10371071] (req 212992->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.542162:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.542169:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.542179:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.542187:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.542197:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468946624
00000100:00100000:0.0:1651532180.542197:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468946560
00000100:00100000:1.0:1651532180.542204:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468946688
00000100:00100000:0.0:1651532180.542207:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468946496
00000100:00100000:1.0:1651532180.542209:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6315
00000100:00100000:1.0:1651532180.542210:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468946624:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532180.542212:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5244
00010000:00010000:1.0:1651532180.542214:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532180.542214:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468946560:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532180.542217:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41623d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eda8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.542221:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.542224:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41623d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eda8 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.542226:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532180.542227:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.542232:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532180.542233:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.542236:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41623d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eda8 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.542237:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.542240:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532180.542241:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.542248:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5245
00000100:00100000:0.0:1651532180.542250:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000782e634b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468946496:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532180.542253:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468946624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.542256:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6315
00000100:00100000:1.0:1651532180.542261:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6316
00010000:00010000:0.0:1651532180.542261:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.542262:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aca61869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468946688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.542265:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.542265:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532180.542266:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.542267:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416252 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44edaf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.542268:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532180.542269:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.542273:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416252 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edaf expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.542273:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.542276:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.542278:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416252 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edaf expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.542281:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532180.542286:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aca61869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468946688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.542288:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6316
00000100:00100000:0.0:1651532180.542580:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.542598:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468947136
00000100:00100000:0.0:1651532180.542605:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.542606:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6317
00000100:00100000:1.0:1651532180.542620:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000208fa08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468947136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.542624:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.542627:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416259 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44edb6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.542634:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416259 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edb6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.542638:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416259 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edb6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.542641:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532180.542654:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000208fa08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468947136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.542657:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6317
00000100:00100000:1.0:1651532180.542662:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468947264
00000100:00100000:1.0:1651532180.542668:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6318
00000100:00100000:1.0:1651532180.542670:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000655dd3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468947264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.542672:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.542682:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416260 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44edbd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.542688:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416260 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edbd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.542692:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416260 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edbd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.542695:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532180.542706:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000655dd3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468947264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.542709:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6318
00000001:00080000:0.0:1651532180.658289:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794285 is committed
00002000:00010000:0.0:1651532180.658302:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532179 -> 1651532180
00002000:00010000:0.0:1651532180.658303:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532179 -> 1651532180
00010000:00010000:0.0:1651532180.658306:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658309:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.658331:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f77ae4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468942080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 515386us (515498us total) trans 158913794285 rc 0/0
00010000:00010000:1.0:1651532180.658332:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.658334:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5237
00010000:00010000:1.0:1651532180.658336:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9f5225e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.658337:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658340:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658346:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.658346:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.658347:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658350:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658358:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658368:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9f5225e/0xa29a79078f41616b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [389120->4919295] (req 389120->4919295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658375:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658379:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.658629:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.658639:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.658646:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.658657:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468947648
00000100:00100000:0.0:1651532180.658661:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468947520
00000100:00100000:1.0:1651532180.658665:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6319
00000100:00100000:1.0:1651532180.658666:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d672f724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468947648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.658670:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.658673:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416267 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44edc4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658678:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.658680:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416267 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edc4 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.658684:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416267 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edc4 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532180.658686:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468947584
00010000:00010000:1.0:1651532180.658690:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532180.658697:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5246
00000100:00100000:0.0:1651532180.658699:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef539604 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468947520:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532180.658709:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d672f724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468947648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.658712:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6319
00010000:00010000:0.0:1651532180.658712:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658717:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532180.658718:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.658720:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5247
00010000:00010000:0.0:1651532180.658720:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532180.658721:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.658722:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc4aa464 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468947584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532180.658725:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658728:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658729:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658732:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.658733:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658736:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532180.658736:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658740:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658744:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658749:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658752:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.658766:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001fd7cd0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468942528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 515235us (515304us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532180.658769:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5238
00010000:00010000:0.0:1651532180.658776:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658782:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a5d6617 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532180.658783:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658786:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.658791:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.658792:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658795:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658821:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.658825:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5d6617/0xa29a79078f416180 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3629056->10190847] (req 3629056->10190847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658828:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658835:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.658850:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.658874:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468947712
00000100:00100000:1.0:1651532180.658907:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6320
00000100:00100000:1.0:1651532180.658909:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037b6d1b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468947712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.658912:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.658915:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41627c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44edcb expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.658922:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41627c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edcb expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.658926:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41627c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edcb expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.658929:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532180.658945:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037b6d1b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468947712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (94us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.658947:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6320
00000100:00100000:0.0:1651532180.659158:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.659169:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468947840
00000100:00100000:1.0:1651532180.659177:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6321
00000100:00100000:1.0:1651532180.659179:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000157757ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468947840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.659182:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.659185:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416283 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44edd2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.659193:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416283 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edd2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.659197:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416283 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edd2 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.659200:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532180.659214:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000157757ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468947840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.659216:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6321
00000001:00080000:0.0:1651532180.750010:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794286 is committed
00010000:00010000:1.0:1651532180.750040:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750045:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.750066:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a36d5072 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468944128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 431539us (431585us total) trans 158913794286 rc 0/0
00000100:00100000:1.0:1651532180.750069:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5239
00010000:00010000:1.0:1651532180.750077:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750080:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.750081:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750087:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750092:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.750092:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.750093:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750096:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750115:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.750116:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750118:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4161db lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [114688->9232383] (req 114688->9232383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.750120:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.750524:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.750534:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.750535:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468948096
00000100:00100000:0.0:1651532180.750542:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.750552:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468948160
00000100:00100000:0.0:1651532180.750556:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.750567:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5248
00000100:00100000:1.0:1651532180.750569:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074833821 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468948096:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532180.750574:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532180.750581:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.750583:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532180.750590:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532180.750591:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.750593:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5249
00000100:00100000:0.0:1651532180.750595:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092ab9b2a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468948160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532180.750597:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532180.750597:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750602:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.750604:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750605:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.750608:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.750609:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.750612:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532180.750612:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.750617:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.750620:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468948288
00010000:00010000:0.0:1651532180.750620:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.750625:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468948480
00000100:00100000:1.0:1651532180.750627:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468948352
00000100:00100000:1.0:1651532180.750629:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468948544
00000100:00100000:1.0:1651532180.750632:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6322
00010000:00010000:0.0:1651532180.750632:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.750634:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003117edcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468948288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.750636:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.750638:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750639:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416298 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44edd9 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750644:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.750652:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416298 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edd9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.750657:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416298 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edd9 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532180.750657:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094f97a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468944192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 432081us (432134us total) trans 0 rc 61440/61440
00000100:00100000:0.0:1651532180.750660:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5240
00010000:00010000:1.0:1651532180.750663:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532180.750671:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003117edcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468948288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.750674:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6322
00000100:00100000:1.0:1651532180.750678:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6323
00000100:00100000:1.0:1651532180.750680:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468948480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.750683:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.750685:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41629f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ede7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750689:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532180.750699:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6324
00010000:00010000:1.0:1651532180.750700:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41629f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ede7 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532180.750701:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c57ad69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468948352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.750704:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.750705:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41629f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ede7 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.750708:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532180.750709:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4162a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ede0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.750714:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532180.750721:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468948480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (163us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.750724:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6323
00010000:00010000:0.0:1651532180.750726:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4162a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ede0 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532180.750728:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6325
00000100:00100000:1.0:1651532180.750730:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468948544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.750730:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4162a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ede0 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.750732:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.750734:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4162ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44edee expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.750734:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5e80ae9, rc 0)
00010000:00010000:1.0:1651532180.750739:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.750741:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4162ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edee expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532180.750742:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c57ad69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468948352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (168us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532180.750745:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4162ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edee expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532180.750745:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6324
00010000:00010000:1.0:1651532180.750748:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532180.750754:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468948544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (171us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.750756:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6325
00010000:00010000:1.0:1651532180.750763:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750766:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.750767:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750770:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750774:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.750775:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.750776:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750790:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750799:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.750813:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4161e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [671744->10416127] (req 671744->10416127) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.750816:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.750823:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.750960:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.750967:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468948672
00000100:00100000:0.0:1651532180.750995:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6326
00000100:00100000:0.0:1651532180.750997:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468948672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.751001:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.751005:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4162b4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44edf5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.751013:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4162b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edf5 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.751017:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4162b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edf5 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.751020:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00000100:00100000:0.0:1651532180.751030:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468948672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.751032:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6326
00000100:00100000:0.0:1651532180.751236:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.751244:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468948928
00000100:00100000:0.0:1651532180.751256:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6327
00000100:00100000:0.0:1651532180.751258:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468948928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.751263:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.751267:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4162bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee03 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.751274:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4162bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee03 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.751278:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4162bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee03 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.751281:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b7f071c, rc 0)
00000100:00100000:0.0:1651532180.751291:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468948928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.751294:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6327
00000100:00100000:0.0:1651532180.751335:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.751342:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.751351:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468948864
00000100:00100000:0.0:1651532180.751353:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468949056
00000100:00100000:1.0:1651532180.751369:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6328
00000100:00100000:1.0:1651532180.751370:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468948864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.751374:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532180.751376:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6329
00010000:00010000:1.0:1651532180.751377:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4162c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44edfc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.751378:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468949056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.751381:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.751384:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4162c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edfc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.751385:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4162c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee0a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.751388:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4162c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44edfc expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.751392:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532180.751393:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4162c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee0a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.751400:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4162c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee0a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532180.751404:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468948864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.751406:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6328
00010000:00010000:0.0:1651532180.751409:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00000100:00100000:0.0:1651532180.751417:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468949056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.751420:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6329
00000100:00100000:0.0:1651532180.751508:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.751515:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468949312
00000100:00100000:0.0:1651532180.751527:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6330
00000100:00100000:0.0:1651532180.751528:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468949312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.751532:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.751535:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4162d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee11 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.751542:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4162d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee11 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.751546:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4162d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee11 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.751550:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001aae7bfe, rc 0)
00000100:00100000:0.0:1651532180.751559:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468949312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.751563:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6330
00000100:00100000:0.0:1651532180.751833:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.751840:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468949440
00000100:00100000:0.0:1651532180.751853:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6331
00000100:00100000:0.0:1651532180.751854:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468949440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.751858:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.751861:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4162d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee18 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.751868:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4162d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee18 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.751872:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4162d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee18 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.751876:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000601104c8, rc 0)
00000100:00100000:0.0:1651532180.751885:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468949440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.751888:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6331
00000100:00100000:0.0:1651532180.752115:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.752122:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468949696
00000100:00100000:0.0:1651532180.752135:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6332
00000100:00100000:0.0:1651532180.752137:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468949696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.752140:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.752144:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162de lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee1f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.752151:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee1f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.752155:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee1f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.752158:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532180.752168:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468949696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.752170:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6332
00000001:00080000:0.0:1651532180.849998:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794287 is committed
00010000:00010000:0.0:1651532180.850012:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850016:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.850032:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8abb43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468944640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 531034us (531165us total) trans 158913794287 rc 0/0
00000100:00100000:0.0:1651532180.850036:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5241
00010000:00010000:0.0:1651532180.850042:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850045:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532180.850046:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850052:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850057:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.850058:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532180.850059:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850062:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850069:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850072:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4161fe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [217088->9756671] (req 217088->9756671) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850077:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850080:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850255:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850259:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850283:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.850283:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8c71a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468945472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424855us (424930us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532180.850287:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5242
00010000:00010000:1.0:1651532180.850288:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532180.850289:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850293:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850298:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.850298:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532180.850299:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850302:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850317:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850321:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41620c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [987136->6852607] (req 987136->6852607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850322:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850326:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.850416:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.850455:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.850503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532180.850512:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.850522:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468950016
00000100:00100000:0.0:1651532180.850522:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468949888
00000100:00100000:1.0:1651532180.850530:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468950080
00000100:00100000:0.0:1651532180.850532:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468949952
00000100:00100000:1.0:1651532180.850535:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6333
00000100:00100000:1.0:1651532180.850537:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468950016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532180.850538:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5250
00000100:00100000:0.0:1651532180.850539:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085347479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468949888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532180.850540:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.850543:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4162e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee26 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850547:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850551:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4162e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee26 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.850551:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532180.850567:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850570:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532180.850571:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850577:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4162e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee26 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532180.850578:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850581:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532180.850582:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532180.850589:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5251
00000100:00100000:1.0:1651532180.850590:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468950016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532180.850591:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f92ef7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468949952:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532180.850593:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6333
00010000:00010000:0.0:1651532180.850596:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532180.850598:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6334
00000100:00100000:1.0:1651532180.850599:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468950080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532180.850599:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532180.850600:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850602:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532180.850603:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532180.850603:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850604:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4162fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee2d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850606:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.850609:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850610:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4162fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee2d expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.850614:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4162fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee2d expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.850617:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532180.850621:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468950080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.850624:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6334
00000100:00100000:0.0:1651532180.850697:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.850716:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468950144
00000100:00100000:1.0:1651532180.850723:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6335
00000100:00100000:1.0:1651532180.850724:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468950144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.850734:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.850736:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416301 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee34 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.850744:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416301 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee34 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.850747:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416301 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee34 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.850763:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532180.850775:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468950144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.850777:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6335
00000100:00100000:0.0:1651532180.850963:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532180.850981:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468950272
00000100:00100000:1.0:1651532180.850989:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6336
00000100:00100000:1.0:1651532180.850991:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468950272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532180.850994:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532180.850997:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416308 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee3b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532180.851004:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416308 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee3b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.851008:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416308 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee3b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532180.851011:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532180.851025:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468950272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532180.851027:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6336
00000001:00080000:0.0:1651532180.999963:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794288 is committed
00010000:00010000:0.0:1651532180.999977:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532180.999981:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.000003:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4575b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468945408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574540us (574620us total) trans 158913794288 rc 0/0
00010000:00010000:1.0:1651532181.000005:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.000006:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5243
00010000:00010000:1.0:1651532181.000010:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532181.000011:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000014:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000019:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.000020:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.000021:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000024:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000033:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000043:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000046:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41621a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [872448->8744959] (req 872448->8744959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000047:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000217:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000221:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.000235:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002bfebb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468946560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458020us (458073us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532181.000238:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5244
00010000:00010000:0.0:1651532181.000245:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000248:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532181.000249:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000252:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000257:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.000258:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.000259:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000262:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000269:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000272:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416244 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2068480->6672383] (req 2068480->6672383) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000277:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000279:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.000397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.000420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.000427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.000441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.000467:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468950784
00000100:00100000:1.0:1651532181.000482:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468950848
00000100:00100000:0.0:1651532181.000486:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468950720
00000100:00100000:1.0:1651532181.000487:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6337
00000100:00100000:1.0:1651532181.000488:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468950784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.000492:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.000495:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41630f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee42 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.000496:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468950656
00000100:00100000:0.0:1651532181.000502:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5252
00010000:00010000:1.0:1651532181.000503:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41630f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee42 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532181.000504:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468950720:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532181.000508:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41630f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee42 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.000511:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532181.000511:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000515:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.000516:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.000519:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.000526:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468950784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.000528:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6337
00000100:00100000:1.0:1651532181.000533:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6338
00000100:00100000:1.0:1651532181.000535:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468950848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.000538:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.000540:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41631d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee49 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000546:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41631d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee49 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.000550:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41631d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee49 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.000553:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532181.000558:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468950848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (117us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.000560:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6338
00000100:00100000:1.0:1651532181.000574:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5253
00000100:00100000:1.0:1651532181.000575:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468950656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532181.000581:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000585:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532181.000587:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000589:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000592:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532181.000593:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000599:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000602:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000606:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.000846:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.000856:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468951232
00000100:00100000:1.0:1651532181.000865:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6339
00000100:00100000:1.0:1651532181.000867:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468951232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.000870:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.000873:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41632b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee50 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.000880:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41632b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee50 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.000884:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41632b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee50 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.000887:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532181.000901:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468951232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.000905:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6339
00000100:00100000:0.0:1651532181.001127:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.001145:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468951424
00000100:00100000:1.0:1651532181.001152:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6340
00000100:00100000:1.0:1651532181.001153:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468951424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.001156:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.001159:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416332 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee57 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.001166:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416332 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee57 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.001170:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416332 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee57 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.001173:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532181.001186:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468951424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.001188:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6340
00000100:00100000:0.0:1651532181.001412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.001429:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468951616
00000100:00100000:1.0:1651532181.001435:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6341
00000100:00100000:1.0:1651532181.001437:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468951616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.001440:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.001443:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416339 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee5e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.001450:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416339 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee5e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.001454:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416339 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee5e expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.001457:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532181.001469:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468951616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.001472:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6341
00000001:00080000:0.0:1651532181.058383:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794289 is committed
00010000:00010000:0.0:1651532181.058398:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.058403:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058426:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.058426:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000782e634b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468946496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516175us (516255us total) trans 158913794289 rc 0/0
00000100:00100000:0.0:1651532181.058429:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5245
00010000:00010000:1.0:1651532181.058431:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532181.058432:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058435:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058440:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.058441:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.058442:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058445:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058454:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.058462:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058467:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41624b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [917504->9302015] (req 917504->9302015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.058469:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.058748:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.058756:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.058770:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468951808
00000100:00100000:1.0:1651532181.058778:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468951872
00000100:00100000:0.0:1651532181.058781:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5254
00000100:00100000:0.0:1651532181.058783:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070f9d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468951808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532181.058791:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.058801:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5255
00000100:00100000:1.0:1651532181.058812:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006388808e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468951872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532181.058819:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058824:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532181.058825:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058833:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532181.058834:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.058838:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.058840:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.058843:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532181.058844:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058847:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.058848:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058851:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.058876:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.058892:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.058901:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468952000
00000100:00100000:1.0:1651532181.058908:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6342
00000100:00100000:1.0:1651532181.058910:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468952000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.058914:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.058917:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41634e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee65 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.058924:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41634e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee65 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.058928:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41634e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee65 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.058931:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532181.058945:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468952000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.058948:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6342
00000001:00080000:0.0:1651532181.166720:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794290 is committed
00010000:00010000:0.0:1651532181.166736:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.166740:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.166763:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.166763:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef539604 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468947520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 508063us (508135us total) trans 158913794290 rc 0/0
00000100:00100000:0.0:1651532181.166767:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5246
00010000:00010000:1.0:1651532181.166768:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532181.166769:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.166772:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.166777:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.166778:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.166779:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.166785:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.166792:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.166794:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41626e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [307200->10461183] (req 307200->10461183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.166800:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.166815:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167036:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167041:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.167055:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc4aa464 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468947584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508332us (508415us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532181.167058:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5247
00010000:00010000:0.0:1651532181.167064:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167068:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532181.167069:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167072:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167077:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.167078:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.167079:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167082:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.167102:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.167106:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167110:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167114:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416275 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2183168->9646079] (req 2183168->9646079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.167140:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.167170:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468952384
00000100:00100000:0.0:1651532181.167182:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6343
00000100:00100000:0.0:1651532181.167184:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468952384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.167187:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.167191:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416355 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee6c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167199:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416355 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee6c expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.167204:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416355 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee6c expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.167207:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532181.167217:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468952384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.167220:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6343
00000100:00100000:0.0:1651532181.167389:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.167397:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.167404:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.167410:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468952576
00000100:00100000:1.0:1651532181.167433:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468952640
00000100:00100000:0.0:1651532181.167441:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5256
00000100:00100000:0.0:1651532181.167443:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468952576:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532181.167447:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5257
00000100:00100000:1.0:1651532181.167449:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d529e503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468952640:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532181.167451:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167455:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532181.167456:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167456:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167459:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532181.167460:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.167466:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.167467:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532181.167468:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.167472:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167472:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167479:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.167487:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468952704
00000100:00100000:0.0:1651532181.167496:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6344
00000100:00100000:0.0:1651532181.167498:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468952704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.167501:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.167503:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41636a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee73 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167510:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41636a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee73 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.167514:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41636a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee73 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.167518:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532181.167528:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468952704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.167531:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6344
00000100:00100000:0.0:1651532181.167545:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.167591:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.167602:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468952832
00000100:00100000:0.0:1651532181.167611:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468952960
00000100:00100000:0.0:1651532181.167617:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6345
00000100:00100000:0.0:1651532181.167619:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e415d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468952832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.167622:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532181.167623:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6346
00000100:00100000:1.0:1651532181.167625:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468952960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.167626:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416371 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee7a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.167628:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.167632:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416378 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee81 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.167639:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416378 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee81 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.167643:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416378 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee81 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.167647:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532181.167647:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416371 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee7a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.167652:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416371 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee7a expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.167655:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532181.167662:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468952960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.167665:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6346
00000100:00100000:0.0:1651532181.167670:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e415d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468952832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (125us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.167673:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6345
00000100:00100000:0.0:1651532181.167824:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.167832:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468953152
00000100:00100000:0.0:1651532181.167842:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6347
00000100:00100000:0.0:1651532181.167844:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468953152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.167847:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.167850:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41637f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee88 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.167858:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41637f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee88 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.167862:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41637f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee88 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.167865:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532181.167875:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468953152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.167878:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6347
00000001:00080000:0.0:1651532181.293279:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794291 is committed
00010000:00010000:1.0:1651532181.293308:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293313:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.293333:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074833821 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468948096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 542764us (542810us total) trans 158913794291 rc 0/0
00000100:00100000:1.0:1651532181.293337:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5248
00010000:00010000:1.0:1651532181.293344:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293348:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532181.293349:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293352:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293357:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.293357:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.293358:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293370:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293389:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293393:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41628a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2473984->2478079] (req 2473984->2478079) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.293396:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.293402:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.293643:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.293648:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293666:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293669:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532181.293669:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092ab9b2a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468948160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 543073us (543134us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532181.293670:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.293672:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5249
00010000:00010000:1.0:1651532181.293676:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293680:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.293681:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.293682:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293685:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293694:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.293697:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416291 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [495616->10092543] (req 495616->10092543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.293703:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.293708:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.294060:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.294071:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.294083:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468953536
00000100:00100000:1.0:1651532181.294088:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468953472
00000100:00100000:0.0:1651532181.294094:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5258
00000100:00100000:0.0:1651532181.294096:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d23405d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468953536:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532181.294100:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5259
00000100:00100000:1.0:1651532181.294102:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007513dfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468953472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532181.294104:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.294108:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.294108:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.294109:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.294112:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532181.294113:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.294118:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532181.294119:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.294122:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532181.294123:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.294127:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.294128:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.294131:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.294131:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532181.358386:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794292 is committed
00010000:00010000:0.0:1651532181.358401:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358405:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.358423:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085347479 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468949888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 507882us (508007us total) trans 158913794292 rc 0/0
00000100:00100000:0.0:1651532181.358426:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5250
00010000:00010000:0.0:1651532181.358433:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358436:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532181.358438:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358441:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358446:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.358446:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.358447:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358450:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358453:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.358454:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.358454:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358457:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358467:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358470:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4162ec lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [368640->8605695] (req 368640->8605695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358475:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358478:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358496:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358500:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358731:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358735:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358751:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.358754:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085659d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468950720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358249us (358357us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532181.358756:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532181.358757:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.358757:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5252
00010000:00010000:1.0:1651532181.358760:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358766:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358767:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358769:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416316 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3129344->8032255] (req 3129344->8032255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.358771:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358782:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358785:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532181.358785:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f92ef7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468949952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508193us (508330us total) trans 0 rc 45056/45056
00010000:00010000:1.0:1651532181.358786:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.358787:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5251
00010000:00010000:1.0:1651532181.358789:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358793:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.358793:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.358794:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358797:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358814:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358818:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4162f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [991232->9396223] (req 991232->9396223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358835:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.358838:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.359010:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.359043:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.359064:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.359074:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468953792
00000100:00100000:0.0:1651532181.359083:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468953984
00000100:00100000:0.0:1651532181.359086:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468953856
00000100:00100000:0.0:1651532181.359089:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6348
00000100:00100000:0.0:1651532181.359090:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468953792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.359094:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.359098:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416394 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee8f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.359131:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416394 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee8f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.359135:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416394 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee8f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532181.359139:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6349
00010000:00010000:0.0:1651532181.359139:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532181.359141:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cefde237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468953984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.359145:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532181.359148:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468953792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (138us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532181.359149:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41639b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee9d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.359151:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6348
00000100:00100000:0.0:1651532181.359156:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6350
00010000:00010000:1.0:1651532181.359158:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41639b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee9d expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532181.359158:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c4207f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468953856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.359160:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.359162:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41639b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee9d expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.359163:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4163a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ee96 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.359165:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532181.359169:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4163a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee96 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.359172:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4163a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ee96 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532181.359175:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cefde237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468953984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (132us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532181.359175:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532181.359178:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6349
00000100:00100000:0.0:1651532181.359181:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c4207f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468953856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (117us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.359183:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6350
00000100:00100000:0.0:1651532181.359197:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.359202:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468954176
00000100:00100000:1.0:1651532181.359211:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6351
00000100:00100000:0.0:1651532181.359211:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.359213:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468954176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.359216:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.359219:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4163a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eea4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.359225:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4163a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eea4 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.359229:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4163a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eea4 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.359232:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532181.359235:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468954112
00000100:00100000:0.0:1651532181.359244:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5260
00000100:00100000:0.0:1651532181.359246:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fef8a7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468954112:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532181.359253:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468954176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.359256:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6351
00010000:00010000:0.0:1651532181.359259:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.359267:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.359268:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.359270:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532181.359271:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.359300:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.359304:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.359474:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.359481:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468954304
00000100:00100000:0.0:1651532181.359490:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5261
00000100:00100000:0.0:1651532181.359492:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7789e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468954304:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532181.359498:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.359502:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.359503:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.359506:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532181.359507:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.359514:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.359517:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.359669:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.359677:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.359688:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.359697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.359699:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468954560
00000100:00100000:0.0:1651532181.359706:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468954624
00000100:00100000:1.0:1651532181.359709:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468954496
00000100:00100000:0.0:1651532181.359711:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468954752
00000100:00100000:1.0:1651532181.359713:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6352
00000100:00100000:1.0:1651532181.359715:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468954560:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532181.359716:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6353
00000100:00100000:0.0:1651532181.359717:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468954624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.359718:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.359721:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4163be lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eeb2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.359721:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.359724:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4163c5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eeb9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.359728:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4163be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eeb2 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.359732:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4163be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eeb2 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.359732:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4163c5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eeb9 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.359735:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532181.359736:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4163c5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eeb9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.359739:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532181.359749:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468954560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.359752:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6352
00000100:00100000:0.0:1651532181.359755:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468954624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.359757:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6354
00000100:00100000:1.0:1651532181.359758:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468954496:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532181.359758:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6353
00010000:00010000:1.0:1651532181.359761:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.359763:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4163cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eeab expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.359764:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6355
00000100:00100000:0.0:1651532181.359765:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468954752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.359768:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.359771:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4163d3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eec0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.359772:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4163cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eeab expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.359776:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4163cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eeab expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.359777:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4163d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eec0 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.359779:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532181.359781:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4163d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eec0 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.359784:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532181.359785:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468954496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.359787:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6354
00000100:00100000:0.0:1651532181.359790:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468954752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.359792:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6355
00000100:00100000:0.0:1651532181.360178:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.360185:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.360199:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.360207:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468954944
00000100:00100000:1.0:1651532181.360209:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468954880
00000100:00100000:0.0:1651532181.360216:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468955136
00000100:00100000:0.0:1651532181.360220:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6356
00000100:00100000:0.0:1651532181.360221:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468954944:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532181.360222:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6357
00000100:00100000:1.0:1651532181.360224:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468954880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.360225:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.360227:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.360228:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4163da lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eece expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.360231:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4163e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eec7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.360236:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4163da lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eece expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.360238:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4163e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eec7 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.360240:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4163da lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eece expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.360242:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4163e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eec7 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.360243:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532181.360245:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532181.360252:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468954944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.360253:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468954880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.360255:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6356
00000100:00100000:1.0:1651532181.360257:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6357
00000100:00100000:0.0:1651532181.360259:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6358
00000100:00100000:0.0:1651532181.360261:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468955136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.360263:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.360265:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4163e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eed5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.360271:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4163e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eed5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.360275:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4163e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eed5 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.360278:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532181.360283:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468955136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.360286:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6358
00000100:00100000:0.0:1651532181.360608:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.360616:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.360629:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468955584
00000100:00100000:1.0:1651532181.360632:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468955392
00000100:00100000:0.0:1651532181.360639:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6359
00000100:00100000:0.0:1651532181.360640:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468955584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.360644:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532181.360645:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6360
00000100:00100000:1.0:1651532181.360647:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468955392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.360647:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4163ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eee3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.360650:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.360653:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163f6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eedc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.360654:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4163ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eee3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.360658:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4163ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eee3 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.360660:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eedc expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.360661:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000413f87ac, rc 0)
00010000:00010000:1.0:1651532181.360664:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eedc expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.360667:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532181.360671:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468955584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.360673:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6359
00000100:00100000:1.0:1651532181.360674:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468955392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.360677:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6360
00000001:00080000:0.0:1651532181.458419:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794293 is committed
00010000:00010000:1.0:1651532181.458448:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458452:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.458474:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024535a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468950656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457898us (458054us total) trans 158913794293 rc 0/0
00000100:00100000:1.0:1651532181.458479:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5253
00010000:00010000:1.0:1651532181.458487:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458490:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532181.458491:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458494:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458499:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.458500:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.458501:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458504:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458520:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458523:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416324 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4935680->10473471] (req 4935680->10473471) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458528:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458534:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.458882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.458899:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468955840
00000100:00100000:1.0:1651532181.458913:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5262
00000100:00100000:1.0:1651532181.458915:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468955840:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532181.458918:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.458930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532181.458938:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.458939:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532181.458948:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532181.458953:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.458955:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468955904
00010000:00010000:1.0:1651532181.458956:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458959:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532181.458959:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458964:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458967:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.458967:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5263
00000100:00100000:0.0:1651532181.458969:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468955904:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532181.458970:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.458976:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.458981:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.458982:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.458985:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532181.458986:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458989:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.458993:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.458996:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.459000:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.459011:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006388808e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468951872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 400199us (400255us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532181.459014:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5255
00000100:00100000:0.0:1651532181.459020:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468956032
00010000:00010000:1.0:1651532181.459021:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.459025:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532181.459026:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.459029:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468956096
00010000:00010000:1.0:1651532181.459034:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.459034:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6361
00000100:00100000:0.0:1651532181.459036:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468956032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.459039:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.459039:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.459040:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.459041:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.459042:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41640b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eeea expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.459044:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.459052:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41640b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eeea expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.459056:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.459059:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416347 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1617920->9166847] (req 1617920->9166847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.459066:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41640b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eeea expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532181.459067:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6362
00000100:00100000:1.0:1651532181.459069:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468956096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.459069:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b80df6d8, rc 0)
00010000:00010000:1.0:1651532181.459072:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.459074:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416412 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eef1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.459079:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468956032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (149us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532181.459081:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416412 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eef1 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532181.459082:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6361
00010000:00010000:1.0:1651532181.459085:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416412 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eef1 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.459088:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532181.459089:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.459092:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.459095:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468956096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (157us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.459098:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6362
00000100:00100000:0.0:1651532181.459482:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.459494:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468956352
00000100:00100000:1.0:1651532181.459502:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6363
00000100:00100000:1.0:1651532181.459504:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000016860e13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468956352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.459508:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.459512:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416419 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eef8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.459519:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416419 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eef8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.459523:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416419 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eef8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.459526:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532181.459539:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000016860e13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468956352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.459542:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6363
00000100:00100000:0.0:1651532181.459771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.459789:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468956608
00000100:00100000:1.0:1651532181.459796:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6364
00000100:00100000:1.0:1651532181.459798:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468956608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.459801:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.459818:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416420 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eeff expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.459826:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416420 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eeff expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.459829:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416420 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eeff expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.459835:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532181.459848:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468956608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.459850:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6364
00000001:00080000:0.0:1651532181.633370:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794294 is committed
00010000:00010000:0.0:1651532181.633397:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633402:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.633419:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070f9d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468951808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574635us (574672us total) trans 158913794294 rc 0/0
00000100:00100000:0.0:1651532181.633423:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5254
00010000:00010000:0.0:1651532181.633430:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633434:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532181.633435:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633438:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633443:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.633443:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.633444:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633447:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633450:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.633451:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.633452:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633455:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633470:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633473:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416340 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [221184->7098367] (req 221184->7098367) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633481:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.633484:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633484:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.633490:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.633507:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.633511:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633540:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633544:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532181.633545:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.633548:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d529e503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468952640:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466097us (466149us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651532181.633548:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.633552:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5257
00010000:00010000:0.0:1651532181.633553:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.633556:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416363 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1613824->1617919] (req 1613824->1617919) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.633922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.633949:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468956864
00000100:00100000:0.0:1651532181.633963:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.633972:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.633973:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468956800
00000100:00100000:0.0:1651532181.633982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.633993:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5264
00000100:00100000:1.0:1651532181.633996:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468956864:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532181.633998:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5265
00000100:00100000:0.0:1651532181.634001:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468956800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532181.634003:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.634010:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.634011:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532181.634012:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532181.634013:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.634019:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.634020:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.634023:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.634026:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532181.634026:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.634030:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.634031:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.634034:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.634037:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.634038:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468956928
00000100:00100000:1.0:1651532181.634044:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468957056
00000100:00100000:1.0:1651532181.634053:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6365
00000100:00100000:1.0:1651532181.634054:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468956928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.634057:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532181.634057:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6366
00000100:00100000:0.0:1651532181.634059:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468957056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.634060:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416435 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef06 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.634062:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.634065:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41643c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef0d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.634068:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416435 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef06 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.634073:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416435 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef06 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.634073:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41643c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef0d expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.634077:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532181.634078:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41643c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef0d expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.634081:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002ac5e3f4, rc 0)
00000100:00100000:1.0:1651532181.634091:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468956928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (119us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.634094:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6365
00000100:00100000:0.0:1651532181.634097:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468957056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (115us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.634100:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6366
00000100:00100000:0.0:1651532181.634358:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.634383:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468957376
00000100:00100000:1.0:1651532181.634395:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6367
00000100:00100000:1.0:1651532181.634397:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468957376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.634400:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.634404:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416443 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef14 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.634412:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416443 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef14 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.634416:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416443 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef14 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.634419:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532181.634432:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468957376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.634435:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6367
00000100:00100000:0.0:1651532181.728127:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532181.728136:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233728
00000100:00100000:0.0:1651532181.728151:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 72
00000100:00100000:0.0:1651532181.728153:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951233728:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532181.728159:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 946176 granted 353108544 pending 200704 free 81138851840 avail 76967854080
00000100:00100000:0.0:1651532181.728172:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f134212c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951233728:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 18us (45us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532181.728174:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 72
00000001:00080000:0.0:1651532181.750005:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794295 is committed
00002000:00010000:0.0:1651532181.750017:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532180 -> 1651532181
00002000:00010000:0.0:1651532181.750018:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532180 -> 1651532181
00010000:00010000:0.0:1651532181.750021:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750027:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.750049:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468952576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582605us (582660us total) trans 158913794295 rc 0/0
00010000:00010000:1.0:1651532181.750050:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.750052:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5256
00010000:00010000:1.0:1651532181.750055:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532181.750056:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750059:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750065:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.750066:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.750067:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750070:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750079:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750088:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750093:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41635c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1896448->9400319] (req 1896448->9400319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750093:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750264:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750268:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.750283:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d23405d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468953536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 456186us (456223us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532181.750286:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5258
00010000:00010000:0.0:1651532181.750292:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750295:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532181.750296:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750300:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750305:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.750305:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.750306:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750309:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750331:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750336:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750344:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750348:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416386 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2060288->5890047] (req 2060288->5890047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.750372:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.750387:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.750409:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.750429:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468957632
00000100:00100000:0.0:1651532181.750433:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468957568
00000100:00100000:1.0:1651532181.750443:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6368
00000100:00100000:1.0:1651532181.750445:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468957632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.750449:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532181.750449:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468957504
00010000:00010000:1.0:1651532181.750453:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41644a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef1b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.750458:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5266
00000100:00100000:0.0:1651532181.750460:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468957568:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532181.750467:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750468:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41644a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef1b expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.750471:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.750473:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750475:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532181.750476:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750480:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41644a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef1b expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.750480:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750484:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750487:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532181.750491:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5267
00000100:00100000:1.0:1651532181.750498:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468957632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.750502:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6368
00000100:00100000:0.0:1651532181.750516:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468957504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532181.750522:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750526:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.750527:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750529:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532181.750530:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750534:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750537:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.750553:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.750564:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468957760
00000100:00100000:1.0:1651532181.750571:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6369
00000100:00100000:1.0:1651532181.750573:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468957760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.750595:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.750600:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41645f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef22 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750608:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41645f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef22 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.750612:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41645f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef22 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532181.750613:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532181.750615:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532181.750625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.750636:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468957760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.750639:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6369
00000100:00100000:1.0:1651532181.750644:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468957824
00000100:00100000:1.0:1651532181.750648:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468957888
00000100:00100000:0.0:1651532181.750660:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6370
00000100:00100000:0.0:1651532181.750662:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468957824:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532181.750665:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6371
00010000:00010000:0.0:1651532181.750665:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532181.750666:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468957888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.750669:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416466 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef29 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750670:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.750673:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41646d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef30 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.750677:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416466 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef29 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.750679:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41646d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef30 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.750682:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416466 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef29 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.750683:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41646d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef30 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.750685:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036ef374e, rc 0)
00010000:00010000:1.0:1651532181.750687:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532181.750695:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468957888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.750695:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468957824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.750698:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6371
00000100:00100000:0.0:1651532181.750699:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6370
00000100:00100000:0.0:1651532181.750857:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.750868:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468958016
00000100:00100000:1.0:1651532181.750881:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6372
00000100:00100000:1.0:1651532181.750883:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468958016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.750886:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.750890:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416474 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef37 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.750898:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416474 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef37 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.750905:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416474 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef37 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.750908:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532181.750922:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468958016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.750924:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6372
00000100:00100000:0.0:1651532181.750981:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.750996:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468958208
00000100:00100000:1.0:1651532181.751010:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6373
00000100:00100000:1.0:1651532181.751011:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468958208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532181.751015:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.751018:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41647b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef3e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.751025:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41647b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef3e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.751029:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41647b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef3e expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.751032:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532181.751032:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.751040:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468958336
00000100:00100000:0.0:1651532181.751047:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6374
00000100:00100000:0.0:1651532181.751049:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468958336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.751053:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532181.751057:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468958208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532181.751060:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6373
00010000:00010000:0.0:1651532181.751062:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416482 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef45 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.751070:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416482 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef45 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.751074:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416482 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef45 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.751077:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e1e35d6a, rc 0)
00000100:00100000:0.0:1651532181.751085:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468958336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.751088:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6374
00000001:00080000:0.0:1651532181.874986:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794296 is committed
00010000:00010000:1.0:1651532181.875016:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.875020:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.875041:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007513dfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468953472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 580939us (580970us total) trans 158913794296 rc 0/0
00010000:00010000:0.0:1651532181.875044:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532181.875045:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5259
00010000:00010000:0.0:1651532181.875049:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532181.875050:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875053:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875059:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.875059:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.875061:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875064:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875071:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875074:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41638d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3833856->7667711] (req 3833856->7667711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875079:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875082:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.875449:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.875460:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.875468:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532181.875478:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468958720
00000100:00100000:1.0:1651532181.875490:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468958784
00000100:00100000:0.0:1651532181.875492:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5268
00000100:00100000:0.0:1651532181.875494:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468958720:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532181.875496:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5269
00000100:00100000:1.0:1651532181.875498:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468958784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532181.875503:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.875506:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875507:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.875508:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875514:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532181.875514:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.875519:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532181.875520:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.875523:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532181.875524:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.875528:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875528:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875531:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.875532:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.875539:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468958848
00000100:00100000:0.0:1651532181.875547:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6375
00000100:00100000:0.0:1651532181.875549:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468958848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.875552:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.875554:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416497 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef4c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.875561:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416497 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef4c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.875566:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f416497 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef4c expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.875569:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036ef374e, rc 0)
00000100:00100000:0.0:1651532181.875582:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468958848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (115us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.875587:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6375
00000001:00080000:0.0:1651532181.991657:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794297 is committed
00010000:00010000:0.0:1651532181.991671:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.991675:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.991697:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fef8a7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468954112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 632450us (632485us total) trans 158913794297 rc 0/0
00010000:00010000:1.0:1651532181.991698:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.991700:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5260
00010000:00010000:1.0:1651532181.991703:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532181.991704:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.991707:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.991713:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.991714:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532181.991714:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.991717:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.991727:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.991737:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.991741:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.991742:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4163b0 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2064384->7553023] (req 2064384->7553023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.991968:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.991972:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.991992:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7789e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468954304:12345-10.240.43.64@tcp:3:fio.0 Request processed in 632499us (632518us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532181.991995:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5261
00010000:00010000:0.0:1651532181.992002:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992005:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532181.992006:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992009:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992014:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.992015:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532181.992015:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992018:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992028:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992031:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4163b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1642496->2482175] (req 1642496->2482175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.992045:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.992049:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.992120:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.992128:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.992134:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.992147:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468959168
00000100:00100000:1.0:1651532181.992151:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468959232
00000100:00100000:0.0:1651532181.992156:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468959360
00000100:00100000:0.0:1651532181.992160:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6376
00000100:00100000:0.0:1651532181.992161:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468959168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.992165:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532181.992167:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6377
00000100:00100000:1.0:1651532181.992169:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468959360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.992169:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41649e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef53 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532181.992173:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532181.992177:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4164a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef61 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992177:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41649e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef53 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.992181:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41649e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef53 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.992184:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036ef374e, rc 0)
00010000:00010000:1.0:1651532181.992185:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4164a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef61 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.992189:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4164a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef61 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532181.992193:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532181.992196:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468959168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.992199:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6376
00000100:00100000:0.0:1651532181.992204:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6378
00000100:00100000:0.0:1651532181.992206:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468959232:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532181.992208:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468959360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (73us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532181.992208:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532181.992211:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6377
00010000:00010000:0.0:1651532181.992211:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4164ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef5a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992216:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4164ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef5a expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.992220:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4164ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef5a expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.992226:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9816573, rc 0)
00000100:00100000:0.0:1651532181.992232:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468959232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (104us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.992234:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6378
00000100:00100000:0.0:1651532181.992381:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.992389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.992396:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.992403:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468959424
00000100:00100000:0.0:1651532181.992419:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468959488
00000100:00100000:0.0:1651532181.992428:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5270
00000100:00100000:0.0:1651532181.992430:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468959424:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532181.992437:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992441:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.992442:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992445:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532181.992446:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992450:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992453:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.992464:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5271
00000100:00100000:0.0:1651532181.992466:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e415d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468959488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532181.992471:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992475:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.992475:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532181.992476:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992479:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532181.992484:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468959552
00000100:00100000:0.0:1651532181.992490:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6379
00000100:00100000:0.0:1651532181.992492:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468959552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.992494:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.992496:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4164c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef68 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992503:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4164c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef68 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.992507:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4164c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef68 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.992513:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00000100:00100000:0.0:1651532181.992546:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468959552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (149us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.992549:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6379
00000100:00100000:1.0:1651532181.992567:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532181.992593:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468959680
00000100:00100000:0.0:1651532181.992600:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6380
00000100:00100000:0.0:1651532181.992602:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468959680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532181.992605:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532181.992608:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4164c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef6f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532181.992615:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4164c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef6f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.992619:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4164c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef6f expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532181.992623:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b7f071c, rc 0)
00000100:00100000:0.0:1651532181.992635:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468959680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532181.992637:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6380
00000001:00080000:0.0:1651532182.058435:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794298 is committed
00010000:00010000:1.0:1651532182.058465:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.058470:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.058494:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468955840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 599578us (599613us total) trans 158913794298 rc 0/0
00010000:00010000:0.0:1651532182.058495:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.058497:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5262
00010000:00010000:0.0:1651532182.058503:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.058504:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.058507:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.058512:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.058513:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.058514:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.058517:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.058520:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.058520:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.058521:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.058524:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.058535:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.058538:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4163fd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->10162175] (req 1003520->10162175) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.058546:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.058549:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.058566:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.058575:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.058966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.058979:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.058979:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468960128
00000100:00100000:1.0:1651532182.058987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.058996:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468960256
00000100:00100000:0.0:1651532182.058999:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468960192
00000100:00100000:1.0:1651532182.059000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.059001:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468960384
00000100:00100000:0.0:1651532182.059005:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6381
00000100:00100000:0.0:1651532182.059006:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468960128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.059015:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.059019:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4164cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef76 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.059023:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.059027:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059031:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.059034:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4164cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef76 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.059038:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4164cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef76 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532182.059045:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468956864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 425048us (425123us total) trans 0 rc 28672/28672
00010000:00010000:0.0:1651532182.059046:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b7f071c, rc 0)
00000100:00100000:1.0:1651532182.059048:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5264
00010000:00010000:1.0:1651532182.059055:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.059055:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468960128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (90us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532182.059059:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532182.059060:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.059060:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6381
00000100:00100000:0.0:1651532182.059064:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6382
00010000:00010000:1.0:1651532182.059065:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.059066:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468960256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.059068:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.059071:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059071:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4164d6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef84 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.059074:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416427 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1662976->6295551] (req 1662976->6295551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059075:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.059077:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4164d6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef84 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532182.059081:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6383
00010000:00010000:0.0:1651532182.059081:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4164d6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef84 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532182.059083:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468960192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.059084:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00010000:00010000:1.0:1651532182.059087:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532182.059089:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468960256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (110us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532182.059090:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4164dd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef7d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.059091:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6382
00010000:00010000:1.0:1651532182.059095:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532182.059095:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6384
00000100:00100000:0.0:1651532182.059096:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468960384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.059098:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4164dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef7d expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.059098:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.059100:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4164e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef8b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.059102:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4164dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef7d expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.059104:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532182.059105:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532182.059106:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4164e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef8b expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.059110:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4164e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef8b expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532182.059112:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468960192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (125us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532182.059113:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9816573, rc 0)
00000100:00100000:1.0:1651532182.059115:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6383
00000100:00100000:0.0:1651532182.059117:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468960384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.059120:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6384
00010000:00010000:0.0:1651532182.059131:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059135:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.059146:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468955904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 600177us (600229us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532182.059149:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5263
00010000:00010000:0.0:1651532182.059154:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059157:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.059159:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059161:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059168:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.059169:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.059170:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059173:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059180:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059182:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f416404 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2580480->6135807] (req 2580480->6135807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059187:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059190:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.059644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.059680:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.059692:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.059698:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.059704:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468960448
00000100:00100000:0.0:1651532182.059706:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.059716:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468960512
00000100:00100000:1.0:1651532182.059721:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5272
00000100:00100000:1.0:1651532182.059724:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468960448:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532182.059729:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5273
00000100:00100000:0.0:1651532182.059731:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cefde237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468960512:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532182.059736:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059738:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.059740:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532182.059741:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.059744:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532182.059745:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059749:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.059750:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059753:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532182.059754:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.059758:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059758:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.059761:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059762:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.059769:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468960640
00000100:00100000:1.0:1651532182.059771:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468960896
00000100:00100000:0.0:1651532182.059777:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468960832
00000100:00100000:0.0:1651532182.059781:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6385
00000100:00100000:1.0:1651532182.059783:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6386
00000100:00100000:0.0:1651532182.059783:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c4207f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468960640:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532182.059785:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468960896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.059785:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.059788:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.059788:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4164f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef92 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.059791:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416500 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efa0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059795:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4164f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef92 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.059798:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416500 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efa0 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.059814:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4164f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef92 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.059815:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416500 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efa0 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.059818:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00010000:00010000:1.0:1651532182.059819:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:0.0:1651532182.059830:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c4207f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468960640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.059833:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6385
00000100:00100000:1.0:1651532182.059835:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468960896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.059838:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6386
00000100:00100000:0.0:1651532182.059840:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6387
00000100:00100000:0.0:1651532182.059841:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468960832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.059844:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.059847:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f416507 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ef99 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.059853:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f416507 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef99 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.059857:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f416507 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ef99 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.059860:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000e522113, rc 0)
00000100:00100000:0.0:1651532182.059865:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468960832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (160us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.059868:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6387
00000100:00100000:0.0:1651532182.060084:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.060091:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468961024
00000100:00100000:0.0:1651532182.060104:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6388
00000100:00100000:0.0:1651532182.060106:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468961024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.060109:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.060113:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41650e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efa7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.060120:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41650e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efa7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.060124:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41650e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efa7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.060127:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5e80ae9, rc 0)
00000100:00100000:0.0:1651532182.060138:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468961024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.060152:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6388
00000100:00100000:0.0:1651532182.060181:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.060188:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.060197:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468961152
00000100:00100000:1.0:1651532182.060199:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468961280
00000100:00100000:0.0:1651532182.060205:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6389
00000100:00100000:0.0:1651532182.060207:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468961152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.060210:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532182.060212:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6390
00000100:00100000:1.0:1651532182.060214:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468961280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.060214:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416515 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efae expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.060217:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.060220:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416515 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efae expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060221:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41651c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efb5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.060225:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416515 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efae expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.060228:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532182.060229:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41651c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efb5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060233:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41651c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efb5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060236:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532182.060239:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468961152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.060242:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6389
00000100:00100000:1.0:1651532182.060251:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468961280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.060253:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6390
00000100:00100000:0.0:1651532182.060335:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.060348:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468961408
00000100:00100000:1.0:1651532182.060356:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6391
00000100:00100000:1.0:1651532182.060358:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468961408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.060371:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.060374:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416523 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efbc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.060382:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416523 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efbc expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060386:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416523 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efbc expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060389:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532182.060399:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468961408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.060402:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6391
00000100:00100000:0.0:1651532182.060516:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.060528:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468961536
00000100:00100000:1.0:1651532182.060537:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6392
00000100:00100000:1.0:1651532182.060539:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468961536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.060542:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.060545:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41652a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efc3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.060552:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41652a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efc3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060559:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41652a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efc3 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060562:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532182.060572:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468961536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.060575:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6392
00000100:00100000:0.0:1651532182.060625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.060637:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468961728
00000100:00100000:1.0:1651532182.060645:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6393
00000100:00100000:1.0:1651532182.060647:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468961728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.060650:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.060653:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416531 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efca expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.060660:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416531 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efca expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060664:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416531 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efca expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060668:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532182.060677:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468961728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.060679:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6393
00000100:00100000:0.0:1651532182.060882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.060894:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468961920
00000100:00100000:1.0:1651532182.060903:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6394
00000100:00100000:1.0:1651532182.060905:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468961920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.060908:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.060911:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416538 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efd1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.060918:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416538 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efd1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060922:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416538 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efd1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.060925:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532182.060935:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468961920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.060937:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6394
00000001:00080000:0.0:1651532182.200002:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794299 is committed
00010000:00010000:0.0:1651532182.200018:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200022:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.200039:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468956800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566038us (566076us total) trans 158913794299 rc 0/0
00000100:00100000:0.0:1651532182.200043:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5265
00010000:00010000:0.0:1651532182.200049:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200053:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.200054:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200057:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200063:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.200063:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.200064:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200067:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200074:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200077:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41642e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [122880->9416703] (req 122880->9416703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200082:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200085:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200278:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200283:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.200309:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468957568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449848us (449936us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651532182.200312:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5266
00010000:00010000:1.0:1651532182.200313:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200318:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532182.200319:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200323:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200328:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532182.200329:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532182.200330:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200333:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200345:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200348:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200351:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f416451 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1183744->10100735] (req 1183744->10100735) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200352:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.200449:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.200460:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468962112
00000100:00100000:1.0:1651532182.200462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.200473:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.200479:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468962048
00000100:00100000:0.0:1651532182.200485:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5274
00000100:00100000:0.0:1651532182.200486:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bb47476 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468962112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532182.200493:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.200496:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5275
00000100:00100000:1.0:1651532182.200500:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468962048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532182.200509:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200532:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.200533:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532182.200534:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200542:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532182.200543:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200547:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200550:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532182.200551:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200554:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200556:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200559:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200562:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.200571:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468962176
00000100:00100000:1.0:1651532182.200579:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6395
00000100:00100000:1.0:1651532182.200581:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468962176:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532182.200582:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532182.200584:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.200593:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41654d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efd8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200600:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41654d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efd8 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.200604:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41654d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efd8 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.200608:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532182.200622:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468962176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (150us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.200627:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6395
00000100:00100000:1.0:1651532182.200631:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468962240
00000100:00100000:1.0:1651532182.200643:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6396
00000100:00100000:1.0:1651532182.200645:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468962240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.200649:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.200654:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416554 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efdf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200662:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416554 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efdf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.200666:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416554 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efdf expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.200669:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532182.200677:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468962240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.200678:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.200679:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6396
00000100:00100000:1.0:1651532182.200684:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468962432
00000100:00100000:1.0:1651532182.200688:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6397
00000100:00100000:1.0:1651532182.200690:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468962432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.200692:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.200694:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41655b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efe6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.200700:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41655b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efe6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.200704:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41655b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efe6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532182.200704:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.200722:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468962560
00000100:00100000:0.0:1651532182.200729:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6398
00010000:00010000:1.0:1651532182.200738:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532182.200743:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468962560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.200746:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532182.200752:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468962432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.200754:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6397
00010000:00010000:0.0:1651532182.200756:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416562 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44efed expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.200765:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416562 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efed expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.200769:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416562 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44efed expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.200772:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532182.200781:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468962560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.200784:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6398
00000100:00100000:0.0:1651532182.200967:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.200975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.200988:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468962688
00000100:00100000:0.0:1651532182.200997:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468962752
00000100:00100000:0.0:1651532182.201003:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6399
00000100:00100000:0.0:1651532182.201005:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468962688:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532182.201009:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6400
00010000:00010000:0.0:1651532182.201009:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532182.201012:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468962752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.201012:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416569 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44eff4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.201016:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.201020:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416570 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44effb expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.201022:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416569 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eff4 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.201026:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416569 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44eff4 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.201027:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416570 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44effb expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.201030:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532182.201031:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416570 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44effb expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.201034:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532182.201042:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468962688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.201045:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6399
00000100:00100000:1.0:1651532182.201049:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468962752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.201052:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6400
00000100:00100000:0.0:1651532182.201300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.201320:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468963072
00000100:00100000:1.0:1651532182.201329:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6401
00000100:00100000:1.0:1651532182.201330:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468963072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.201334:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.201337:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416577 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f002 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.201344:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416577 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f002 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.201348:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416577 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f002 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.201351:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532182.201372:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468963072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.201374:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6401
00000001:00080000:0.0:1651532182.333341:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794300 is committed
00010000:00010000:0.0:1651532182.333356:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333360:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.333388:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468957504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 582872us (583000us total) trans 158913794300 rc 0/0
00000100:00100000:0.0:1651532182.333391:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5267
00010000:00010000:0.0:1651532182.333398:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333402:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.333403:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333406:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333411:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.333412:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.333412:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333415:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333422:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333425:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f416458 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4386816->8945663] (req 4386816->8945663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333430:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333433:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.333739:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.333746:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.333790:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468963328
00000100:00100000:0.0:1651532182.333793:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.333819:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468963264
00000100:00100000:1.0:1651532182.333826:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5276
00000100:00100000:1.0:1651532182.333828:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468963328:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532182.333837:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5277
00000100:00100000:0.0:1651532182.333839:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468963264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532182.333840:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.333845:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532182.333846:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333847:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.333849:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532182.333850:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333855:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.333856:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333859:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532182.333860:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.333864:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333865:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.333868:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.333868:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.333877:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468963392
00000100:00100000:1.0:1651532182.333884:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6402
00000100:00100000:1.0:1651532182.333886:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468963392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.333888:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.333891:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41658c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f009 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.333897:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41658c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f009 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.333901:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41658c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f009 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.333904:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532182.333914:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468963392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (122us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.333917:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6402
00000001:00080000:0.0:1651532182.492068:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794301 is committed
00010000:00010000:0.0:1651532182.492083:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492086:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492108:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.492109:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d9ea3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468958720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 616614us (616660us total) trans 158913794301 rc 0/0
00000100:00100000:0.0:1651532182.492112:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5268
00010000:00010000:1.0:1651532182.492115:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532182.492116:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492119:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492125:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532182.492125:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532182.492126:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492129:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492137:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492140:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f416489 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->8310783] (req 1187840->8310783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492144:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492148:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.492422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.492435:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.492448:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468963648
00010000:00010000:0.0:1651532182.492452:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492456:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.492457:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468963712
00000100:00100000:1.0:1651532182.492465:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6403
00000100:00100000:1.0:1651532182.492467:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468963648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.492471:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.492474:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416593 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f010 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.492479:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034af49f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468958784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 616980us (617019us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532182.492482:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5269
00010000:00010000:1.0:1651532182.492485:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532182.492488:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416593 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f010 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.492490:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492492:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416593 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f010 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.492493:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.492494:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492495:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532182.492497:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492502:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.492503:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532182.492504:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468963648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (83us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532182.492504:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.492507:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6403
00010000:00010000:0.0:1651532182.492507:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.492511:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6404
00010000:00010000:0.0:1651532182.492511:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.492511:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.492512:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.492513:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468963712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.492514:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492515:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.492518:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41659a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f017 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492521:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492523:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41659a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f017 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.492524:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416490 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2768896->8654847] (req 2768896->8654847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492527:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41659a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f017 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.492529:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492530:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532182.492532:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.492535:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468963712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.492538:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6404
00010000:00010000:0.0:1651532182.492544:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492548:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.492561:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e415d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468959488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 500095us (500172us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532182.492564:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5271
00010000:00010000:0.0:1651532182.492570:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492573:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492589:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492592:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.492594:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492596:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492601:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492604:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4164ba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [9646080->9650175] (req 9646080->9650175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.492919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.492932:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.492932:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468963776
00000100:00100000:1.0:1651532182.492942:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.492954:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468963840
00000100:00100000:1.0:1651532182.492957:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5278
00000100:00100000:1.0:1651532182.492959:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468963776:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532182.492965:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5279
00000100:00100000:0.0:1651532182.492966:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468963840:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532182.492973:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492975:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492978:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532182.492979:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492982:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532182.492982:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492986:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.492987:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.492988:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492992:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.492992:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.492996:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.493000:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468963968
00000100:00100000:0.0:1651532182.493009:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6405
00000100:00100000:0.0:1651532182.493011:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468963968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.493013:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.493016:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4165af lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f01e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.493039:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4165af lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f01e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493044:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4165af lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f01e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493047:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532182.493062:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468963968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.493065:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6405
00000100:00100000:1.0:1651532182.493074:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.493102:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468964224
00000100:00100000:0.0:1651532182.493112:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6406
00000100:00100000:0.0:1651532182.493113:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468964224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.493117:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.493120:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4165b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f025 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.493126:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4165b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f025 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493130:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4165b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f025 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493134:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532182.493143:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468964224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.493145:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6406
00000100:00100000:1.0:1651532182.493340:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.493351:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468964352
00000100:00100000:0.0:1651532182.493369:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6407
00000100:00100000:0.0:1651532182.493371:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000208fa08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468964352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.493374:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.493377:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4165bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f02c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.493384:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4165bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f02c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493389:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4165bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f02c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493392:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532182.493403:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000208fa08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468964352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.493405:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6407
00000100:00100000:1.0:1651532182.493465:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.493475:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468964544
00000100:00100000:0.0:1651532182.493485:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6408
00000100:00100000:0.0:1651532182.493487:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000655dd3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468964544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.493490:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.493493:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4165c4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f033 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.493500:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4165c4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f033 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493504:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4165c4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f033 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493507:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532182.493517:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000655dd3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468964544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.493520:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6408
00000100:00100000:1.0:1651532182.493659:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.493670:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468964672
00000100:00100000:0.0:1651532182.493680:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6409
00000100:00100000:0.0:1651532182.493682:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d672f724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468964672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.493685:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.493688:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4165cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f03a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.493695:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4165cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f03a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493699:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4165cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f03a expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493702:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532182.493712:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d672f724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468964672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.493714:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6409
00000100:00100000:1.0:1651532182.493776:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.493786:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468964864
00000100:00100000:0.0:1651532182.493796:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6410
00000100:00100000:0.0:1651532182.493798:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a53cedc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468964864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.493801:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.493815:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165d2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f041 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.493822:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165d2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f041 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493830:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165d2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f041 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.493833:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532182.493843:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a53cedc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468964864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.493845:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6410
00000001:00080000:0.0:1651532182.570563:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794302 is committed
00010000:00010000:0.0:1651532182.570577:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.570581:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.570602:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468959424:12345-10.240.43.64@tcp:4:fio.0 Request processed in 578171us (578221us total) trans 158913794302 rc 0/0
00010000:00010000:1.0:1651532182.570603:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.570605:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5270
00010000:00010000:1.0:1651532182.570609:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532182.570610:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.570613:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.570619:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532182.570620:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532182.570620:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.570623:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.570631:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.570635:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4164b3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [528384->9584639] (req 528384->9584639) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.570639:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.570643:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.570989:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.570997:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.571007:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.571009:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468965120
00000100:00100000:0.0:1651532182.571014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.571029:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468965056
00000100:00100000:1.0:1651532182.571038:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5280
00000100:00100000:1.0:1651532182.571040:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468965120:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532182.571048:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.571053:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532182.571054:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.571057:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532182.571058:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.571062:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.571065:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.571073:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468965376
00000100:00100000:1.0:1651532182.571079:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468965184
00000100:00100000:1.0:1651532182.571083:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6411
00000100:00100000:1.0:1651532182.571084:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468965376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.571087:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.571089:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4165e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f04f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.571097:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4165e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f04f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532182.571098:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5281
00000100:00100000:0.0:1651532182.571100:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468965056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532182.571104:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4165e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f04f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.571107:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532182.571108:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.571113:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.571114:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.571117:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.571122:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468965376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.571125:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6411
00010000:00010000:0.0:1651532182.571126:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532182.571127:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.571130:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6412
00000100:00100000:1.0:1651532182.571131:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468965184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.571132:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.571134:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.571135:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.571136:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4165ee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f048 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.571138:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.571143:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4165ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f048 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.571146:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4165ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f048 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.571149:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532182.571155:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468965184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (141us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.571157:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6412
00000001:00080000:0.0:1651532182.637277:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794303 is committed
00010000:00010000:0.0:1651532182.637291:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637298:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.637315:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468960448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 577590us (577672us total) trans 158913794303 rc 0/0
00000100:00100000:0.0:1651532182.637318:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5272
00010000:00010000:0.0:1651532182.637325:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637328:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.637329:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637332:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637337:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.637337:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.637338:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637341:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637344:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.637345:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.637345:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637351:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637358:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637361:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4164eb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1490944->8867839] (req 1490944->8867839) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637377:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637380:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637403:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637406:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637608:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637612:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.637642:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bb47476 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468962112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 437155us (437194us total) trans 0 rc 57344/57344
00000100:00100000:0.0:1651532182.637646:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5274
00010000:00010000:0.0:1651532182.637653:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637656:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.637657:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637660:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637665:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637668:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41653f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [385024->9363455] (req 385024->9363455) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.637865:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.637880:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468965632
00010000:00010000:0.0:1651532182.637885:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637889:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.637890:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6413
00000100:00100000:1.0:1651532182.637892:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468965632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.637901:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.637904:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4165f5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f056 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.637906:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cefde237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468960512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 578175us (578227us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651532182.637909:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5273
00010000:00010000:1.0:1651532182.637910:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532182.637913:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4165f5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f056 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.637917:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4165f5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f056 expref: 13 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.637920:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532182.637929:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754468965632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.637932:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6413
00010000:00010000:0.0:1651532182.637944:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637948:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.637949:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637952:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637957:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.637958:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.637959:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637962:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637972:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.637975:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4164f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [933888->9175039] (req 933888->9175039) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.637986:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.637990:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.638008:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.638058:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.638066:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.638076:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468965952
00000100:00100000:1.0:1651532182.638077:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468966080
00000100:00100000:1.0:1651532182.638089:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6414
00000100:00100000:1.0:1651532182.638091:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468966080:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532182.638094:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468966016
00010000:00010000:1.0:1651532182.638095:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.638098:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4165fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f05d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.638100:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5282
00000100:00100000:0.0:1651532182.638102:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468965952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532182.638108:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4165fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f05d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.638109:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.638114:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.638115:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.638117:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532182.638118:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.638122:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.638123:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4165fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f05d expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.638129:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532182.638144:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468966080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.638147:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6414
00010000:00010000:0.0:1651532182.638157:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.638165:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5283
00000100:00100000:0.0:1651532182.638167:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468966016:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532182.638173:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.638176:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.638177:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.638180:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532182.638180:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.638184:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.638187:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.638246:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.638254:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.638263:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.638272:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468966208
00000100:00100000:0.0:1651532182.638278:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468966144
00000100:00100000:0.0:1651532182.638281:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468966336
00000100:00100000:0.0:1651532182.638283:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6415
00000100:00100000:0.0:1651532182.638285:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468966208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.638288:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.638292:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416611 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f06b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.638299:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416611 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f06b expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.638304:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416611 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f06b expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532182.638305:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6416
00010000:00010000:0.0:1651532182.638307:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532182.638308:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468966144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.638311:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.638315:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416618 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f064 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.638317:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468966208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.638320:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6415
00010000:00010000:1.0:1651532182.638322:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416618 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f064 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532182.638324:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6417
00010000:00010000:1.0:1651532182.638326:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416618 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f064 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532182.638326:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468966336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.638328:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.638330:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532182.638330:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41661f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f072 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.638336:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41661f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f072 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532182.638339:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468966144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (85us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532182.638340:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41661f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f072 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532182.638342:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6416
00010000:00010000:0.0:1651532182.638343:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532182.638348:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468966336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.638350:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6417
00000100:00100000:0.0:1651532182.638494:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.638514:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468966464
00000100:00100000:1.0:1651532182.638523:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6418
00000100:00100000:1.0:1651532182.638525:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468966464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.638528:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.638532:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416626 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f079 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.638539:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416626 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f079 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.638543:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416626 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f079 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.638546:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532182.638563:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468966464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.638566:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6418
00000100:00100000:0.0:1651532182.638776:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.638790:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.638795:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468966656
00000100:00100000:1.0:1651532182.638818:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468966720
00000100:00100000:0.0:1651532182.638820:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6419
00000100:00100000:0.0:1651532182.638822:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468966656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532182.638827:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6420
00000100:00100000:1.0:1651532182.638829:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468966720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.638831:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.638832:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.638835:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41662d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f080 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.638836:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416634 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f087 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.638842:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41662d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f080 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.638846:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416634 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f087 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.638846:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41662d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f080 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.638850:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416634 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f087 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.638850:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532182.638853:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532182.638859:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468966656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.638861:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468966720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.638862:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6419
00000100:00100000:1.0:1651532182.638864:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6420
00000100:00100000:0.0:1651532182.639172:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.639191:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468966976
00000100:00100000:0.0:1651532182.639194:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.639202:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468966912
00000100:00100000:1.0:1651532182.639212:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6421
00000100:00100000:1.0:1651532182.639214:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468966976:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532182.639214:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6422
00000100:00100000:0.0:1651532182.639216:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468966912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.639218:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.639220:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.639221:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41663b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f095 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.639223:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416642 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f08e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.639228:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41663b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f095 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.639230:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416642 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f08e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.639232:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41663b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f095 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.639234:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416642 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f08e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.639236:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532182.639240:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532182.639250:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468966976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.639253:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6421
00000100:00100000:0.0:1651532182.639256:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468966912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.639259:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6422
00000001:00080000:0.0:1651532182.737317:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794304 is committed
00010000:00010000:1.0:1651532182.737345:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.737350:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.737378:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468962048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 536879us (536916us total) trans 158913794304 rc 0/0
00010000:00010000:0.0:1651532182.737380:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.737381:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5275
00010000:00010000:0.0:1651532182.737385:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.737386:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737389:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737395:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.737396:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.737397:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737400:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737409:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737412:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416546 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2879488->8708095] (req 2879488->8708095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.737432:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.737438:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.737659:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.737667:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.737685:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468967232
00010000:00010000:1.0:1651532182.737688:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.737692:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.737700:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468967296
00000100:00100000:0.0:1651532182.737711:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5284
00000100:00100000:0.0:1651532182.737713:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037b6d1b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468967232:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532182.737725:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468963328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 403896us (403986us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651532182.737730:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5276
00000100:00100000:1.0:1651532182.737737:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5285
00010000:00010000:0.0:1651532182.737741:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.737745:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000157757ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468967296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532182.737746:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.737747:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532182.737748:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737751:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.737753:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.737757:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.737757:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.737758:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.737761:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532182.737762:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737765:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532182.737767:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737767:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.737770:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737770:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737775:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.737775:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.737776:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737779:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737786:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737789:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41657e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1556480->8794111] (req 1556480->8794111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737795:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.737797:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532182.737798:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.737842:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468967360
00000100:00100000:0.0:1651532182.737850:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6423
00000100:00100000:0.0:1651532182.737852:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003117edcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468967360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.737855:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532182.737858:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532182.737858:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416657 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f09c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737865:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416657 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f09c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.737869:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416657 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f09c expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.737873:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532182.737880:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003117edcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468967360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.737883:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6423
00000100:00100000:0.0:1651532182.737887:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468967424
00000100:00100000:0.0:1651532182.737895:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6424
00000100:00100000:0.0:1651532182.737897:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468967424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.737900:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.737902:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41665e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0a3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.737908:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41665e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0a3 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.737912:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41665e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0a3 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.737915:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532182.737920:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468967424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.737935:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6424
00000100:00100000:1.0:1651532182.738220:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.738244:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468967616
00000100:00100000:0.0:1651532182.738254:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6425
00000100:00100000:1.0:1651532182.738256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.738256:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c57ad69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468967616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.738265:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.738269:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416665 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0aa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.738270:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532182.738282:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416665 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0aa expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.738286:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416665 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0aa expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.738289:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532182.738300:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c57ad69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468967616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.738303:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6425
00000100:00100000:0.0:1651532182.738308:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468967680
00000100:00100000:0.0:1651532182.738311:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468967744
00000100:00100000:0.0:1651532182.738314:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6426
00000100:00100000:0.0:1651532182.738315:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468967680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.738318:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.738320:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41666c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0b1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.738326:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41666c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0b1 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.738329:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41666c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0b1 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.738333:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532182.738338:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468967680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.738340:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6426
00000100:00100000:0.0:1651532182.738344:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6427
00000100:00100000:0.0:1651532182.738345:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468967744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.738348:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.738349:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416673 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0b8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.738354:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416673 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0b8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.738358:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416673 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0b8 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.738370:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532182.738377:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468967744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (107us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.738379:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6427
00000100:00100000:1.0:1651532182.738659:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.738670:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468968000
00000100:00100000:0.0:1651532182.738677:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6428
00000100:00100000:0.0:1651532182.738679:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000208fa08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468968000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.738682:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.738686:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41667a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0bf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.738693:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41667a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0bf expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.738697:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41667a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0bf expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.738700:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532182.738710:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000208fa08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468968000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.738712:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6428
00000001:00080000:0.0:1651532182.853940:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794305 is committed
00010000:00010000:0.0:1651532182.853954:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.853958:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.853980:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468963264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 520139us (520233us total) trans 158913794305 rc 0/0
00000100:00100000:0.0:1651532182.853983:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5277
00010000:00010000:0.0:1651532182.853990:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.853994:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.853995:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.853998:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854003:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.854004:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.854005:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854008:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854011:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.854011:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.854012:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854015:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854025:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854028:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416585 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1822720->8876031] (req 1822720->8876031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.854032:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854033:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854036:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.854037:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854049:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854052:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.854066:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468963840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 361099us (361133us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532182.854069:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5279
00010000:00010000:0.0:1651532182.854074:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854093:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.854095:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854098:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854103:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854106:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4165a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1228800->1232895] (req 1228800->1232895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.854416:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.854428:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468968192
00000100:00100000:1.0:1651532182.854435:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.854445:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468968256
00000100:00100000:1.0:1651532182.854447:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.854461:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5286
00000100:00100000:1.0:1651532182.854462:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.854463:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000655dd3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468968192:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532182.854474:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854478:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.854479:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854482:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854485:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532182.854485:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854490:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854492:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854496:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.854503:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5287
00000100:00100000:0.0:1651532182.854505:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d672f724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468968256:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532182.854509:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854512:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.854513:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854516:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532182.854516:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854520:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854522:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.854531:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468968384
00000100:00100000:1.0:1651532182.854533:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468968448
00000100:00100000:0.0:1651532182.854537:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6429
00000100:00100000:0.0:1651532182.854538:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468968384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.854541:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532182.854546:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6430
00000100:00100000:1.0:1651532182.854548:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468968448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532182.854549:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41668f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0c6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.854551:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.854556:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416696 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0cd expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854557:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41668f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0c6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.854561:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41668f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0c6 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.854564:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416696 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0cd expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.854567:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532182.854569:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416696 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0cd expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532182.854577:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468968384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532182.854580:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6429
00010000:00010000:1.0:1651532182.854586:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532182.854596:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468968448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.854599:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6430
00000100:00100000:1.0:1651532182.854901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.854910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.854921:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468968640
00000100:00100000:0.0:1651532182.854921:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468968576
00000100:00100000:0.0:1651532182.854934:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6431
00000100:00100000:0.0:1651532182.854936:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468968576:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532182.854937:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6432
00010000:00010000:0.0:1651532182.854940:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.854943:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41669d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0d4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.854946:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468968640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.854950:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.854950:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41669d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0d4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.854954:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166a4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0db expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.854955:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41669d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0d4 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.854958:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532182.854962:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0db expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.854966:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0db expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532182.854968:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468968576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (67us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532182.854970:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532182.854971:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6431
00000100:00100000:1.0:1651532182.854979:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468968640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.854982:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6432
00000100:00100000:1.0:1651532182.855223:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.855230:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468968832
00000100:00100000:1.0:1651532182.855242:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6433
00000100:00100000:1.0:1651532182.855244:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468968832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.855247:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.855251:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166ab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0e2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.855258:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0e2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.855273:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0e2 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.855276:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532182.855289:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468968832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.855292:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6433
00000001:00080000:0.0:1651532182.912600:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794306 is committed
00010000:00010000:1.0:1651532182.912629:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.912634:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.912655:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468963776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 419695us (419737us total) trans 158913794306 rc 0/0
00010000:00010000:0.0:1651532182.912656:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.912658:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5278
00010000:00010000:0.0:1651532182.912663:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.912664:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.912668:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.912673:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.912674:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.912675:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.912678:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.912687:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.912690:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4165a1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1777664->8736767] (req 1777664->8736767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.912709:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.912714:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.913006:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.913015:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.913026:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.913027:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468969024
00000100:00100000:0.0:1651532182.913041:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468969088
00000100:00100000:1.0:1651532182.913044:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532182.913049:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5288
00000100:00100000:0.0:1651532182.913051:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468969024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532182.913064:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.913065:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5289
00000100:00100000:1.0:1651532182.913068:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468969088:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532182.913071:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532182.913072:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.913075:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532182.913075:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913076:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913080:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.913080:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913082:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913085:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532182.913085:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.913089:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913090:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913093:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.913096:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468969152
00000100:00100000:0.0:1651532182.913102:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468969216
00010000:00010000:1.0:1651532182.913106:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.913106:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6434
00000100:00100000:0.0:1651532182.913108:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468969152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.913109:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.913110:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532182.913113:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166c0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0e9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.913124:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532182.913128:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f912a73e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468965120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 342088us (342140us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532182.913131:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5280
00010000:00010000:0.0:1651532182.913131:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0e9 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.913136:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0e9 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.913140:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532182.913147:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6435
00000100:00100000:1.0:1651532182.913148:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468969216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532182.913149:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468969152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (122us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532182.913151:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532182.913152:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6434
00010000:00010000:1.0:1651532182.913154:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166c7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0f0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913159:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.913159:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913162:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0f0 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.913163:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532182.913164:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913166:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0f0 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532182.913167:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913169:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532182.913171:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.913172:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532182.913173:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.913176:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468969216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (138us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532182.913176:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532182.913179:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6435
00010000:00010000:0.0:1651532182.913182:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532182.913185:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4165d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->10178559] (req 2805760->10178559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913190:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913193:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532182.913543:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.913555:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468969344
00000100:00100000:1.0:1651532182.913565:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6436
00000100:00100000:1.0:1651532182.913567:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468969344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.913571:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.913575:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166ce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0f7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913582:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166ce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0f7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.913586:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166ce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0f7 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.913590:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532182.913600:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468969344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.913603:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6436
00000100:00100000:0.0:1651532182.913895:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532182.913908:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468969536
00000100:00100000:1.0:1651532182.913917:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6437
00000100:00100000:1.0:1651532182.913919:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468969536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532182.913922:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532182.913926:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166d5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f0fe expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532182.913933:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166d5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0fe expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.913937:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166d5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f0fe expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532182.913940:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532182.913951:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468969536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532182.913953:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6437
00000001:00080000:0.0:1651532183.012411:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794307 is committed
00010000:00010000:1.0:1651532183.012442:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012447:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.012468:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f024cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468965056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 441368us (441471us total) trans 158913794307 rc 0/0
00010000:00010000:0.0:1651532183.012471:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.012472:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5281
00010000:00010000:0.0:1651532183.012475:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.012476:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.012479:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.012485:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.012485:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.012486:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.012489:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.012497:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.012500:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4165e7 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [225280->8798207] (req 225280->8798207) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012516:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012524:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.012882:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.012889:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.012896:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.012903:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468969792
00000100:00100000:1.0:1651532183.012913:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468969728
00000100:00100000:1.0:1651532183.012918:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5290
00000100:00100000:1.0:1651532183.012920:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468969792:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532183.012927:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012935:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532183.012936:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012939:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.012946:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5291
00000100:00100000:1.0:1651532183.012947:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c4207f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468969728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532183.012951:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012954:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532183.012955:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012958:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012960:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532183.012961:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012965:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012968:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.012971:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.013043:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468969920
00000100:00100000:1.0:1651532183.013052:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6438
00000100:00100000:1.0:1651532183.013054:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468969920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.013057:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.013060:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166ea lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f105 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.013068:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166ea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f105 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.013072:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166ea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f105 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.013075:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532183.013086:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468969920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (189us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.013088:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6438
00000001:00080000:0.0:1651532183.104052:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794308 is committed
00002000:00010000:1.0:1651532183.104082:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532181 -> 1651532182
00002000:00010000:1.0:1651532183.104084:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532181 -> 1651532182
00010000:00010000:1.0:1651532183.104087:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.104093:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.104115:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468965952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466012us (466107us total) trans 158913794308 rc 0/0
00010000:00010000:0.0:1651532183.104117:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.104119:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5282
00010000:00010000:0.0:1651532183.104122:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.104123:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104126:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104131:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.104132:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.104133:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104136:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104139:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.104140:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.104140:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104143:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104151:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104153:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416603 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [856064->9654271] (req 856064->9654271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104159:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104162:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104193:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104197:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.104517:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.104535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.104557:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468970368
00000100:00100000:1.0:1651532183.104568:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468970304
00000100:00100000:1.0:1651532183.104575:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6439
00000100:00100000:1.0:1651532183.104577:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468970368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.104581:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.104585:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166f1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f113 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.104587:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6440
00000100:00100000:0.0:1651532183.104590:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468970304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.104593:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166f1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f113 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.104594:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.104597:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4166f1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f113 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.104598:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4166f8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f10c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.104600:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532183.104607:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4166f8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f10c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532183.104610:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468970368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (94us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532183.104611:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4166f8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f10c expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.104614:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532183.104615:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6439
00000100:00100000:0.0:1651532183.104624:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468970304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.104627:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6440
00010000:00010000:0.0:1651532183.104640:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104644:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.104662:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468966016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466494us (466604us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532183.104665:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5283
00010000:00010000:0.0:1651532183.104671:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104674:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.104675:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104678:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104683:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.104686:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41660a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [266240->1433599] (req 266240->1433599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.105008:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.105019:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468970560
00000100:00100000:1.0:1651532183.105020:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.105027:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468970624
00000100:00100000:0.0:1651532183.105035:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5292
00000100:00100000:0.0:1651532183.105037:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468970560:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532183.105044:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5293
00010000:00010000:0.0:1651532183.105044:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.105045:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468970624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532183.105048:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532183.105049:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.105052:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.105052:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532183.105053:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.105057:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532183.105058:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.105061:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532183.105062:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.105065:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.105066:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.105069:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.105070:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.105141:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.105148:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468970816
00000100:00100000:1.0:1651532183.105160:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6441
00000100:00100000:1.0:1651532183.105162:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468970816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.105167:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.105170:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41670d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f11a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.105177:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41670d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f11a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.105182:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41670d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f11a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.105185:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532183.105195:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468970816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.105198:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6441
00000001:00080000:0.0:1651532183.254070:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794309 is committed
00010000:00010000:0.0:1651532183.254085:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254089:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.254112:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037b6d1b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468967232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516398us (516453us total) trans 158913794309 rc 0/0
00000100:00100000:0.0:1651532183.254115:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5284
00010000:00010000:0.0:1651532183.254123:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254126:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.254127:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254130:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254135:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.254135:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.254136:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254139:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254149:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254152:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416649 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1437696->10420223] (req 1437696->10420223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.254178:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.254183:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.254455:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.254459:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254472:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254476:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.254477:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.254478:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000157757ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468967296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 516738us (516810us total) trans 0 rc 40960/40960
00010000:00010000:0.0:1651532183.254480:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.254482:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5285
00010000:00010000:0.0:1651532183.254485:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.254486:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.254486:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254489:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254496:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254499:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416650 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1781760->9719807] (req 1781760->9719807) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254504:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254507:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.254553:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.254591:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.254605:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.254611:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468971072
00000100:00100000:1.0:1651532183.254613:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468971200
00000100:00100000:0.0:1651532183.254622:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468970944
00000100:00100000:0.0:1651532183.254627:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6442
00000100:00100000:0.0:1651532183.254628:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468971072:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532183.254629:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6443
00000100:00100000:1.0:1651532183.254631:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468971200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.254632:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.254634:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.254636:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416714 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f128 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.254638:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41671b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f12f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254644:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416714 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f128 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.254647:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41671b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f12f expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.254648:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416714 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f128 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.254651:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41671b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f12f expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.254652:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532183.254655:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532183.254664:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468971072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (112us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.254667:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6442
00000100:00100000:1.0:1651532183.254670:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468971200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.254672:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6444
00000100:00100000:1.0:1651532183.254674:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6443
00000100:00100000:0.0:1651532183.254674:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468970944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.254676:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.254679:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416722 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f121 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254685:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416722 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f121 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.254688:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416722 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f121 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.254691:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532183.254710:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468970944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (105us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.254713:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6444
00000100:00100000:1.0:1651532183.254831:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.254841:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.254852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.254861:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468971264
00000100:00100000:1.0:1651532183.254872:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468971328
00000100:00100000:1.0:1651532183.254886:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5294
00000100:00100000:1.0:1651532183.254888:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468971264:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532183.254889:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5295
00000100:00100000:0.0:1651532183.254891:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468971328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532183.254897:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254901:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.254904:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532183.254905:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532183.254906:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254928:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532183.254929:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.254933:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.254934:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.254943:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468971392
00000100:00100000:0.0:1651532183.254963:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6445
00000100:00100000:0.0:1651532183.254965:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468971392:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532183.254966:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532183.254968:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.254971:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416737 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f136 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.254973:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468971520
00010000:00010000:0.0:1651532183.254978:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416737 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f136 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532183.254980:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6446
00000100:00100000:1.0:1651532183.254982:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468971520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.254982:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416737 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f136 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.254985:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.254988:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532183.254989:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41673e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f13d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.254996:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41673e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f13d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532183.255002:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468971392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (151us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.255005:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6445
00010000:00010000:1.0:1651532183.255008:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41673e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f13d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255012:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532183.255028:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468971520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.255031:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6446
00000100:00100000:1.0:1651532183.255106:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.255114:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.255120:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468971648
00000100:00100000:1.0:1651532183.255126:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468971712
00000100:00100000:1.0:1651532183.255135:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6447
00000100:00100000:1.0:1651532183.255137:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468971648:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532183.255138:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6448
00010000:00010000:1.0:1651532183.255140:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532183.255140:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468971712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.255143:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.255144:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416745 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f144 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.255147:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41674c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f14b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.255152:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416745 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f144 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.255154:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41674c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f14b expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255156:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416745 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f144 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.255158:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f41674c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f14b expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255159:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532183.255161:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532183.255169:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468971648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.255169:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468971712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.255172:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6447
00000100:00100000:0.0:1651532183.255173:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6448
00000100:00100000:1.0:1651532183.255282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.255291:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.255301:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468971904
00000100:00100000:0.0:1651532183.255301:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468971968
00000100:00100000:0.0:1651532183.255311:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6449
00000100:00100000:0.0:1651532183.255312:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468971968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.255315:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532183.255317:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6450
00000100:00100000:1.0:1651532183.255319:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468971904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.255319:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416753 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f159 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.255322:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.255326:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41675a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f152 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.255326:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416753 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f159 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.255330:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416753 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f159 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.255333:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532183.255334:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41675a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f152 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255338:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41675a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f152 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255342:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532183.255345:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468971968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.255348:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6449
00000100:00100000:1.0:1651532183.255356:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468971904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.255359:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6450
00000100:00100000:1.0:1651532183.255514:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.255523:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.255529:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468972160
00000100:00100000:1.0:1651532183.255535:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468972224
00000100:00100000:1.0:1651532183.255544:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6451
00000100:00100000:1.0:1651532183.255545:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468972160:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532183.255548:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6452
00010000:00010000:1.0:1651532183.255549:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532183.255550:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468972224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.255553:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416761 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f160 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.255553:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.255557:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416768 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f167 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.255560:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416761 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f160 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.255564:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416768 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f167 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255567:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416761 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f160 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.255568:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416768 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f167 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255570:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532183.255571:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532183.255581:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468972160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.255581:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468972224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.255584:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6451
00000100:00100000:0.0:1651532183.255586:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6452
00000100:00100000:1.0:1651532183.255649:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.255656:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468972416
00000100:00100000:1.0:1651532183.255667:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6453
00000100:00100000:1.0:1651532183.255669:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468972416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.255673:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.255676:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41676f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f16e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.255683:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41676f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f16e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255687:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41676f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f16e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255690:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532183.255700:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468972416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.255704:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6453
00000100:00100000:1.0:1651532183.255847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.255855:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468972608
00000100:00100000:1.0:1651532183.255866:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6454
00000100:00100000:1.0:1651532183.255868:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468972608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.255871:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.255875:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416776 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f175 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.255883:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416776 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f175 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255887:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416776 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f175 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.255890:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532183.255899:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468972608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.255902:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6454
00000100:00100000:1.0:1651532183.255971:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.255978:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468972800
00000100:00100000:1.0:1651532183.255989:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6455
00000100:00100000:1.0:1651532183.255991:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468972800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.255994:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.255998:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41677d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f17c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.256006:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41677d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f17c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.256010:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41677d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f17c expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.256013:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532183.256022:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468972800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.256024:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6455
00000001:00080000:0.0:1651532183.354011:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794310 is committed
00010000:00010000:0.0:1651532183.354026:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354030:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.354051:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000655dd3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468968192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499588us (499635us total) trans 158913794310 rc 0/0
00000100:00100000:0.0:1651532183.354055:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5286
00010000:00010000:0.0:1651532183.354062:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354065:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.354066:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354069:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354074:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.354075:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.354076:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354079:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354089:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354092:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416681 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [749568->10182655] (req 749568->10182655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354097:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354100:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.354411:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.354420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.354436:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468973120
00010000:00010000:0.0:1651532183.354441:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.354443:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468973248
00010000:00010000:0.0:1651532183.354445:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.354447:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6456
00000100:00100000:1.0:1651532183.354449:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468973120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.354453:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.354456:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416784 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f183 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.354465:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d672f724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468968256:12345-10.240.43.64@tcp:3:fio.0 Request processed in 499959us (500029us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532183.354468:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5287
00010000:00010000:1.0:1651532183.354469:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532183.354472:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416784 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f183 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.354475:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.354476:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416784 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f183 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.354479:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532183.354480:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532183.354480:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354485:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.354488:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468973120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (78us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532183.354490:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532183.354491:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6456
00010000:00010000:0.0:1651532183.354491:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.354491:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354494:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.354495:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6457
00000100:00100000:1.0:1651532183.354497:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a617cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468973248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.354499:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.354501:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.354502:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41678b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f18a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354504:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416688 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2891776->10186751] (req 2891776->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.354507:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41678b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f18a expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.354509:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.354511:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41678b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f18a expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.354512:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.354514:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532183.354519:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a617cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468973248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.354521:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6457
00000100:00100000:1.0:1651532183.354930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.354943:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468973504
00000100:00100000:1.0:1651532183.354944:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.354960:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468973440
00000100:00100000:0.0:1651532183.354969:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5296
00000100:00100000:0.0:1651532183.354971:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468973504:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532183.354977:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5297
00000100:00100000:1.0:1651532183.354980:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468973440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532183.354990:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.354995:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.355001:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532183.355002:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.355005:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532183.355005:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.355009:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532183.355010:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.355013:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.355016:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.355019:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532183.355019:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 6/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.355024:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.355024:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.355027:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.355028:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.355030:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.355033:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.355051:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.355058:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.355068:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468973696
00000100:00100000:1.0:1651532183.355069:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468973760
00000100:00100000:0.0:1651532183.355076:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6458
00000100:00100000:0.0:1651532183.355083:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468973696:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532183.355085:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6459
00000100:00100000:1.0:1651532183.355086:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468973760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.355086:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.355089:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.355089:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4167a0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f191 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.355092:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167a7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f198 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.355097:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4167a0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f191 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.355100:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167a7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f198 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.355101:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4167a0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f191 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.355104:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167a7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f198 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.355105:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532183.355107:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532183.355119:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468973696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.355123:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6458
00000100:00100000:1.0:1651532183.355124:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468973760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.355127:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6459
00000100:00100000:1.0:1651532183.355409:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.355417:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468973888
00000100:00100000:1.0:1651532183.355431:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6460
00000100:00100000:1.0:1651532183.355433:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468973888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.355436:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.355440:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4167ae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f19f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.355447:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4167ae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f19f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.355451:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4167ae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f19f expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.355455:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532183.355464:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468973888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.355467:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6460
00000001:00080000:0.0:1651532183.487332:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794311 is committed
00010000:00010000:0.0:1651532183.487347:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487351:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.487381:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065e7bf8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468969024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574329us (574376us total) trans 158913794311 rc 0/0
00000100:00100000:0.0:1651532183.487384:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5288
00010000:00010000:0.0:1651532183.487392:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487395:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.487396:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487399:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487404:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.487405:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.487406:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487409:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487412:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.487413:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.487413:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487416:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487422:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487425:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4166b2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1499136->7245823] (req 1499136->7245823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.487440:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.487444:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.487471:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.487477:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.487677:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.487688:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487702:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487706:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.487707:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487710:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.487711:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d179bd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468969088:12345-10.240.43.64@tcp:3:fio.0 Request processed in 574642us (574695us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532183.487714:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5289
00010000:00010000:0.0:1651532183.487718:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487721:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4166b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1552384->8884223] (req 1552384->8884223) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.487766:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.487776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532183.487793:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.487794:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468974080
00010000:00010000:1.0:1651532183.487797:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.487802:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468974144
00000100:00100000:0.0:1651532183.487824:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6461
00000100:00100000:0.0:1651532183.487826:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468974080:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532183.487827:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468969792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474905us (474945us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532183.487829:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532183.487830:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5290
00010000:00010000:0.0:1651532183.487833:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4167b5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1a6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.487838:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6462
00010000:00010000:0.0:1651532183.487838:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532183.487840:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468974144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.487841:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4167b5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1a6 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.487843:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.487845:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4167b5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1a6 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.487847:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4167bc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1ad expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487849:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532183.487852:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532183.487855:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4167bc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1ad expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532183.487858:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468974080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.487860:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6461
00010000:00010000:1.0:1651532183.487862:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4167bc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1ad expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.487865:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532183.487867:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487871:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532183.487872:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468974144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (96us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532183.487872:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.487874:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6462
00010000:00010000:0.0:1651532183.487875:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487879:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.487880:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.487880:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487883:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487893:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487897:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4166dc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2940928->8802303] (req 2940928->8802303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487908:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.487911:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.487952:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.488011:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.488021:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.488032:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468974336
00000100:00100000:1.0:1651532183.488034:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468974272
00000100:00100000:0.0:1651532183.488044:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6463
00000100:00100000:0.0:1651532183.488045:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468974336:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532183.488051:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468974208
00010000:00010000:0.0:1651532183.488054:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532183.488060:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5298
00000100:00100000:1.0:1651532183.488062:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468974272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532183.488062:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4167c3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1b4 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.488069:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.488070:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4167c3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1b4 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.488073:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532183.488074:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.488077:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532183.488078:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.488081:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4167c3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1b4 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.488082:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.488085:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532183.488086:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.488093:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5299
00000100:00100000:0.0:1651532183.488097:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468974336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.488099:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6463
00000100:00100000:1.0:1651532183.488100:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468974208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532183.488105:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.488111:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532183.488112:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.488116:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532183.488117:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.488124:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.488129:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.488176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.488261:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.488271:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.488281:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468974464
00000100:00100000:1.0:1651532183.488290:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468974528
00000100:00100000:1.0:1651532183.488293:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468974592
00000100:00100000:1.0:1651532183.488297:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6464
00000100:00100000:1.0:1651532183.488298:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468974464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.488302:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.488305:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4167d8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1bb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.488313:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4167d8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1bb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.488317:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4167d8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1bb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.488320:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532183.488330:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468974464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (155us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.488333:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6465
00000100:00100000:0.0:1651532183.488335:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468974528:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532183.488337:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6464
00010000:00010000:0.0:1651532183.488339:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532183.488342:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6466
00010000:00010000:0.0:1651532183.488342:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4167df lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1c2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.488344:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468974592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.488346:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.488349:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4167e6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1c9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.488350:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4167df lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1c2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.488355:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4167e6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1c9 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.488355:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4167df lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1c2 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.488358:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532183.488359:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4167e6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1c9 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.488375:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532183.488377:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468974528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (116us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.488380:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6465
00000100:00100000:1.0:1651532183.488387:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468974592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.488392:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6466
00000100:00100000:1.0:1651532183.488454:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.488490:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468974784
00000100:00100000:1.0:1651532183.488502:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6467
00000100:00100000:1.0:1651532183.488505:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468974784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.488509:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.488514:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4167ed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1d0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.488525:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4167ed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1d0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.488529:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4167ed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1d0 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.488533:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532183.488544:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468974784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.488546:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6467
00000100:00100000:1.0:1651532183.488787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.488795:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468975104
00000100:00100000:1.0:1651532183.488820:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6468
00000100:00100000:1.0:1651532183.488822:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468975104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.488825:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.488829:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4167f4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1d7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.488836:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4167f4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1d7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.488840:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4167f4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1d7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.488844:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532183.488854:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468975104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.488856:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6468
00000001:00080000:0.0:1651532183.579012:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794312 is committed
00010000:00010000:0.0:1651532183.579027:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579030:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.579053:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c4207f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468969728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 566104us (566163us total) trans 158913794312 rc 0/0
00000100:00100000:0.0:1651532183.579056:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5291
00010000:00010000:0.0:1651532183.579063:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579067:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.579068:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579071:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579076:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.579076:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.579078:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579081:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579088:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579090:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4166e3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1556480->8806399] (req 1556480->8806399) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579095:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579099:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.579477:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.579487:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.579496:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.579504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.579513:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468975488
00000100:00100000:1.0:1651532183.579523:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468975552
00000100:00100000:1.0:1651532183.579529:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6469
00000100:00100000:1.0:1651532183.579531:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003117edcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468975488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.579534:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.579539:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4167fb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1de expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.579549:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4167fb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1de expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.579553:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4167fb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1de expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.579556:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532183.579566:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003117edcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468975488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.579566:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6470
00000100:00100000:1.0:1651532183.579568:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6469
00000100:00100000:0.0:1651532183.579568:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468975552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.579572:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.579576:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416802 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1e5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579584:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416802 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1e5 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.579588:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416802 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1e5 expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.579592:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532183.579607:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468975552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (102us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.579609:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6470
00000100:00100000:0.0:1651532183.579619:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468975424
00000100:00100000:0.0:1651532183.579627:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468975360
00000100:00100000:0.0:1651532183.579633:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5300
00000100:00100000:0.0:1651532183.579635:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468975424:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532183.579641:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579645:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532183.579646:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579649:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532183.579649:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.579652:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5301
00010000:00010000:0.0:1651532183.579653:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.579654:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468975360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532183.579657:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.579664:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.579671:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532183.579672:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.579676:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532183.579677:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.579682:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.579689:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.579936:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.579946:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468975808
00000100:00100000:0.0:1651532183.579955:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6471
00000100:00100000:0.0:1651532183.579957:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c57ad69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468975808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.579960:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.579964:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416817 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1ec expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.579971:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416817 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1ec expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.579975:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416817 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1ec expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.579978:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532183.579996:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c57ad69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468975808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.579999:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6471
00000001:00080000:0.0:1651532183.695694:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794313 is committed
00002000:00010000:0.0:1651532183.695707:0:323282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532182 -> 1651532183
00002000:00010000:0.0:1651532183.695709:0:323282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532182 -> 1651532183
00010000:00010000:0.0:1651532183.695711:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695715:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.695737:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f95394f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468970560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 590699us (590730us total) trans 158913794313 rc 0/0
00000100:00100000:0.0:1651532183.695742:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5292
00010000:00010000:0.0:1651532183.695749:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695753:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.695754:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695757:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695762:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.695762:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.695763:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695766:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695769:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.695770:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.695770:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695773:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695776:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.695776:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.695777:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695780:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695791:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695794:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4166ff lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [237568->8978431] (req 237568->8978431) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695799:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.695813:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695814:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.695817:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695827:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695831:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.695848:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.695852:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.695860:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468971328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 440967us (441018us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532183.695863:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5295
00010000:00010000:0.0:1651532183.695869:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695875:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.695876:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695879:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695884:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.695887:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416730 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7008256->7012351] (req 7008256->7012351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.696188:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.696200:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.696200:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468976128
00000100:00100000:1.0:1651532183.696210:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.696215:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468976000
00000100:00100000:0.0:1651532183.696217:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468976192
00000100:00100000:0.0:1651532183.696221:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6472
00000100:00100000:0.0:1651532183.696244:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468976128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.696248:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.696252:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41681e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1fa expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696260:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41681e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1fa expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696264:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41681e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1fa expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696270:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532183.696279:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468976128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (92us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.696282:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6472
00000100:00100000:0.0:1651532183.696287:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6473
00000100:00100000:0.0:1651532183.696288:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468976000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.696291:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.696292:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416825 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f1f3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696298:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416825 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1f3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696302:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416825 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f1f3 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696305:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532183.696308:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.696309:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468976000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (110us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.696312:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6473
00010000:00010000:1.0:1651532183.696313:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.696315:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6474
00000100:00100000:0.0:1651532183.696317:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000208fa08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468976192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.696319:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.696329:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41682c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f201 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.696332:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002902973a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468970624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 591286us (591312us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532183.696335:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41682c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f201 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532183.696337:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5293
00010000:00010000:0.0:1651532183.696338:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f41682c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f201 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696342:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532183.696348:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000208fa08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468976192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.696350:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6474
00010000:00010000:0.0:1651532183.696356:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696360:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.696361:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696376:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696381:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696384:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416706 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [913408->8773631] (req 913408->8773631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.696385:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.696402:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.696412:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468976256
00000100:00100000:0.0:1651532183.696421:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468976320
00000100:00100000:0.0:1651532183.696427:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5302
00000100:00100000:0.0:1651532183.696428:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468976256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532183.696434:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696438:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.696439:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696442:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532183.696443:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696447:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696450:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.696457:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5303
00000100:00100000:0.0:1651532183.696458:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468976320:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532183.696463:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696466:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.696467:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696470:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532183.696470:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696473:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696476:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.696661:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.696672:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468976448
00000100:00100000:0.0:1651532183.696679:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6475
00000100:00100000:0.0:1651532183.696681:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468976448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.696684:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.696687:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416841 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f208 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696694:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416841 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f208 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696715:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416841 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f208 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696719:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532183.696731:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468976448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.696734:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6475
00000100:00100000:1.0:1651532183.696737:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.696747:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468976512
00000100:00100000:0.0:1651532183.696755:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6476
00000100:00100000:0.0:1651532183.696757:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468976512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.696760:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.696762:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416848 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f20f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696769:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416848 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f20f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696773:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416848 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f20f expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696776:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532183.696781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.696782:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468976512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.696785:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6476
00000100:00100000:0.0:1651532183.696788:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468976704
00000100:00100000:0.0:1651532183.696792:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6477
00000100:00100000:0.0:1651532183.696793:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468976704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.696795:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.696797:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41684f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f216 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.696816:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41684f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f216 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696820:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41684f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f216 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.696824:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532183.696831:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468976704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.696834:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6477
00000100:00100000:1.0:1651532183.696995:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.697006:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468976832
00000100:00100000:0.0:1651532183.697014:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6478
00000100:00100000:0.0:1651532183.697015:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468976832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.697018:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.697022:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416856 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f21d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.697029:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416856 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f21d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.697033:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416856 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f21d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.697036:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532183.697050:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468976832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.697052:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6478
00000100:00100000:1.0:1651532183.697244:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.697254:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468977024
00000100:00100000:1.0:1651532183.697255:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.697265:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468976960
00000100:00100000:0.0:1651532183.697273:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6479
00000100:00100000:0.0:1651532183.697274:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468977024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.697277:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532183.697280:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6480
00010000:00010000:0.0:1651532183.697281:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41685d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f22b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.697282:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468976960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.697287:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.697288:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41685d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f22b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.697291:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416864 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f224 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.697291:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41685d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f22b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.697295:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532183.697299:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416864 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f224 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.697303:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416864 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f224 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532183.697307:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468977024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.697309:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6479
00010000:00010000:1.0:1651532183.697313:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532183.697322:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468976960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.697325:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6480
00000100:00100000:1.0:1651532183.697613:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.697620:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468977280
00000100:00100000:1.0:1651532183.697635:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6481
00000100:00100000:1.0:1651532183.697637:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468977280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.697640:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.697644:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41686b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f232 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.697651:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41686b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f232 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.697655:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41686b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f232 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.697659:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532183.697669:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468977280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.697671:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6481
00000001:00080000:0.0:1651532183.787410:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794314 is committed
00010000:00010000:1.0:1651532183.787441:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.787445:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.787467:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468971264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532578us (532636us total) trans 158913794314 rc 0/0
00010000:00010000:0.0:1651532183.787468:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.787470:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5294
00010000:00010000:0.0:1651532183.787473:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.787474:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.787477:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.787483:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.787483:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.787485:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.787488:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.787495:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.787498:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416729 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8773632->10194943] (req 8773632->10194943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.787514:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.787520:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.787878:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.787887:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.787897:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.787904:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.787915:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468977664
00000100:00100000:1.0:1651532183.787916:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468977536
00000100:00100000:0.0:1651532183.787923:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468977728
00000100:00100000:1.0:1651532183.787926:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468977472
00000100:00100000:0.0:1651532183.787928:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6482
00000100:00100000:0.0:1651532183.787930:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468977664:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532183.787935:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5304
00000100:00100000:1.0:1651532183.787936:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468977536:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532183.787939:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.787942:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416872 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f239 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.787944:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.787947:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532183.787949:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532183.787950:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532183.787951:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.787955:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.787956:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416872 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f239 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.787960:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416872 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f239 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532183.787962:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5305
00000100:00100000:1.0:1651532183.787964:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468977472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532183.787964:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532183.787968:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.787974:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532183.787978:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468977664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.787980:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6482
00010000:00010000:1.0:1651532183.787981:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.787984:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.787985:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6483
00010000:00010000:1.0:1651532183.787987:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532183.787987:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.787987:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468977728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.787990:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.787991:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.787992:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416887 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f240 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.787994:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.787996:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532183.787997:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.787998:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416887 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f240 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.788002:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416887 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f240 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.788005:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532183.788009:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.788011:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468977728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (107us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532183.788012:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.788013:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6483
00010000:00010000:0.0:1651532183.788028:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.788030:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468973504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433059us (433101us total) trans 0 rc 65536/65536
00010000:00010000:0.0:1651532183.788032:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.788033:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.788035:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5296
00010000:00010000:0.0:1651532183.788036:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.788041:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.788041:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.788042:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.788045:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.788055:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.788058:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416799 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [339968->9052159] (req 339968->9052159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.788067:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.788070:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.788453:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.788463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.788465:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468977920
00000100:00100000:0.0:1651532183.788473:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468977856
00000100:00100000:0.0:1651532183.788478:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6484
00000100:00100000:0.0:1651532183.788479:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468977920:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532183.788481:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532183.788483:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.788487:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41688e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f24e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.788494:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41688e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f24e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.788498:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41688e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f24e expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532183.788500:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468978048
00010000:00010000:0.0:1651532183.788501:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532183.788508:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6485
00000100:00100000:1.0:1651532183.788510:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468977856:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532183.788516:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468977920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.788519:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6484
00010000:00010000:1.0:1651532183.788520:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.788524:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416895 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f247 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.788524:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6486
00000100:00100000:0.0:1651532183.788526:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468978048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.788528:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.788531:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41689c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f255 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.788533:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416895 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f247 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.788537:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416895 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f247 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.788537:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41689c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f255 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.788540:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532183.788541:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41689c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f255 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.788547:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532183.788549:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468977856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.788552:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6485
00000100:00100000:0.0:1651532183.788553:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468978048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.788555:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6486
00000100:00100000:1.0:1651532183.788776:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.788787:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468978176
00000100:00100000:0.0:1651532183.788794:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6487
00000100:00100000:0.0:1651532183.788796:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468978176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.788799:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.788817:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4168a3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f25c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.788824:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4168a3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f25c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.788828:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4168a3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f25c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.788832:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532183.788853:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468978176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.788856:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6487
00000100:00100000:1.0:1651532183.788889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.788900:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468978304
00000100:00100000:1.0:1651532183.788902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.788914:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468978432
00000100:00100000:0.0:1651532183.788921:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6488
00000100:00100000:0.0:1651532183.788922:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468978304:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532183.788925:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6489
00010000:00010000:0.0:1651532183.788926:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532183.788927:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468978432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.788929:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168aa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f263 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.788932:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.788935:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4168b1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f26a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.788936:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168aa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f263 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.788939:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168aa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f263 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.788943:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4168b1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f26a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.788943:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532183.788947:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4168b1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f26a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.788950:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532183.788954:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468978304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.788957:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6488
00000100:00100000:1.0:1651532183.788965:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468978432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.788968:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6489
00000100:00100000:1.0:1651532183.789238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.789245:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468978688
00000100:00100000:1.0:1651532183.789257:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6490
00000100:00100000:1.0:1651532183.789259:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468978688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.789262:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.789266:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168b8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f271 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.789273:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168b8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f271 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.789277:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168b8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f271 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.789281:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532183.789291:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468978688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.789293:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6490
00000100:00100000:1.0:1651532183.789527:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.789535:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468978880
00000100:00100000:1.0:1651532183.789549:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6491
00000100:00100000:1.0:1651532183.789551:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468978880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.789554:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.789558:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4168bf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f278 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.789565:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4168bf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f278 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.789569:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4168bf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f278 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.789572:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532183.789582:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468978880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.789584:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6491
00000100:00100000:1.0:1651532183.789822:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.789830:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468979008
00000100:00100000:1.0:1651532183.789840:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6492
00000100:00100000:1.0:1651532183.789842:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468979008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.789845:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532183.789849:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168c6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f27f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.789856:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168c6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f27f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.789860:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168c6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f27f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.789863:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532183.789873:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468979008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.789875:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6492
00000001:00080000:0.0:1651532183.845760:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794315 is committed
00010000:00010000:0.0:1651532183.845775:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.845779:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.845800:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468973440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 490820us (490856us total) trans 158913794315 rc 0/0
00000100:00100000:0.0:1651532183.845815:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5297
00010000:00010000:0.0:1651532183.845822:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.845828:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.845829:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.845833:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.845838:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.845838:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.845839:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.845842:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.845848:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.845851:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416792 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5652480->10280959] (req 5652480->10280959) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.845861:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.845866:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.846198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.846211:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.846211:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468979200
00000100:00100000:1.0:1651532183.846219:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.846221:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468979136
00000100:00100000:0.0:1651532183.846231:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5306
00000100:00100000:0.0:1651532183.846233:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b9096eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468979200:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532183.846235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532183.846245:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.846246:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5307
00000100:00100000:1.0:1651532183.846248:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468979136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532183.846251:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.846252:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.846255:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532183.846256:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.846257:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.846260:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.846261:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532183.846262:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.846265:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532183.846266:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.846269:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.846271:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.846274:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.846278:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468979456
00000100:00100000:0.0:1651532183.846284:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468979520
00010000:00010000:1.0:1651532183.846285:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.846288:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6493
00010000:00010000:1.0:1651532183.846289:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.846289:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468979456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.846292:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.846294:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4168db lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f286 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.846305:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532183.846307:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468974272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358245us (358357us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651532183.846308:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4168db lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f286 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532183.846310:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5298
00010000:00010000:0.0:1651532183.846312:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4168db lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f286 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.846315:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532183.846318:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6494
00000100:00100000:1.0:1651532183.846320:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468979520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.846323:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532183.846324:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468979456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (105us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532183.846326:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4168e2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f28d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.846327:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6493
00010000:00010000:1.0:1651532183.846331:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532183.846333:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4168e2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f28d expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.846334:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.846337:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4168e2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f28d expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.846338:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.846339:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.846340:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532183.846342:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.846346:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532183.846347:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468979520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (112us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532183.846347:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.846347:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.846349:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6494
00010000:00010000:0.0:1651532183.846351:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.846361:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.846373:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4167ca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2093056->9535487] (req 2093056->9535487) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.846388:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.846391:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.846694:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.846707:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468979776
00000100:00100000:1.0:1651532183.846715:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.846716:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6495
00000100:00100000:0.0:1651532183.846718:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468979776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.846721:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.846725:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168e9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f294 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.846732:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168e9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f294 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.846736:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168e9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f294 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532183.846737:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468979840
00010000:00010000:0.0:1651532183.846740:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532183.846750:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6496
00000100:00100000:1.0:1651532183.846752:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468979840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.846755:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532183.846760:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468979776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.846763:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6495
00010000:00010000:1.0:1651532183.846766:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168f0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f29b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.846774:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168f0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f29b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.846781:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168f0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f29b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.846784:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532183.846793:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468979840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.846795:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6496
00000001:00080000:0.0:1651532183.979075:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794316 is committed
00010000:00010000:0.0:1651532183.979089:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979093:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.979115:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b76333f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468974208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491019us (491104us total) trans 158913794316 rc 0/0
00000100:00100000:0.0:1651532183.979118:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5299
00010000:00010000:0.0:1651532183.979125:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979129:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.979130:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979133:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979137:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.979138:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.979139:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979142:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979149:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979152:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4167d1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->7368703] (req 2953216->7368703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.979166:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.979171:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.979515:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.979528:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468980096
00000100:00100000:1.0:1651532183.979536:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.979547:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468980032
00000100:00100000:1.0:1651532183.979553:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.979554:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5308
00000100:00100000:0.0:1651532183.979556:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468980096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532183.979562:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.979565:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5309
00010000:00010000:0.0:1651532183.979566:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.979567:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.979568:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0aea5df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468980032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532183.979570:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532183.979571:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979575:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.979576:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979578:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.979581:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532183.979582:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.979585:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532183.979586:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.979591:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.979594:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.979599:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468980224
00010000:00010000:1.0:1651532183.979605:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532183.979606:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6497
00000100:00100000:0.0:1651532183.979607:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468980224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.979608:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979610:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.979612:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416905 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2a2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979627:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532183.979628:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a9fe9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468975424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 399992us (400151us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532183.979629:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416905 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2a2 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532183.979631:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5300
00010000:00010000:0.0:1651532183.979634:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416905 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2a2 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.979637:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532183.979646:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468980224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.979648:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6497
00010000:00010000:0.0:1651532183.979655:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979658:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532183.979659:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979662:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979667:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.979667:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532183.979668:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979671:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979681:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979685:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416809 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [741376->8871935] (req 741376->8871935) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979694:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979697:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532183.979942:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532183.979953:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468980416
00000100:00100000:0.0:1651532183.979967:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6498
00000100:00100000:0.0:1651532183.979969:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468980416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532183.979972:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.979976:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41690c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2a9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.979983:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41690c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2a9 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.979987:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41690c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2a9 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.979991:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532183.980007:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468980416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532183.980010:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6498
00000100:00100000:1.0:1651532183.980072:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.980084:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532183.980096:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468980480
00000100:00100000:0.0:1651532183.980098:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468980544
00000100:00100000:1.0:1651532183.980107:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6499
00000100:00100000:1.0:1651532183.980109:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468980480:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532183.980111:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6500
00010000:00010000:1.0:1651532183.980113:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532183.980113:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468980544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532183.980116:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416913 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2b0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532183.980116:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532183.980120:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41691a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2b7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532183.980128:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416913 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2b0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.980129:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41691a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2b7 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.980132:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416913 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2b0 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532183.980133:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41691a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2b7 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532183.980136:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532183.980136:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532183.980153:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468980544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.980162:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468980480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532183.980165:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6499
00000100:00100000:0.0:1651532183.980167:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6500
00000001:00080000:0.0:1651532184.079090:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794317 is committed
00010000:00010000:0.0:1651532184.079105:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079109:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.079134:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b88317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754468975360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499479us (499646us total) trans 158913794317 rc 0/0
00000100:00100000:0.0:1651532184.079138:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5301
00010000:00010000:0.0:1651532184.079145:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079148:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.079149:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079152:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079157:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.079158:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.079158:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079161:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079168:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079171:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416810 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1601536->7282687] (req 1601536->7282687) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079176:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079179:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.079513:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.079522:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.079530:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.079539:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.079548:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468980864
00000100:00100000:1.0:1651532184.079561:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468980928
00000100:00100000:1.0:1651532184.079569:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5310
00000100:00100000:1.0:1651532184.079570:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468980864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532184.079578:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.079582:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532184.079583:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.079586:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532184.079587:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.079592:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.079593:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5311
00010000:00010000:1.0:1651532184.079596:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.079596:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468980928:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532184.079603:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.079608:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468980992
00010000:00010000:0.0:1651532184.079608:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532184.079609:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079612:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532184.079612:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.079617:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468981120
00000100:00100000:1.0:1651532184.079621:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6501
00000100:00100000:1.0:1651532184.079623:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468980992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.079624:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.079626:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.079628:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41692f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2be expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079628:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.079635:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41692f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2be expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532184.079636:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6502
00000100:00100000:0.0:1651532184.079638:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468981120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.079639:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41692f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2be expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.079641:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.079643:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532184.079643:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416936 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2c5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079651:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416936 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2c5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532184.079653:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468980992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (123us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532184.079655:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416936 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2c5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532184.079656:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6501
00010000:00010000:0.0:1651532184.079658:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532184.079680:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468981120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (128us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.079683:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6502
00000100:00100000:1.0:1651532184.079952:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.079964:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468981248
00000100:00100000:0.0:1651532184.079975:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6503
00000100:00100000:0.0:1651532184.079977:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468981248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.079980:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.079984:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41693d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2cc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.079991:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41693d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2cc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.079995:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f41693d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2cc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.079998:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532184.080011:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468981248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.080014:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6503
00000001:00080000:0.0:1651532184.145830:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794318 is committed
00010000:00010000:0.0:1651532184.145845:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145849:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.145872:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468976256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449442us (449487us total) trans 158913794318 rc 0/0
00000100:00100000:0.0:1651532184.145875:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5302
00010000:00010000:0.0:1651532184.145882:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145886:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.145887:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145890:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145895:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.145895:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.145896:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145899:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145905:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.145905:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.145906:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145909:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145916:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145919:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416833 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [942080->7925759] (req 942080->7925759) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145924:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.145926:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.145932:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.145937:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.146267:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.146283:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468981568
00000100:00100000:0.0:1651532184.146295:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6504
00000100:00100000:0.0:1651532184.146297:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a83fbab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468981568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.146299:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146301:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.146303:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146305:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416944 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2d3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146316:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.146319:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416944 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2d3 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532184.146322:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b6e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468977536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358385us (358444us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532184.146325:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5304
00010000:00010000:0.0:1651532184.146328:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416944 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2d3 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.146332:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532184.146338:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.146340:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a83fbab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468981568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (75us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532184.146341:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532184.146342:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.146343:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6504
00010000:00010000:1.0:1651532184.146345:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.146351:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.146357:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416879 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3039232->8617983] (req 3039232->8617983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146389:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146393:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.146405:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264ef79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468976320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 449946us (450003us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532184.146408:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5303
00010000:00010000:0.0:1651532184.146414:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146417:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.146418:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146421:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146429:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.146429:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.146430:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146433:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146445:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146448:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41683a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1810432->7815167] (req 1810432->7815167) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.146455:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.146459:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.146838:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.146846:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.146856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.146859:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468981696
00000100:00100000:0.0:1651532184.146863:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468981632
00000100:00100000:1.0:1651532184.146881:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5312
00000100:00100000:1.0:1651532184.146883:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468981696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532184.146898:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.146898:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5313
00000100:00100000:0.0:1651532184.146900:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468981632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532184.146903:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532184.146904:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532184.146904:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146907:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.146908:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146912:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532184.146913:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146916:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146919:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532184.146920:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.146924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532184.146924:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146927:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.146930:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.146932:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.146939:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468981888
00000100:00100000:0.0:1651532184.146948:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468981824
00000100:00100000:0.0:1651532184.146950:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468982080
00000100:00100000:0.0:1651532184.146953:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6505
00000100:00100000:0.0:1651532184.146954:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468981888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.146957:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.146960:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416959 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2e1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.146964:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532184.146966:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416959 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2e1 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.146971:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416959 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2e1 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532184.146973:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468982016
00010000:00010000:0.0:1651532184.146977:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532184.146980:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6506
00000100:00100000:1.0:1651532184.146982:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468981824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.146985:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532184.146988:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468981888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (131us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532184.146989:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416960 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2da expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.146990:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6505
00000100:00100000:0.0:1651532184.146995:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6507
00010000:00010000:1.0:1651532184.146997:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416960 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2da expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532184.146997:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468982080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.146999:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.147001:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416960 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2da expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.147001:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416967 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2ef expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.147005:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532184.147007:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416967 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2ef expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.147011:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416967 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2ef expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532184.147013:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468981824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (89us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532184.147014:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532184.147016:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6506
00000100:00100000:0.0:1651532184.147020:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468982080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.147021:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6508
00000100:00100000:1.0:1651532184.147023:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468982016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532184.147023:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6507
00010000:00010000:1.0:1651532184.147025:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.147027:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41696e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2e8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.147033:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41696e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2e8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.147037:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41696e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2e8 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.147040:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532184.147045:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468982016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.147048:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6508
00000100:00100000:1.0:1651532184.147469:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.147477:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468982336
00000100:00100000:1.0:1651532184.147491:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6509
00000100:00100000:1.0:1651532184.147493:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468982336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.147496:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.147500:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416975 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2f6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.147507:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416975 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2f6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.147511:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416975 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2f6 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.147515:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532184.147528:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468982336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.147531:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6509
00000001:00080000:0.0:1651532184.237529:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794319 is committed
00010000:00010000:1.0:1651532184.237559:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.237566:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.237587:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007746fb5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468977472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449622us (449700us total) trans 158913794319 rc 0/0
00010000:00010000:0.0:1651532184.237589:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.237591:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5305
00010000:00010000:0.0:1651532184.237594:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.237595:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.237598:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.237603:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.237604:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.237605:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.237608:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.237615:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.237618:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416880 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3170304->9056255] (req 3170304->9056255) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.237636:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.237641:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.237973:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.237982:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.237994:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.237995:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468982528
00000100:00100000:0.0:1651532184.238006:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468982592
00000100:00100000:1.0:1651532184.238008:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5314
00000100:00100000:1.0:1651532184.238010:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468982528:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532184.238012:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5315
00000100:00100000:0.0:1651532184.238014:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468982592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532184.238018:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.238020:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.238023:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532184.238024:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.238027:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532184.238028:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.238032:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.238033:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.238039:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532184.238040:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.238043:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.238044:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.238047:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.238047:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.238058:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.238060:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468982656
00010000:00010000:1.0:1651532184.238061:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.238066:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6510
00000100:00100000:0.0:1651532184.238068:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa3ce2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468982656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.238071:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.238074:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41698a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f2fd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.238079:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b9096eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468979200:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391845us (391881us total) trans 0 rc 45056/45056
00000100:00100000:1.0:1651532184.238082:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5306
00010000:00010000:0.0:1651532184.238085:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.238088:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41698a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2fd expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.238089:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.238092:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f41698a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f2fd expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.238093:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532184.238094:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.238095:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532184.238097:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.238101:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.238102:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.238103:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.238105:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa3ce2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468982656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (111us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532184.238106:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.238108:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6510
00010000:00010000:1.0:1651532184.238112:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.238115:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4168cd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [294912->8409087] (req 294912->8409087) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.238120:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.238123:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.238603:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.238617:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.238628:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468982784
00000100:00100000:0.0:1651532184.238638:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468982848
00000100:00100000:0.0:1651532184.238643:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6511
00000100:00100000:0.0:1651532184.238644:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468982784:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532184.238645:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6512
00000100:00100000:1.0:1651532184.238648:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468982848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.238648:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.238652:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.238652:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416991 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f304 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.238656:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416998 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f30b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.238659:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416991 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f304 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.238664:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416991 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f304 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.238665:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416998 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f30b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.238667:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532184.238672:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416998 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f30b expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.238676:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532184.238677:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468982784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.238680:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6511
00000100:00100000:1.0:1651532184.238684:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468982848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.238687:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6512
00000001:00080000:0.0:1651532184.295888:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794320 is committed
00010000:00010000:1.0:1651532184.295918:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.295923:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.295944:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d1bca15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468979136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449695us (449732us total) trans 158913794320 rc 0/0
00010000:00010000:0.0:1651532184.295945:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.295947:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5307
00010000:00010000:0.0:1651532184.295950:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.295951:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.295957:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.295962:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.295963:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.295964:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.295967:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.295974:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.295977:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4168d4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1155072->10104831] (req 1155072->10104831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.295993:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.295998:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.296375:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.296385:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.296392:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.296399:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.296412:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468983360
00000100:00100000:1.0:1651532184.296414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.296428:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468983296
00000100:00100000:0.0:1651532184.296431:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468983488
00000100:00100000:1.0:1651532184.296432:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468983168
00000100:00100000:0.0:1651532184.296434:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6513
00000100:00100000:0.0:1651532184.296436:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468983360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.296440:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532184.296445:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468983104
00010000:00010000:0.0:1651532184.296448:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41699f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f319 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.296455:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5316
00000100:00100000:1.0:1651532184.296458:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468983168:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532184.296458:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.296461:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41699f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f319 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.296465:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41699f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f319 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.296466:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296469:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532184.296470:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.296472:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532184.296472:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.296475:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.296479:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468983360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (87us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.296482:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6513
00010000:00010000:1.0:1651532184.296486:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.296487:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6514
00000100:00100000:0.0:1651532184.296488:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468983296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.296489:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296491:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.296493:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4169ad lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f312 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296504:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.296506:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4169ad lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f312 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532184.296507:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba2d11e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468980096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316950us (316993us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532184.296510:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5308
00010000:00010000:0.0:1651532184.296510:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4169ad lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f312 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.296513:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:1.0:1651532184.296515:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5317
00000100:00100000:1.0:1651532184.296517:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468983104:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532184.296520:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468983296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (122us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532184.296522:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.296522:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6514
00010000:00010000:1.0:1651532184.296526:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532184.296527:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.296527:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6515
00000100:00100000:0.0:1651532184.296529:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468983488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.296530:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296531:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.296533:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532184.296533:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296533:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4169bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f320 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296537:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.296539:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296539:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4169bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f320 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.296542:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296543:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f4169bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f320 expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.296545:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296546:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532184.296550:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468983488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.296552:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6515
00010000:00010000:0.0:1651532184.296560:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296563:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.296564:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296567:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296572:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.296572:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.296573:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296576:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296589:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.296592:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4168f7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2248704->9539583] (req 2248704->9539583) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.296603:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.296607:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.297015:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.297024:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.297031:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468983552
00000100:00100000:1.0:1651532184.297042:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468983872
00000100:00100000:1.0:1651532184.297047:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6516
00000100:00100000:1.0:1651532184.297049:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468983552:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532184.297050:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6517
00000100:00100000:0.0:1651532184.297052:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468983872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.297053:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.297056:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.297057:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f327 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.297060:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4169c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f32e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.297065:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f327 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.297067:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4169c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f32e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.297070:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f327 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.297071:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4169c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f32e expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.297073:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532184.297075:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532184.297086:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468983552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.297089:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6516
00000100:00100000:0.0:1651532184.297092:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468983872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.297096:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6517
00000100:00100000:1.0:1651532184.297343:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.297355:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468984000
00000100:00100000:0.0:1651532184.297371:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6518
00000100:00100000:0.0:1651532184.297372:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468984000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.297376:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.297379:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4169d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f335 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.297386:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4169d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f335 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.297390:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4169d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f335 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.297393:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532184.297403:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468984000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.297406:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6518
00000100:00100000:1.0:1651532184.297615:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.297626:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468984192
00000100:00100000:0.0:1651532184.297637:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6519
00000100:00100000:0.0:1651532184.297638:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468984192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.297641:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.297644:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169d7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f33c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.297651:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f33c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.297655:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f33c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.297659:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532184.297669:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468984192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.297671:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6519
00000001:00080000:0.0:1651532184.404233:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794321 is committed
00010000:00010000:1.0:1651532184.404262:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404267:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.404284:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0aea5df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468980032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 424716us (424748us total) trans 158913794321 rc 0/0
00000100:00100000:1.0:1651532184.404290:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5309
00010000:00010000:1.0:1651532184.404297:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404300:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532184.404301:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404304:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404309:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.404310:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.404311:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404314:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404321:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404324:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4168fe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2699264->10223615] (req 2699264->10223615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404329:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404332:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.404673:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.404682:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.404698:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.404706:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468984384
00000100:00100000:0.0:1651532184.404707:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468984448
00000100:00100000:0.0:1651532184.404721:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5318
00000100:00100000:1.0:1651532184.404734:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5319
00000100:00100000:0.0:1651532184.404736:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468984448:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532184.404737:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468984384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532184.404744:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.404748:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532184.404749:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.404752:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532184.404753:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.404758:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404761:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.404761:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404766:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532184.404767:0:323282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.404769:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468984512
00010000:00010000:1.0:1651532184.404770:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532184.404770:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.404775:0:323282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.404780:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6520
00000100:00100000:0.0:1651532184.404782:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468984512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.404785:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.404787:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.404787:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4169ec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f343 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.404794:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4169ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f343 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.404798:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4169ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f343 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.404818:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532184.404830:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468984512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (132us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.404833:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6520
00000100:00100000:1.0:1651532184.404842:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.404870:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468984640
00000100:00100000:0.0:1651532184.404880:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6521
00000100:00100000:0.0:1651532184.404881:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468984640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.404885:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.404888:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4169f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f34a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.404895:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4169f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f34a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.404899:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4169f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f34a expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.404902:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532184.404912:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468984640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.404914:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6521
00000001:00080000:0.0:1651532184.470930:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794322 is committed
00010000:00010000:1.0:1651532184.470958:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.470965:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.470987:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468980864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 391416us (391475us total) trans 158913794322 rc 0/0
00010000:00010000:0.0:1651532184.470988:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.470991:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5310
00010000:00010000:0.0:1651532184.470992:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.470993:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.470997:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471002:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.471003:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.471003:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471007:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471010:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.471011:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.471011:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471014:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471025:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471027:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416921 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->9609215] (req 999424->9609215) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471046:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471050:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471079:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471082:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.471334:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.471345:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468985024
00000100:00100000:0.0:1651532184.471357:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6522
00000100:00100000:0.0:1651532184.471359:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468985024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.471371:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.471374:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4169fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f351 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471379:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.471381:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471387:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471393:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4169fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f351 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.471397:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4169fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f351 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532184.471411:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e8df8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468981696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 324527us (324573us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532184.471416:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5312
00010000:00010000:1.0:1651532184.471424:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471431:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532184.471441:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468985024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 81us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.471444:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6522
00010000:00010000:1.0:1651532184.471445:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532184.471447:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471450:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471456:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471459:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41694b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5419008->10108927] (req 5419008->10108927) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.471460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532184.471469:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471473:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.471473:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.471494:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754468980928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391898us (391971us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532184.471497:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5311
00010000:00010000:0.0:1651532184.471507:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471511:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.471512:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471515:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471520:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.471521:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.471521:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471524:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471531:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471534:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416928 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [299008->6086655] (req 299008->6086655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471539:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.471540:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468985088
00010000:00010000:0.0:1651532184.471543:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.471550:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468985216
00000100:00100000:1.0:1651532184.471556:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6523
00000100:00100000:1.0:1651532184.471559:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468985088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.471564:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.471569:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416a01 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f358 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471578:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416a01 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f358 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.471582:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416a01 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f358 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532184.471584:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6524
00010000:00010000:1.0:1651532184.471586:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532184.471586:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468985216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.471590:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.471593:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416a08 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f35f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.471594:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468985088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.471597:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6523
00010000:00010000:0.0:1651532184.471600:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416a08 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f35f expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.471604:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416a08 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f35f expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.471607:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532184.471614:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468985216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (141us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.471617:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6524
00000100:00100000:0.0:1651532184.471838:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.471847:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.471856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.471858:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468985344
00000100:00100000:1.0:1651532184.471869:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468985280
00000100:00100000:1.0:1651532184.471874:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5320
00000100:00100000:1.0:1651532184.471876:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468985344:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532184.471883:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471888:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532184.471889:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471894:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532184.471895:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471899:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471903:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.471910:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5321
00000100:00100000:1.0:1651532184.471911:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468985280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532184.471917:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471920:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532184.471920:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468985472
00010000:00010000:1.0:1651532184.471921:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471923:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532184.471924:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.471927:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.471932:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6525
00000100:00100000:0.0:1651532184.471934:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468985472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.471938:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.471939:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471941:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416a1d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f366 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.471948:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416a1d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f366 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.471972:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416a1d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f366 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.471976:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532184.471982:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.471987:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468985472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (131us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.471990:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6525
00000100:00100000:0.0:1651532184.472007:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468985728
00000100:00100000:0.0:1651532184.472017:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6526
00000100:00100000:0.0:1651532184.472019:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468985728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.472022:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.472025:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416a24 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f36d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.472032:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416a24 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f36d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.472036:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416a24 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f36d expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.472042:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532184.472043:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.472049:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468985728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.472052:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6526
00000100:00100000:0.0:1651532184.472056:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468985792
00000100:00100000:0.0:1651532184.472059:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6527
00000100:00100000:0.0:1651532184.472061:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468985792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.472063:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.472065:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416a2b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f374 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.472070:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416a2b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f374 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.472074:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416a2b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f374 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.472076:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532184.472086:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468985792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (44us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.472089:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6527
00000100:00100000:0.0:1651532184.472235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.472242:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468985984
00000100:00100000:0.0:1651532184.472255:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6528
00000100:00100000:0.0:1651532184.472257:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468985984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.472260:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.472264:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a32 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f37b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.472270:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a32 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f37b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.472274:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a32 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f37b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.472277:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532184.472289:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468985984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.472291:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6528
00000100:00100000:0.0:1651532184.472456:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.472463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.472475:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468986176
00000100:00100000:0.0:1651532184.472484:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468986112
00000100:00100000:0.0:1651532184.472491:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6529
00000100:00100000:0.0:1651532184.472492:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468986176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.472496:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532184.472497:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6530
00000100:00100000:1.0:1651532184.472499:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468986112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.472499:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a39 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f389 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.472503:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.472506:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a39 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f389 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.472508:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a40 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f382 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.472513:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a39 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f389 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.472516:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a40 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f382 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.472516:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532184.472520:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a40 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f382 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.472524:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:0.0:1651532184.472527:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468986176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.472530:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6529
00000100:00100000:1.0:1651532184.472539:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468986112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.472542:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6530
00000001:00080000:0.0:1651532184.587622:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794323 is committed
00010000:00010000:0.0:1651532184.587637:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.587641:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.587657:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000022ba026 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468981632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 440756us (440810us total) trans 158913794323 rc 0/0
00000100:00100000:0.0:1651532184.587660:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5313
00010000:00010000:0.0:1651532184.587667:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.587670:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.587671:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.587674:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.587679:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.587680:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.587681:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.587684:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.587696:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.587699:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416952 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2801664->10395647] (req 2801664->10395647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.587709:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.587714:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.588057:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.588074:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.588080:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468986560
00000100:00100000:1.0:1651532184.588081:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.588088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.588094:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468986496
00000100:00100000:0.0:1651532184.588102:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5322
00000100:00100000:0.0:1651532184.588104:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468986560:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532184.588107:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5323
00000100:00100000:1.0:1651532184.588110:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468986496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532184.588111:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.588115:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532184.588116:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.588118:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.588119:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532184.588120:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.588140:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532184.588141:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.588144:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532184.588145:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.588149:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.588150:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.588153:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.588153:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.588161:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468986624
00000100:00100000:0.0:1651532184.588167:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468986688
00000100:00100000:1.0:1651532184.588170:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6531
00000100:00100000:1.0:1651532184.588171:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468986624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.588174:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532184.588174:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6532
00000100:00100000:0.0:1651532184.588175:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468986688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.588177:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416a55 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f390 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.588178:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.588181:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a5c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f397 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.588187:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416a55 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f390 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.588189:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a5c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f397 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.588192:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416a55 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f390 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.588193:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a5c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f397 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.588195:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532184.588196:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532184.588210:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468986624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (129us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.588214:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6531
00000100:00100000:0.0:1651532184.588215:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468986688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.588218:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6532
00000100:00100000:1.0:1651532184.588504:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.588522:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468986816
00000100:00100000:0.0:1651532184.588530:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6533
00000100:00100000:0.0:1651532184.588531:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468986816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.588535:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.588538:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416a63 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f39e expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.588545:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416a63 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f39e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.588549:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416a63 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f39e expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.588553:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532184.588562:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468986816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.588565:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6533
00000001:00080000:0.0:1651532184.654372:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794324 is committed
00010000:00010000:1.0:1651532184.654403:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654408:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.654425:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468982528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 416415us (416452us total) trans 158913794324 rc 0/0
00000100:00100000:1.0:1651532184.654428:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5314
00010000:00010000:1.0:1651532184.654435:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654439:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532184.654440:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654443:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654448:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.654449:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.654449:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654452:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654456:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.654456:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.654457:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654459:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654472:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654475:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41697c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->10285055] (req 393216->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654481:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654484:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.654485:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.654490:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.654714:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.654719:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654724:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654729:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.654741:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468982592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416721us (416752us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651532184.654745:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5315
00000100:00100000:1.0:1651532184.654746:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468983168:12345-10.240.43.64@tcp:3:fio.0 Request processed in 358287us (358371us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532184.654749:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5316
00010000:00010000:0.0:1651532184.654752:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.654756:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.654757:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.654760:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654762:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.654765:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654766:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532184.654767:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.654768:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416983 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [643072->10289151] (req 643072->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654770:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654775:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.654775:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.654776:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654779:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654788:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654791:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4169a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2936832->10297343] (req 2936832->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654836:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654840:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.654917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.654928:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987136
00000100:00100000:1.0:1651532184.654930:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.654943:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987200
00000100:00100000:1.0:1651532184.654952:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6534
00000100:00100000:0.0:1651532184.654954:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6535
00000100:00100000:1.0:1651532184.654955:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468987136:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532184.654956:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468987200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.654960:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.654960:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.654963:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416a6a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3b3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.654966:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416a71 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3ac expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.654970:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416a6a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3b3 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.654978:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416a71 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3ac expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.654978:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416a6a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3b3 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.654981:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532184.654986:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416a71 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3ac expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.654993:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532184.655030:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468987200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 73us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.655033:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6535
00000100:00100000:1.0:1651532184.655048:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468987136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 92us (131us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.655051:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6534
00000100:00100000:0.0:1651532184.655081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.655106:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.655115:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.655124:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.655131:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987328
00000100:00100000:0.0:1651532184.655143:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987392
00000100:00100000:0.0:1651532184.655148:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5324
00000100:00100000:0.0:1651532184.655149:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468987328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532184.655156:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.655160:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532184.655161:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.655164:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5325
00010000:00010000:0.0:1651532184.655164:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532184.655165:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.655166:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468987392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532184.655172:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.655175:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.655176:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.655180:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532184.655181:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.655184:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532184.655184:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.655189:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.655192:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.655200:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987072
00000100:00100000:1.0:1651532184.655212:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987264
00000100:00100000:0.0:1651532184.655220:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6536
00000100:00100000:0.0:1651532184.655222:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468987072:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532184.655223:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6537
00000100:00100000:1.0:1651532184.655225:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468987264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.655225:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.655228:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.655228:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416a86 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3a5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.655231:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416a8d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3ba expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.655236:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416a86 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3a5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.655239:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416a8d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3ba expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.655240:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416a86 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3a5 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.655243:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416a8d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3ba expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.655243:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532184.655246:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:0.0:1651532184.655253:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468987072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.655256:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6536
00000100:00100000:1.0:1651532184.655276:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468987264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (159us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.655281:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6537
00000100:00100000:0.0:1651532184.655304:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.655325:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987520
00000100:00100000:1.0:1651532184.655333:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6538
00000100:00100000:1.0:1651532184.655334:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468987520:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532184.655335:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.655344:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987648
00010000:00010000:1.0:1651532184.655348:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532184.655351:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6539
00000100:00100000:0.0:1651532184.655352:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003117edcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468987648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.655353:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416a94 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3c1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.655355:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.655359:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416a9b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3c8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.655360:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416a94 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3c1 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.655376:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416a94 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3c1 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.655376:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416a9b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3c8 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.655380:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416a9b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3c8 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.655383:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532184.655383:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:1.0:1651532184.655395:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468987520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.655395:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003117edcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468987648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.655397:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6539
00000100:00100000:1.0:1651532184.655399:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6538
00000100:00100000:0.0:1651532184.655620:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.655644:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.655655:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987840
00000100:00100000:0.0:1651532184.655662:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.655678:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987776
00000100:00100000:0.0:1651532184.655680:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468987904
00000100:00100000:1.0:1651532184.655683:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6540
00000100:00100000:1.0:1651532184.655685:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468987840:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532184.655687:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6541
00010000:00010000:1.0:1651532184.655688:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532184.655688:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c57ad69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468987776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.655692:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416aa2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3d6 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.655692:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.655696:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416aa9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3cf expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.655700:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416aa2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3d6 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.655703:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416aa9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3cf expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.655704:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416aa2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3d6 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.655707:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532184.655707:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416aa9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3cf expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.655710:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532184.655718:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468987840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.655718:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c57ad69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468987776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.655720:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6541
00000100:00100000:1.0:1651532184.655722:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6540
00000100:00100000:0.0:1651532184.655725:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6542
00000100:00100000:0.0:1651532184.655726:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468987904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.655729:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.655731:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416ab0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3dd expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.655736:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416ab0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3dd expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.655740:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416ab0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3dd expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.655743:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532184.655747:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468987904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.655750:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6542
00000100:00100000:0.0:1651532184.656003:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.656009:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468988160
00000100:00100000:0.0:1651532184.656016:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6543
00000100:00100000:0.0:1651532184.656018:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468988160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.656021:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.656024:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ab7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3e4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.656030:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ab7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3e4 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.656034:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ab7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3e4 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.656037:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532184.656053:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468988160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.656055:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6543
00000001:00080000:0.0:1651532184.779313:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794325 is committed
00002000:00010000:1.0:1651532184.779341:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532183 -> 1651532184
00010000:00010000:1.0:1651532184.779345:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779351:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.779382:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468983104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482864us (482996us total) trans 158913794325 rc 0/0
00000100:00100000:1.0:1651532184.779385:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5317
00010000:00010000:1.0:1651532184.779393:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779396:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532184.779397:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779400:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779405:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.779406:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.779407:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779410:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779430:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779433:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779436:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4169b4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2805760->7376895] (req 2805760->7376895) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779438:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.779713:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.779729:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.779737:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.779739:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468988352
00000100:00100000:0.0:1651532184.779747:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.779754:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468988416
00000100:00100000:1.0:1651532184.779762:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5326
00000100:00100000:1.0:1651532184.779764:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000208fa08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468988352:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532184.779767:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5327
00000100:00100000:0.0:1651532184.779770:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468988416:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532184.779771:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779776:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532184.779777:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779778:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779780:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532184.779780:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779786:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.779788:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779791:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532184.779791:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779795:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779796:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779799:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779799:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.779823:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468988480
00010000:00010000:0.0:1651532184.779823:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779827:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.779829:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468988544
00000100:00100000:1.0:1651532184.779833:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6544
00000100:00100000:1.0:1651532184.779835:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754468988480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.779838:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.779840:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416acc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3eb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.779846:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc3432e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468984448:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375122us (375164us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651532184.779849:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5318
00010000:00010000:1.0:1651532184.779852:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.779854:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416acc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3eb expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.779857:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779859:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416acc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3eb expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.779860:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532184.779861:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779862:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532184.779864:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779869:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.779869:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532184.779870:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.779871:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468988480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (134us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532184.779873:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.779874:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6544
00000100:00100000:1.0:1651532184.779879:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6545
00010000:00010000:0.0:1651532184.779881:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779885:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4169de lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [618496->8888319] (req 618496->8888319) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.779887:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468988544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.779890:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.779892:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416ad3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3f2 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779898:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416ad3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3f2 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.779898:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.779901:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.779902:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416ad3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3f2 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.779905:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532184.779911:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468988544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (163us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.779913:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6545
00000100:00100000:1.0:1651532184.780252:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.780260:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468988672
00000100:00100000:1.0:1651532184.780272:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6546
00000100:00100000:1.0:1651532184.780274:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468988672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.780278:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.780298:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416ada lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f3f9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.780309:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416ada lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3f9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.780313:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416ada lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f3f9 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.780317:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532184.780328:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468988672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.780331:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6546
00000100:00100000:0.0:1651532184.780339:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.780400:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468988864
00000100:00100000:0.0:1651532184.780429:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6547
00000100:00100000:0.0:1651532184.780432:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468988864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.780436:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.780440:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416ae1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f400 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.780448:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416ae1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f400 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.780452:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416ae1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f400 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.780456:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532184.780472:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468988864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (133us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.780475:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6547
00000100:00100000:1.0:1651532184.780524:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.780536:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468988928
00000100:00100000:0.0:1651532184.780547:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6548
00000100:00100000:0.0:1651532184.780549:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468988928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.780552:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.780555:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416ae8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f407 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.780576:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416ae8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f407 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.780581:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416ae8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f407 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.780584:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532184.780594:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468988928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.780597:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6548
00000100:00100000:1.0:1651532184.780852:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.780863:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468989312
00000100:00100000:0.0:1651532184.780873:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6549
00000100:00100000:0.0:1651532184.780875:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468989312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.780878:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.780882:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416aef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f40e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.780889:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416aef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f40e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.780893:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416aef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f40e expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.780896:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532184.780906:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468989312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.780909:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6549
00000001:00080000:0.0:1651532184.922741:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794326 is committed
00010000:00010000:0.0:1651532184.922756:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.922760:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.922781:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006964da6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468984384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 518044us (518109us total) trans 158913794326 rc 0/0
00010000:00010000:1.0:1651532184.922782:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.922784:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5319
00010000:00010000:1.0:1651532184.922788:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532184.922789:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.922792:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.922798:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.922799:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.922800:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.922812:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.922820:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.922823:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4169e5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [397312->9334783] (req 397312->9334783) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.922830:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.922835:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923003:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923008:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923027:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.923028:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468985344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 451150us (451190us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651532184.923031:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532184.923031:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5320
00010000:00010000:1.0:1651532184.923032:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923036:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923044:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.923044:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532184.923045:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923048:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923070:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923075:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416a0f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3059712->8413183] (req 3059712->8413183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923082:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923085:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.923094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.923142:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.923151:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.923158:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468989568
00000100:00100000:0.0:1651532184.923167:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468989504
00000100:00100000:0.0:1651532184.923173:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5328
00000100:00100000:0.0:1651532184.923175:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468989568:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532184.923195:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923200:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532184.923201:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532184.923202:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923205:0:323282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.923241:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5329
00000100:00100000:0.0:1651532184.923243:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468989504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532184.923249:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923253:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532184.923253:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923256:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923259:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532184.923260:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923265:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923268:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923271:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532184.923280:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468989632
00000100:00100000:0.0:1651532184.923290:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6550
00000100:00100000:0.0:1651532184.923291:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468989632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.923294:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.923297:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b04 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f415 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923304:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b04 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f415 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.923308:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b04 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f415 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.923311:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532184.923319:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468989632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (168us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.923324:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6550
00000100:00100000:0.0:1651532184.923380:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.923389:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.923399:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468989696
00000100:00100000:0.0:1651532184.923405:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468989824
00000100:00100000:0.0:1651532184.923409:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6551
00000100:00100000:0.0:1651532184.923411:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008675f510 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468989696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.923414:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.923417:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416b0b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f41c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.923424:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416b0b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f41c expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.923428:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416b0b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f41c expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.923432:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:1.0:1651532184.923440:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6552
00000100:00100000:0.0:1651532184.923440:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008675f510 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468989696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.923442:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468989824:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532184.923443:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6551
00010000:00010000:1.0:1651532184.923446:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.923450:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416b12 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f423 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923459:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416b12 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f423 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.923463:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416b12 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f423 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.923466:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532184.923476:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468989824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.923479:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6552
00000100:00100000:0.0:1651532184.923596:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.923610:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468990016
00000100:00100000:1.0:1651532184.923622:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6553
00000100:00100000:1.0:1651532184.923624:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468990016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.923628:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.923631:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416b19 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f42a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923639:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416b19 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f42a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.923643:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416b19 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f42a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.923646:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532184.923659:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468990016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.923662:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6553
00000100:00100000:0.0:1651532184.923770:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.923792:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468990144
00000100:00100000:1.0:1651532184.923820:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6554
00000100:00100000:1.0:1651532184.923822:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468990144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.923825:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.923829:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416b20 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f431 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.923836:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416b20 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f431 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532184.923840:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.923848:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468990208
00010000:00010000:1.0:1651532184.923852:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416b20 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f431 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532184.923855:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6555
00010000:00010000:1.0:1651532184.923856:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:0.0:1651532184.923857:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468990208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.923860:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532184.923864:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416b27 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f438 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532184.923872:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468990144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (102us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.923875:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6554
00010000:00010000:0.0:1651532184.923879:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416b27 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f438 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.923883:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416b27 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f438 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.923887:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532184.923895:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468990208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.923898:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6555
00000100:00100000:0.0:1651532184.924168:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.924175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532184.924181:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468990528
00000100:00100000:0.0:1651532184.924194:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468990464
00000100:00100000:0.0:1651532184.924198:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6556
00000100:00100000:0.0:1651532184.924200:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468990528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.924203:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532184.924205:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6557
00000100:00100000:1.0:1651532184.924207:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb589f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468990464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532184.924207:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b2e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f446 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.924211:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.924214:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416b35 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f43f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532184.924214:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b2e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f446 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.924222:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416b35 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f43f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.924222:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b2e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f446 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532184.924225:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532184.924229:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416b35 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f43f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.924232:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532184.924234:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468990528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532184.924237:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6556
00000100:00100000:1.0:1651532184.924240:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb589f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468990464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.924243:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6557
00000100:00100000:0.0:1651532184.924488:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532184.924507:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468990720
00000100:00100000:1.0:1651532184.924521:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6558
00000100:00100000:1.0:1651532184.924523:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468990720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532184.924526:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532184.924530:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b3c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f44d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532184.924537:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b3c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f44d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.924541:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b3c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f44d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532184.924544:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532184.924558:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468990720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532184.924561:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6558
00000001:00080000:0.0:1651532185.045941:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794327 is committed
00010000:00010000:1.0:1651532185.045972:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.045977:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.045995:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.046000:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468985280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 574087us (574152us total) trans 158913794327 rc 0/0
00000100:00100000:1.0:1651532185.046003:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5321
00010000:00010000:0.0:1651532185.046004:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.046006:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046009:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046014:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.046015:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.046016:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046019:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046029:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046032:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416a16 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [937984->7016447] (req 937984->7016447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046038:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046040:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046232:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046237:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.046248:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.046253:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532185.046254:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.046256:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468986560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 458152us (458200us total) trans 0 rc 36864/36864
00010000:00010000:1.0:1651532185.046258:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.046260:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5322
00010000:00010000:1.0:1651532185.046263:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.046264:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.046265:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.046270:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.046282:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.046305:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416a47 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2080768->10293247] (req 2080768->10293247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.046308:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532185.046311:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.046314:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.046325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.046335:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468990912
00000100:00100000:0.0:1651532185.046351:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468990976
00000100:00100000:1.0:1651532185.046355:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5330
00000100:00100000:1.0:1651532185.046358:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468990912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532185.046378:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.046382:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532185.046383:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.046386:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532185.046387:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.046394:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5331
00000100:00100000:0.0:1651532185.046396:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468990976:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532185.046403:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046403:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.046407:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046408:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.046409:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532185.046410:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046414:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.046460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.046476:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.046488:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468991168
00000100:00100000:1.0:1651532185.046492:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.046502:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468991104
00000100:00100000:1.0:1651532185.046509:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.046517:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468991232
00000100:00100000:1.0:1651532185.046523:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468991296
00000100:00100000:1.0:1651532185.046526:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6559
00000100:00100000:0.0:1651532185.046529:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6560
00000100:00100000:0.0:1651532185.046531:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468991104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.046534:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.046538:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416b51 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f454 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.046540:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468991168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.046544:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.046545:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416b51 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f454 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.046548:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416b58 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f45b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.046549:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416b51 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f454 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.046553:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00010000:00010000:1.0:1651532185.046556:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416b58 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f45b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.046560:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416b58 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f45b expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.046566:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468991104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.046571:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6560
00010000:00010000:1.0:1651532185.046572:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:0.0:1651532185.046576:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6561
00000100:00100000:0.0:1651532185.046578:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468991232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.046580:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532185.046581:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468991168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (122us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532185.046583:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416b5f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f462 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.046584:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6559
00010000:00010000:0.0:1651532185.046588:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416b5f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f462 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532185.046590:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6562
00000100:00100000:1.0:1651532185.046591:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468991296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.046592:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416b5f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f462 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.046594:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.046595:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532185.046597:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416b66 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f469 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.046601:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468991232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (109us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532185.046603:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416b66 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f469 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.046603:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6561
00010000:00010000:1.0:1651532185.046607:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416b66 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f469 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.046610:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532185.046615:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468991296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.046618:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6562
00000100:00100000:1.0:1651532185.046897:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.046906:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468991424
00000100:00100000:1.0:1651532185.046918:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6563
00000100:00100000:1.0:1651532185.046920:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468991424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.046924:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.046928:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416b6d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f470 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.046935:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416b6d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f470 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.046939:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416b6d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f470 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.046945:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532185.046957:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468991424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.046960:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6563
00000100:00100000:1.0:1651532185.047081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.047088:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.047098:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468991616
00000100:00100000:1.0:1651532185.047099:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.047108:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468991744
00000100:00100000:0.0:1651532185.047110:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468991936
00000100:00100000:1.0:1651532185.047114:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6564
00000100:00100000:1.0:1651532185.047116:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468991616:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532185.047116:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6565
00000100:00100000:0.0:1651532185.047118:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468991744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.047119:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.047121:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.047122:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416b74 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f477 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.047124:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b7b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f47e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.047129:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416b74 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f477 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.047132:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b7b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f47e expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.047133:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416b74 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f477 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.047136:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b7b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f47e expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.047137:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532185.047139:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532185.047149:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468991616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.047152:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6564
00000100:00100000:0.0:1651532185.047154:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468991744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.047157:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6566
00000100:00100000:1.0:1651532185.047159:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468991936:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532185.047159:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6565
00010000:00010000:1.0:1651532185.047161:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.047163:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b82 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f485 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.047169:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b82 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f485 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.047173:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b82 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f485 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.047176:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532185.047181:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754468991936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.047183:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6566
00000001:00080000:0.0:1651532185.129307:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794328 is committed
00010000:00010000:1.0:1651532185.129336:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129340:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.129357:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468986496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541247us (541283us total) trans 158913794328 rc 0/0
00000100:00100000:1.0:1651532185.129360:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5323
00010000:00010000:1.0:1651532185.129378:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129384:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532185.129385:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129388:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129393:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.129394:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.129395:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129398:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129410:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129413:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416a4e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2949120->8146943] (req 2949120->8146943) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.129419:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.129423:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.129743:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.129757:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.129764:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468992448
00000100:00100000:0.0:1651532185.129766:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.129776:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468992384
00000100:00100000:1.0:1651532185.129787:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5332
00000100:00100000:1.0:1651532185.129790:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468992448:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532185.129819:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5333
00000100:00100000:0.0:1651532185.129821:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468992384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532185.129823:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.129829:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129831:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532185.129832:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129835:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532185.129836:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.129840:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.129841:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.129847:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.129849:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532185.129850:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129854:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.129854:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129857:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.129857:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.129861:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.129866:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468992512
00000100:00100000:1.0:1651532185.129876:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6567
00000100:00100000:1.0:1651532185.129877:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468992512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.129880:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.129883:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416b97 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f48c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129890:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416b97 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f48c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.129894:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416b97 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f48c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.129900:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532185.129913:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468992512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (147us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.129916:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6567
00000100:00100000:0.0:1651532185.129924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.129965:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468992640
00000100:00100000:1.0:1651532185.129978:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6568
00000100:00100000:1.0:1651532185.129979:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468992640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.129982:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.129986:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416b9e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f493 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.129993:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416b9e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f493 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.129997:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416b9e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f493 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.130000:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532185.130012:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468992640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.130015:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6568
00000001:00080000:0.0:1651532185.213749:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794329 is committed
00002000:00010000:0.0:1651532185.213762:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532183 -> 1651532184
00010000:00010000:0.0:1651532185.213765:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.213769:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.213791:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468987328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 558640us (558710us total) trans 158913794329 rc 0/0
00000100:00100000:0.0:1651532185.213796:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5324
00010000:00010000:0.0:1651532185.213815:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.213819:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.213820:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.213823:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.213828:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.213829:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.213830:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.213833:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.213841:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.213844:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416a78 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2969600->8855551] (req 2969600->8855551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.213859:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.213864:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.214100:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.214113:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.214123:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468992832
00010000:00010000:1.0:1651532185.214126:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.214130:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.214131:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468992896
00000100:00100000:0.0:1651532185.214136:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6569
00000100:00100000:0.0:1651532185.214137:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468992832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.214141:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532185.214147:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468987392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 558980us (559023us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532185.214151:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5325
00010000:00010000:0.0:1651532185.214151:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416ba5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f49a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214157:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.214158:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214160:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416ba5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f49a expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.214161:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532185.214162:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214164:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416ba5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f49a expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.214165:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214167:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532185.214170:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.214171:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.214172:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.214175:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.214176:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468992832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.214179:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6569
00010000:00010000:1.0:1651532185.214183:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.214184:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6570
00000100:00100000:0.0:1651532185.214185:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468992896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.214186:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416a7f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2953216->8843263] (req 2953216->8843263) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214188:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.214190:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4a1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.214191:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.214193:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214196:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4a1 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.214199:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4a1 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.214205:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532185.214211:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468992896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.214213:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6570
00000100:00100000:0.0:1651532185.214564:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.214584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.214600:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468993088
00000100:00100000:0.0:1651532185.214610:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468993152
00000100:00100000:0.0:1651532185.214616:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5334
00000100:00100000:0.0:1651532185.214617:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468993088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532185.214624:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214629:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.214629:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.214630:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532185.214632:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532185.214633:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214637:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.214638:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532185.214640:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.214651:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5335
00000100:00100000:1.0:1651532185.214654:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468993152:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532185.214656:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468993216
00000100:00100000:0.0:1651532185.214662:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468993280
00010000:00010000:1.0:1651532185.214663:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.214669:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6571
00000100:00100000:0.0:1651532185.214671:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468993216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.214673:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.214674:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.214675:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214676:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416bc1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4a8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.214678:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532185.214678:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.214687:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214688:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416bc1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4a8 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.214691:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.214692:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416bc1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4a8 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.214695:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532185.214698:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6572
00000100:00100000:1.0:1651532185.214700:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468993280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.214702:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.214705:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416bc8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4af expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.214706:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468993216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.214709:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6571
00010000:00010000:1.0:1651532185.214712:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416bc8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4af expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.214716:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416bc8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4af expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.214719:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532185.214728:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468993280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.214730:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6572
00000100:00100000:1.0:1651532185.214955:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.214963:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468993408
00000100:00100000:1.0:1651532185.214971:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6573
00000100:00100000:1.0:1651532185.214973:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468993408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.214977:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.214980:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416bcf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4b6 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.214988:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416bcf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4b6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.214992:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416bcf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4b6 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.214995:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532185.215009:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468993408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.215012:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6573
00000100:00100000:1.0:1651532185.215210:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.215217:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468993600
00000100:00100000:1.0:1651532185.215224:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6574
00000100:00100000:1.0:1651532185.215226:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468993600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.215229:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.215233:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416bd6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4bd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.215240:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416bd6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4bd expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.215247:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416bd6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4bd expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.215250:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532185.215264:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468993600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.215266:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6574
00000001:00080000:0.0:1651532185.313747:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794330 is committed
00010000:00010000:1.0:1651532185.313777:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.313781:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.313798:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000208fa08e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468988352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 534033us (534086us total) trans 158913794330 rc 0/0
00000100:00100000:1.0:1651532185.313802:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5326
00010000:00010000:0.0:1651532185.313831:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313836:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.313837:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313841:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313849:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.313850:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.313851:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313854:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313857:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.313857:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.313858:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313861:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313868:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313871:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f416abe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [409600->10477567] (req 409600->10477567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313876:0:323282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313879:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313901:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.313905:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.314198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.314206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.314212:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.314234:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468993920
00010000:00010000:0.0:1651532185.314238:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.314244:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468993856
00000100:00100000:1.0:1651532185.314247:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468993984
00010000:00010000:0.0:1651532185.314248:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.314250:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6575
00000100:00100000:1.0:1651532185.314251:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468993920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.314255:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.314259:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416bdd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4cb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.314264:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c4e85bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468989568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391088us (391170us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532185.314265:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.314267:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416bdd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4cb expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.314268:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5328
00010000:00010000:1.0:1651532185.314272:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416bdd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4cb expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.314275:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532185.314278:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.314281:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.314283:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754468993920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (86us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.314285:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6575
00000100:00100000:0.0:1651532185.314297:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc355412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468988416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 534527us (534568us total) trans 0 rc 40960/40960
00000100:00100000:1.0:1651532185.314299:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6576
00000100:00100000:0.0:1651532185.314300:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5327
00000100:00100000:1.0:1651532185.314301:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468993856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.314304:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.314306:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416be4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4c4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.314308:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6577
00010000:00010000:1.0:1651532185.314310:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532185.314310:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468993984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.314312:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416be4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4c4 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.314313:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.314316:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416be4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4c4 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.314317:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416beb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4d2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.314322:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00010000:00010000:0.0:1651532185.314322:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.314325:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416beb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4d2 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532185.314328:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468993856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (122us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532185.314330:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416beb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4d2 expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532185.314331:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6576
00010000:00010000:0.0:1651532185.314333:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532185.314337:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.314339:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468993984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (127us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532185.314341:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532185.314341:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6577
00010000:00010000:1.0:1651532185.314342:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.314345:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.314348:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.314350:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.314351:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.314352:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.314353:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416af6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [393216->8024063] (req 393216->8024063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.314355:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.314360:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.314360:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.314361:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.314375:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.314383:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.314386:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416ac5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2940928->10362879] (req 2940928->10362879) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.314392:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.314394:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.314941:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.314950:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.314956:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.314969:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468994240
00000100:00100000:0.0:1651532185.314975:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.314983:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6578
00000100:00100000:1.0:1651532185.314985:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468994240:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532185.314985:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532185.314989:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532185.314992:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532185.314993:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416bf2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4e0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.315000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.315007:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468994048
00010000:00010000:1.0:1651532185.315008:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416bf2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4e0 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.315012:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416bf2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4e0 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.315016:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532185.315017:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468994304
00000100:00100000:0.0:1651532185.315022:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468994368
00000100:00100000:1.0:1651532185.315026:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468994240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.315030:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5336
00000100:00100000:0.0:1651532185.315032:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468994048:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532185.315034:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6578
00010000:00010000:0.0:1651532185.315039:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.315040:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468994496
00000100:00100000:1.0:1651532185.315043:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468994176
00000100:00100000:1.0:1651532185.315045:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468994624
00010000:00010000:0.0:1651532185.315047:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532185.315048:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6579
00010000:00010000:0.0:1651532185.315048:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651532185.315048:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.315049:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468994496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.315051:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.315052:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.315054:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416c00 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4e7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.315058:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5337
00010000:00010000:1.0:1651532185.315060:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416c00 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4e7 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.315060:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa3ce2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468994304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532185.315064:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.315065:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416c00 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4e7 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.315068:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.315068:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.315070:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532185.315071:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.315074:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532185.315074:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.315076:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468994496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (92us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532185.315078:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.315079:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6579
00010000:00010000:0.0:1651532185.315081:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.315082:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6580
00000100:00100000:1.0:1651532185.315084:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468994176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.315085:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.315086:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.315088:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416c0e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4d9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.315091:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5338
00000100:00100000:0.0:1651532185.315092:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468994368:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532185.315093:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416c0e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4d9 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.315096:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.315097:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416c0e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4d9 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.315099:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532185.315100:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532185.315100:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.315103:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532185.315103:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.315105:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468994176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.315107:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6580
00010000:00010000:0.0:1651532185.315107:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.315110:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6581
00010000:00010000:0.0:1651532185.315110:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.315112:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468994624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.315114:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.315115:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416c1c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4ee expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.315121:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416c1c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4ee expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.315124:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416c1c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4ee expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.315127:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532185.315131:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468994624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 19us (131us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.315133:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6581
00000100:00100000:0.0:1651532185.315486:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.315501:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.315507:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468994816
00000100:00100000:0.0:1651532185.315508:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468995072
00000100:00100000:0.0:1651532185.315515:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6582
00000100:00100000:1.0:1651532185.315522:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6583
00000100:00100000:0.0:1651532185.315522:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468995072:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532185.315525:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468994816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.315526:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.315529:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c23 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f503 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.315530:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.315534:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416c2a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4f5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.315545:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416c2a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4f5 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.315549:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416c2a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4f5 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.315552:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532185.315563:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c23 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f503 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.315568:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c23 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f503 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.315571:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532185.315585:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468994816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (99us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.315588:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6583
00000100:00100000:0.0:1651532185.315590:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468995072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 72us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.315593:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6582
00000100:00100000:1.0:1651532185.315609:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.315614:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468995008
00000100:00100000:1.0:1651532185.315617:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.315628:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468995264
00000100:00100000:0.0:1651532185.315638:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6584
00000100:00100000:0.0:1651532185.315639:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468995008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.315642:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.315645:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416c31 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f4fc expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.315647:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6585
00000100:00100000:1.0:1651532185.315649:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468995264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.315653:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.315653:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416c31 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4fc expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.315656:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416c38 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f50a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.315657:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416c31 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f4fc expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.315660:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532185.315664:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416c38 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f50a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.315668:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416c38 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f50a expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.315668:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468995008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.315670:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6584
00010000:00010000:1.0:1651532185.315671:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532185.315679:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468995264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.315681:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6585
00000100:00100000:1.0:1651532185.316021:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.316029:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.316042:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.316051:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468995392
00000100:00100000:0.0:1651532185.316054:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468995456
00000100:00100000:1.0:1651532185.316061:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468995584
00000100:00100000:1.0:1651532185.316065:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6586
00000100:00100000:1.0:1651532185.316066:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468995392:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532185.316067:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6587
00000100:00100000:0.0:1651532185.316069:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468995456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.316070:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.316072:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.316074:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416c3f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f511 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.316076:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416c46 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f518 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.316081:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416c3f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f511 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.316083:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416c46 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f518 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.316085:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416c3f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f511 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.316087:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416c46 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f518 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.316088:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532185.316091:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532185.316101:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468995392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.316103:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6586
00000100:00100000:0.0:1651532185.316106:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468995456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.316108:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6588
00000100:00100000:1.0:1651532185.316110:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468995584:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532185.316110:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6587
00010000:00010000:1.0:1651532185.316112:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.316115:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416c4d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f51f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.316120:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416c4d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f51f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.316124:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416c4d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f51f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.316129:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532185.316135:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468995584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (93us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.316137:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6588
00000001:00080000:0.0:1651532185.463744:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794331 is committed
00010000:00010000:0.0:1651532185.463760:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463767:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.463790:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b3ea3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468989504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 540546us (540647us total) trans 158913794331 rc 0/0
00000100:00100000:0.0:1651532185.463793:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5329
00010000:00010000:0.0:1651532185.463800:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463814:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.463815:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463818:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463824:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.463824:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.463825:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463829:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463832:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.463832:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.463833:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463838:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463849:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463852:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416afd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2301952->10366975] (req 2301952->10366975) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463857:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.463860:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.463862:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.463867:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.464250:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.464263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.464273:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.464280:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532185.464291:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.464294:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.464311:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468995904
00000100:00100000:0.0:1651532185.464313:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5ba224 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468990976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 417916us (417987us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532185.464318:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468996032
00000100:00100000:0.0:1651532185.464318:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5331
00000100:00100000:1.0:1651532185.464320:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468995968
00000100:00100000:1.0:1651532185.464323:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468996096
00000100:00100000:0.0:1651532185.464325:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6589
00000100:00100000:0.0:1651532185.464327:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468995904:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532185.464328:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6590
00000100:00100000:1.0:1651532185.464330:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468996032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.464331:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.464333:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.464334:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416c54 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f526 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464337:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416c5b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f534 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.464342:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416c54 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f526 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.464345:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416c5b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f534 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.464347:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416c54 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f526 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.464349:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416c5b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f534 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.464350:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532185.464356:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468995904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (127us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.464358:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6589
00000100:00100000:0.0:1651532185.464372:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6591
00000100:00100000:0.0:1651532185.464375:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468995968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.464377:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.464379:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00010000:00010000:0.0:1651532185.464380:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416c62 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f52d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.464386:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416c62 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f52d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532185.464389:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468996032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (126us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.464392:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6590
00010000:00010000:0.0:1651532185.464393:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416c62 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f52d expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.464396:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532185.464397:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6592
00000100:00100000:1.0:1651532185.464399:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468996096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.464402:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532185.464402:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754468995968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (129us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532185.464404:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416c69 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f53b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.464405:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6591
00010000:00010000:1.0:1651532185.464411:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416c69 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f53b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.464415:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416c69 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f53b expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.464418:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532185.464423:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468996096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (144us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.464426:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6592
00010000:00010000:1.0:1651532185.464432:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464436:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532185.464437:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464466:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464483:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464486:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416b4a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4087808->10018815] (req 4087808->10018815) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.464771:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.464799:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.464825:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.464834:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.464840:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.464848:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468996416
00000100:00100000:0.0:1651532185.464850:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.464855:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468996672
00000100:00100000:1.0:1651532185.464857:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468996608
00000100:00100000:0.0:1651532185.464858:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468996352
00000100:00100000:1.0:1651532185.464859:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468996736
00000100:00100000:1.0:1651532185.464862:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6593
00000100:00100000:1.0:1651532185.464864:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754468996416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.464867:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532185.464867:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468996288
00010000:00010000:1.0:1651532185.464871:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416c70 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f542 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.464873:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5339
00000100:00100000:0.0:1651532185.464875:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003117edcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754468996352:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532185.464878:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416c70 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f542 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.464881:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464882:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416c70 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f542 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.464886:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532185.464886:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.464887:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532185.464888:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.464891:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.464901:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754468996416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.464904:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6593
00000100:00100000:0.0:1651532185.464905:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5340
00000100:00100000:0.0:1651532185.464907:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c57ad69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754468996288:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532185.464909:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6594
00000100:00100000:1.0:1651532185.464911:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468996672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.464912:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464913:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.464915:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532185.464916:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416c85 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f550 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.464916:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.464919:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.464921:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532185.464922:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464927:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416c85 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f550 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.464927:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.464929:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464931:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416c85 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f550 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.464933:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464934:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532185.464940:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468996672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (106us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.464941:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6595
00000100:00100000:1.0:1651532185.464943:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6594
00000100:00100000:0.0:1651532185.464943:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468996608:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532185.464946:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6596
00010000:00010000:0.0:1651532185.464946:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532185.464948:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468996736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.464948:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416c8c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f549 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.464950:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.464952:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416c93 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f557 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.464955:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416c8c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f549 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.464958:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416c93 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f557 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.464959:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416c8c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f549 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.464962:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416c93 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f557 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.464963:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532185.464965:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532185.464971:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468996736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (121us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.464971:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468996608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.464973:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6596
00000100:00100000:0.0:1651532185.464975:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6595
00000100:00100000:0.0:1651532185.465314:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.465329:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.465341:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468996928
00000100:00100000:1.0:1651532185.465352:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468997120
00000100:00100000:0.0:1651532185.465357:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6597
00000100:00100000:1.0:1651532185.465359:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6598
00000100:00100000:0.0:1651532185.465359:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfde6df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468996928:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532185.465361:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf7a70b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468997120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.465362:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.465372:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.465375:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416c9a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f55e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.465376:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416ca1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f565 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.465384:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416c9a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f55e expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.465385:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416ca1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f565 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.465388:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416c9a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f55e expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.465389:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416ca1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f565 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.465392:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532185.465392:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532185.465403:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf7a70b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754468997120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.465403:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfde6df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468996928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.465405:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6598
00000100:00100000:0.0:1651532185.465410:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6597
00000100:00100000:0.0:1651532185.465678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.465686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.465699:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468997312
00000100:00100000:1.0:1651532185.465705:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468997376
00000100:00100000:0.0:1651532185.465709:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6599
00000100:00100000:0.0:1651532185.465711:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754468997312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.465714:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532185.465718:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6600
00010000:00010000:0.0:1651532185.465718:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416ca8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f56c expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.465720:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfde6df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754468997376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.465723:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.465725:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416ca8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f56c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.465726:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416caf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f573 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.465729:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416ca8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f56c expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.465732:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00010000:00010000:1.0:1651532185.465734:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416caf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f573 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.465738:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416caf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f573 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.465741:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532185.465742:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754468997312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.465745:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6599
00000100:00100000:1.0:1651532185.465749:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfde6df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468997376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.465752:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6600
00000100:00100000:0.0:1651532185.465979:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.465998:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468997568
00000100:00100000:1.0:1651532185.466006:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6601
00000100:00100000:1.0:1651532185.466008:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468997568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.466011:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.466015:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416cb6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f57a expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.466022:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416cb6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f57a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.466029:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416cb6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f57a expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.466032:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532185.466046:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468997568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.466048:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6601
00000001:00080000:0.0:1651532185.522112:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794332 is committed
00010000:00010000:1.0:1651532185.522143:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.522148:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.522168:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d54a39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468990912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 475810us (475860us total) trans 158913794332 rc 0/0
00000100:00100000:1.0:1651532185.522171:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5330
00010000:00010000:0.0:1651532185.522171:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.522175:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.522177:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.522180:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.522185:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.522186:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.522187:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.522190:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.522199:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.522202:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f416b43 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3018752->3137535] (req 3018752->3137535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.522212:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.522215:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.522498:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.522514:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468997824
00010000:00010000:0.0:1651532185.522520:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.522523:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6602
00000100:00100000:1.0:1651532185.522525:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754468997824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.522525:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.522528:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.522538:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416cbd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f581 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.522544:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532185.522544:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f71747b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468992448:12345-10.240.43.64@tcp:3:fio.0 Request processed in 392754us (392832us total) trans 0 rc 32768/32768
00010000:00010000:1.0:1651532185.522547:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416cbd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f581 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.522548:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5332
00010000:00010000:1.0:1651532185.522551:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416cbd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f581 expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.522554:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532185.522562:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468997824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.522564:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6602
00010000:00010000:1.0:1651532185.522571:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.522609:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532185.522611:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.522614:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.522620:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.522620:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.522621:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.522624:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.522640:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.522646:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416b89 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2224128->8986623] (req 2224128->8986623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.522662:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.522667:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.522990:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.522998:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.523008:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.523014:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.523022:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.523031:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.523038:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468998016
00000100:00100000:1.0:1651532185.523050:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468997952
00000100:00100000:0.0:1651532185.523055:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5341
00000100:00100000:0.0:1651532185.523056:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468998016:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532185.523065:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5342
00000100:00100000:1.0:1651532185.523066:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754468997952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532185.523069:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.523073:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.523076:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.523077:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.523080:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532185.523081:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.523085:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532185.523086:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.523089:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532185.523090:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.523094:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.523094:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.523097:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.523098:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.523105:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468998080
00000100:00100000:1.0:1651532185.523109:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468998272
00000100:00100000:1.0:1651532185.523112:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6603
00000100:00100000:1.0:1651532185.523114:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468998080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.523116:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.523119:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416cd2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f588 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.523125:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416cd2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f588 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.523129:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416cd2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f588 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.523132:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532185.523145:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754468998080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.523148:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6603
00000100:00100000:1.0:1651532185.523152:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468998336
00000100:00100000:1.0:1651532185.523155:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468998208
00000100:00100000:1.0:1651532185.523158:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6604
00000100:00100000:1.0:1651532185.523159:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754468998272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.523162:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.523164:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416cd9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f596 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.523170:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416cd9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f596 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.523173:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6605
00010000:00010000:1.0:1651532185.523174:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416cd9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f596 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.523175:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6801443 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754468998336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.523177:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532185.523179:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.523182:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416ce0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f59d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.523183:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754468998272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (169us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.523186:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6604
00000100:00100000:1.0:1651532185.523189:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6606
00010000:00010000:0.0:1651532185.523190:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416ce0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f59d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532185.523191:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754468998208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.523193:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.523194:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416ce0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f59d expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.523195:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416ce7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f58f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.523198:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532185.523201:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416ce7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f58f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.523204:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416ce7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f58f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.523207:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532185.523208:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6801443 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468998336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (186us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.523211:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6605
00000100:00100000:1.0:1651532185.523212:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754468998208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (181us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.523215:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6606
00000001:00080000:0.0:1651532185.588814:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794333 is committed
00002000:00010000:0.0:1651532185.588827:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532184 -> 1651532185
00010000:00010000:0.0:1651532185.588830:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.588834:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.588855:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eb6bde3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754468992384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 459033us (459098us total) trans 158913794333 rc 0/0
00000100:00100000:0.0:1651532185.588859:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5333
00010000:00010000:0.0:1651532185.588866:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.588869:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.588870:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.588873:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.588878:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.588878:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.588879:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.588885:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.588892:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.588895:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416b90 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2297856->10399743] (req 2297856->10399743) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.588900:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.588903:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.589135:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.589163:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468998720
00000100:00100000:0.0:1651532185.589169:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.589184:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.589187:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468998784
00000100:00100000:0.0:1651532185.589191:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468998656
00000100:00100000:1.0:1651532185.589192:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6607
00000100:00100000:1.0:1651532185.589193:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468998720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.589198:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532185.589198:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6608
00000100:00100000:0.0:1651532185.589200:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468998784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.589202:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416cee lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5a4 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.589203:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.589208:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416cf5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5b2 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.589210:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416cee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5a4 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.589215:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416cee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5a4 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.589216:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416cf5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5b2 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.589218:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532185.589223:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416cf5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5b2 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.589227:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:1.0:1651532185.589230:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754468998720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.589232:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6607
00000100:00100000:0.0:1651532185.589235:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754468998784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.589237:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6609
00000100:00100000:1.0:1651532185.589239:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754468998656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532185.589239:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6608
00010000:00010000:1.0:1651532185.589242:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.589244:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416cfc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5ab expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.589250:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416cfc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5ab expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.589254:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416cfc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5ab expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.589259:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532185.589265:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468998656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.589267:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6609
00000100:00100000:0.0:1651532185.589588:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.589609:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468999040
00000100:00100000:1.0:1651532185.589621:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6610
00000100:00100000:1.0:1651532185.589623:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468999040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.589626:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.589630:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d03 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5b9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.589637:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d03 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5b9 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.589641:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d03 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5b9 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.589644:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532185.589654:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754468999040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.589657:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6610
00000001:00080000:0.0:1651532185.630809:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794334 is committed
00010000:00010000:0.0:1651532185.630824:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630828:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.630843:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468993088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 416225us (416280us total) trans 158913794334 rc 0/0
00000100:00100000:0.0:1651532185.630846:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5334
00010000:00010000:0.0:1651532185.630853:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630856:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.630857:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630860:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630865:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.630866:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.630867:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630870:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630873:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.630874:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.630874:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630877:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630890:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630893:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416bb3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4792320->4796415] (req 4792320->4796415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630898:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.630901:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.630903:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.630908:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631159:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631164:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.631180:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468994048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316148us (316240us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532185.631184:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5336
00010000:00010000:1.0:1651532185.631185:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.631189:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631202:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631206:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.631207:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.631208:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb803d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754468993152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416553us (416624us total) trans 0 rc 16384/16384
00010000:00010000:0.0:1651532185.631209:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.631211:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5335
00010000:00010000:0.0:1651532185.631215:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631217:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416bf9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3190784->10436607] (req 3190784->10436607) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631220:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631223:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.631224:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631227:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631231:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.631231:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.631232:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631235:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631257:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631260:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f416bba lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2400256->5709823] (req 2400256->5709823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631266:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631269:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.631325:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.631336:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.631343:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468999168
00000100:00100000:1.0:1651532185.631348:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468999232
00000100:00100000:0.0:1651532185.631353:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5343
00000100:00100000:0.0:1651532185.631355:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468999168:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532185.631362:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5344
00000100:00100000:1.0:1651532185.631373:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468999232:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532185.631378:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.631381:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631382:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.631383:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631386:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532185.631387:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.631391:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532185.631392:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.631395:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532185.631396:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631400:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.631401:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631403:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.631404:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.631678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.631680:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.631688:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468999616
00000100:00100000:1.0:1651532185.631701:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6611
00000100:00100000:0.0:1651532185.631702:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468999360
00000100:00100000:1.0:1651532185.631703:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468999616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.631706:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.631710:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416d18 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5c0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.631713:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5345
00000100:00100000:0.0:1651532185.631715:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754468999360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532185.631718:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416d18 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5c0 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.631721:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.631722:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416d18 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5c0 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.631726:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532185.631726:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.631726:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631729:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532185.631730:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.631735:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.631736:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754468999616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.631738:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6611
00010000:00010000:0.0:1651532185.631738:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532185.747267:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794335 is committed
00002000:00010000:0.0:1651532185.747279:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532184 -> 1651532185
00010000:00010000:0.0:1651532185.747282:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747286:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.747302:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa3ce2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468994304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432241us (432352us total) trans 158913794335 rc 0/0
00000100:00100000:0.0:1651532185.747305:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5337
00010000:00010000:0.0:1651532185.747312:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747315:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.747316:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747319:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747324:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.747325:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.747326:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747329:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747332:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.747332:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.747333:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747335:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747342:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747345:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416c07 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3194880->10440703] (req 3194880->10440703) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747350:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747353:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747391:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747395:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747606:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747611:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.747632:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003117edcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468996352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 282756us (282861us total) trans 0 rc 53248/53248
00010000:00010000:1.0:1651532185.747635:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.747635:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5339
00010000:00010000:1.0:1651532185.747640:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532185.747641:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747644:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747648:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747652:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747663:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.747663:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754468994368:12345-10.240.43.64@tcp:3:fio.0 Request processed in 432569us (432687us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532185.747665:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5338
00010000:00010000:1.0:1651532185.747666:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416c77 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3117056->9015295] (req 3117056->9015295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747670:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747672:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532185.747673:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747676:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747679:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.747680:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.747681:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747684:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747693:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747704:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747705:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416c15 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3043328->6422527] (req 3043328->6422527) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747708:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.747862:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.747870:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.747877:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.747887:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468999808
00000100:00100000:0.0:1651532185.747896:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468999872
00000100:00100000:0.0:1651532185.747901:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5346
00000100:00100000:0.0:1651532185.747903:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468999808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532185.747916:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.747918:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754468999936
00010000:00010000:0.0:1651532185.747921:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.747922:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747925:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532185.747925:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.747928:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6612
00000100:00100000:1.0:1651532185.747930:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468999936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.747930:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747933:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.747933:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747937:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416d2d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5c7 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.747940:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5347
00000100:00100000:0.0:1651532185.747942:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754468999872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532185.747945:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416d2d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5c7 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.747949:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416d2d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5c7 expref: 15 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.747949:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.747952:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00010000:00010000:0.0:1651532185.747953:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.747953:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747956:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532185.747957:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.747960:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.747965:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754468999936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.747968:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6612
00010000:00010000:0.0:1651532185.747969:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.748083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.748089:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.748098:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469000064
00000100:00100000:0.0:1651532185.748113:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5348
00000100:00100000:0.0:1651532185.748115:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb589f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469000064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532185.748122:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.748126:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532185.748127:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469000192
00010000:00010000:0.0:1651532185.748127:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532185.748127:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.748133:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.748137:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6613
00000100:00100000:1.0:1651532185.748138:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469000192:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532185.748147:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532185.748154:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.748158:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416d42 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5d5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.748165:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416d42 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5d5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.748169:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416d42 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5d5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.748172:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532185.748173:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532185.748178:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469000128
00000100:00100000:1.0:1651532185.748183:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469000192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (101us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.748183:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469000256
00000100:00100000:0.0:1651532185.748186:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6614
00000100:00100000:0.0:1651532185.748187:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469000128:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532185.748188:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6613
00010000:00010000:0.0:1651532185.748191:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532185.748193:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6615
00010000:00010000:0.0:1651532185.748194:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d49 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5ce expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.748195:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469000256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.748197:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.748199:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416d50 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5dc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.748202:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d49 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5ce expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.748205:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416d50 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5dc expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.748206:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d49 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5ce expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.748209:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416d50 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5dc expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.748209:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00010000:00010000:1.0:1651532185.748212:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532185.748217:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469000128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.748218:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469000256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.748220:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6614
00000100:00100000:1.0:1651532185.748222:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6615
00000100:00100000:0.0:1651532185.748321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.748335:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469000448
00000100:00100000:1.0:1651532185.748347:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6616
00000100:00100000:1.0:1651532185.748349:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469000448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.748352:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.748356:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416d57 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5e3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.748373:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416d57 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5e3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.748378:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416d57 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5e3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.748381:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532185.748392:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469000448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.748395:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6616
00000100:00100000:0.0:1651532185.748478:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.748491:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469000576
00000100:00100000:1.0:1651532185.748503:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6617
00000100:00100000:1.0:1651532185.748505:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469000576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.748508:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.748511:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416d5e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5ea expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.748518:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416d5e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5ea expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.748522:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416d5e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5ea expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.748526:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532185.748536:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469000576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.748538:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6617
00000100:00100000:0.0:1651532185.748669:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.748682:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.748689:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469000768
00000100:00100000:0.0:1651532185.748689:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469000960
00000100:00100000:0.0:1651532185.748699:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6618
00000100:00100000:0.0:1651532185.748701:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469000960:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532185.748709:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6619
00010000:00010000:0.0:1651532185.748710:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532185.748711:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469000768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.748713:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d65 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5f8 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.748714:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.748718:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416d6c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5f1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.748720:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d65 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5f8 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.748725:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d65 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5f8 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.748726:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416d6c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5f1 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.748729:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532185.748730:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416d6c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5f1 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.748733:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:0.0:1651532185.748742:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469000960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.748745:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6618
00000100:00100000:1.0:1651532185.748748:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469000768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.748751:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6619
00000100:00100000:0.0:1651532185.748996:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.749015:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469001152
00000100:00100000:1.0:1651532185.749024:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6620
00000100:00100000:1.0:1651532185.749025:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469001152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.749029:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.749032:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416d73 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f5ff expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.749040:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416d73 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5ff expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.749044:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416d73 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f5ff expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.749047:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532185.749056:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469001152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.749059:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6620
00000001:00080000:0.0:1651532185.863947:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794336 is committed
00010000:00010000:0.0:1651532185.863962:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.863966:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.863982:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c57ad69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468996288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 399074us (399183us total) trans 158913794336 rc 0/0
00000100:00100000:0.0:1651532185.863985:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5340
00010000:00010000:0.0:1651532185.863992:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.863995:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.863996:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.863999:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864004:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.864004:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.864005:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864008:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864015:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864018:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416c7e lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2326528->9367551] (req 2326528->9367551) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864023:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864025:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864232:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864237:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.864258:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7254c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754468998016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341201us (341269us total) trans 0 rc 53248/53248
00000100:00100000:0.0:1651532185.864261:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5341
00010000:00010000:0.0:1651532185.864268:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864272:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532185.864273:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864276:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864280:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.864281:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532185.864282:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864285:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864294:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864297:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416cc4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2400256->9113599] (req 2400256->9113599) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.864312:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.864317:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.864481:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.864496:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469001408
00000100:00100000:0.0:1651532185.864508:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5349
00000100:00100000:0.0:1651532185.864510:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469001408:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532185.864516:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864521:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.864521:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864524:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532185.864525:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864529:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.864530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532185.864532:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.864543:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.864546:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469001344
00000100:00100000:1.0:1651532185.864550:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.864554:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5350
00000100:00100000:0.0:1651532185.864555:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469001344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532185.864560:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864575:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.864576:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864580:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864582:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532185.864583:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.864586:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532185.864587:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864589:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864598:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.864601:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.864613:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469001600
00000100:00100000:0.0:1651532185.864618:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469001536
00000100:00100000:0.0:1651532185.864620:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469001728
00000100:00100000:0.0:1651532185.864622:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469001792
00000100:00100000:0.0:1651532185.864625:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6621
00000100:00100000:0.0:1651532185.864627:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469001600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.864629:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.864632:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416d88 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f60d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864640:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416d88 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f60d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.864644:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416d88 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f60d expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.864647:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532185.864662:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754469001600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.864664:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6621
00000100:00100000:0.0:1651532185.864669:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6622
00000100:00100000:0.0:1651532185.864671:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469001536:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532185.864674:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6623
00010000:00010000:0.0:1651532185.864674:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532185.864676:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469001728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.864676:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416d8f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f606 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.864680:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.864682:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416d8f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f606 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.864684:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416d96 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f614 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.864686:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416d8f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f606 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.864689:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00010000:00010000:1.0:1651532185.864692:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416d96 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f614 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.864695:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469001536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (146us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532185.864696:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416d96 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f614 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532185.864697:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6622
00010000:00010000:1.0:1651532185.864700:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532185.864701:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6624
00000100:00100000:0.0:1651532185.864703:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469001792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.864705:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.864707:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416d9d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f61b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.864709:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469001728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.864711:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6623
00010000:00010000:0.0:1651532185.864712:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416d9d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f61b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.864716:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416d9d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f61b expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.864719:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532185.864724:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469001792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (123us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.864727:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6624
00000100:00100000:1.0:1651532185.865004:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.865012:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469001920
00000100:00100000:1.0:1651532185.865025:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6625
00000100:00100000:1.0:1651532185.865027:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469001920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.865031:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.865035:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416da4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f622 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.865042:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416da4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f622 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865047:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416da4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f622 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865050:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532185.865063:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469001920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.865066:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6625
00000100:00100000:1.0:1651532185.865112:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.865121:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.865131:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469002112
00000100:00100000:1.0:1651532185.865132:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469002176
00000100:00100000:0.0:1651532185.865142:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6626
00000100:00100000:0.0:1651532185.865149:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469002112:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532185.865150:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6627
00000100:00100000:1.0:1651532185.865152:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469002176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.865152:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.865155:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.865156:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416dab lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f629 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.865158:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416db2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f630 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.865163:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416dab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f629 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865166:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416db2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f630 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.865167:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416dab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f629 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865170:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416db2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f630 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.865171:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532185.865173:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532185.865181:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469002176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.865181:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469002112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.865183:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6626
00000100:00100000:1.0:1651532185.865185:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6627
00000100:00100000:1.0:1651532185.865263:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.865271:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469002368
00000100:00100000:1.0:1651532185.865278:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6628
00000100:00100000:1.0:1651532185.865279:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469002368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.865283:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.865286:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416db9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f637 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.865293:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416db9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f637 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865297:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416db9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f637 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865300:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532185.865314:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469002368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.865316:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6628
00000100:00100000:1.0:1651532185.865472:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.865480:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.865486:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469002496
00000100:00100000:1.0:1651532185.865497:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469002624
00000100:00100000:0.0:1651532185.865506:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6629
00000100:00100000:1.0:1651532185.865509:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6630
00000100:00100000:0.0:1651532185.865509:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469002496:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532185.865510:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469002624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532185.865512:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.865514:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532185.865516:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dc0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f63e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.865518:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416dc7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f645 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.865523:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dc0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f63e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865525:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416dc7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f645 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.865527:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dc0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f63e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865529:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416dc7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f645 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532185.865530:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532185.865532:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532185.865540:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469002496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.865541:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469002624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532185.865542:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6629
00000100:00100000:1.0:1651532185.865544:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6630
00000100:00100000:1.0:1651532185.865613:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.865621:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469002752
00000100:00100000:1.0:1651532185.865627:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6631
00000100:00100000:1.0:1651532185.865629:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469002752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.865632:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.865636:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416dce lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f64c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.865643:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416dce lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f64c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865647:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416dce lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f64c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865653:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532185.865667:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469002752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.865670:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6631
00000100:00100000:1.0:1651532185.865826:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.865834:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469002880
00000100:00100000:1.0:1651532185.865841:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6632
00000100:00100000:1.0:1651532185.865843:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469002880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.865846:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.865849:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416dd5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f653 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.865856:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416dd5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f653 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865860:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416dd5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f653 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.865864:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532185.865876:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469002880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.865878:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6632
00000100:00100000:1.0:1651532185.866107:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.866114:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469003136
00000100:00100000:1.0:1651532185.866121:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6633
00000100:00100000:1.0:1651532185.866123:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469003136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.866126:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.866129:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416ddc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f65a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.866136:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416ddc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f65a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.866140:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416ddc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f65a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.866144:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532185.866157:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469003136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.866160:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6633
00000100:00100000:1.0:1651532185.866346:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.866353:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469003264
00000100:00100000:1.0:1651532185.866359:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6634
00000100:00100000:1.0:1651532185.866361:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469003264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.866374:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.866378:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416de3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f661 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.866385:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416de3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f661 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.866392:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416de3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f661 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.866395:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532185.866407:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469003264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.866410:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6634
00000001:00080000:0.0:1651532185.955600:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794337 is committed
00010000:00010000:1.0:1651532185.955631:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.955636:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.955653:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f25c2304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754468997952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 432586us (432655us total) trans 158913794337 rc 0/0
00000100:00100000:1.0:1651532185.955656:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5342
00010000:00010000:1.0:1651532185.955663:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.955666:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532185.955667:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.955670:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.955678:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.955679:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532185.955680:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.955683:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.955695:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.955698:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416ccb lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [688128->9117695] (req 688128->9117695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.955703:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.955708:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532185.956044:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532185.956059:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.956082:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469003520
00000100:00100000:0.0:1651532185.956101:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532185.956113:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469003456
00000100:00100000:0.0:1651532185.956125:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5351
00000100:00100000:1.0:1651532185.956128:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5352
00000100:00100000:0.0:1651532185.956128:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469003520:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532185.956130:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469003456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532185.956137:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.956137:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.956142:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532185.956143:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.956146:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532185.956147:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.956151:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532185.956152:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.956155:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532185.956156:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.956162:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.956163:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532185.956166:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.956167:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532185.956175:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469003648
00000100:00100000:1.0:1651532185.956181:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6635
00000100:00100000:1.0:1651532185.956182:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469003648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532185.956185:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532185.956187:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416df8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f668 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532185.956195:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416df8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f668 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.956199:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416df8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f668 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532185.956202:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532185.956212:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469003648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532185.956215:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6635
00000001:00080000:0.0:1651532186.048593:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794338 is committed
00010000:00010000:0.0:1651532186.048607:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048611:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.048628:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ce87427 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468999168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 417272us (417303us total) trans 158913794338 rc 0/0
00000100:00100000:0.0:1651532186.048632:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5343
00010000:00010000:0.0:1651532186.048639:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048642:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532186.048643:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048646:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048651:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.048651:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.048652:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048655:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048669:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048675:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416d0a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [999424->8859647] (req 999424->8859647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.048680:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.048688:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.048902:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.048907:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048926:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.048928:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004145235f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754468999232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 417554us (417591us total) trans 0 rc 32768/32768
00010000:00010000:0.0:1651532186.048930:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532186.048931:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.048932:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5344
00010000:00010000:0.0:1651532186.048934:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048939:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.048940:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.048940:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048943:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048951:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048953:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f416d11 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2228224->10313727] (req 2228224->10313727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048959:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.048962:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.049063:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.049090:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469003904
00000100:00100000:1.0:1651532186.049100:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6636
00000100:00100000:1.0:1651532186.049101:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469003904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.049105:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.049109:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416dff lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f66f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.049116:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416dff lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f66f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.049120:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416dff lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f66f expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.049124:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532186.049134:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469003904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.049136:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6636
00000100:00100000:0.0:1651532186.049298:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.049312:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.049317:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469004224
00000100:00100000:0.0:1651532186.049319:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469004288
00000100:00100000:1.0:1651532186.049333:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5353
00000100:00100000:1.0:1651532186.049335:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469004224:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532186.049340:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5354
00010000:00010000:1.0:1651532186.049341:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.049342:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469004288:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532186.049346:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532186.049347:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.049350:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532186.049350:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.049350:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.049355:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.049356:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.049359:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532186.049359:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.049373:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.049375:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.049380:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.049380:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.049448:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.049456:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469004736
00000100:00100000:1.0:1651532186.049463:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6637
00000100:00100000:1.0:1651532186.049465:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469004736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.049468:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.049471:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e14 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f676 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.049479:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e14 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f676 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.049483:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e14 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f676 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.049486:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532186.049500:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469004736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.049503:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6637
00000001:00080000:0.0:1651532186.203870:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794339 is committed
00010000:00010000:0.0:1651532186.203886:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.203890:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.203914:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bdb1a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754468999360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 572198us (572234us total) trans 158913794339 rc 0/0
00010000:00010000:1.0:1651532186.203915:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.203917:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5345
00010000:00010000:1.0:1651532186.203920:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532186.203921:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.203925:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.203930:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.203931:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.203932:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.203935:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.203945:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.203948:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416d1f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3407872->3411967] (req 3407872->3411967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.203954:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.203959:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532186.315259:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794340 is committed
00010000:00010000:0.0:1651532186.315274:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315278:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.315295:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f6a20d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754468999808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 567391us (567433us total) trans 158913794340 rc 0/0
00000100:00100000:0.0:1651532186.315298:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5346
00010000:00010000:0.0:1651532186.315305:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315308:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532186.315309:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315312:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315317:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.315318:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.315319:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315322:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315325:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.315326:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.315326:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315329:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315336:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315339:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416d26 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [696320->8028159] (req 696320->8028159) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315344:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315350:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315414:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315417:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315429:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315432:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.315447:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fd4ee28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754468999872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 567505us (567577us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532186.315451:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5347
00010000:00010000:0.0:1651532186.315457:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315471:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532186.315472:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315476:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315484:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315487:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416d34 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7147520->7151615] (req 7147520->7151615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.315914:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.315926:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.315933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.315942:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.315951:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.315955:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469005120
00000100:00100000:0.0:1651532186.315958:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469005248
00000100:00100000:1.0:1651532186.315969:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469005312
00000100:00100000:0.0:1651532186.315973:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6638
00000100:00100000:0.0:1651532186.315976:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754469005120:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532186.315978:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6639
00000100:00100000:1.0:1651532186.315980:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754469005248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532186.315980:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532186.315984:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416e1b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f67d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.315985:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.315990:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e22 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f684 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.315992:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416e1b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f67d expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.315996:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416e1b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f67d expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.316000:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e22 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f684 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.316000:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532186.316005:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e22 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f684 expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.316009:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532186.316010:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754469005120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532186.316014:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6638
00000100:00100000:0.0:1651532186.316019:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6640
00000100:00100000:1.0:1651532186.316020:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469005248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532186.316021:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469005312:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532186.316023:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6639
00010000:00010000:0.0:1651532186.316023:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532186.316025:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e29 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f68b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.316031:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e29 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f68b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.316035:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e29 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f68b expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532186.316038:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469005056
00010000:00010000:0.0:1651532186.316038:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532186.316044:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469005312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532186.316046:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6640
00000100:00100000:1.0:1651532186.316051:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469004992
00000100:00100000:1.0:1651532186.316059:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5355
00000100:00100000:1.0:1651532186.316060:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469005056:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532186.316066:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5356
00000100:00100000:0.0:1651532186.316068:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469004992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532186.316071:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.316073:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.316076:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532186.316077:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532186.316078:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.316084:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532186.316086:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.316091:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.316094:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532186.316095:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.316098:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x40010000000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.316099:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.316102:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.316117:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.316464:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.316471:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469005504
00000100:00100000:0.0:1651532186.316478:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6641
00000100:00100000:0.0:1651532186.316480:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469005504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532186.316483:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532186.316486:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e3e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f692 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.316494:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e3e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f692 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.316501:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e3e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f692 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.316504:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532186.316521:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469005504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532186.316524:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6641
00000001:00080000:0.0:1651532186.415244:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794341 is committed
00010000:00010000:0.0:1651532186.415258:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415269:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.415289:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb589f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469000064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 667173us (667201us total) trans 158913794341 rc 0/0
00000100:00100000:0.0:1651532186.415292:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5348
00010000:00010000:1.0:1651532186.415293:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415299:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532186.415300:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415303:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415310:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.415310:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.415311:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415314:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415338:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415341:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416d3b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4988928->4993023] (req 4988928->4993023) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415351:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415355:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.415650:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.415658:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.415664:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.415676:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469005696
00000100:00100000:0.0:1651532186.415688:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469005760
00000100:00100000:1.0:1651532186.415695:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5357
00000100:00100000:1.0:1651532186.415697:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469005696:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532186.415699:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5358
00000100:00100000:0.0:1651532186.415700:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469005760:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532186.415706:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415707:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415710:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532186.415711:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415714:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:1.0:1651532186.415715:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415719:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.415721:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415723:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532186.415724:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415728:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415729:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415732:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415732:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.415744:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469005824
00010000:00010000:0.0:1651532186.415746:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415749:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.415756:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6642
00000100:00100000:1.0:1651532186.415758:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754469005824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.415762:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.415764:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416e53 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f699 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415770:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532186.415774:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08408c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754469001408:12345-10.240.43.64@tcp:3:fio.0 Request processed in 551264us (551295us total) trans 0 rc 36864/36864
00010000:00010000:1.0:1651532186.415779:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416e53 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f699 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532186.415779:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5349
00010000:00010000:1.0:1651532186.415784:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416e53 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f699 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.415786:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.415787:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532186.415789:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532186.415790:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415793:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.415797:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469005824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (132us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532186.415798:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.415798:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.415799:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.415800:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6642
00010000:00010000:0.0:1651532186.415814:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415821:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415824:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416d7a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [761856->7426047] (req 761856->7426047) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415829:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.415832:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.416175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.416193:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.416214:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469005952
00000100:00100000:1.0:1651532186.416223:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469006080
00000100:00100000:1.0:1651532186.416227:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6643
00000100:00100000:1.0:1651532186.416229:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469005952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.416233:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.416237:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416e5a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6a0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.416245:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416e5a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6a0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.416252:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416e5a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6a0 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.416255:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532186.416266:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469005952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.416269:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6643
00000100:00100000:1.0:1651532186.416273:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6644
00000100:00100000:1.0:1651532186.416275:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469006080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.416277:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.416279:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416e61 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6a7 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.416285:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416e61 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6a7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.416289:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416e61 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6a7 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.416292:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532186.416297:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469006080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (104us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.416299:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6644
00000100:00100000:0.0:1651532186.416596:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.416615:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469006336
00000100:00100000:1.0:1651532186.416624:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6645
00000100:00100000:1.0:1651532186.416625:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000706143c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469006336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.416629:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.416632:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416e68 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6ae expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.416639:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416e68 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6ae expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.416643:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416e68 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6ae expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.416646:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532186.416656:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000706143c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469006336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.416658:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6645
00000001:00080000:0.0:1651532186.523566:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794342 is committed
00010000:00010000:0.0:1651532186.523582:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.523586:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.523609:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469001344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 659052us (659078us total) trans 158913794342 rc 0/0
00010000:00010000:1.0:1651532186.523610:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.523612:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5350
00010000:00010000:1.0:1651532186.523615:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532186.523616:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.523620:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.523626:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.523627:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.523628:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.523631:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.523647:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.523650:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.523651:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416d81 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [774144->9306111] (req 774144->9306111) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.523655:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.524013:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.524053:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.524062:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.524078:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.524079:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469006656
00000100:00100000:0.0:1651532186.524087:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.524097:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469006464
00000100:00100000:1.0:1651532186.524098:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469006720
00000100:00100000:1.0:1651532186.524101:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469006848
00000100:00100000:1.0:1651532186.524104:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6646
00000100:00100000:1.0:1651532186.524106:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469006656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532186.524107:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469006528
00010000:00010000:1.0:1651532186.524110:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532186.524112:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5359
00010000:00010000:1.0:1651532186.524113:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416e6f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6b5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.524114:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469006464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532186.524119:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.524122:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416e6f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6b5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.524122:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.524126:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532186.524127:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.524130:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532186.524131:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524135:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416e6f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6b5 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.524135:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.524139:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524141:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532186.524146:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5360
00000100:00100000:0.0:1651532186.524147:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469006528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532186.524152:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.524153:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469006656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (90us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532186.524155:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532186.524156:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6646
00010000:00010000:0.0:1651532186.524156:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.524158:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532186.524159:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.524161:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6647
00010000:00010000:0.0:1651532186.524162:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.524163:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469006720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.524165:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532186.524165:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524168:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416e84 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6bc expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524172:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.524174:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416e84 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6bc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.524176:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.524179:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524182:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416e84 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6bc expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.524185:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532186.524193:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469006720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (115us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532186.524193:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d9afd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754469003520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 568065us (568150us total) trans 0 rc 57344/57344
00000100:00100000:1.0:1651532186.524195:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6647
00000100:00100000:0.0:1651532186.524196:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5351
00000100:00100000:1.0:1651532186.524199:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6648
00000100:00100000:1.0:1651532186.524200:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469006848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.524203:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532186.524203:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524204:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416e8b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6c3 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.524206:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532186.524207:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524209:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.524210:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416e8b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6c3 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.524210:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524215:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416e8b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6c3 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.524215:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.524216:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.524217:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524218:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532186.524220:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.524222:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469006848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (135us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.524224:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6648
00010000:00010000:0.0:1651532186.524229:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.524232:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416dea lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [405504->10326015] (req 405504->10326015) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524239:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524243:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.524790:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.524797:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.524817:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.524827:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469007232
00000100:00100000:0.0:1651532186.524827:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.524836:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469007360
00000100:00100000:1.0:1651532186.524839:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469007168
00000100:00100000:1.0:1651532186.524842:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469007488
00000100:00100000:0.0:1651532186.524843:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6649
00000100:00100000:0.0:1651532186.524845:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754469007232:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532186.524847:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6650
00000100:00100000:1.0:1651532186.524848:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469007360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532186.524849:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.524852:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532186.524853:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416e92 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6d1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524856:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416e99 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6d8 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.524861:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416e92 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6d1 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.524867:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416e99 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6d8 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.524867:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416e92 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6d1 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.524871:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416e99 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6d8 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.524873:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00010000:00010000:1.0:1651532186.524874:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532186.524884:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469007360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (86us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532186.524884:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754469007232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.524886:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6650
00000100:00100000:0.0:1651532186.524888:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6649
00000100:00100000:1.0:1651532186.524891:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6651
00000100:00100000:1.0:1651532186.524893:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469007168:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532186.524893:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6652
00010000:00010000:1.0:1651532186.524895:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532186.524895:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469007488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.524897:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ea0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6ca expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.524897:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532186.524900:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ea7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6df expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.524902:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ea0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6ca expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.524906:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ea0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6ca expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.524906:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ea7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6df expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.524909:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532186.524910:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ea7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6df expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532186.524913:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469007168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 20us (97us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532186.524913:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:1.0:1651532186.524916:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6651
00000100:00100000:0.0:1651532186.524918:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469007488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (91us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532186.524920:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6652
00000100:00100000:0.0:1651532186.525245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.525252:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469007744
00000100:00100000:0.0:1651532186.525259:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6653
00000100:00100000:0.0:1651532186.525261:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469007744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532186.525265:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532186.525268:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eae lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6e6 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.525276:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eae lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6e6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.525280:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eae lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6e6 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.525283:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532186.525292:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469007744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532186.525294:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6653
00000001:00080000:0.0:1651532186.648556:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794343 is committed
00010000:00010000:1.0:1651532186.648586:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.648591:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.648613:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469003456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 692482us (692553us total) trans 158913794343 rc 0/0
00010000:00010000:0.0:1651532186.648615:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.648616:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5352
00010000:00010000:0.0:1651532186.648620:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532186.648621:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.648624:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.648630:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.648630:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.648632:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.648635:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.648644:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.648647:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416df1 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [925696->9617407] (req 925696->9617407) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.648657:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.648660:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.648965:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.648976:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.648985:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.648987:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469007936
00000100:00100000:0.0:1651532186.648992:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469008000
00000100:00100000:1.0:1651532186.649010:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5361
00000100:00100000:0.0:1651532186.649013:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5362
00000100:00100000:1.0:1651532186.649014:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469007936:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532186.649015:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469008000:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532186.649023:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.649025:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.649027:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532186.649028:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532186.649029:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.649035:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532186.649036:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.649039:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.649042:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532186.649042:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.649074:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.649075:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.649079:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.649082:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.649085:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469008064
00000100:00100000:0.0:1651532186.649092:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6654
00000100:00100000:0.0:1651532186.649094:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469008064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532186.649097:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532186.649099:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532186.649100:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ec3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6ed expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.649107:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469008128
00010000:00010000:0.0:1651532186.649107:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ec3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6ed expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.649112:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ec3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6ed expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532186.649113:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6655
00000100:00100000:1.0:1651532186.649115:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469008128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532186.649115:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00010000:00010000:1.0:1651532186.649118:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.649121:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416eca lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6f4 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.649126:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754469008064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (141us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532186.649128:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416eca lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6f4 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532186.649129:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6654
00010000:00010000:1.0:1651532186.649132:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416eca lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6f4 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.649136:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532186.649144:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469008128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (45us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.649146:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6655
00000100:00100000:1.0:1651532186.649414:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.649422:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469008384
00000100:00100000:1.0:1651532186.649429:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6656
00000100:00100000:1.0:1651532186.649430:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469008384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.649434:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.649437:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ed1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f6fb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.649444:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ed1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6fb expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.649448:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ed1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f6fb expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.649451:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532186.649465:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469008384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.649468:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6656
00000100:00100000:1.0:1651532186.649705:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.649712:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469008576
00000100:00100000:1.0:1651532186.649718:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6657
00000100:00100000:1.0:1651532186.649720:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469008576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.649723:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.649726:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416ed8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f702 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.649733:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416ed8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f702 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.649740:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416ed8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f702 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.649743:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532186.649757:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469008576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.649759:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6657
00000001:00080000:0.0:1651532186.715282:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794344 is committed
00002000:00010000:0.0:1651532186.715297:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532185 -> 1651532186
00002000:00010000:0.0:1651532186.715298:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532185 -> 1651532186
00010000:00010000:0.0:1651532186.715301:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.715305:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.715330:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a76f2cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469004224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 665994us (666032us total) trans 158913794344 rc 0/0
00010000:00010000:1.0:1651532186.715333:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.715334:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5353
00010000:00010000:1.0:1651532186.715338:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532186.715339:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715343:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715349:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.715350:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.715350:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715353:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715357:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.715357:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.715358:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715361:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715395:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715399:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416e06 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2310144->7917567] (req 2310144->7917567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715405:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715408:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.715409:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.715413:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.715427:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.715436:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.715466:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd0fd3e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469004288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 666123us (666154us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532186.715469:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5354
00010000:00010000:1.0:1651532186.715473:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715478:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532186.715479:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715482:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715488:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715491:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416e0d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7102464->7106559] (req 7102464->7106559) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.715668:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532186.715684:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715688:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.715708:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469005056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 399647us (399814us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532186.715712:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5355
00010000:00010000:0.0:1651532186.715712:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.715717:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532186.715718:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.715721:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469008768
00010000:00010000:0.0:1651532186.715721:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.715728:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6658
00000100:00100000:1.0:1651532186.715729:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469008768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.715733:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.715736:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416edf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f709 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.715741:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.715742:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.715743:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.715747:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715755:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416edf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f709 expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.715756:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715759:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416edf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f709 expref: 13 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.715759:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416e30 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4100096->7933951] (req 4100096->7933951) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.715765:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715766:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532186.715768:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.715773:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469008768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.715776:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6658
00000100:00100000:1.0:1651532186.715822:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.715837:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.715846:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469009024
00000100:00100000:1.0:1651532186.715864:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5363
00000100:00100000:1.0:1651532186.715866:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469009024:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532186.715879:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715884:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532186.715885:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715888:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532186.715889:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715893:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715896:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.715904:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469008832
00000100:00100000:1.0:1651532186.715910:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6659
00000100:00100000:1.0:1651532186.715912:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469008832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.715915:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.715917:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416eed lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f710 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.715924:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416eed lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f710 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.715928:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416eed lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f710 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.715931:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532186.715947:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469008832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (125us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.715950:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6659
00000100:00100000:1.0:1651532186.715961:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.715984:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469008960
00000100:00100000:1.0:1651532186.715993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.715997:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5364
00000100:00100000:0.0:1651532186.715999:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469008960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532186.716006:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.716011:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532186.716017:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.716019:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469009088
00010000:00010000:0.0:1651532186.716021:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532186.716021:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.716026:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.716027:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6660
00000100:00100000:1.0:1651532186.716028:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469009088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532186.716029:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.716032:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.716035:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416efb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f717 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.716042:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416efb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f717 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.716049:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416efb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f717 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.716052:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532186.716061:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469009088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.716063:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6660
00000001:00080000:0.0:1651532186.815290:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794345 is committed
00010000:00010000:0.0:1651532186.815305:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.815310:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.815332:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469004992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499263us (499405us total) trans 158913794345 rc 0/0
00010000:00010000:1.0:1651532186.815335:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.815335:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5356
00010000:00010000:1.0:1651532186.815340:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532186.815341:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.815345:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.815351:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.815351:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.815352:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.815355:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.815374:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.815381:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.815385:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.815388:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416e37 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [524288->10338303] (req 524288->10338303) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.815730:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.815739:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.815746:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.815757:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.815758:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469009600
00000100:00100000:0.0:1651532186.815767:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469009536
00000100:00100000:1.0:1651532186.815776:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469009664
00000100:00100000:1.0:1651532186.815783:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6661
00000100:00100000:1.0:1651532186.815785:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469009600:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532186.815787:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469009408
00010000:00010000:1.0:1651532186.815789:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.815792:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416f02 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f71e expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.815794:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5365
00000100:00100000:0.0:1651532186.815796:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469009536:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532186.815800:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416f02 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f71e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.815821:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416f02 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f71e expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.815824:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532186.815831:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.815838:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469009600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.815841:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6661
00010000:00010000:0.0:1651532186.815841:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532186.815842:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.815845:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00000100:00100000:1.0:1651532186.815846:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6662
00010000:00010000:0.0:1651532186.815846:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.815848:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469009664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.815850:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532186.815851:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.815853:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416f10 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f725 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.815854:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.815859:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416f10 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f725 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532186.815862:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5366
00010000:00010000:1.0:1651532186.815863:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416f10 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f725 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532186.815864:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469009408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532186.815866:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532186.815870:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.815871:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469009664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.815873:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6662
00010000:00010000:0.0:1651532186.815874:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532186.815874:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.815877:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:0.0:1651532186.815877:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.815881:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.815884:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.815899:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.815910:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469009792
00000100:00100000:1.0:1651532186.815917:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6663
00000100:00100000:1.0:1651532186.815919:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469009792:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532186.815919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532186.815922:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.815930:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f1e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f72c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.815937:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f1e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f72c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.815949:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f1e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f72c expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.815953:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532186.815965:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469009792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.815968:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6663
00000100:00100000:1.0:1651532186.815973:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469009856
00000100:00100000:1.0:1651532186.815980:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6664
00000100:00100000:1.0:1651532186.815981:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469009856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.815984:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.815995:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416f25 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f733 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.816002:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416f25 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f733 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.816006:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416f25 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f733 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532186.816009:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532186.816020:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469009856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (101us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532186.816022:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6664
00000100:00100000:0.0:1651532186.848105:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532186.848114:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951234048
00000100:00100000:0.0:1651532186.848128:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 73
00000100:00100000:0.0:1651532186.848130:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951234048:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532186.848135:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 831488 granted 353788480 pending 114688 free 81138851840 avail 76966248448
00000100:00100000:0.0:1651532186.848148:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f061e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951234048:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 18us (44us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532186.848151:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 73
00000001:00080000:0.0:1651532186.931935:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794346 is committed
00010000:00010000:0.0:1651532186.931965:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.931968:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.931990:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469005696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 516292us (516340us total) trans 158913794346 rc 0/0
00010000:00010000:1.0:1651532186.931991:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.931993:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5357
00010000:00010000:1.0:1651532186.931997:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532186.931998:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.932001:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.932007:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.932008:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.932009:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.932012:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.932022:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932030:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.932032:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416e45 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [778240->3866623] (req 778240->3866623) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932034:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.932289:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532186.932307:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469010240
00010000:00010000:0.0:1651532186.932310:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932314:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.932317:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6665
00000100:00100000:1.0:1651532186.932319:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469010240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532186.932322:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532186.932326:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416f2c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f73a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532186.932331:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a29f73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469005760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 516630us (516672us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532186.932334:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5358
00010000:00010000:1.0:1651532186.932338:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532186.932341:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416f2c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f73a expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.932341:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932344:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532186.932345:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416f2c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f73a expref: 14 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532186.932345:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932349:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932354:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.932354:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532186.932355:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932358:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.932361:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532186.932375:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932378:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416e4c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1171456->8040447] (req 1171456->8040447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.932381:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469010240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (93us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532186.932384:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.932385:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6665
00010000:00010000:0.0:1651532186.932386:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532186.932725:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.932736:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469010560
00000100:00100000:1.0:1651532186.932737:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532186.932753:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469010496
00000100:00100000:0.0:1651532186.932762:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5367
00000100:00100000:0.0:1651532186.932764:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469010560:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532186.932765:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5368
00000100:00100000:1.0:1651532186.932768:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469010496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532186.932771:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932775:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532186.932777:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932777:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932779:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532186.932780:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.932787:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532186.932788:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.932791:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532186.932792:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932795:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.932796:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532186.932799:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532186.932800:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532187.015321:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794347 is committed
00010000:00010000:0.0:1651532187.015335:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015338:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.015360:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edbe5117 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469006464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 491245us (491348us total) trans 158913794347 rc 0/0
00010000:00010000:1.0:1651532187.015363:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.015364:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5359
00010000:00010000:1.0:1651532187.015382:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.015383:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015387:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015393:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.015393:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.015394:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015397:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015401:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.015401:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.015402:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015412:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015425:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015429:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f416e76 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3420160->6733823] (req 3420160->6733823) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015439:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015444:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015448:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015451:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015681:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015685:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015689:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015698:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.015704:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008886a2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469006528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 491556us (491651us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651532187.015707:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5360
00000100:00100000:1.0:1651532187.015721:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ff5bcbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469008000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366705us (366744us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651532187.015725:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5362
00010000:00010000:0.0:1651532187.015732:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015733:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015736:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532187.015736:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532187.015737:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015738:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015740:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015741:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015746:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015748:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.015749:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.015750:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015755:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015760:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416eb5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [786432->9662463] (req 786432->9662463) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015766:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015769:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416e7d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3321856->7229439] (req 3321856->7229439) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015771:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015774:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.015784:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.015819:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469010880
00000100:00100000:0.0:1651532187.015821:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.015849:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469011008
00000100:00100000:0.0:1651532187.015854:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6666
00000100:00100000:0.0:1651532187.015856:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469010880:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532187.015861:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6667
00000100:00100000:1.0:1651532187.015863:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469011008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.015866:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.015867:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.015869:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416f41 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f741 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.015871:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416f48 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f748 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.015879:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416f41 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f741 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.015880:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416f48 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f748 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.015883:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416f41 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f741 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.015884:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416f48 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f748 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.015887:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532187.015888:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532187.015897:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469011008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.015897:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469010880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.015901:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6667
00000100:00100000:0.0:1651532187.015903:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6666
00000100:00100000:1.0:1651532187.016108:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.016125:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.016146:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.016154:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469011136
00000100:00100000:1.0:1651532187.016168:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5369
00000100:00100000:1.0:1651532187.016170:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a1abca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469011136:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532187.016170:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469011200
00010000:00010000:1.0:1651532187.016178:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.016182:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469011264
00000100:00100000:0.0:1651532187.016189:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6668
00000100:00100000:0.0:1651532187.016190:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469011200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.016194:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.016198:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416f56 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f74f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.016201:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.016203:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.016208:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532187.016209:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.016217:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.016217:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416f56 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f74f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.016220:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.016229:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6669
00000100:00100000:1.0:1651532187.016231:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469011264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.016234:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.016236:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416f56 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f74f expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.016237:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416f5d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f756 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.016240:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532187.016245:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416f5d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f756 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.016249:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416f5d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f756 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532187.016254:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469011200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.016257:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6668
00010000:00010000:1.0:1651532187.016260:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532187.016274:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.016291:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469011264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (145us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.016294:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6669
00000100:00100000:0.0:1651532187.016300:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.016307:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469011456
00000100:00100000:1.0:1651532187.016318:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6670
00000100:00100000:1.0:1651532187.016325:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469011456:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532187.016327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532187.016328:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.016331:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416f64 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f764 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.016333:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469011520
00010000:00010000:1.0:1651532187.016338:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416f64 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f764 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.016342:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416f64 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f764 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532187.016343:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5370
00010000:00010000:1.0:1651532187.016345:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532187.016345:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469011520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532187.016352:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.016358:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469011456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.016361:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6670
00000100:00100000:1.0:1651532187.016373:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469011392
00000100:00100000:1.0:1651532187.016377:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6671
00000100:00100000:1.0:1651532187.016379:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469011392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.016381:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.016384:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416f72 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f75d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.016384:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532187.016385:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.016388:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532187.016389:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.016393:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416f72 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f75d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.016393:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.016397:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416f72 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f75d expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.016397:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.016400:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532187.016407:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469011392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.016409:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6671
00000100:00100000:1.0:1651532187.016598:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.016607:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.016613:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469011712
00000100:00100000:1.0:1651532187.016623:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469011776
00000100:00100000:0.0:1651532187.016633:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6672
00000100:00100000:1.0:1651532187.016635:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6673
00000100:00100000:0.0:1651532187.016635:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469011712:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532187.016637:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469011776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.016639:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.016640:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.016642:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416f79 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f76b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.016644:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f80 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f772 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.016650:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416f79 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f76b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.016651:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f80 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f772 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.016654:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416f79 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f76b expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.016655:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f80 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f772 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.016657:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00010000:00010000:1.0:1651532187.016659:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532187.016670:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469011776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.016672:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6673
00000100:00100000:0.0:1651532187.016687:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469011712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.016691:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6672
00000100:00100000:1.0:1651532187.016720:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.016745:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469012032
00000100:00100000:0.0:1651532187.016752:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6674
00000100:00100000:0.0:1651532187.016754:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfde6df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469012032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.016757:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.016760:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416f87 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f779 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.016767:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416f87 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f779 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.016771:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416f87 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f779 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.016775:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532187.016784:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfde6df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469012032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.016786:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6674
00000100:00100000:1.0:1651532187.016955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.016966:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469012224
00000100:00100000:0.0:1651532187.016973:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6675
00000100:00100000:0.0:1651532187.016975:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469012224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.016978:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.016981:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416f8e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f780 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.016991:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416f8e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f780 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.016995:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416f8e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f780 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.016998:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532187.017007:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469012224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.017010:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6675
00000100:00100000:1.0:1651532187.017061:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.017071:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469012352
00000100:00100000:0.0:1651532187.017078:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6676
00000100:00100000:0.0:1651532187.017080:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469012352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.017083:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.017086:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416f95 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f787 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.017093:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416f95 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f787 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.017097:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416f95 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f787 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.017100:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532187.017109:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469012352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.017112:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6676
00000001:00080000:0.0:1651532187.107005:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794348 is committed
00010000:00010000:1.0:1651532187.107038:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107043:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.107061:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008622b3f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469007936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 458048us (458097us total) trans 158913794348 rc 0/0
00000100:00100000:1.0:1651532187.107065:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5361
00010000:00010000:1.0:1651532187.107072:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107078:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.107079:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107082:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107087:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.107088:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.107088:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107091:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107098:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107101:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f416ebc lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [434176->8044543] (req 434176->8044543) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107106:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107109:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107298:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107303:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.107325:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469009024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391458us (391487us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532187.107328:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5363
00010000:00010000:1.0:1651532187.107335:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107338:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.107339:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107342:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107347:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.107348:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.107348:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107359:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107378:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107384:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f416ee6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3424256->10371071] (req 3424256->10371071) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.107386:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.107391:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.107504:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.107514:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469012608
00000100:00100000:0.0:1651532187.107514:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.107524:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.107533:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469012544
00000100:00100000:1.0:1651532187.107542:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5371
00000100:00100000:1.0:1651532187.107543:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469012608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532187.107550:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107555:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.107556:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532187.107556:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107559:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.107581:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5372
00000100:00100000:1.0:1651532187.107582:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469012544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532187.107588:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.107588:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532187.107591:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.107592:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.107595:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532187.107597:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107606:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532187.107607:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107611:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.107613:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532187.107614:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.107625:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469012800
00010000:00010000:1.0:1651532187.107629:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.107632:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469012736
00000100:00100000:0.0:1651532187.107634:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469012928
00000100:00100000:1.0:1651532187.107636:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469012864
00000100:00100000:0.0:1651532187.107637:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6677
00000100:00100000:0.0:1651532187.107639:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469012800:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532187.107642:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6678
00010000:00010000:0.0:1651532187.107642:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532187.107643:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469012736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.107646:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.107647:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416faa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f78e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107649:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416fb1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f795 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.107655:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416faa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f78e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.107657:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416fb1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f795 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.107659:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f416faa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f78e expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.107663:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00010000:00010000:1.0:1651532187.107664:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f416fb1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f795 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.107667:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:0.0:1651532187.107674:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469012800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (149us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.107675:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469012736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.107677:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6677
00000100:00100000:1.0:1651532187.107679:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6678
00000100:00100000:0.0:1651532187.107682:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6679
00000100:00100000:0.0:1651532187.107683:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469012928:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532187.107684:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6680
00000100:00100000:1.0:1651532187.107685:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469012864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.107686:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.107688:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.107688:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416fb8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7a3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.107690:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416fbf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f79c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.107694:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416fb8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7a3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.107695:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416fbf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f79c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.107698:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f416fb8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7a3 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.107699:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f416fbf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f79c expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.107701:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532187.107702:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532187.107706:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469012928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (111us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.107707:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469012864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (94us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.107709:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6679
00000100:00100000:1.0:1651532187.107710:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6680
00000100:00100000:1.0:1651532187.108007:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.108016:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469013056
00000100:00100000:1.0:1651532187.108023:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6681
00000100:00100000:1.0:1651532187.108025:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469013056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.108028:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.108032:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416fc6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7aa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.108039:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416fc6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7aa expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.108044:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f416fc6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7aa expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.108047:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532187.108060:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469013056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.108063:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6681
00000100:00100000:1.0:1651532187.108171:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.108180:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.108186:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469013184
00000100:00100000:1.0:1651532187.108191:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469013312
00000100:00100000:1.0:1651532187.108199:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6682
00000100:00100000:1.0:1651532187.108201:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6801443 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469013184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.108204:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532187.108204:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6683
00000100:00100000:0.0:1651532187.108206:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469013312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.108207:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416fcd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7b1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.108211:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.108214:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416fd4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7b8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.108217:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416fcd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7b1 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.108221:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f416fcd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7b1 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.108223:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416fd4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7b8 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.108225:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00010000:00010000:0.0:1651532187.108227:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f416fd4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7b8 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.108230:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532187.108236:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6801443 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469013184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.108239:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6682
00000100:00100000:0.0:1651532187.108246:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469013312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.108249:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6683
00000100:00100000:1.0:1651532187.108525:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.108543:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469013568
00000100:00100000:0.0:1651532187.108556:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6684
00000100:00100000:0.0:1651532187.108558:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469013568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.108561:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.108565:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416fdb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7bf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.108572:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416fdb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7bf expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.108576:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f416fdb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7bf expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.108579:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532187.108589:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469013568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.108592:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6684
00000100:00100000:1.0:1651532187.108827:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.108837:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469013760
00000100:00100000:0.0:1651532187.108848:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6685
00000100:00100000:0.0:1651532187.108850:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469013760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.108853:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.108856:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416fe2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7c6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.108863:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416fe2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7c6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.108867:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f416fe2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7c6 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.108870:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532187.108880:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469013760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.108882:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6685
00000100:00100000:1.0:1651532187.109088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.109099:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469013888
00000100:00100000:0.0:1651532187.109109:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6686
00000100:00100000:0.0:1651532187.109111:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469013888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.109115:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.109118:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416fe9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7cd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.109125:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416fe9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7cd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.109129:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f416fe9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7cd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.109132:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532187.109142:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469013888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.109144:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6686
00000100:00100000:1.0:1651532187.109338:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.109348:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469014016
00000100:00100000:0.0:1651532187.109359:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6687
00000100:00100000:0.0:1651532187.109360:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469014016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.109364:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.109374:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416ff0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7d4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.109381:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416ff0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7d4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.109385:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f416ff0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7d4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.109389:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532187.109399:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469014016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.109402:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6687
00000100:00100000:1.0:1651532187.109621:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.109632:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469014144
00000100:00100000:0.0:1651532187.109642:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6688
00000100:00100000:0.0:1651532187.109644:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469014144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.109647:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.109650:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ff7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7db expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.109657:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ff7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7db expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.109661:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ff7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7db expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.109664:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532187.109674:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469014144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.109676:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6688
00000001:00080000:0.0:1651532187.248632:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794349 is committed
00010000:00010000:0.0:1651532187.248647:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.248651:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.248673:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469008960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532673us (532711us total) trans 158913794349 rc 0/0
00000100:00100000:0.0:1651532187.248676:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5364
00010000:00010000:0.0:1651532187.248684:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.248687:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532187.248689:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.248692:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.248696:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.248697:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.248698:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.248701:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.248708:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.248711:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f416ef4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3522560->10166271] (req 3522560->10166271) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.248722:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.248727:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.248986:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.249000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.249012:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469014336
00010000:00010000:1.0:1651532187.249018:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.249022:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469014400
00010000:00010000:1.0:1651532187.249024:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.249028:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5373
00000100:00100000:0.0:1651532187.249030:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469014336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532187.249036:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.249042:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000199b935 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469009536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 433246us (433312us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532187.249046:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5365
00000100:00100000:1.0:1651532187.249052:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5374
00000100:00100000:1.0:1651532187.249054:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469014400:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532187.249063:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532187.249064:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.249067:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532187.249068:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.249068:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249072:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.249074:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249077:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532187.249078:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.249081:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249082:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.249085:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249086:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249092:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249098:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.249099:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249102:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.249105:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532187.249106:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.249107:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.249107:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249110:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249119:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249123:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f416f09 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3342336->5976063] (req 3342336->5976063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.249135:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532187.249145:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.249149:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469014528
00010000:00010000:0.0:1651532187.249149:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.249157:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469014656
00000100:00100000:1.0:1651532187.249161:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6689
00000100:00100000:1.0:1651532187.249163:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754469014528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.249166:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.249169:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41700c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7e2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.249182:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6690
00010000:00010000:1.0:1651532187.249183:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41700c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7e2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532187.249184:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469014656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.249187:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41700c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7e2 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.249187:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.249190:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417013 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7e9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.249191:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532187.249199:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469014528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (95us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532187.249201:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417013 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7e9 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532187.249202:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6689
00010000:00010000:0.0:1651532187.249205:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417013 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7e9 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.249209:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532187.249216:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469014656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.249218:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6690
00000100:00100000:1.0:1651532187.249514:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.249524:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469014912
00000100:00100000:0.0:1651532187.249533:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6691
00000100:00100000:0.0:1651532187.249535:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469014912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.249539:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.249542:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41701a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7f0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.249550:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41701a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7f0 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.249554:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41701a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7f0 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.249557:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532187.249568:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469014912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.249571:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6691
00000100:00100000:1.0:1651532187.249791:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.249812:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469015040
00000100:00100000:0.0:1651532187.249821:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6692
00000100:00100000:0.0:1651532187.249822:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045d23ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469015040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.249826:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.249829:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417021 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7f7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.249836:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417021 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7f7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.249840:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417021 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7f7 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.249843:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532187.249853:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045d23ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469015040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.249856:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6692
00000001:00080000:0.0:1651532187.340326:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794350 is committed
00010000:00010000:0.0:1651532187.340340:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340344:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.340374:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469009408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524500us (524625us total) trans 158913794350 rc 0/0
00010000:00010000:1.0:1651532187.340378:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.340378:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5366
00010000:00010000:1.0:1651532187.340383:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.340384:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340387:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340393:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.340394:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.340395:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340400:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340411:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340419:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340421:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f416f17 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->10182655] (req 958464->10182655) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340423:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.340734:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.340744:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.340752:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.340758:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.340763:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.340780:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469015360
00000100:00100000:0.0:1651532187.340780:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469015232
00000100:00100000:1.0:1651532187.340789:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469015424
00000100:00100000:0.0:1651532187.340790:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469015296
00000100:00100000:1.0:1651532187.340792:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469015488
00000100:00100000:1.0:1651532187.340795:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6693
00000100:00100000:0.0:1651532187.340796:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5375
00000100:00100000:1.0:1651532187.340797:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469015360:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532187.340798:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469015232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532187.340801:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.340817:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340821:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41702f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f7fe expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340827:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532187.340828:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340831:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532187.340831:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340835:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.340837:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340838:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41702f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7fe expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.340841:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340843:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41702f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f7fe expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.340846:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532187.340849:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6694
00000100:00100000:0.0:1651532187.340850:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469015424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.340853:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.340856:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417036 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f805 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.340859:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469015360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (107us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.340862:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6693
00010000:00010000:0.0:1651532187.340867:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532187.340868:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6695
00000100:00100000:1.0:1651532187.340870:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469015488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.340870:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417036 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f805 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.340872:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.340874:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417036 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f805 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.340875:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41703d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f80c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340877:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532187.340880:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.340882:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41703d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f80c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.340886:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41703d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f80c expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532187.340886:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469015424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (128us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532187.340889:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:0.0:1651532187.340889:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6694
00000100:00100000:1.0:1651532187.340895:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754469015488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (132us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.340898:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6695
00010000:00010000:0.0:1651532187.340901:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340904:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.340912:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5376
00000100:00100000:1.0:1651532187.340913:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469015296:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532187.340918:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469010560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 408154us (408194us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651532187.340919:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.340921:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5367
00010000:00010000:1.0:1651532187.340923:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.340924:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340929:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532187.340929:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340930:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340933:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.340934:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340934:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340937:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340938:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340942:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.340943:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.340943:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340946:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340957:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.340961:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f416f33 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3428352->8056831] (req 3428352->8056831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340966:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.340970:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.341282:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.341318:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469015680
00000100:00100000:1.0:1651532187.341330:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6696
00000100:00100000:1.0:1651532187.341331:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469015680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.341335:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.341339:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41704b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f81a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.341346:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41704b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f81a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.341353:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41704b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f81a expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.341357:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:0.0:1651532187.341374:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.341397:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469015680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.341400:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6696
00000100:00100000:1.0:1651532187.341405:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469015616
00000100:00100000:1.0:1651532187.341418:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6697
00000100:00100000:1.0:1651532187.341420:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469015616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.341423:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.341426:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417052 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f813 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.341433:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417052 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f813 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.341437:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417052 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f813 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.341440:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532187.341453:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469015616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.341455:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6697
00000100:00100000:0.0:1651532187.341607:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.341625:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469015872
00000100:00100000:1.0:1651532187.341632:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6698
00000100:00100000:1.0:1651532187.341634:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469015872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.341637:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.341640:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417059 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f821 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.341647:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417059 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f821 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.341651:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417059 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f821 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.341654:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00000100:00100000:1.0:1651532187.341667:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469015872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.341670:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6698
00000001:00080000:0.0:1651532187.432035:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794351 is committed
00010000:00010000:1.0:1651532187.432068:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432073:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.432096:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469010496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 499328us (499359us total) trans 158913794351 rc 0/0
00000100:00100000:1.0:1651532187.432100:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5368
00010000:00010000:1.0:1651532187.432108:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432111:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.432112:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432115:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432121:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.432121:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.432122:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432125:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432142:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432145:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f416f3a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3334144->10186751] (req 3334144->10186751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432151:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432154:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.432512:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.432521:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.432530:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.432538:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.432553:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469016128
00000100:00100000:0.0:1651532187.432566:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469016064
00000100:00100000:0.0:1651532187.432572:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5377
00000100:00100000:0.0:1651532187.432574:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469016128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532187.432581:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.432586:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532187.432587:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532187.432588:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.432592:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.432593:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5378
00000100:00100000:1.0:1651532187.432596:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469016064:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532187.432599:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469016320
00000100:00100000:0.0:1651532187.432607:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469016256
00000100:00100000:0.0:1651532187.432611:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6699
00010000:00010000:1.0:1651532187.432613:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.432613:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754469016320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.432617:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.432620:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41706e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f82f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432621:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.432622:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432627:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432632:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532187.432633:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432641:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.432641:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41706e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f82f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.432645:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41706e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f82f expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.432646:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.432649:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532187.432652:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.432660:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754469016320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.432663:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6699
00000100:00100000:1.0:1651532187.432666:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6700
00000100:00100000:1.0:1651532187.432668:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469016256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.432672:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.432675:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417075 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f828 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.432706:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417075 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f828 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.432711:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417075 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f828 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.432714:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532187.432729:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469016256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (191us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.432732:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6700
00000001:00080000:0.0:1651532187.573665:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794352 is committed
00002000:00010000:1.0:1651532187.573694:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532186 -> 1651532187
00002000:00010000:1.0:1651532187.573696:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532186 -> 1651532187
00010000:00010000:1.0:1651532187.573698:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.573702:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.573723:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a1abca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469011136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 557552us (557617us total) trans 158913794352 rc 0/0
00010000:00010000:0.0:1651532187.573726:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.573727:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5369
00010000:00010000:0.0:1651532187.573730:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532187.573732:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.573735:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.573740:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.573741:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.573742:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.573745:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.573748:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.573749:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.573749:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.573752:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.573762:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.573766:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f416f4f lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1003520->8298495] (req 1003520->8298495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.573778:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.573783:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.573822:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.573826:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.574086:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532187.574105:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574109:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.574126:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f67ceec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469012608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466582us (466623us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532187.574129:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5371
00010000:00010000:1.0:1651532187.574136:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574140:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.574141:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574144:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.574153:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469016640
00010000:00010000:1.0:1651532187.574158:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574161:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f416f9c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [499712->10252287] (req 499712->10252287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.574162:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6701
00000100:00100000:0.0:1651532187.574163:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469016640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.574167:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.574170:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574171:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41707c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f836 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574173:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574177:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.574180:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41707c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f836 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532187.574187:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469011520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 557842us (557887us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651532187.574187:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41707c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f836 expref: 14 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532187.574190:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5370
00010000:00010000:0.0:1651532187.574191:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532187.574196:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574199:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532187.574199:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469016640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (114us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532187.574200:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.574202:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6701
00010000:00010000:1.0:1651532187.574203:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574207:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.574208:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.574208:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574211:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574218:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574221:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f416f6b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6107136->9457663] (req 6107136->9457663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574226:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574229:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.574403:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.574414:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469016768
00000100:00100000:0.0:1651532187.574422:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.574433:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469016832
00000100:00100000:0.0:1651532187.574433:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.574444:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5379
00000100:00100000:1.0:1651532187.574445:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469016768:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532187.574446:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469016896
00010000:00010000:1.0:1651532187.574452:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.574454:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6702
00000100:00100000:0.0:1651532187.574455:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469016896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.574457:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.574458:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574459:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.574460:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532187.574461:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574462:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41708a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f83d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574465:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.574470:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574470:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41708a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f83d expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.574474:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41708a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f83d expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.574493:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532187.574502:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469016896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.574505:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6702
00000100:00100000:0.0:1651532187.574513:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5380
00000100:00100000:0.0:1651532187.574515:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469016832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532187.574521:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574525:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532187.574526:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574529:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532187.574529:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574534:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574537:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.574545:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.574576:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469016960
00000100:00100000:0.0:1651532187.574583:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6703
00000100:00100000:0.0:1651532187.574585:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469016960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.574588:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.574591:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f417098 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f844 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574601:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f417098 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f844 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.574604:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f417098 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f844 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.574608:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532187.574617:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469016960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.574619:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6703
00000100:00100000:1.0:1651532187.574686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.574697:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469017216
00000100:00100000:0.0:1651532187.574704:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6704
00000100:00100000:0.0:1651532187.574706:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469017216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.574709:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.574713:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41709f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f84b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.574719:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41709f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f84b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.574723:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41709f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f84b expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.574727:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532187.574736:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469017216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.574738:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6704
00000100:00100000:1.0:1651532187.575058:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.575069:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469017536
00000100:00100000:0.0:1651532187.575077:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6705
00000100:00100000:0.0:1651532187.575079:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469017536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.575082:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.575085:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170a6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f852 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.575092:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170a6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f852 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.575096:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170a6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f852 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.575099:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:0.0:1651532187.575109:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469017536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.575112:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6705
00000001:00080000:0.0:1651532187.640361:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794353 is committed
00010000:00010000:1.0:1651532187.640399:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.640404:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.640427:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092eab5d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469012544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 532844us (532912us total) trans 158913794353 rc 0/0
00010000:00010000:0.0:1651532187.640427:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.640430:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5372
00010000:00010000:0.0:1651532187.640432:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532187.640433:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.640439:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.640444:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.640445:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.640446:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.640449:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.640456:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.640459:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f416fa3 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3358720->6123519] (req 3358720->6123519) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.640473:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.640477:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.640746:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.640766:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.640767:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469017728
00000100:00100000:1.0:1651532187.640792:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469017792
00000100:00100000:0.0:1651532187.640820:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5381
00000100:00100000:0.0:1651532187.640822:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469017728:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532187.640831:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5382
00010000:00010000:0.0:1651532187.640831:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.640833:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469017792:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532187.640835:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532187.640836:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.640841:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.640841:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532187.640842:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.640846:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.640848:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.640850:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532187.640851:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.640855:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.640856:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.640859:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.640859:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532187.698746:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794354 is committed
00010000:00010000:1.0:1651532187.698777:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.698781:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.698799:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469014336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 449769us (449814us total) trans 158913794354 rc 0/0
00000100:00100000:1.0:1651532187.698819:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5373
00010000:00010000:0.0:1651532187.698831:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.698835:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532187.698836:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.698839:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.698845:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.698845:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.698846:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.698849:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.698861:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.698865:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f416ffe lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7565311] (req 1007616->7565311) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.698876:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.698880:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.699132:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.699148:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018112
00000100:00100000:0.0:1651532187.699157:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6706
00000100:00100000:0.0:1651532187.699159:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469018112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.699162:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.699166:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4170bb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f860 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.699171:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532187.699173:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532187.699174:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4170bb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f860 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532187.699183:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532187.699185:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4170bb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f860 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.699193:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532187.699200:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.699205:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469018112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.699208:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6706
00000100:00100000:0.0:1651532187.699213:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018048
00000100:00100000:0.0:1651532187.699216:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018240
00000100:00100000:0.0:1651532187.699219:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018176
00000100:00100000:0.0:1651532187.699221:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6707
00000100:00100000:0.0:1651532187.699223:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469018048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.699225:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.699228:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4170c2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f859 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.699232:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.699234:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4170c2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f859 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.699237:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699242:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.699245:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4170c2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f859 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.699249:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532187.699256:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469018048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.699257:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469014400:12345-10.240.43.64@tcp:3:fio.0 Request processed in 450202us (450257us total) trans 0 rc 49152/49152
00000100:00100000:0.0:1651532187.699259:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6707
00000100:00100000:1.0:1651532187.699260:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5374
00000100:00100000:0.0:1651532187.699263:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6708
00000100:00100000:0.0:1651532187.699265:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469018240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.699266:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.699267:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.699270:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532187.699270:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4170c9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f86e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699271:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.699274:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.699275:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.699276:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4170c9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f86e expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.699280:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.699281:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.699282:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699288:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.699292:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4170c9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f86e expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.699295:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532187.699299:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699302:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417005 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->10309631] (req 0->10309631) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.699307:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469018240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (124us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.699310:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6708
00000100:00100000:0.0:1651532187.699314:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6709
00000100:00100000:0.0:1651532187.699316:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469018176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.699318:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.699320:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4170d0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f867 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.699326:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4170d0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f867 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.699329:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f4170d0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f867 expref: 14 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.699332:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532187.699343:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469018176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (143us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.699345:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6709
00010000:00010000:0.0:1651532187.699351:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.699355:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.699603:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.699610:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.699617:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.699623:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018432
00000100:00100000:1.0:1651532187.699633:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018368
00000100:00100000:1.0:1651532187.699638:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5383
00000100:00100000:1.0:1651532187.699640:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469018432:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532187.699648:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699652:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.699653:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699657:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.699663:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5384
00000100:00100000:1.0:1651532187.699678:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469018368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532187.699685:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699692:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.699694:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699699:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699703:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532187.699704:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699710:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699713:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699717:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.699730:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018496
00000100:00100000:1.0:1651532187.699754:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6710
00000100:00100000:1.0:1651532187.699756:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469018496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.699759:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.699763:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4170e5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f875 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699771:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4170e5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f875 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.699775:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4170e5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f875 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.699779:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532187.699792:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469018496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (182us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.699795:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6710
00000100:00100000:1.0:1651532187.699865:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.699873:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.699880:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.699887:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018688
00000100:00100000:1.0:1651532187.699896:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018624
00000100:00100000:1.0:1651532187.699900:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6711
00000100:00100000:0.0:1651532187.699900:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018752
00000100:00100000:1.0:1651532187.699902:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469018688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.699905:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.699908:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4170ec lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f883 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.699908:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6712
00000100:00100000:0.0:1651532187.699910:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754469018624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.699913:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.699916:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4170ec lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f883 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.699917:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4170f3 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f87c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.699920:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4170ec lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f883 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.699924:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00010000:00010000:0.0:1651532187.699925:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4170f3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f87c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.699929:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4170f3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f87c expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532187.699935:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754469018688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.699938:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6711
00010000:00010000:0.0:1651532187.699939:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532187.699943:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6713
00000100:00100000:1.0:1651532187.699945:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469018752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.699947:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532187.699948:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469018624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (75us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532187.699950:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4170fa lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f88a expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.699951:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6712
00010000:00010000:1.0:1651532187.699955:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4170fa lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f88a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.699959:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4170fa lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f88a expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.699962:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532187.699968:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469018752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.699970:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6713
00000100:00100000:1.0:1651532187.700054:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.700061:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469018944
00000100:00100000:1.0:1651532187.700067:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6714
00000100:00100000:1.0:1651532187.700069:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469018944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.700073:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.700077:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417101 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f891 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.700083:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417101 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f891 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.700087:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417101 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f891 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.700090:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532187.700103:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469018944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.700106:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6714
00000100:00100000:1.0:1651532187.700299:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.700307:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.700313:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469019072
00000100:00100000:1.0:1651532187.700319:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469019136
00000100:00100000:1.0:1651532187.700327:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6715
00000100:00100000:1.0:1651532187.700329:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469019072:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532187.700330:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6716
00010000:00010000:1.0:1651532187.700332:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532187.700333:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469019136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.700335:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417108 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f898 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.700336:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.700339:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41710f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f89f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.700342:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417108 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f898 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.700349:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417108 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f898 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.700349:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41710f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f89f expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.700353:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00010000:00010000:0.0:1651532187.700353:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f41710f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f89f expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.700357:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:1.0:1651532187.700364:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469019072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.700375:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6715
00000100:00100000:0.0:1651532187.700382:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469019136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.700385:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6716
00000100:00100000:1.0:1651532187.700687:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.700705:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469019328
00000100:00100000:0.0:1651532187.700718:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6717
00000100:00100000:0.0:1651532187.700719:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469019328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.700723:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.700726:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417116 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8a6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.700733:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417116 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8a6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.700737:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417116 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8a6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.700740:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532187.700750:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469019328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.700753:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6717
00000001:00080000:0.0:1651532187.807105:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794355 is committed
00010000:00010000:0.0:1651532187.807120:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807125:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.807146:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000966cb330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469015232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466348us (466412us total) trans 158913794355 rc 0/0
00000100:00100000:0.0:1651532187.807150:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5375
00010000:00010000:0.0:1651532187.807157:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807160:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532187.807162:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807165:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807169:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.807170:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.807171:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807174:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807180:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.807180:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.807181:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807184:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807194:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807197:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417028 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [413696->8876031] (req 413696->8876031) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807203:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807204:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807206:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807209:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.807508:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532187.807533:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807537:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.807548:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469019648
00000100:00100000:0.0:1651532187.807561:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6718
00000100:00100000:0.0:1651532187.807563:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469019648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.807566:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532187.807567:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0a0720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469015296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 466652us (466821us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532187.807570:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5376
00010000:00010000:0.0:1651532187.807570:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41711d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8ad expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807578:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.807581:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41711d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8ad expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532187.807585:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532187.807585:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f41711d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8ad expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.807588:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532187.807596:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469019648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.807599:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6718
00000100:00100000:0.0:1651532187.807603:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469019776
00000100:00100000:0.0:1651532187.807612:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6719
00000100:00100000:0.0:1651532187.807613:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469019776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.807616:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.807618:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f417124 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8bb expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807623:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.807624:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f417124 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8bb expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532187.807627:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532187.807628:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f417124 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8bb expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.807634:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532187.807640:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469019776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.807643:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6719
00000100:00100000:0.0:1651532187.807646:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469019712
00000100:00100000:0.0:1651532187.807650:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6720
00000100:00100000:0.0:1651532187.807651:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469019712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.807653:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.807655:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41712b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8b4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807659:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.807661:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41712b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8b4 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.807664:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f41712b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8b4 expref: 15 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.807667:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532187.807676:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469019712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 25us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.807679:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6720
00010000:00010000:0.0:1651532187.807690:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807696:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.807713:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000136e56df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469016128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 375139us (375202us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532187.807715:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.807716:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5377
00010000:00010000:1.0:1651532187.807719:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.807720:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807723:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807730:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807732:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417044 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2965504->10285055] (req 2965504->10285055) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807736:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807739:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000234bee3b already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.807739:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807748:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807751:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.807752:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.807753:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807756:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807764:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807766:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417060 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3366912->10289151] (req 3366912->10289151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807772:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807775:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.807862:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.807871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.807881:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469019840
00000100:00100000:0.0:1651532187.807881:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469019904
00000100:00100000:0.0:1651532187.807891:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5385
00000100:00100000:0.0:1651532187.807899:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469019904:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532187.807900:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5386
00000100:00100000:1.0:1651532187.807902:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469019840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532187.807905:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807909:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807910:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532187.807911:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807914:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532187.807914:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807918:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.807919:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807922:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532187.807923:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807927:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807928:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.807931:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.807931:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.808051:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.808060:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.808073:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.808083:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469020096
00000100:00100000:0.0:1651532187.808091:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469020160
00000100:00100000:0.0:1651532187.808094:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469020032
00000100:00100000:0.0:1651532187.808096:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6721
00000100:00100000:0.0:1651532187.808098:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469020096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.808101:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.808105:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417140 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8c9 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.808112:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417140 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8c9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.808116:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417140 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8c9 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.808119:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532187.808132:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754469020096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.808137:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6722
00000100:00100000:0.0:1651532187.808139:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6721
00000100:00100000:1.0:1651532187.808140:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469020160:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532187.808144:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6723
00010000:00010000:1.0:1651532187.808146:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532187.808146:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469020032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.808148:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.808151:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417147 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8d0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.808151:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41714e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8c2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.808156:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41714e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8c2 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.808161:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41714e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8c2 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.808164:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417147 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8d0 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.808165:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:0.0:1651532187.808170:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469020032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 24us (97us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532187.808171:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417147 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8d0 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532187.808172:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6723
00010000:00010000:1.0:1651532187.808175:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532187.808200:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469020160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (140us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.808204:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6722
00000100:00100000:0.0:1651532187.808454:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.808474:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469020352
00000100:00100000:1.0:1651532187.808483:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6724
00000100:00100000:1.0:1651532187.808485:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469020352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.808489:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.808492:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417155 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8d7 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.808500:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417155 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8d7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.808504:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417155 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8d7 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.808507:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00000100:00100000:1.0:1651532187.808518:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469020352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.808520:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6724
00000100:00100000:0.0:1651532187.808577:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.808595:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469020544
00000100:00100000:1.0:1651532187.808602:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6725
00000100:00100000:1.0:1651532187.808604:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469020544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.808607:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.808610:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41715c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8de expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.808617:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41715c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8de expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.808621:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41715c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8de expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.808627:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532187.808637:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469020544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.808640:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6725
00000100:00100000:0.0:1651532187.808711:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.808729:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469020736
00000100:00100000:1.0:1651532187.808737:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6726
00000100:00100000:1.0:1651532187.808738:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469020736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.808741:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.808745:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417163 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8e5 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.808752:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417163 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8e5 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.808756:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417163 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8e5 expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.808759:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532187.808768:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469020736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.808771:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6726
00000001:00080000:0.0:1651532187.898777:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794356 is committed
00010000:00010000:1.0:1651532187.898817:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.898822:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.898843:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d18a34d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469016064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466247us (466321us total) trans 158913794356 rc 0/0
00010000:00010000:0.0:1651532187.898846:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.898847:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5378
00010000:00010000:0.0:1651532187.898850:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532187.898851:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.898855:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.898860:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.898861:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.898862:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.898866:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.898875:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.898878:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417067 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2453504->6127615] (req 2453504->6127615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.898887:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.898890:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.899155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.899164:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.899170:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469020992
00000100:00100000:1.0:1651532187.899183:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469021056
00000100:00100000:1.0:1651532187.899191:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5387
00000100:00100000:1.0:1651532187.899193:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfde6df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469020992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532187.899200:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.899218:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.899219:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.899222:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532187.899223:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.899227:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.899231:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.899238:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5388
00000100:00100000:1.0:1651532187.899240:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469021056:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532187.899246:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.899250:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532187.899251:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.899253:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:1.0:1651532187.899254:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.899258:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.899263:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.899286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.899301:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.899309:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469021120
00000100:00100000:1.0:1651532187.899316:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469021248
00000100:00100000:1.0:1651532187.899329:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6727
00000100:00100000:1.0:1651532187.899332:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469021120:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532187.899334:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6728
00010000:00010000:1.0:1651532187.899337:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532187.899337:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469021248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.899341:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.899342:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417178 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8ec expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.899344:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41717f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8f3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.899353:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41717f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8f3 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.899363:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417178 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8ec expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.899379:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417178 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8ec expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.899382:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41717f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8f3 expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.899383:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532187.899386:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532187.899395:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469021120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (111us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.899396:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469021248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.899398:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6727
00000100:00100000:0.0:1651532187.899400:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6728
00000001:00080000:0.0:1651532187.965500:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794357 is committed
00010000:00010000:0.0:1651532187.965515:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.965519:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.965541:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e4422a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469016768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 391094us (391138us total) trans 158913794357 rc 0/0
00000100:00100000:0.0:1651532187.965544:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5379
00010000:00010000:0.0:1651532187.965551:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.965555:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532187.965556:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.965559:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.965564:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.965564:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532187.965566:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.965569:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.965576:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.965579:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417083 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1036288->10297343] (req 1036288->10297343) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.965588:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.965593:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.965882:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.965887:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.965902:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000563b7feb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469016832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 391386us (391479us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651532187.965905:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5380
00010000:00010000:1.0:1651532187.965911:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.965915:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b6abf35c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532187.965916:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.965919:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.965924:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.965925:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532187.965926:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.965928:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.965941:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.965944:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f417091 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1179648->5156863] (req 1179648->5156863) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.965959:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.965963:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.965988:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.966018:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.966028:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469021504
00000100:00100000:1.0:1651532187.966029:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469021696
00000100:00100000:0.0:1651532187.966041:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6729
00000100:00100000:1.0:1651532187.966045:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6730
00000100:00100000:1.0:1651532187.966047:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469021696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.966051:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532187.966055:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417186 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f901 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.966055:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6801443 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469021504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532187.966059:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.966063:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41718d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f8fa expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.966065:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417186 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f901 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.966070:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417186 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f901 expref: 17 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.966072:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41718d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8fa expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.966074:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fea6e5f, rc 0)
00010000:00010000:0.0:1651532187.966076:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41718d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f8fa expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.966080:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db537446, rc 0)
00000100:00100000:1.0:1651532187.966084:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469021696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.966087:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6730
00000100:00100000:0.0:1651532187.966120:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6801443 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469021504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 76us (132us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.966123:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6729
00000100:00100000:1.0:1651532187.966282:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.966291:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532187.966301:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532187.966302:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469021824
00000100:00100000:1.0:1651532187.966321:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469021888
00000100:00100000:1.0:1651532187.966335:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5389
00000100:00100000:1.0:1651532187.966337:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469021888:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532187.966344:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.966354:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532187.966354:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5390
00010000:00010000:1.0:1651532187.966355:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532187.966356:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532187.966356:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469021824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532187.966359:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.966364:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.966378:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532187.966379:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.966382:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.966385:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532187.966385:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.966388:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532187.966390:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.966393:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.966395:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469022016
00010000:00010000:0.0:1651532187.966399:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532187.966401:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469022144
00000100:00100000:1.0:1651532187.966405:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6731
00000100:00100000:1.0:1651532187.966406:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469022016:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532187.966408:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6732
00010000:00010000:1.0:1651532187.966409:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532187.966410:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469022144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532187.966412:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171a2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f908 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532187.966413:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532187.966415:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171a9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f90f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532187.966419:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171a2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f908 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.966423:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171a9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f90f expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.966424:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171a2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f908 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532187.966427:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532187.966427:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171a9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f90f expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532187.966430:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532187.966437:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469022016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (136us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532187.966439:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469022144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532187.966440:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6731
00000100:00100000:0.0:1651532187.966442:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6732
00000001:00080000:0.0:1651532188.123810:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794358 is committed
00010000:00010000:0.0:1651532188.123827:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123832:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.123860:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002279ad59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469017728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 483036us (483114us total) trans 158913794358 rc 0/0
00000100:00100000:0.0:1651532188.123864:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5381
00010000:00010000:0.0:1651532188.123872:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123876:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.123877:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123880:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123885:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.123886:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.123887:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123890:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123893:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.123894:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.123894:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123897:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123907:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123910:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4170ad lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1191936->7581695] (req 1191936->7581695) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.123913:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.123918:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123919:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123922:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123935:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.123938:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.123967:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469018432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 424311us (424349us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532188.123971:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5383
00010000:00010000:1.0:1651532188.123994:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124003:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532188.124004:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124008:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124014:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124016:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4170d7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3379200->3383295] (req 3379200->3383295) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124196:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124200:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.124215:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a252c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469017792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 483381us (483449us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651532188.124219:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5382
00010000:00010000:1.0:1651532188.124225:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124228:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532188.124229:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124233:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124237:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.124238:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.124239:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124242:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124249:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124251:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4170b4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1187840->10383359] (req 1187840->10383359) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124256:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124259:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.124364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.124386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.124387:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469022592
00000100:00100000:1.0:1651532188.124394:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.124398:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469022656
00000100:00100000:0.0:1651532188.124402:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6733
00000100:00100000:0.0:1651532188.124404:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469022592:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532188.124408:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532188.124408:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532188.124419:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6734
00000100:00100000:1.0:1651532188.124422:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469022656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.124426:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.124429:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171b7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f91d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124437:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171b7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f91d expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.124441:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171b0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f916 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.124451:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171b0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f916 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.124456:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171b7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f91d expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.124456:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171b0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f916 expref: 16 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.124459:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532188.124460:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:1.0:1651532188.124471:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469022656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.124471:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469022592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.124473:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6734
00000100:00100000:0.0:1651532188.124475:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6733
00000100:00100000:1.0:1651532188.124483:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469022784
00000100:00100000:0.0:1651532188.124485:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469022720
00000100:00100000:1.0:1651532188.124497:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5391
00000100:00100000:1.0:1651532188.124499:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469022784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532188.124505:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.124505:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5392
00000100:00100000:0.0:1651532188.124507:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469022720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532188.124509:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532188.124510:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124513:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532188.124513:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124514:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.124518:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532188.124519:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.124522:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532188.124523:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124526:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.124527:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124530:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.124531:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.124864:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.124872:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469023104
00000100:00100000:1.0:1651532188.124886:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6735
00000100:00100000:1.0:1651532188.124888:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469023104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.124892:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.124896:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171cc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f924 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.124904:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171cc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f924 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.124908:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171cc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f924 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.124911:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005cd99c96, rc 0)
00000100:00100000:1.0:1651532188.124921:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469023104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.124924:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6735
00000001:00080000:0.0:1651532188.223813:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794359 is committed
00010000:00010000:1.0:1651532188.223845:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.223850:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.223873:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469018368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 524196us (524256us total) trans 158913794359 rc 0/0
00010000:00010000:0.0:1651532188.223873:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.223877:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5384
00010000:00010000:0.0:1651532188.223878:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.223879:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.223882:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.223887:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.223888:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.223889:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.223892:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.223899:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.223902:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4170de lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [417792->8892415] (req 417792->8892415) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.223910:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.223923:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.224198:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.224206:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.224216:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469023360
00010000:00010000:1.0:1651532188.224223:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.224227:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.224227:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469023296
00000100:00100000:0.0:1651532188.224233:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5393
00000100:00100000:0.0:1651532188.224235:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469023360:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532188.224241:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075cd6aa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469019904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416342us (416370us total) trans 0 rc 45056/45056
00010000:00010000:0.0:1651532188.224242:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.224244:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5385
00010000:00010000:0.0:1651532188.224246:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.224247:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.224250:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5394
00010000:00010000:0.0:1651532188.224250:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532188.224250:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.224252:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098606df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469023296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532188.224255:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224258:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.224259:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.224263:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532188.224265:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.224267:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532188.224268:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224270:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.224273:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224273:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.224274:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.224276:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224279:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224284:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.224284:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.224285:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224288:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224298:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224301:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417132 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [552960->7921663] (req 552960->7921663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224309:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224312:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.224726:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.224742:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.224754:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469023680
00000100:00100000:1.0:1651532188.224756:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.224766:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469023808
00000100:00100000:0.0:1651532188.224769:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469023744
00000100:00100000:0.0:1651532188.224772:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6736
00000100:00100000:0.0:1651532188.224774:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469023680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.224778:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532188.224783:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6737
00000100:00100000:1.0:1651532188.224786:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469023808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.224790:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.224794:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171e1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f939 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.224795:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4171e8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f92b expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.224816:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171e1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f939 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.224821:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171e1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f939 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.224822:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4171e8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f92b expref: 21 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.224825:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532188.224827:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4171e8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f92b expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.224830:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00000100:00100000:1.0:1651532188.224836:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469023808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.224839:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6737
00000100:00100000:0.0:1651532188.224840:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469023680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (115us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.224843:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6736
00000100:00100000:1.0:1651532188.224845:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6738
00000100:00100000:1.0:1651532188.224847:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469023744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.224849:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.224852:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171ef lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f932 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.224858:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171ef lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f932 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.224862:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171ef lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f932 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.224865:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008be91647, rc 0)
00000100:00100000:1.0:1651532188.224870:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469023744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (114us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.224873:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6738
00000001:00080000:0.0:1651532188.323809:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794360 is committed
00010000:00010000:0.0:1651532188.323825:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.323829:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.323850:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036458dd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469019840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 515947us (515988us total) trans 158913794360 rc 0/0
00000100:00100000:0.0:1651532188.323854:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5386
00010000:00010000:1.0:1651532188.323855:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.323860:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532188.323861:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.323864:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.323870:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.323870:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.323871:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.323874:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.323882:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.323886:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417139 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2457600->9678847] (req 2457600->9678847) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.323890:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.323897:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.324133:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.324145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.324153:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469024128
00000100:00100000:1.0:1651532188.324166:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469024064
00000100:00100000:1.0:1651532188.324174:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5395
00000100:00100000:1.0:1651532188.324176:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469024128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532188.324183:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.324188:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532188.324189:0:330054:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.324192:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532188.324193:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.324197:0:330054:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.324200:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.324226:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5396
00000100:00100000:1.0:1651532188.324230:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469024064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532188.324240:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.324243:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532188.324247:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532188.324256:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532188.324257:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.324262:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469024320
00010000:00010000:1.0:1651532188.324270:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532188.324271:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.324276:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.324279:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.324282:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469024256
00000100:00100000:0.0:1651532188.324286:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6739
00000100:00100000:0.0:1651532188.324288:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b60e634 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469024320:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532188.324289:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6740
00000100:00100000:1.0:1651532188.324291:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469024256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.324292:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.324294:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.324296:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417204 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f947 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.324297:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41720b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f940 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.324305:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417204 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f947 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.324306:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41720b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f940 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.324309:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417204 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f947 expref: 21 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.324310:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41720b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f940 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.324313:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b4a2559, rc 0)
00010000:00010000:1.0:1651532188.324314:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532188.324327:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b60e634 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469024320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.324330:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6739
00000100:00100000:1.0:1651532188.324332:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469024256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.324335:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6740
00000100:00100000:0.0:1651532188.324634:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.324641:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469024576
00000100:00100000:0.0:1651532188.324648:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6741
00000100:00100000:0.0:1651532188.324650:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469024576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.324654:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.324657:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417212 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f94e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.324664:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417212 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f94e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.324669:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417212 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f94e expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.324672:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532188.324689:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469024576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.324692:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6741
00000100:00100000:0.0:1651532188.324919:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.324926:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469024768
00000100:00100000:0.0:1651532188.324933:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6742
00000100:00100000:0.0:1651532188.324934:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469024768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.324938:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.324941:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f417219 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f955 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.324948:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f417219 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f955 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.324955:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f417219 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f955 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.324959:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00000100:00100000:0.0:1651532188.324975:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469024768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.324977:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6742
00000001:00080000:0.0:1651532188.440493:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794361 is committed
00010000:00010000:0.0:1651532188.440508:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440512:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.440529:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfde6df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469020992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 541335us (541374us total) trans 158913794361 rc 0/0
00000100:00100000:0.0:1651532188.440532:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5387
00010000:00010000:0.0:1651532188.440538:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440542:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.440543:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440546:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440551:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.440552:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.440553:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440556:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440560:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.440560:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.440561:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440563:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440576:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440579:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41716a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3022848->6500351] (req 3022848->6500351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.440591:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.440596:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440611:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440615:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.440894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.440927:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.440948:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532188.440956:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.440964:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440967:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.440976:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.440989:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f56ab00a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469021056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 541742us (541819us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651532188.440992:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5388
00000100:00100000:0.0:1651532188.440994:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ef779d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469021888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474656us (474702us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532188.440997:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5389
00010000:00010000:1.0:1651532188.441000:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441003:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532188.441004:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441005:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441007:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441008:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.441010:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441013:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441013:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441016:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417171 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [626688->6488063] (req 626688->6488063) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441018:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.441019:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.441019:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441023:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441029:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441033:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417194 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3035136->6504447] (req 3035136->6504447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.441040:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469024896
00000100:00100000:0.0:1651532188.441048:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469024960
00000100:00100000:0.0:1651532188.441051:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469025024
00000100:00100000:0.0:1651532188.441054:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6743
00000100:00100000:0.0:1651532188.441056:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469024896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.441059:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.441062:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f417220 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f95c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.441065:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6744
00000100:00100000:1.0:1651532188.441067:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469024960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.441069:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f417220 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f95c expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.441071:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.441074:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f417220 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f95c expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.441075:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417227 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f963 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441077:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000024e2e401, rc 0)
00010000:00010000:1.0:1651532188.441083:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417227 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f963 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532188.441086:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469024896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (193us total) trans 0 rc 301/301
00010000:00010000:1.0:1651532188.441088:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417227 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f963 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532188.441089:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6743
00010000:00010000:1.0:1651532188.441091:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:0.0:1651532188.441093:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6745
00000100:00100000:0.0:1651532188.441095:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469025024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.441097:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532188.441099:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469024960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (172us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532188.441100:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41722e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f96a expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.441102:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6744
00010000:00010000:0.0:1651532188.441105:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41722e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f96a expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.441109:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41722e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f96a expref: 13 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.441112:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00010000:00010000:1.0:1651532188.441114:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441117:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.441117:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469025024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (169us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.441120:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6745
00000100:00100000:1.0:1651532188.441237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.441248:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469025088
00000100:00100000:1.0:1651532188.441256:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.441279:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469025152
00000100:00100000:0.0:1651532188.441282:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5397
00000100:00100000:0.0:1651532188.441284:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073eec7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469025088:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651532188.441290:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5398
00010000:00010000:0.0:1651532188.441291:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.441292:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469025152:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532188.441295:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532188.441296:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441299:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441299:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:0.0:1651532188.441300:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441304:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532188.441305:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441308:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532188.441309:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441312:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441313:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441316:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441317:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.441453:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.441466:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469025344
00000100:00100000:0.0:1651532188.441477:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6746
00000100:00100000:0.0:1651532188.441479:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469025344:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532188.441482:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532188.441482:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.441485:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417243 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f978 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441492:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417243 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f978 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532188.441493:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532188.441496:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417243 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f978 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532188.441500:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469025408
00010000:00010000:0.0:1651532188.441500:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:1.0:1651532188.441507:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469025280
00000100:00100000:0.0:1651532188.441510:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469025344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.441513:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6746
00000100:00100000:0.0:1651532188.441518:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6747
00000100:00100000:0.0:1651532188.441519:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469025408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.441522:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.441524:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41724a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f97f expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.441526:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6748
00000100:00100000:1.0:1651532188.441528:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469025280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.441529:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41724a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f97f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.441532:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.441533:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41724a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f97f expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.441536:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417251 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f971 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441536:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532188.441541:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469025408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.441543:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6747
00010000:00010000:1.0:1651532188.441545:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417251 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f971 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.441549:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417251 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f971 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.441555:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532188.441564:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469025280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.441567:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6748
00000100:00100000:1.0:1651532188.441837:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.441845:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469025664
00000100:00100000:1.0:1651532188.441852:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6749
00000100:00100000:1.0:1651532188.441853:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469025664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.441857:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.441860:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417258 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f98d expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441867:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417258 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f98d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.441871:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417258 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f98d expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.441875:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00000100:00100000:1.0:1651532188.441887:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469025664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.441890:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6749
00000100:00100000:1.0:1651532188.441935:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.441943:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.441948:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469025600
00000100:00100000:1.0:1651532188.441954:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469025856
00000100:00100000:1.0:1651532188.441962:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6750
00000100:00100000:1.0:1651532188.441963:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469025600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.441966:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532188.441966:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6751
00000100:00100000:0.0:1651532188.441968:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469025856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.441969:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41725f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f986 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.441972:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.441976:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41725f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f986 expref: 19 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.441976:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f417266 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f994 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.441981:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41725f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f986 expref: 20 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.441983:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f417266 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f994 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.441984:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054c6cc1e, rc 0)
00010000:00010000:0.0:1651532188.441987:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f417266 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f994 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.441990:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:1.0:1651532188.441996:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469025600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.441998:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6750
00000100:00100000:0.0:1651532188.442005:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469025856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.442008:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6751
00000100:00100000:1.0:1651532188.442075:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.442086:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469026048
00000100:00100000:0.0:1651532188.442096:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6752
00000100:00100000:0.0:1651532188.442098:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469026048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.442101:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.442104:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41726d lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f99b expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.442111:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41726d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f99b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.442115:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f41726d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f99b expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.442118:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532188.442128:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469026048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.442131:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6752
00000100:00100000:1.0:1651532188.442325:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.442335:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469026304
00000100:00100000:0.0:1651532188.442345:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6753
00000100:00100000:0.0:1651532188.442347:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469026304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.442350:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.442353:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f417274 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9a2 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.442359:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f417274 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9a2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.442363:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f417274 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9a2 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.442375:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532188.442386:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469026304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.442388:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6753
00000001:00080000:0.0:1651532188.507218:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794362 is committed
00010000:00010000:1.0:1651532188.507252:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507256:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.507279:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d96498fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469021824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 540922us (540997us total) trans 158913794362 rc 0/0
00010000:00010000:0.0:1651532188.507280:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.507284:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5390
00010000:00010000:0.0:1651532188.507284:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004c88a049 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.507285:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507289:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507294:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.507295:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.507296:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507299:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507308:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507311:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f41719b lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4202496->9691135] (req 4202496->9691135) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507317:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507329:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507523:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507527:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.507547:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469022784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 383047us (383152us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532188.507550:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5391
00010000:00010000:1.0:1651532188.507557:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507560:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532188.507562:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507564:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507569:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.507570:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.507571:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507583:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507593:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507596:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4171be lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2629632->6660095] (req 2629632->6660095) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507596:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507601:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.507677:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.507688:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469026496
00000100:00100000:0.0:1651532188.507688:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.507697:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.507703:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469026432
00000100:00100000:0.0:1651532188.507705:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469026688
00000100:00100000:1.0:1651532188.507712:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5399
00000100:00100000:1.0:1651532188.507714:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469026496:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532188.507721:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6754
00000100:00100000:0.0:1651532188.507723:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f315f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469026688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.507725:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507727:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.507730:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532188.507731:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:1.0:1651532188.507731:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507735:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.507742:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5400
00000100:00100000:1.0:1651532188.507749:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b9b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469026432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532188.507753:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507757:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532188.507757:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507762:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f417289 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9b0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507768:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532188.507768:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507775:0:330281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507776:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f417289 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9b0 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.507778:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507780:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f417289 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9b0 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.507783:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532188.507792:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f315f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469026688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (95us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.507795:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6754
00000100:00100000:1.0:1651532188.507856:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.507867:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.507875:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.507882:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469026624
00000100:00100000:1.0:1651532188.507888:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469026816
00000100:00100000:1.0:1651532188.507891:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469026944
00000100:00100000:1.0:1651532188.507893:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6755
00000100:00100000:1.0:1651532188.507895:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469026624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.507899:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.507902:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417290 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9a9 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.507907:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6756
00000100:00100000:0.0:1651532188.507909:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469026816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.507913:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.507914:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417290 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9a9 expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.507916:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f417297 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9b7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.507921:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417290 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9a9 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.507924:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f417297 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9b7 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.507928:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532188.507928:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f417297 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9b7 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.507931:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532188.507943:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469026816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.507945:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469026624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.507946:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6756
00000100:00100000:1.0:1651532188.507949:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6755
00000100:00100000:0.0:1651532188.507951:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6757
00000100:00100000:0.0:1651532188.507953:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469026944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.507955:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.507957:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41729e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9be expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.507963:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41729e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9be expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.507966:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41729e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9be expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.507969:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532188.507974:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469026944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 21us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.507977:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6757
00000100:00100000:0.0:1651532188.508042:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.508049:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469027072
00000100:00100000:0.0:1651532188.508060:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6758
00000100:00100000:0.0:1651532188.508075:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469027072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.508078:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.508082:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4172a5 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9c5 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.508089:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4172a5 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9c5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.508093:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4172a5 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9c5 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.508096:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532188.508110:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469027072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.508114:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6758
00000100:00100000:0.0:1651532188.508303:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.508310:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469027200
00000100:00100000:0.0:1651532188.508323:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6759
00000100:00100000:0.0:1651532188.508325:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469027200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.508328:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.508332:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172ac lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9cc expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.508339:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172ac lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9cc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.508343:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172ac lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9cc expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.508346:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f28e900, rc 0)
00000100:00100000:0.0:1651532188.508358:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469027200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.508360:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6759
00000001:00080000:0.0:1651532188.607191:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794363 is committed
00002000:00010000:0.0:1651532188.607204:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532187 -> 1651532188
00002000:00010000:0.0:1651532188.607206:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532187 -> 1651532188
00010000:00010000:0.0:1651532188.607208:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607212:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.607228:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469022720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 482721us (482820us total) trans 158913794363 rc 0/0
00000100:00100000:0.0:1651532188.607232:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5392
00010000:00010000:0.0:1651532188.607238:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607241:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.607242:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607245:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607250:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.607251:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.607251:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607254:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607261:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607264:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f4171c5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [4268032->9695231] (req 4268032->9695231) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607271:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607274:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607461:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607465:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.607486:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469023360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 383250us (383289us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532188.607490:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.607490:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5393
00010000:00010000:1.0:1651532188.607495:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000383c3166 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532188.607497:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.607500:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.607505:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.607506:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.607507:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.607510:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.607520:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.607523:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f4171d3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3551232->6688767] (req 3551232->6688767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.607529:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.607532:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.607619:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.607627:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.607633:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469027456
00000100:00100000:0.0:1651532188.607684:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469027392
00000100:00100000:0.0:1651532188.607695:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5401
00000100:00100000:0.0:1651532188.607697:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469027456:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532188.607704:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607709:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532188.607710:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607715:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00000100:00100000:1.0:1651532188.607716:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532188.607716:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607727:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.607729:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5402
00000100:00100000:1.0:1651532188.607732:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469027392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532188.607740:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607746:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.607751:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532188.607752:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.607755:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.607756:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469027648
00010000:00010000:1.0:1651532188.607757:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532188.607758:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.607765:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6760
00010000:00010000:1.0:1651532188.607767:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.607767:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469027648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.607770:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.607771:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607773:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4172c1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9d3 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.607774:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607780:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4172c1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9d3 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.607784:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4172c1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9d3 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.607788:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:0.0:1651532188.607796:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469027648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.607800:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6760
00000100:00100000:0.0:1651532188.607836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.607855:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469027712
00000100:00100000:0.0:1651532188.607882:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6761
00000100:00100000:0.0:1651532188.607885:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a238cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469027712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.607888:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.607892:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4172c8 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9da expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.607899:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4172c8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9da expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.607903:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f4172c8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9da expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.607906:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532188.607916:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a238cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469027712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.607918:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6761
00000100:00100000:1.0:1651532188.608214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.608225:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469027968
00000100:00100000:0.0:1651532188.608237:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6762
00000100:00100000:0.0:1651532188.608239:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469027968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.608242:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.608246:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172cf lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9e1 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.608255:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172cf lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9e1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.608259:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172cf lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9e1 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.608262:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:0.0:1651532188.608273:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469027968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.608275:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6762
00000001:00080000:0.0:1651532188.690823:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794364 is committed
00010000:00010000:1.0:1651532188.690855:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.690860:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.690882:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098606df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469023296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 466629us (466676us total) trans 158913794364 rc 0/0
00010000:00010000:0.0:1651532188.690883:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.690886:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5394
00010000:00010000:0.0:1651532188.690887:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.690888:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.690891:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.690897:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.690897:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.690898:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.690901:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.690911:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.690914:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4171da lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2465792->7626751] (req 2465792->7626751) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.690926:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.690930:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691110:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691114:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.691126:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.691130:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532188.691133:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469024128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 366956us (367001us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651532188.691136:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5395
00010000:00010000:0.0:1651532188.691136:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.691139:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.691144:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.691145:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.691146:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.691149:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.691158:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.691161:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4171f6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [6336512->7655423] (req 6336512->7655423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691165:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691169:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.691240:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.691258:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.691267:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.691281:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469028096
00000100:00100000:1.0:1651532188.691293:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469028160
00000100:00100000:1.0:1651532188.691301:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5403
00000100:00100000:1.0:1651532188.691303:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469028096:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532188.691309:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5404
00010000:00010000:1.0:1651532188.691310:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.691311:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469028160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532188.691314:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532188.691315:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691318:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532188.691319:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691324:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691328:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.691333:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.691338:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532188.691339:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.691340:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469028224
00010000:00010000:0.0:1651532188.691341:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532188.691342:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.691346:0:330282:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.691347:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6763
00000100:00100000:1.0:1651532188.691349:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469028224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.691350:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691351:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.691354:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4172e4 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9e8 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691361:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4172e4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9e8 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.691381:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4172e4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9e8 expref: 16 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.691385:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532188.691394:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469028224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (127us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.691397:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6763
00000100:00100000:0.0:1651532188.691434:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.691445:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.691504:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469028288
00000100:00100000:0.0:1651532188.691508:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.691535:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469028416
00000100:00100000:1.0:1651532188.691543:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469028480
00000100:00100000:1.0:1651532188.691549:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6764
00000100:00100000:1.0:1651532188.691552:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469028288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.691558:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.691563:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4172eb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9ef expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691576:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4172eb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9ef expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.691584:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4172eb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9ef expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.691590:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532188.691609:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469028288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (175us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.691612:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6764
00000100:00100000:1.0:1651532188.691634:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6765
00000100:00100000:1.0:1651532188.691636:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469028416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.691646:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.691650:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4172f2 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9f6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691657:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4172f2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9f6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.691661:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4172f2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9f6 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.691674:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532188.691686:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469028416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (241us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.691689:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6765
00000100:00100000:1.0:1651532188.691694:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6766
00000100:00100000:1.0:1651532188.691696:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469028480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.691698:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.691701:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4172f9 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44f9fd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691707:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4172f9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9fd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.691719:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4172f9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44f9fd expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.691722:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532188.691733:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469028480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (226us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.691736:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6766
00000100:00100000:1.0:1651532188.691910:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.691918:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469028672
00000100:00100000:1.0:1651532188.691924:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6767
00000100:00100000:1.0:1651532188.691926:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469028672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.691931:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.691934:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417300 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa04 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.691941:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417300 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa04 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.691945:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417300 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa04 expref: 18 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.691948:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532188.691961:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469028672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.691964:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6767
00000100:00100000:1.0:1651532188.692191:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.692198:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469028928
00000100:00100000:1.0:1651532188.692204:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6768
00000100:00100000:1.0:1651532188.692206:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469028928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.692209:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.692212:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417307 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa0b expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.692219:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417307 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa0b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.692222:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417307 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa0b expref: 18 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.692226:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532188.692239:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469028928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (49us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.692242:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6768
00000001:00080000:0.0:1651532188.758953:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794365 is committed
00010000:00010000:1.0:1651532188.758985:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.758990:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.759007:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469024064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 434778us (434862us total) trans 158913794365 rc 0/0
00000100:00100000:1.0:1651532188.759011:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5396
00010000:00010000:1.0:1651532188.759017:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759021:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532188.759022:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759025:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759030:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.759030:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.759031:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759037:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759049:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759052:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4171fd lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [557056->7745535] (req 557056->7745535) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.759061:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.759066:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.759432:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.759443:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.759452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.759459:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469029120
00000100:00100000:0.0:1651532188.759460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.759469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.759482:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469029056
00000100:00100000:0.0:1651532188.759485:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5405
00000100:00100000:0.0:1651532188.759487:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469029120:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532188.759493:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5406
00000100:00100000:1.0:1651532188.759495:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469029056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532188.759502:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.759502:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.759507:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532188.759508:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532188.759509:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759513:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532188.759514:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759517:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759520:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532188.759520:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.759524:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x50010000000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759525:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759528:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759531:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.759533:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469029248
00000100:00100000:0.0:1651532188.759543:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469029312
00000100:00100000:0.0:1651532188.759546:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469029376
00000100:00100000:1.0:1651532188.759549:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6769
00000100:00100000:1.0:1651532188.759551:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754469029248:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532188.759551:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6770
00000100:00100000:0.0:1651532188.759553:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754469029312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.759554:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.759556:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41731c lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa12 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.759556:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.759559:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417323 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa19 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759563:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41731c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa12 expref: 21 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.759568:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41731c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa12 expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.759569:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417323 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa19 expref: 22 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.759571:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00010000:00010000:0.0:1651532188.759573:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f417323 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa19 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.759577:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00000100:00100000:1.0:1651532188.759582:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754469029248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (130us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.759585:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6769
00000100:00100000:0.0:1651532188.759586:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754469029312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (126us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.759589:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6770
00000100:00100000:1.0:1651532188.759591:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6771
00000100:00100000:1.0:1651532188.759592:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469029376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.759596:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.759598:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41732a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa20 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759604:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41732a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa20 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.759608:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41732a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa20 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.759611:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532188.759616:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469029376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (147us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.759619:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6771
00000100:00100000:0.0:1651532188.759943:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.759954:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469029504
00000100:00100000:1.0:1651532188.759965:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6772
00000100:00100000:1.0:1651532188.759967:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469029504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.759971:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.759974:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417331 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa27 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.759981:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417331 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa27 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.759985:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417331 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa27 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.759991:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532188.760001:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469029504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.760004:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6772
00000001:00080000:0.0:1651532188.842303:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794366 is committed
00010000:00010000:0.0:1651532188.842318:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842322:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.842339:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073eec7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469025088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 401054us (401102us total) trans 158913794366 rc 0/0
00000100:00100000:0.0:1651532188.842342:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5397
00010000:00010000:0.0:1651532188.842349:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842352:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.842353:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842357:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842361:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.842362:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.842363:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842377:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842380:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.842381:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.842381:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842384:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842396:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842399:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f417235 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3584000->7786495] (req 3584000->7786495) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.842409:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.842414:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842431:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842435:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.842802:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.842828:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.842844:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469029888
00010000:00010000:0.0:1651532188.842850:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.842856:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469029952
00000100:00100000:1.0:1651532188.842863:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6773
00000100:00100000:1.0:1651532188.842865:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469029888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.842865:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.842868:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.842872:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417338 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa2e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.842878:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532188.842884:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754469026496:12345-10.240.43.64@tcp:3:fio.0 Request processed in 335169us (335207us total) trans 0 rc 45056/45056
00010000:00010000:1.0:1651532188.842887:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417338 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa2e expref: 17 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532188.842887:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5399
00010000:00010000:1.0:1651532188.842891:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417338 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa2e expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.842895:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:0.0:1651532188.842896:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6774
00000100:00100000:0.0:1651532188.842898:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469029952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.842901:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532188.842904:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469029888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (102us total) trans 0 rc 301/301
00010000:00010000:0.0:1651532188.842905:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41733f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa35 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.842906:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6773
00010000:00010000:0.0:1651532188.842910:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.842913:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41733f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa35 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.842917:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41733f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa35 expref: 15 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.842918:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842921:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000416f439b, rc 0)
00010000:00010000:1.0:1651532188.842922:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.842928:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469029952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.842931:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6774
00000100:00100000:1.0:1651532188.842933:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469025152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 401641us (401678us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651532188.842936:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5398
00010000:00010000:0.0:1651532188.842937:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842940:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.842941:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.842942:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842944:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.842945:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532188.842946:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842949:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.842949:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.842950:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842953:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.842957:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842963:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842966:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41727b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3067904->9228287] (req 3067904->9228287) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.842967:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.842970:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41723c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7749632->9703423] (req 7749632->9703423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842977:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.842983:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.843357:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.843378:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.843389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.843390:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469030144
00000100:00100000:1.0:1651532188.843398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.843407:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469030080
00000100:00100000:1.0:1651532188.843421:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5407
00000100:00100000:1.0:1651532188.843422:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469030080:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651532188.843430:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.843435:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532188.843441:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5408
00010000:00010000:1.0:1651532188.843442:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.843443:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469030144:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532188.843445:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532188.843446:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.843451:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.843451:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.843454:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.843456:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532188.843457:0:330280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.843459:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 5
00010000:00010000:0.0:1651532188.843460:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.843464:0:330280:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.843468:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.843476:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469030336
00000100:00100000:0.0:1651532188.843482:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469030272
00000100:00100000:0.0:1651532188.843489:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6775
00000100:00100000:0.0:1651532188.843491:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469030336:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532188.843492:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6776
00000100:00100000:1.0:1651532188.843494:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469030272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.843494:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.843496:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f417354 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa43 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.843499:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.843501:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41735b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa3c expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.843504:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f417354 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa43 expref: 19 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.843508:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f417354 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa43 expref: 20 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.843509:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41735b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa3c expref: 20 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.843512:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00010000:00010000:1.0:1651532188.843513:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41735b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa3c expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.843517:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:0.0:1651532188.843524:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029389bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469030336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (135us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.843527:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6775
00000100:00100000:1.0:1651532188.843532:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000860e6c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469030272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (134us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.843535:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6776
00000100:00100000:0.0:1651532188.843560:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.843592:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469030400
00000100:00100000:1.0:1651532188.843602:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6777
00000100:00100000:1.0:1651532188.843604:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469030400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.843607:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.843610:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417362 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa4a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.843616:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417362 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa4a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.843620:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417362 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa4a expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.843626:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532188.843633:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469030400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.843636:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6777
00000100:00100000:0.0:1651532188.843875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.843885:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469030592
00000100:00100000:1.0:1651532188.843897:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6778
00000100:00100000:1.0:1651532188.843898:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469030592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.843902:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.843905:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417369 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa51 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.843912:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417369 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa51 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.843916:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417369 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa51 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.843919:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532188.843929:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469030592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.843932:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6778
00000100:00100000:1.0:1651532188.843975:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.843985:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.843995:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469030848
00000100:00100000:0.0:1651532188.843995:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469030720
00000100:00100000:1.0:1651532188.844004:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6779
00000100:00100000:1.0:1651532188.844006:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469030848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532188.844009:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532188.844011:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6780
00010000:00010000:1.0:1651532188.844012:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417370 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa5f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.844013:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469030720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.844017:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.844019:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417370 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa5f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.844020:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417377 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa58 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.844023:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417370 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa5f expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.844027:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532188.844028:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417377 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa58 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651532188.844038:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c82f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469030848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.844040:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6779
00010000:00010000:0.0:1651532188.844041:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417377 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa58 expref: 19 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.844045:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532188.844053:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000341c18b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469030720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.844056:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6780
00000100:00100000:1.0:1651532188.844145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.844155:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469030976
00000100:00100000:0.0:1651532188.844163:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6781
00000100:00100000:0.0:1651532188.844164:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6801443 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469030976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.844167:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.844171:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41737e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa66 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.844178:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41737e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa66 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.844182:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f41737e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa66 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.844185:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e417baf2, rc 0)
00000100:00100000:0.0:1651532188.844195:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6801443 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469030976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.844197:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6781
00000001:00080000:0.0:1651532188.958937:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794367 is committed
00010000:00010000:0.0:1651532188.958952:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.958956:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.958978:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b9b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469026432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 451228us (451289us total) trans 158913794367 rc 0/0
00000100:00100000:0.0:1651532188.958981:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5400
00010000:00010000:0.0:1651532188.958988:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.958992:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532188.958993:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.958996:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.959001:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.959002:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.959003:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.959006:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.959013:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.959016:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417282 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3072000->7241727] (req 3072000->7241727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959027:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959032:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.959237:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.959255:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.959255:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469031296
00000100:00100000:1.0:1651532188.959264:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469031232
00000100:00100000:0.0:1651532188.959271:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5409
00000100:00100000:0.0:1651532188.959272:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469031296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532188.959279:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532188.959284:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5410
00000100:00100000:1.0:1651532188.959286:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469031232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532188.959289:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.959290:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532188.959291:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959294:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.959294:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959298:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532188.959299:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959302:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959305:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532188.959306:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959310:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959313:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959316:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959327:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959330:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.959353:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.959361:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469027456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 351663us (351742us total) trans 0 rc 24576/24576
00000100:00100000:1.0:1651532188.959365:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5401
00000100:00100000:0.0:1651532188.959365:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532188.959391:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469031360
00000100:00100000:0.0:1651532188.959403:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469031424
00000100:00100000:0.0:1651532188.959411:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6782
00000100:00100000:1.0:1651532188.959413:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6783
00000100:00100000:0.0:1651532188.959413:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b6f3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469031424:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532188.959415:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469031360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.959416:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532188.959419:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.959420:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417393 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa74 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959422:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41739a lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa6d expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.959425:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.959428:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532188.959428:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417393 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa74 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.959431:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41739a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa6d expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.959432:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417393 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa74 expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532188.959435:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41739a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa6d expref: 17 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.959436:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00010000:00010000:1.0:1651532188.959438:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:0.0:1651532188.959445:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b6f3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469031424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532188.959446:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea9c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469031360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (94us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.959448:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6782
00000100:00100000:1.0:1651532188.959450:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6783
00010000:00010000:1.0:1651532188.959457:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959460:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532188.959462:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959465:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959469:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.959470:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532188.959471:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959474:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959481:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.959483:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.959487:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532188.959493:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f4172b3 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3092480->7835647] (req 3092480->7835647) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532188.959875:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532188.959883:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469031744
00000100:00100000:0.0:1651532188.959895:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6784
00000100:00100000:0.0:1651532188.959897:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f738f070 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469031744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532188.959901:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532188.959905:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a1 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa7b expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532188.959912:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a1 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa7b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.959919:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a1 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa7b expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532188.959922:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d866a08, rc 0)
00000100:00100000:0.0:1651532188.959935:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f738f070 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469031744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532188.959937:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6784
00000001:00080000:0.0:1651532189.050689:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794368 is committed
00010000:00010000:0.0:1651532189.050704:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.050708:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.050732:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469027392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 443000us (443104us total) trans 158913794368 rc 0/0
00010000:00010000:1.0:1651532189.050733:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.050735:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5402
00010000:00010000:1.0:1651532189.050739:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532189.050740:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.050743:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.050752:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.050752:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.050753:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.050756:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.050764:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.050768:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.050772:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.050775:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4172ba lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [5165056->9269247] (req 5165056->9269247) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.051125:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.051137:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469032000
00000100:00100000:0.0:1651532189.051153:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5411
00000100:00100000:1.0:1651532189.051154:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.051155:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469032000:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532189.051165:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469031936
00010000:00010000:0.0:1651532189.051168:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.051173:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532189.051174:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.051180:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5412
00000100:00100000:1.0:1651532189.051182:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469031936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532189.051182:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532189.051182:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.051187:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.051189:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.051191:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.051194:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532189.051195:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.051198:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 9
00010000:00010000:1.0:1651532189.051198:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.051204:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.051207:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532189.142356:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794369 is committed
00010000:00010000:0.0:1651532189.142379:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142383:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.142400:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469028096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 451097us (451160us total) trans 158913794369 rc 0/0
00000100:00100000:0.0:1651532189.142404:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5403
00010000:00010000:0.0:1651532189.142411:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142414:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.142416:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142419:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142424:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.142424:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.142425:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142428:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142431:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.142432:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.142432:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142435:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142442:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142445:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4172d6 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2498560->9838591] (req 2498560->9838591) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142453:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142456:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142481:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142484:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142677:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142682:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.142703:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089f7a5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469029120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 383216us (383271us total) trans 0 rc 24576/24576
00010000:00010000:1.0:1651532189.142706:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.142706:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5405
00010000:00010000:1.0:1651532189.142711:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000010a1a758 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532189.142712:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142715:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142716:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142720:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142734:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142737:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41730e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [589824->7380991] (req 589824->7380991) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.142737:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469028160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 451426us (451479us total) trans 0 rc 12288/12288
00010000:00010000:1.0:1651532189.142740:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.142740:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5404
00010000:00010000:1.0:1651532189.142743:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6126ee9 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532189.142744:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142747:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142751:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.142751:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.142752:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142755:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142762:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142765:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f4172dd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3096576->7372799] (req 3096576->7372799) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142770:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142773:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.142860:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.142871:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469032256
00000100:00100000:1.0:1651532189.142874:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.142880:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469032192
00000100:00100000:1.0:1651532189.142882:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6785
00000100:00100000:1.0:1651532189.142884:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469032256:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532189.142886:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6786
00000100:00100000:0.0:1651532189.142888:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000414d1fc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469032192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532189.142890:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.142891:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532189.142893:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4173b6 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa89 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.142895:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4173bd lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa82 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.142902:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4173b6 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa89 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.142903:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4173bd lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa82 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532189.142906:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4173b6 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa89 expref: 16 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.142908:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4173bd lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa82 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532189.142910:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00010000:00010000:0.0:1651532189.142911:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:1.0:1651532189.142922:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469032256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532189.142925:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6785
00000100:00100000:0.0:1651532189.142928:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000414d1fc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469032192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.142931:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6786
00000100:00100000:1.0:1651532189.143129:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.143154:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469032320
00000100:00100000:0.0:1651532189.143166:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5413
00000100:00100000:0.0:1651532189.143167:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469032320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532189.143174:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.143178:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.143179:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.143180:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.143184:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.143426:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.143438:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.143451:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532189.143462:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469032448
00000100:00100000:0.0:1651532189.143462:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.143469:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469032576
00000100:00100000:1.0:1651532189.143471:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469032512
00000100:00100000:1.0:1651532189.143476:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6787
00000100:00100000:1.0:1651532189.143478:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b6f3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469032448:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651532189.143478:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469032640
00010000:00010000:1.0:1651532189.143481:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532189.143483:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5414
00010000:00010000:1.0:1651532189.143485:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4173cb lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa90 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.143485:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f738f070 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469032576:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532189.143492:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.143493:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4173cb lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa90 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.143496:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 2/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.143499:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532189.143500:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.143503:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532189.143503:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.143510:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4173cb lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa90 expref: 21 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.143512:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.143514:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00010000:00010000:0.0:1651532189.143516:0:323281:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.143519:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.143525:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b6f3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754469032448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (99us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.143526:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5415
00000100:00100000:1.0:1651532189.143528:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6787
00000100:00100000:0.0:1651532189.143528:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000858eee5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469032640:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532189.143532:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.143533:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6788
00000100:00100000:1.0:1651532189.143535:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000594bfa5a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469032512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532189.143535:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532189.143536:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.143537:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.143539:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 6
00010000:00010000:0.0:1651532189.143539:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.143540:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173e0 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa97 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.143543:0:323284:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.143546:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173e0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa97 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.143546:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.143549:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173e0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa97 expref: 20 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532189.143552:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532189.143557:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000594bfa5a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469032512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 22us (106us total) trans 0 rc 301/301
00000100:00100000:1.0:1651532189.143560:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6788
00000100:00100000:0.0:1651532189.143840:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.143848:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469032960
00000100:00100000:0.0:1651532189.143859:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6789
00000100:00100000:0.0:1651532189.143861:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a9091a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754469032960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532189.143864:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.143868:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173e7 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fa9e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.143876:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173e7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa9e expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.143880:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173e7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fa9e expref: 22 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.143884:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a5a2527a, rc 0)
00000100:00100000:0.0:1651532189.143896:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a9091a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754469032960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.143898:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6789
00000001:00080000:0.0:1651532189.200748:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794371 is committed
00002000:00010000:0.0:1651532189.200767:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb mtime from disk: 1651532188 -> 1651532189
00010000:00010000:0.0:1651532189.200770:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.200773:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200781:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200786:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.200793:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469032320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 57624us (57664us total) trans 158913794371 rc 0/0
00000100:00100000:0.0:1651532189.200796:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5413
00010000:00010000:0.0:1651532189.200816:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.200818:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fe1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469029056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 441322us (441374us total) trans 158913794370 rc 0/0
00010000:00010000:0.0:1651532189.200820:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.200821:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.200822:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5406
00010000:00010000:0.0:1651532189.200824:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200830:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.200830:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200833:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.200833:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f4173c4 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [7712768->8462335] (req 7712768->8462335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200834:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200837:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200842:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.200843:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.200844:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200847:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200854:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200857:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417315 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3100672->6365183] (req 3100672->6365183) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200863:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.200866:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.201154:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.201170:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.201178:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469033152
00000100:00100000:0.0:1651532189.201187:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469033088
00000100:00100000:1.0:1651532189.201191:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.201193:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5416
00000100:00100000:0.0:1651532189.201195:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469033152:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532189.201213:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.201220:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532189.201221:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532189.201221:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.201224:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5417
00010000:00010000:0.0:1651532189.201224:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.201226:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f1159de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469033088:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651532189.201232:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469033216
00010000:00010000:1.0:1651532189.201235:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.201243:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6790
00000100:00100000:0.0:1651532189.201244:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469033216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651532189.201246:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532189.201247:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.201247:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.201250:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4173fc lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44faa5 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.201251:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.201253:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 7
00010000:00010000:1.0:1651532189.201254:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 5/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.201260:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.201261:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4173fc lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faa5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532189.201263:0:330058:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.201265:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f4173fc lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faa5 expref: 19 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532189.201269:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.201269:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532189.201280:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469033216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.201283:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6790
00000001:00080000:0.0:1651532189.300780:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794372 is committed
00010000:00010000:1.0:1651532189.300823:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.300827:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.300848:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.300851:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000990a282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469030080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457427us (457472us total) trans 158913794372 rc 0/0
00010000:00010000:0.0:1651532189.300853:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532189.300854:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5407
00010000:00010000:0.0:1651532189.300854:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.300858:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.300863:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.300864:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.300864:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.300867:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.300871:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.300871:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.300872:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.300874:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.300882:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.300885:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417346 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [962560->7409663] (req 962560->7409663) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.300891:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.300894:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.300896:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.300901:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301140:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301144:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301160:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.301161:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469030144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 457717us (457811us total) trans 0 rc 16384/16384
00010000:00010000:1.0:1651532189.301164:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.301164:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5408
00010000:00010000:0.0:1651532189.301171:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301174:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db537446 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.301175:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.301178:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060764d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469031296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341905us (341942us total) trans 0 rc 36864/36864
00010000:00010000:0.0:1651532189.301178:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.301183:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5409
00010000:00010000:0.0:1651532189.301183:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301189:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db537446/0xa29a79078f41734d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [958464->7438335] (req 958464->7438335) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301191:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301194:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e417baf2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532189.301195:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301198:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301203:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.301204:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.301204:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301207:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301214:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301217:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e417baf2/0xa29a79078f417385 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [1007616->7454719] (req 1007616->7454719) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.301238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532189.301240:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301243:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.301247:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469033472
00000100:00100000:0.0:1651532189.301258:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6791
00000100:00100000:0.0:1651532189.301260:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000123e6357 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469033472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532189.301263:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.301267:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417403 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44faac expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301281:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417403 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faac expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.301285:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c88a049/0xa29a79078f417403 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faac expref: 14 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.301289:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004c88a049, rc 0)
00000100:00100000:0.0:1651532189.301302:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000123e6357 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469033472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.301304:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6791
00000100:00100000:1.0:1651532189.301524:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532189.301533:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532189.301544:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.301544:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469033600
00000100:00100000:0.0:1651532189.301562:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469033536
00000100:00100000:0.0:1651532189.301568:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5418
00000100:00100000:0.0:1651532189.301570:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469033600:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532189.301579:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41740a lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301583:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.301584:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.301585:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41740a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301589:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41740a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.301614:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5419
00000100:00100000:1.0:1651532189.301616:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469033536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532189.301617:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41740a lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301621:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41740a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301626:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301633:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.301634:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532189.301639:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469033600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 68us (128us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651532189.301642:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5418
00010000:00010000:1.0:1651532189.301645:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301650:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41740a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.301652:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301654:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000416f439b already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.301655:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41740a lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301658:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41740a lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301663:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41740a lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301666:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416f439b/0xa29a79078f41740a lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [8065024->8069119] (req 8065024->8069119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.301672:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469033728
00000100:00100000:0.0:1651532189.301681:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6792
00000100:00100000:0.0:1651532189.301683:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469033728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532189.301686:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.301689:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f417418 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fab3 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301695:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f417418 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fab3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.301699:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6126ee9/0xa29a79078f417418 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fab3 expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.301703:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6126ee9, rc 0)
00000100:00100000:1.0:1651532189.301705:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.301710:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469033728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 27us (166us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.301712:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6792
00000100:00100000:0.0:1651532189.301716:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469033856
00000100:00100000:0.0:1651532189.301724:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6793
00000100:00100000:0.0:1651532189.301726:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469033856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532189.301729:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.301731:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41741f lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44faba expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.301737:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41741f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faba expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.301740:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a1a758/0xa29a79078f41741f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faba expref: 18 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.301743:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010a1a758, rc 0)
00000100:00100000:0.0:1651532189.301749:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469033856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (45us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.301751:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6793
00000100:00100000:1.0:1651532189.302027:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532189.302038:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532189.302048:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469034048
00000100:00100000:0.0:1651532189.302048:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469034112
00000100:00100000:0.0:1651532189.302064:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5420
00000100:00100000:1.0:1651532189.302066:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5421
00000100:00100000:0.0:1651532189.302066:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469034112:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651532189.302068:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469034048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532189.302072:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.302076:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.302076:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 2/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.302079:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532189.302080:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 4
00010000:00010000:0.0:1651532189.302081:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.302111:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532189.302112:0:330059:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.302123:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:1.0:1651532189.302124:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.302128:0:330057:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.302129:0:330059:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.302133:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.302133:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.302151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.302157:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469034304
00000100:00100000:0.0:1651532189.302167:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6794
00000100:00100000:0.0:1651532189.302169:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ef92022 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754469034304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532189.302172:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.302175:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f417434 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fac1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.302182:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f417434 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fac1 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.302186:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383c3166/0xa29a79078f417434 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fac1 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.302189:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000383c3166, rc 0)
00000100:00100000:0.0:1651532189.302201:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ef92022 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754469034304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.302204:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6794
00000100:00100000:0.0:1651532189.302477:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.302484:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469034432
00000100:00100000:0.0:1651532189.302497:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6795
00000100:00100000:0.0:1651532189.302499:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002079689 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754469034432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532189.302502:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.302505:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41743b lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fac8 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.302512:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41743b lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fac8 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.302516:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6abf35c/0xa29a79078f41743b lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fac8 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.302519:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b6abf35c, rc 0)
00000100:00100000:0.0:1651532189.302533:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002079689 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754469034432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.302535:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6795
00000100:00100000:0.0:1651532189.302744:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.302751:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469034624
00000100:00100000:0.0:1651532189.302764:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6796
00000100:00100000:0.0:1651532189.302766:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc57afc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754469034624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532189.302769:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.302773:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417442 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44facf expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.302780:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417442 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44facf expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.302786:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234bee3b/0xa29a79078f417442 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44facf expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.302790:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000234bee3b, rc 0)
00000100:00100000:0.0:1651532189.302813:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc57afc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754469034624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.302816:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6796
00000100:00100000:0.0:1651532189.303024:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.303031:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469034752
00000100:00100000:0.0:1651532189.303044:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6797
00000100:00100000:0.0:1651532189.303046:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de5c3e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754469034752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532189.303049:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.303053:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417449 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fad6 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.303060:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417449 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fad6 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.303064:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417449 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fad6 expref: 22 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.303067:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036ef374e, rc 0)
00000100:00100000:0.0:1651532189.303078:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de5c3e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754469034752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.303083:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6797
00000001:00080000:0.0:1651532189.392443:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794374 is committed
00002000:00010000:1.0:1651532189.392475:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d2f:0x0] updating lvb ctime from disk: 1651532188 -> 1651532189
00010000:00010000:1.0:1651532189.392479:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392483:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.392507:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469033536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 90890us (90973us total) trans 158913794374 rc 0/0
00010000:00010000:0.0:1651532189.392509:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.392511:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5419
00010000:00010000:0.0:1651532189.392513:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.392514:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392517:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392524:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392525:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392526:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417411 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [8110080->8417279] (req 8110080->8417279) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392528:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.392542:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be8deb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469031232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 433256us (433287us total) trans 158913794373 rc 0/0
00000100:00100000:1.0:1651532189.392545:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5410
00010000:00010000:1.0:1651532189.392551:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392555:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532189.392556:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392580:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392586:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.392587:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.392588:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392596:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392608:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392611:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41738c lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3198976->7651327] (req 3198976->7651327) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392617:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392622:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.392839:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532189.392851:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469034944
00000100:00100000:0.0:1651532189.392851:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532189.392870:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469034880
00000100:00100000:1.0:1651532189.392878:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5422
00010000:00010000:0.0:1651532189.392879:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.392880:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc14aba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469034944:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532189.392886:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392887:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392890:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.392891:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392894:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532189.392895:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392899:0:330279:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.392904:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469032000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 341748us (341779us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532189.392907:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5411
00010000:00010000:1.0:1651532189.392909:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.392913:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5423
00000100:00100000:0.0:1651532189.392915:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045e3ea5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469034880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532189.392921:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392926:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532189.392927:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392930:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 8
00010000:00010000:0.0:1651532189.392930:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392935:0:330055:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392938:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392945:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392948:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d866a08 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.392949:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392952:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392956:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.392957:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.392958:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392960:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392969:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392972:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.392972:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d866a08/0xa29a79078f4173a8 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [3239936->7655423] (req 3239936->7655423) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.392976:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532189.509075:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794375 is committed
00010000:00010000:1.0:1651532189.509107:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.509112:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.509133:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469031936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 457951us (457985us total) trans 158913794375 rc 0/0
00010000:00010000:0.0:1651532189.509136:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.509137:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5412
00010000:00010000:0.0:1651532189.509140:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.509141:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.509147:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.509152:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.509153:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.509154:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.509157:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.509164:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.509167:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f4173af lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2535424->7712767] (req 2535424->7712767) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.509173:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.509185:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.509509:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.509520:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469035008
00000100:00100000:0.0:1651532189.509532:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6798
00000100:00100000:0.0:1651532189.509534:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754469035008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532189.509538:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.509541:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41745e lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fadd expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.509549:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41745e lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fadd expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.509556:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41745e lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fadd expref: 17 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532189.509559:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000601104c8, rc 0)
00000100:00100000:0.0:1651532189.509572:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754469035008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.509575:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6798
00000100:00100000:1.0:1651532189.509862:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532189.509871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532189.509882:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469035200
00000100:00100000:0.0:1651532189.509888:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469035136
00000100:00100000:1.0:1651532189.509894:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5424
00000100:00100000:0.0:1651532189.509899:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6799
00000100:00100000:0.0:1651532189.509901:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469035136:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651532189.509902:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469035200:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532189.509904:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532189.509908:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417465 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fae4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.509911:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.509915:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532189.509915:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417465 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fae4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532189.509917:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.509920:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651532189.509921:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 4/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.509924:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417465 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fae4 expref: 18 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532189.509925:0:330278:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 12 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.509928:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.509928:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e1e35d6a, rc 0)
00000100:00100000:0.0:1651532189.509940:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469035136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651532189.509942:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6799
00000001:00080000:0.0:1651532189.617444:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794376 is committed
00010000:00010000:1.0:1651532189.617477:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617482:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.617505:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f738f070 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469032576:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474019us (474067us total) trans 158913794376 rc 0/0
00010000:00010000:0.0:1651532189.617505:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.617508:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5414
00010000:00010000:0.0:1651532189.617509:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b4a2559 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.617510:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617513:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617519:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.617519:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.617520:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617523:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617526:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.617527:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.617527:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617530:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617542:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617545:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a2559/0xa29a79078f4173d2 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2555904->8036351] (req 2555904->8036351) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617551:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617551:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617554:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617556:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.617860:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532189.617880:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617884:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617888:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617892:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.617904:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000858eee5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469032640:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474375us (474442us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532189.617908:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5415
00000100:00100000:1.0:1651532189.617912:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469033152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 416716us (416759us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651532189.617914:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469035328
00000100:00100000:1.0:1651532189.617915:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5416
00000100:00100000:1.0:1651532189.617927:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5425
00000100:00100000:1.0:1651532189.617929:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469035328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532189.617933:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617936:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e2e401 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532189.617938:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617938:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617940:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617942:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.617943:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651532189.617943:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617947:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617950:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617953:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617953:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e2e401/0xa29a79078f4173d9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2543616->8019967] (req 2543616->8019967) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617956:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5a2527a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532189.617957:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617960:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617965:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.617966:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.617967:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617970:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617973:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.617973:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.617974:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617976:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617988:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617989:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617991:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a2527a/0xa29a79078f4173ee lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2600960->8056831] (req 2600960->8056831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.617992:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617996:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.617999:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.618226:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.618230:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.618251:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469034112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 316184us (316224us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651532189.618254:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5420
00010000:00010000:0.0:1651532189.618260:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.618264:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f28e900 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.618265:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.618267:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.618275:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.618276:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.618277:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.618280:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.618288:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.618292:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.618297:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.618327:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f28e900/0xa29a79078f417426 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2641920->8486911] (req 2641920->8486911) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.618350:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532189.618361:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469035456
00000100:00100000:0.0:1651532189.618383:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5426
00000100:00100000:0.0:1651532189.618385:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469035456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651532189.618392:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.618396:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532189.618397:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651532189.618397:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.618400:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532189.676066:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794378 is committed
00010000:00010000:1.0:1651532189.676099:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676104:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.676126:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f1159de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469033088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474899us (474956us total) trans 158913794377 rc 0/0
00010000:00010000:0.0:1651532189.676127:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.676129:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5417
00010000:00010000:0.0:1651532189.676131:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.676132:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.676135:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.676141:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676142:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.676144:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4173f5 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2613248->2617343] (req 2613248->2617343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676146:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.676157:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469034048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 374088us (374119us total) trans 158913794378 rc 0/0
00000100:00100000:1.0:1651532189.676159:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5421
00010000:00010000:1.0:1651532189.676165:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676169:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532189.676170:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676173:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676178:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.676179:0:323267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532189.676179:0:323267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676182:0:323267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676199:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676203:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41742d lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [2654208->8429567] (req 2654208->8429567) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676208:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676211:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676386:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.676390:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.676403:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.676407:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.676408:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.676410:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc14aba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469034944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 283529us (283571us total) trans 0 rc 20480/20480
00010000:00010000:0.0:1651532189.676412:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.676413:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5422
00010000:00010000:0.0:1651532189.676419:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.676420:0:323265:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.676421:0:323265:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.676424:0:323265:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.676431:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.676434:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417450 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [2682880->3571711] (req 2682880->3571711) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.676439:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.676442:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532189.751095:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794379 is committed
00010000:00010000:0.0:1651532189.751109:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751112:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.751129:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045e3ea5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469034880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 358213us (358278us total) trans 158913794379 rc 0/0
00000100:00100000:0.0:1651532189.751133:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5423
00010000:00010000:0.0:1651532189.751140:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751143:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.751144:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751147:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751152:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.751152:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.751153:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751156:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751159:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.751160:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.751160:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751163:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 4/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751165:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.751166:0:328040:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532189.751167:0:328040:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751169:0:328040:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751183:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751186:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417457 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [2695168->8552447] (req 2695168->8552447) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751191:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751194:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.751197:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.751203:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.751218:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.751221:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.751237:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469035200:12345-10.240.43.64@tcp:3:fio.0 Request processed in 241341us (241375us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532189.751241:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5424
00010000:00010000:1.0:1651532189.751248:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.751252:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.751268:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751280:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532189.751297:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751308:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.751310:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751313:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532189.751316:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469035328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 133386us (133457us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651532189.751319:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5425
00010000:00010000:0.0:1651532189.751334:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751340:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f41746c lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [3575808->3579903] (req 3575808->3579903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751344:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751346:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.751347:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751350:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751353:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.751356:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417473 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [3588096->3592191] (req 3588096->3592191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532189.792840:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794380 is committed
00010000:00010000:0.0:1651532189.792857:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.792862:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532189.792881:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cf69656 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754469035456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 174495us (174531us total) trans 158913794380 rc 0/0
00000100:00100000:0.0:1651532189.792885:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5426
00010000:00010000:0.0:1651532189.792893:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.792897:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532189.792898:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.792901:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.792906:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532189.792909:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41747a lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [3596288->3600383] (req 3596288->3600383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532190.956788:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532190.956822:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469035840
00000100:00100000:0.0:1651532190.956851:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6800
00000100:00100000:0.0:1651532190.956853:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754469035840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651532190.956864:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532190.956878:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417481 lrc: 2/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44faf2 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532190.956891:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d2f:0x0] initial LVB size: 41943040, mtime: 0x6270619d, atime: 0x0, ctime: 0x6270619d, blocks: 0x14000
00010000:00010000:0.0:1651532190.956902:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532190.956903:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532190.956907:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417481 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faf2 expref: 6 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532190.956915:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417481 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faf2 expref: 6 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532190.956921:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e1e35d6a, rc 0)
00000100:00100000:0.0:1651532190.956946:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006de23d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754469035840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 93us (163us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532190.956950:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6800
00000100:00100000:1.0:1651532191.457915:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532191.457948:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469036224
00000100:00100000:1.0:1651532191.457950:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532191.457961:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532191.457971:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532191.457981:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532191.457993:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532191.458010:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469036352
00000100:00100000:0.0:1651532191.458019:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469036480
00000100:00100000:1.0:1651532191.458041:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469036608
00000100:00100000:0.0:1651532191.458047:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469036160
00000100:00100000:1.0:1651532191.458050:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469036288
00000100:00100000:1.0:1651532191.458058:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5427
00000100:00100000:1.0:1651532191.458061:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469036224:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532191.458068:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5428
00000100:00100000:0.0:1651532191.458071:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469036480:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532191.458087:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417488 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.458095:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.458097:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.458099:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417488 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.458101:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41748f lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.458114:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417488 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.458114:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532191.458115:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532191.458117:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41748f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.458122:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41748f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532191.458358:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5429
00000100:00100000:1.0:1651532191.458360:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469036352:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651532191.458361:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5430
00000100:00100000:0.0:1651532191.458363:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469036608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532191.458382:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417496 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.458387:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.458387:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.458388:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417496 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.458390:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41749d lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.458392:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417496 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.458394:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532191.458395:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532191.458396:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41749d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.458400:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41749d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532191.458577:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5431
00000100:00100000:0.0:1651532191.458579:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469036288:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532191.458586:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4174a4 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.458590:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532191.458590:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532191.458591:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4174a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532191.458592:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5432
00000100:00100000:1.0:1651532191.458594:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469036160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532191.458595:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4174a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.458601:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4174ab lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.458604:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.458605:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.458606:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4174ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.458609:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4174ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532191.458866:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532191.458878:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469036416
00000100:00100000:1.0:1651532191.458893:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5433
00000100:00100000:1.0:1651532191.458895:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbeafe06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469036416:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532191.458901:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4174b2 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.458905:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.458905:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.458907:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4174b2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.458910:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4174b2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532191.459146:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532191.459157:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532191.459163:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469036544
00000100:00100000:1.0:1651532191.459171:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469036672
00000100:00100000:1.0:1651532191.459177:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5434
00000100:00100000:1.0:1651532191.459179:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754469036544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532191.459185:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174b9 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.459189:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.459190:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.459191:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.459195:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532191.459429:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5435
00000100:00100000:1.0:1651532191.459431:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754469036672:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651532191.459438:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4174c0 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.459442:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.459443:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532191.459444:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4174c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [33554432->37748735] (req 33554432->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.459448:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4174c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [33554432->37748735] (req 33554432->37748735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.464912:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417488 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.464922:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417488 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532191.464958:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d921c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754469036224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 6895us (7046us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532191.464964:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5427
00010000:00010000:0.0:1651532191.464980:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417488 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.464984:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532191.464986:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417488 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.464990:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417488 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.465001:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417488 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.465003:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417488 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.465079:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41748f lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.465083:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41748f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532191.465101:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c531c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754469036480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 7030us (7140us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532191.465106:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5428
00010000:00010000:0.0:1651532191.465114:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41748f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.465117:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532191.465119:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41748f lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.465121:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41748f lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.465126:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41748f lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.465129:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f41748f lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 10 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.466493:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41749d lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.466500:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41749d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532191.466538:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272a6b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469036608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 8173us (8565us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532191.466542:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5430
00010000:00010000:0.0:1651532191.466554:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41749d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.466558:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532191.466560:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41749d lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.466563:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41749d lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.466571:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41749d lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.466573:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41749d lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.468411:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417496 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.468421:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417496 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532191.468457:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059f76551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754469036352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 10095us (10506us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532191.468462:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5429
00010000:00010000:1.0:1651532191.468485:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417496 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.468489:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532191.468490:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417496 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.468494:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417496 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.468504:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417496 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.468507:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417496 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 8 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.470068:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4174a4 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.470075:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4174a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532191.470108:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6d59ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469036288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 11526us (12113us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532191.470112:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5431
00010000:00010000:1.0:1651532191.470129:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4174a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.470133:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532191.470135:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4174a4 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.470138:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4174a4 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.470146:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4174a4 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.470149:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4174a4 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.471638:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4174ab lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.471649:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4174ab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532191.471677:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb95e744 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469036160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 13081us (13694us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532191.471681:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5432
00010000:00010000:1.0:1651532191.471827:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4174ab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.471831:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532191.471832:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4174ab lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.471835:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4174ab lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.471844:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4174ab lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.471849:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4174ab lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532191.473597:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532191.474839:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469036800
00000100:00100000:0.0:1651532191.474874:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5436
00000100:00100000:0.0:1651532191.474876:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469036800:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651532191.474897:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4174c7 lrc: 3/1,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.474905:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532191.474906:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532191.474909:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4174c7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [37748736->41943039] (req 37748736->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.474916:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4174c7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [37748736->41943039] (req 37748736->41943039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.475206:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4174b2 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.475211:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4174b2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532191.475243:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbeafe06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469036416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 16348us (16378us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532191.475247:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5433
00010000:00010000:1.0:1651532191.476581:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174b9 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476589:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532191.476651:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469036544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 17457us (17506us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532191.476656:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5434
00010000:00010000:1.0:1651532191.476671:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4174b2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476675:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532191.476677:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4174b2 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476680:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4174b2 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476690:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4174b2 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476692:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4174b2 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 6 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476700:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476702:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532191.476703:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174b9 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476721:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174b9 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476725:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174b9 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476728:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174b9 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476791:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4174c0 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [33554432->37748735] (req 33554432->37748735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.476795:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4174c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [33554432->37748735] (req 33554432->37748735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532191.476833:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469036672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 17401us (17676us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532191.476836:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5435
00010000:00010000:0.0:1651532191.476836:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4174c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [33554432->37748735] (req 33554432->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.476841:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532191.476842:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4174c0 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [33554432->37748735] (req 33554432->37748735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.476845:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4174c0 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [33554432->37748735] (req 33554432->37748735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.476852:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4174c0 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [33554432->37748735] (req 33554432->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.476855:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4174c0 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [33554432->37748735] (req 33554432->37748735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.477944:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4174c7 lrc: 3/1,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [37748736->41943039] (req 37748736->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532191.477950:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4174c7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [37748736->41943039] (req 37748736->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.477970:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4174c7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [37748736->41943039] (req 37748736->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.477977:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532191.477978:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4174c7 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [37748736->41943039] (req 37748736->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532191.477980:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469036800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 3102us (4386us total) trans 0 rc 4194304/4194304
00010000:00010000:1.0:1651532191.477981:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4174c7 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [37748736->41943039] (req 37748736->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532191.477984:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5436
00010000:00010000:1.0:1651532191.477987:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4174c7 lrc: 1/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [37748736->41943039] (req 37748736->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532191.477990:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4174c7 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [37748736->41943039] (req 37748736->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532191.969290:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532191.969309:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951234432
00000100:00100000:0.0:1651532191.969334:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 74
00000100:00100000:0.0:1651532191.969337:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951234432:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532191.969358:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 352875072 pending 0 free 81138851840 avail 76968140800
00000100:00100000:0.0:1651532191.969399:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b3d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951234432:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 60us (111us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532191.969404:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 74
00000100:00100000:0.0:1651532192.444878:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c1ca2757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966863936:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532192.445212:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c1ca2757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966863936:10.240.43.61@tcp:400:kworker/u4:0.0
00000400:00000080:0.0:1651532192.997979:0:330499:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532192.997981:0:330499:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398d: run aiocp to verify block size > stripe size ========================================================== 22:56:32 (1651532192)
00000100:00100000:0.0:1651532193.115978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.115999:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469038848
00000100:00100000:0.0:1651532193.116028:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6801
00000100:00100000:0.0:1651532193.116030:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:682204:x1731754469038848:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532193.116041:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532193.116069:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4174ce lrc: 2/0,0 mode: --/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fb3f expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532193.116091:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532193.116103:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.116104:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.116108:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4174ce lrc: 3/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb3f expref: 7 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.116115:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4174ce lrc: 3/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb3f expref: 7 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.116121:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036ef374e, rc 0)
00000100:00100000:0.0:1651532193.116144:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:682204:x1731754469038848:12345-10.240.43.64@tcp:101:dd.0 Request processed in 113us (170us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532193.116148:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6801
00000100:00100000:0.0:1651532193.117352:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.117363:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469039040
00002000:00010000:0.0:1651532193.117382:0:330279:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216368/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532193.117383:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002292cef9 with x1731754469039040 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532193.117387:0:330279:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002292cef9.
00000100:00100000:0.0:1651532193.117399:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5437
00000100:00100000:0.0:1651532193.117401:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469039040:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:0.0:1651532193.117471:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d30:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532193.117472:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d30:0x0] updating lvb mtime from disk: 0 -> 1651532193
00002000:00010000:0.0:1651532193.117473:0:330279:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d30:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532193.117474:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d30:0x0] updating lvb ctime from disk: 0 -> 1651532193
00002000:00010000:0.0:1651532193.117475:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d30:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651532193.117488:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469039040:12345-10.240.43.64@tcp:10:dd.0 Request processed in 86us (137us total) trans 158913794381 rc 0/0
00000100:00100000:0.0:1651532193.117492:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5437
00002000:00010000:0.0:1651532193.117493:0:330279:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216368/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532193.117494:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002292cef9 with x1731754469039040 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532193.117496:0:330279:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002292cef9.
00000100:00100000:0.0:1651532193.300431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.300445:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469039232
00002000:00100000:0.0:1651532193.300462:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (0->4194303)  req@000000000de3b5b0 x1731754469039232/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/0 e 0 to 0 dl 1651532236 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532193.300468:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000de3b5b0 with x1731754469039232 ext(0->4194303)
00002000:00010000:0.0:1651532193.300470:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000de3b5b0
00000100:00100000:0.0:1651532193.300485:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5438
00000100:00100000:0.0:1651532193.300488:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469039232:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532193.311135:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469039232:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10643us (10703us total) trans 158913794382 rc 0/0
00000100:00100000:0.0:1651532193.311143:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5438
00002000:00100000:0.0:1651532193.311149:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (0->4194303)  req@000000000de3b5b0 x1731754469039232/t158913794382(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/448 e 0 to 0 dl 1651532236 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532193.311154:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000de3b5b0 with x1731754469039232 ext(0->4194303)
00002000:00010000:0.0:1651532193.311157:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000de3b5b0
00000100:00100000:0.0:1651532193.369469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.369487:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469039488
00002000:00100000:0.0:1651532193.369515:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (4194304->8388607)  req@00000000eeac2f5c x1731754469039488/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/0 e 0 to 0 dl 1651532236 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532193.369522:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000eeac2f5c with x1731754469039488 ext(4194304->8388607)
00002000:00010000:0.0:1651532193.369525:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000eeac2f5c
00000100:00100000:0.0:1651532193.369541:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5439
00000100:00100000:0.0:1651532193.369543:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469039488:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532193.378319:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469039488:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8772us (8850us total) trans 158913794383 rc 0/0
00000100:00100000:0.0:1651532193.378327:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5439
00002000:00100000:0.0:1651532193.378333:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (4194304->8388607)  req@00000000eeac2f5c x1731754469039488/t158913794383(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/448 e 0 to 0 dl 1651532236 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532193.378338:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000eeac2f5c with x1731754469039488 ext(4194304->8388607)
00002000:00010000:0.0:1651532193.378342:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000eeac2f5c
00000100:00100000:0.0:1651532193.439482:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.439500:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469039744
00002000:00100000:0.0:1651532193.439521:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (8388608->12582911)  req@00000000ac6a619d x1731754469039744/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/0 e 0 to 0 dl 1651532236 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532193.439526:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ac6a619d with x1731754469039744 ext(8388608->12582911)
00002000:00010000:0.0:1651532193.439529:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ac6a619d
00000100:00100000:0.0:1651532193.439546:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5440
00000100:00100000:0.0:1651532193.439549:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469039744:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532193.448071:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6a619d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469039744:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8518us (8589us total) trans 158913794384 rc 0/0
00000100:00100000:0.0:1651532193.448078:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5440
00002000:00100000:0.0:1651532193.448084:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (8388608->12582911)  req@00000000ac6a619d x1731754469039744/t158913794384(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/448 e 0 to 0 dl 1651532236 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532193.448090:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ac6a619d with x1731754469039744 ext(8388608->12582911)
00002000:00010000:0.0:1651532193.448093:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ac6a619d
00000100:00100000:0.0:1651532193.509457:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.509475:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469040000
00002000:00100000:0.0:1651532193.509497:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (12582912->16777215)  req@0000000085c9ebfb x1731754469040000/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/0 e 0 to 0 dl 1651532236 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532193.509502:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000085c9ebfb with x1731754469040000 ext(12582912->16777215)
00002000:00010000:0.0:1651532193.509505:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000085c9ebfb
00000100:00100000:0.0:1651532193.509522:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5441
00000100:00100000:0.0:1651532193.509524:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469040000:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532193.525038:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085c9ebfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469040000:12345-10.240.43.64@tcp:4:dd.0 Request processed in 15509us (15580us total) trans 158913794385 rc 0/0
00000100:00100000:0.0:1651532193.525045:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5441
00002000:00100000:0.0:1651532193.525052:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (12582912->16777215)  req@0000000085c9ebfb x1731754469040000/t158913794385(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/448 e 0 to 0 dl 1651532236 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532193.525057:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000085c9ebfb with x1731754469040000 ext(12582912->16777215)
00002000:00010000:0.0:1651532193.525060:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000085c9ebfb
00000100:00100000:0.0:1651532193.581477:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.581496:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469040256
00002000:00100000:0.0:1651532193.581518:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (16777216->20971519)  req@0000000008245d82 x1731754469040256/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/0 e 0 to 0 dl 1651532236 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532193.581524:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008245d82 with x1731754469040256 ext(16777216->20971519)
00002000:00010000:0.0:1651532193.581527:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000008245d82
00000100:00100000:0.0:1651532193.581545:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5442
00000100:00100000:0.0:1651532193.581548:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469040256:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532193.592354:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469040256:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10802us (10877us total) trans 158913794386 rc 0/0
00000100:00100000:0.0:1651532193.592362:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5442
00002000:00100000:0.0:1651532193.592368:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (16777216->20971519)  req@0000000008245d82 x1731754469040256/t158913794386(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/448 e 0 to 0 dl 1651532236 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532193.592383:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008245d82 with x1731754469040256 ext(16777216->20971519)
00002000:00010000:0.0:1651532193.592386:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000008245d82
00000100:00100000:0.0:1651532193.653449:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.653466:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469040512
00002000:00100000:0.0:1651532193.653487:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (20971520->25165823)  req@0000000078cad74e x1731754469040512/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/0 e 0 to 0 dl 1651532236 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532193.653493:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000078cad74e with x1731754469040512 ext(20971520->25165823)
00002000:00010000:0.0:1651532193.653495:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000078cad74e
00000100:00100000:0.0:1651532193.653512:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5443
00000100:00100000:0.0:1651532193.653515:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469040512:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532193.669841:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469040512:12345-10.240.43.64@tcp:4:dd.0 Request processed in 16321us (16391us total) trans 158913794387 rc 0/0
00000100:00100000:0.0:1651532193.669849:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5443
00002000:00100000:0.0:1651532193.669855:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (20971520->25165823)  req@0000000078cad74e x1731754469040512/t158913794387(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/448 e 0 to 0 dl 1651532236 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532193.669861:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000078cad74e with x1731754469040512 ext(20971520->25165823)
00002000:00010000:0.0:1651532193.669864:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000078cad74e
00000100:00100000:0.0:1651532193.726450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.726466:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469040768
00002000:00100000:0.0:1651532193.726485:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (25165824->29360127)  req@00000000abbd560e x1731754469040768/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/0 e 0 to 0 dl 1651532236 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532193.726490:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000abbd560e with x1731754469040768 ext(25165824->29360127)
00002000:00010000:0.0:1651532193.726492:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000abbd560e
00000100:00100000:0.0:1651532193.726508:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5444
00000100:00100000:0.0:1651532193.726511:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469040768:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532193.738183:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469040768:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11669us (11733us total) trans 158913794388 rc 0/0
00000100:00100000:0.0:1651532193.738191:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5444
00002000:00100000:0.0:1651532193.738197:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (25165824->29360127)  req@00000000abbd560e x1731754469040768/t158913794388(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/448 e 0 to 0 dl 1651532236 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532193.738202:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000abbd560e with x1731754469040768 ext(25165824->29360127)
00002000:00010000:0.0:1651532193.738205:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000abbd560e
00000100:00100000:0.0:1651532193.798465:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.798482:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469041024
00002000:00100000:0.0:1651532193.798502:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (29360128->33554431)  req@0000000083c0dd3a x1731754469041024/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/0 e 0 to 0 dl 1651532236 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532193.798507:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000083c0dd3a with x1731754469041024 ext(29360128->33554431)
00002000:00010000:0.0:1651532193.798509:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000083c0dd3a
00000100:00100000:0.0:1651532193.798525:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5445
00000100:00100000:0.0:1651532193.798528:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469041024:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532193.809036:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754469041024:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10504us (10570us total) trans 158913794389 rc 0/0
00000100:00100000:0.0:1651532193.809044:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5445
00002000:00100000:0.0:1651532193.809050:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d30:0x0] (29360128->33554431)  req@0000000083c0dd3a x1731754469041024/t158913794389(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:691/0 lens 488/448 e 0 to 0 dl 1651532236 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532193.809055:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000083c0dd3a with x1731754469041024 ext(29360128->33554431)
00002000:00010000:0.0:1651532193.809058:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000083c0dd3a
00000100:00100000:0.0:1651532193.922330:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.922344:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.922357:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.922379:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.922396:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469041984
00000100:00100000:0.0:1651532193.922396:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469041856
00000100:00100000:1.0:1651532193.922433:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469041920
00000100:00100000:0.0:1651532193.922436:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469042048
00000100:00100000:1.0:1651532193.922445:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5446
00000100:00100000:1.0:1651532193.922448:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754469041984:12345-10.240.43.64@tcp:3:aiocp.0
00000100:00100000:0.0:1651532193.922451:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5447
00000100:00100000:0.0:1651532193.922453:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754469041856:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:1.0:1651532193.922470:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.922470:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.922481:0:323284:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4174ce lrc: 2/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb3f expref: 27 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.922485:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532193.922486:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532193.922487:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 4/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.922495:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.922497:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.922497:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.922503:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.922510:0:323284:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4174ce lrc: 3/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb3f expref: 27 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.922511:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5448
00000100:00100000:0.0:1651532193.922513:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f315f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754469041920:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:1.0:1651532193.922516:0:323284:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4174ce lrc: 4/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb3f expref: 27 pid: 328039 timeout: 15943 lvb_type: 0
00010000:00010000:0.0:1651532193.922519:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.922523:0:323284:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2d89679 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:323284:1731745966864000:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532193.922523:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.922524:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.922524:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.922527:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.922534:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5449
00000100:00100000:0.0:1651532193.922536:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c9ea687 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754469042048:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:0.0:1651532193.922540:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.922543:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.922543:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.922544:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.922547:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.922556:0:323284:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e6433d3 going to sleep for 6 seconds
00000100:00100000:1.0:1651532193.922823:0:323284:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2d89679 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:323284:1731745966864000:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532193.922831:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.930608:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.930650:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469042752
00010000:00010000:1.0:1651532193.930667:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4174ce lrc: 4/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb3f expref: 28 pid: 328039 timeout: 15943 lvb_type: 0
00000100:00100000:1.0:1651532193.930689:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 293
00000100:00100000:1.0:1651532193.930691:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438149:x1731754469042752:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651532193.930698:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00002000:00010000:1.0:1651532193.930709:0:323259:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d30:0x0] updating lvb size from disk: 0 -> 33554432
00002000:00010000:1.0:1651532193.930711:0:323259:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d30:0x0] updating lvb blocks from disk: 0 -> 65536
00010000:00010000:1.0:1651532193.930713:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4174ce lrc: 4/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb3f expref: 28 pid: 328039 timeout: 15943 lvb_type: 0
00010000:00010000:1.0:1651532193.930721:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4174ce lrc: 3/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb3f expref: 28 pid: 328039 timeout: 15943 lvb_type: 0
00010000:00010000:1.0:1651532193.930734:0:323259:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4174ce lrc: 0/0,0 mode: --/PW res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb3f expref: 28 pid: 328039 timeout: 15943 lvb_type: 0
00010000:00010000:1.0:1651532193.930740:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.930740:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.930742:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.930747:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 4/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.930751:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.930751:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.930752:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.930754:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 4/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.930757:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.930758:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.930758:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.930762:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 4/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.930765:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.930766:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.930766:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.930769:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 4/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.930787:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532193.930796:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.930801:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.930830:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754469042752:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 138us (226us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532193.930833:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 293
00010000:00010000:1.0:1651532193.930843:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.930846:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.931030:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.931035:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.931043:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.931047:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.933724:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.933736:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.933765:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469042816
00000100:00100000:0.0:1651532193.933796:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469042944
00000100:00100000:0.0:1651532193.933824:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5450
00000100:00100000:0.0:1651532193.933827:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438146:x1731754469042816:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:0.0:1651532193.933850:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4174f1 lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.933858:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.933859:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.933862:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4174f1 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.933869:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4174f1 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.934099:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5451
00000100:00100000:0.0:1651532193.934101:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a238cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438146:x1731754469042944:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:0.0:1651532193.934108:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4174f8 lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934113:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.934113:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.934115:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4174f8 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934119:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4174f8 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.934343:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.934363:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.934387:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469042880
00000100:00100000:0.0:1651532193.934403:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043008
00000100:00100000:0.0:1651532193.934411:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5452
00000100:00100000:0.0:1651532193.934413:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754469042880:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:0.0:1651532193.934420:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4174ff lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934424:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.934424:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.934426:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4174ff lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934430:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4174ff lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.934625:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5453
00000100:00100000:0.0:1651532193.934628:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438146:x1731754469043008:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:0.0:1651532193.934637:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417506 lrc: 3/1,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934640:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.934641:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.934642:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417506 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934646:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417506 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942440:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942448:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.942484:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f315f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754469041920:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 19969us (20125us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.942489:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5448
00010000:00010000:0.0:1651532193.942510:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942514:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532193.942516:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942520:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942532:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 1/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942535:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4174e3 lrc: 0/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942875:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 8 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942879:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 8 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.942900:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438149:x1731754469041984:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 20452us (20556us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.942904:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5446
00010000:00010000:0.0:1651532193.942921:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 8 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942925:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532193.942926:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 8 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942929:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 8 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942934:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 1/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 8 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.942940:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4174dc lrc: 0/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 8 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.944773:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.944782:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.944828:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c9ea687 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438149:x1731754469042048:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 22289us (22447us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532193.944834:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5449
00010000:00010000:1.0:1651532193.944849:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.944853:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532193.944855:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.944858:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.944870:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 1/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.944873:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4174ea lrc: 0/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 7 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.946177:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.946184:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.946227:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754469041856:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 23771us (23900us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532193.946234:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5447
00010000:00010000:0.0:1651532193.946418:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.946425:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532193.946427:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.946431:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.946442:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 1/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.946445:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4174d5 lrc: 0/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.949676:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4174f1 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.949686:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4174f1 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.949724:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1762deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438146:x1731754469042816:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 15895us (16003us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.949733:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5450
00010000:00010000:0.0:1651532193.949748:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4174f1 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.949752:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5e80ae9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532193.949754:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4174f1 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.949758:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4174f1 lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.949769:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4174f1 lrc: 1/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.949771:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f4174f1 lrc: 0/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 5 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.951898:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4174f8 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.951907:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4174f8 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.951947:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a238cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438146:x1731754469042944:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 17843us (18209us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532193.951952:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5451
00010000:00010000:1.0:1651532193.951966:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4174f8 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.951970:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532193.951972:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4174f8 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.951976:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4174f8 lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.951985:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4174f8 lrc: 1/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.951988:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4174f8 lrc: 0/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.955421:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4174ff lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.955431:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4174ff lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.955476:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000641df69a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754469042880:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 21060us (21132us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.955482:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5452
00010000:00010000:0.0:1651532193.955498:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4174ff lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.955502:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532193.955504:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4174ff lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.955508:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4174ff lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.955518:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4174ff lrc: 1/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.955520:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4174ff lrc: 0/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.956972:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417506 lrc: 3/1,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.956977:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417506 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.957006:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8c94d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754469043008:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 22376us (22642us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.957009:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5453
00010000:00010000:0.0:1651532193.957019:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417506 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.957022:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532193.957023:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417506 lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.957027:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417506 lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.957032:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417506 lrc: 1/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.957035:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417506 lrc: 0/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.980801:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.980828:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.980836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.980849:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.980865:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044352
00000100:00100000:0.0:1651532193.980867:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.980877:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.980886:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.980894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.980910:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044480
00000100:00100000:0.0:1651532193.980915:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044608
00000100:00100000:1.0:1651532193.980919:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044736
00000100:00100000:1.0:1651532193.980926:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044288
00000100:00100000:1.0:1651532193.980932:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044416
00000100:00100000:0.0:1651532193.980940:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044544
00000100:00100000:1.0:1651532193.980944:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044672
00000100:00100000:0.0:1651532193.980946:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5454
00000100:00100000:0.0:1651532193.980949:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438148:x1731754469044352:12345-10.240.43.64@tcp:4:aiocp.0
00000100:00100000:1.0:1651532193.980951:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5455
00000100:00100000:1.0:1651532193.980953:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438148:x1731754469044480:12345-10.240.43.64@tcp:4:aiocp.0
00002000:00010000:0.0:1651532193.980990:0:330054:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532193.980995:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417514 lrc: 3/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.980995:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41750d lrc: 3/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.981002:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.981004:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.981006:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41750d lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.981012:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41750d lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.981013:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.981014:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.981015:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417514 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.981020:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417514 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.981832:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5456
00000100:00100000:0.0:1651532193.981834:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438148:x1731754469044736:12345-10.240.43.64@tcp:4:aiocp.0
00000100:00100000:1.0:1651532193.981837:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5457
00000100:00100000:1.0:1651532193.981840:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438148:x1731754469044288:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:0.0:1651532193.981842:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41751b lrc: 3/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.981846:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.981847:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417522 lrc: 3/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.981847:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.981848:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41751b lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.981852:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41751b lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 5 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.981853:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.981854:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.981855:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417522 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.981859:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417522 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.982583:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5458
00000100:00100000:0.0:1651532193.982585:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754469044608:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:0.0:1651532193.982592:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f417529 lrc: 3/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.982596:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.982597:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.982598:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f417529 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 6 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.982599:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5459
00000100:00100000:1.0:1651532193.982601:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754469044416:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:0.0:1651532193.982605:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f417529 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 6 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.982608:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417530 lrc: 3/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.982612:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.982612:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.982613:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417530 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.982618:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417530 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.983360:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5460
00000100:00100000:0.0:1651532193.983362:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438148:x1731754469044544:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:0.0:1651532193.983378:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417537 lrc: 3/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.983382:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.983383:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.983384:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417537 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 8 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.983387:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417537 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 8 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.983434:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5461
00000100:00100000:1.0:1651532193.983436:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a1abca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754469044672:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:1.0:1651532193.983443:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41753e lrc: 3/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.983447:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.983448:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.983449:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41753e lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 9 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.983452:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41753e lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 9 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532196.303534:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794390 is committed
00002000:00010000:1.0:1651532196.303717:0:330054:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d31:0x0] updating lvb size from disk: 0 -> 33554432
00002000:00010000:1.0:1651532196.303722:0:330054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d31:0x0] updating lvb mtime from disk: 0 -> 1651532193
00002000:00010000:1.0:1651532196.303723:0:330054:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d31:0x0] updating lvb ctime from disk: 0 -> 1651532193
00002000:00010000:1.0:1651532196.303724:0:330054:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d31:0x0] updating lvb blocks from disk: 0 -> 65536
00010000:00010000:1.0:1651532196.303734:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41750d lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.303741:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41750d lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.303778:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41750d lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.303785:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532196.303787:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41750d lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.303792:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41750d lrc: 3/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532196.303819:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cf2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754469044352:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2322851us (2323003us total) trans 158913794390 rc 0/0
00010000:00010000:0.0:1651532196.303826:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41750d lrc: 1/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532196.303827:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5454
00010000:00010000:0.0:1651532196.303831:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f41750d lrc: 0/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 9 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.304061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532196.304077:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951234624
00000100:00100000:0.0:1651532196.304101:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6802
00000100:00100000:0.0:1651532196.304104:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951234624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:0.0:1651532196.304121:0:328039:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216367 count 1
00010000:00010000:0.0:1651532196.304132:0:328039:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.304142:0:328039:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417481 lrc: 2/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faf2 expref: 33 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532196.304149:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532196.304150:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532196.304151:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 4/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.304168:0:328039:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417481 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faf2 expref: 33 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532196.304176:0:328039:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417481 lrc: 4/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faf2 expref: 33 pid: 328039 timeout: 15945 lvb_type: 1
00000100:00100000:0.0:1651532196.304191:0:328039:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000559fc8e2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966864064:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532196.304215:0:328039:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c01edfad going to sleep for 6 seconds
00000100:00100000:0.0:1651532196.307966:0:328039:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000559fc8e2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966864064:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532196.307974:0:328039:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 3/0,1 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.308083:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.308119:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044864
00010000:00010000:1.0:1651532196.308130:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417481 lrc: 4/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faf2 expref: 34 pid: 328039 timeout: 15945 lvb_type: 1
00000100:00100000:1.0:1651532196.308148:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 294
00000100:00100000:1.0:1651532196.308152:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438147:x1731754469044864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651532196.308157:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532196.308160:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417481 lrc: 4/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faf2 expref: 34 pid: 328039 timeout: 15945 lvb_type: 1
00010000:00010000:1.0:1651532196.308167:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417481 lrc: 3/0,0 mode: PR/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faf2 expref: 34 pid: 328039 timeout: 15945 lvb_type: 1
00010000:00010000:1.0:1651532196.308178:0:323259:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417481 lrc: 0/0,0 mode: --/PR res: [0x34d2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44faf2 expref: 34 pid: 328039 timeout: 15945 lvb_type: 1
00010000:00010000:1.0:1651532196.308189:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532196.308190:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532196.308192:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.308198:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 4/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.308212:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532196.308217:0:328039:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.308223:0:328039:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532196.308229:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438147:x1731754469044864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 77us (146us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532196.308234:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 294
00010000:00010000:0.0:1651532196.308236:0:328039:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 3/0,1 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.308241:0:328039:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.308273:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.308278:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532196.308280:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 2/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.308285:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 3/0,0 mode: PW/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.308292:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 1/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.308296:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417545 lrc: 0/0,0 mode: --/PW res: [0x34d2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.311838:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951234624:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 7733us (7778us total) trans 158913794398 rc 0/0
00000100:00100000:0.0:1651532196.311843:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6802
00000001:00080000:0.0:1651532196.456224:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794397 is committed
00010000:00010000:1.0:1651532196.456314:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f417529 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456320:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f417529 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456347:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f417529 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532196.456351:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bc45090 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469044608:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2473765us (2475514us total) trans 158913794394 rc 0/0
00000100:00100000:1.0:1651532196.456355:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5458
00010000:00010000:0.0:1651532196.456357:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5e80ae9 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532196.456358:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f417529 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456362:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f417529 lrc: 3/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456370:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f417529 lrc: 1/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456382:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f417529 lrc: 0/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456428:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417537 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456432:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417537 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532196.456453:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022920425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469044544:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2473090us (2475567us total) trans 158913794396 rc 0/0
00000100:00100000:1.0:1651532196.456456:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5460
00010000:00010000:0.0:1651532196.456469:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41751b lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456473:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41751b lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.456502:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f966eeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469044736:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2474667us (2475652us total) trans 158913794392 rc 0/0
00000100:00100000:0.0:1651532196.456507:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5456
00010000:00010000:0.0:1651532196.456516:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417537 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456520:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532196.456521:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417522 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456525:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417522 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456528:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417537 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456532:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417537 lrc: 3/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456543:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417537 lrc: 1/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532196.456546:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f1dba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469044288:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2474706us (2475679us total) trans 158913794393 rc 0/0
00010000:00010000:0.0:1651532196.456546:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417537 lrc: 0/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456549:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41751b lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532196.456551:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5457
00010000:00010000:0.0:1651532196.456552:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532196.456552:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41751b lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456555:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41751b lrc: 3/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456558:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41751b lrc: 1/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456559:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417522 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456561:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41751b lrc: 0/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 7 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456563:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532196.456564:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417522 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456567:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417522 lrc: 3/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456572:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417522 lrc: 1/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456575:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417522 lrc: 0/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456620:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41753e lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456626:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41753e lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.456644:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a1abca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469044672:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2473207us (2475749us total) trans 158913794397 rc 0/0
00010000:00010000:1.0:1651532196.456647:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417514 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.456647:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5461
00010000:00010000:1.0:1651532196.456651:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417514 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456654:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41753e lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456665:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532196.456666:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41753e lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456669:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41753e lrc: 3/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532196.456671:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0af3a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469044480:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2475717us (2475842us total) trans 158913794391 rc 0/0
00000100:00100000:1.0:1651532196.456674:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5455
00010000:00010000:0.0:1651532196.456674:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41753e lrc: 1/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456676:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41753e lrc: 0/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456679:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417514 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456682:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532196.456683:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417514 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456686:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417514 lrc: 3/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456690:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417514 lrc: 1/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456692:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417514 lrc: 0/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456746:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417530 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.456749:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417530 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456762:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417530 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456769:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532196.456770:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417530 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456773:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417530 lrc: 3/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.456773:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000756eca33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754469044416:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2474171us (2475895us total) trans 158913794395 rc 0/0
00000100:00100000:0.0:1651532196.456776:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5459
00010000:00010000:1.0:1651532196.456778:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417530 lrc: 1/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.456781:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417530 lrc: 0/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532196.480207:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.480234:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469045184
00000100:00100000:0.0:1651532196.480252:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6803
00000100:00100000:0.0:1651532196.480254:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754469045184:12345-10.240.43.64@tcp:101:diff.0
00010000:00010000:0.0:1651532196.480262:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532196.480269:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41754c lrc: 2/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fb69 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532196.480276:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d30:0x0] initial LVB size: 33554432, mtime: 0x627061a1, atime: 0x0, ctime: 0x627061a1, blocks: 0x10000
00010000:00010000:0.0:1651532196.480284:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532196.480285:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532196.480288:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41754c lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb69 expref: 6 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532196.480294:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41754c lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb69 expref: 6 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532196.480298:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00000100:00100000:0.0:1651532196.480312:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469045184:12345-10.240.43.64@tcp:101:diff.0 Request processed in 57us (106us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532196.480315:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6803
00000100:00100000:1.0:1651532196.481236:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.481258:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469045440
00000100:00100000:0.0:1651532196.481270:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6804
00000100:00100000:0.0:1651532196.481272:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469045440:12345-10.240.43.64@tcp:101:diff.0
00010000:00010000:0.0:1651532196.481276:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532196.481280:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417553 lrc: 2/0,0 mode: --/PR res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fb85 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532196.481285:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d31:0x0] initial LVB size: 33554432, mtime: 0x627061a1, atime: 0x0, ctime: 0x627061a1, blocks: 0x10000
00010000:00010000:0.0:1651532196.481289:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532196.481289:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532196.481291:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417553 lrc: 3/0,0 mode: PR/PR res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb85 expref: 7 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532196.481295:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417553 lrc: 3/0,0 mode: PR/PR res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb85 expref: 7 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532196.481303:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ffdbbad6, rc 0)
00000100:00100000:0.0:1651532196.481313:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469045440:12345-10.240.43.64@tcp:101:diff.0 Request processed in 40us (78us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532196.481316:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6804
00000100:00100000:1.0:1651532196.484121:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.484144:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469045888
00002000:00100000:0.0:1651532196.484155:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d30:0x0] (0->2097151)  req@000000001bb47476 x1731754469045888/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.484160:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001bb47476 with x1731754469045888 ext(0->2097151)
00002000:00010000:0.0:1651532196.484162:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001bb47476
00000100:00100000:0.0:1651532196.484172:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5462
00000100:00100000:0.0:1651532196.484174:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001bb47476 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469045888:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.486698:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001bb47476 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469045888:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2520us (2575us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532196.486703:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5462
00002000:00100000:0.0:1651532196.486706:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d30:0x0] (0->2097151)  req@000000001bb47476 x1731754469045888/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532196.486711:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001bb47476 with x1731754469045888 ext(0->2097151)
00002000:00010000:0.0:1651532196.486713:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001bb47476
00000100:00100000:0.0:1651532196.491926:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.491936:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469046208
00002000:00100000:0.0:1651532196.491948:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d31:0x0] (0->2097151)  req@000000005c09075e x1731754469046208/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.491952:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005c09075e with x1731754469046208 ext(0->2097151)
00002000:00010000:0.0:1651532196.491954:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005c09075e
00000100:00100000:0.0:1651532196.491966:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5463
00000100:00100000:0.0:1651532196.491968:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469046208:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.493929:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c09075e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469046208:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1957us (2001us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532196.493934:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5463
00002000:00100000:0.0:1651532196.493938:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d31:0x0] (0->2097151)  req@000000005c09075e x1731754469046208/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532196.493942:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005c09075e with x1731754469046208 ext(0->2097151)
00002000:00010000:0.0:1651532196.493944:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005c09075e
00000100:00100000:1.0:1651532196.499497:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.499523:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469046400
00002000:00100000:0.0:1651532196.499538:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d30:0x0] (2097152->4194303)  req@0000000019c95151 x1731754469046400/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.499542:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000019c95151 with x1731754469046400 ext(2097152->4194303)
00002000:00010000:0.0:1651532196.499544:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000019c95151
00000100:00100000:0.0:1651532196.499555:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5464
00000100:00100000:0.0:1651532196.499557:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469046400:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.501462:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000019c95151 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469046400:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1903us (1966us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532196.501467:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5464
00002000:00100000:0.0:1651532196.501471:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d30:0x0] (2097152->4194303)  req@0000000019c95151 x1731754469046400/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532196.501476:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000019c95151 with x1731754469046400 ext(2097152->4194303)
00002000:00010000:0.0:1651532196.501478:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000019c95151
00000100:00100000:0.0:1651532196.505207:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.505218:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469046656
00002000:00100000:0.0:1651532196.505232:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d31:0x0] (2097152->4194303)  req@000000009e648062 x1731754469046656/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.505236:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009e648062 with x1731754469046656 ext(2097152->4194303)
00002000:00010000:0.0:1651532196.505238:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009e648062
00000100:00100000:0.0:1651532196.505251:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5465
00000100:00100000:0.0:1651532196.505253:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469046656:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.507233:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e648062 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469046656:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1977us (2024us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532196.507237:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5465
00002000:00100000:0.0:1651532196.507241:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d31:0x0] (2097152->4194303)  req@000000009e648062 x1731754469046656/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532196.507245:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009e648062 with x1731754469046656 ext(2097152->4194303)
00002000:00010000:0.0:1651532196.507247:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009e648062
00000100:00100000:1.0:1651532196.513085:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.513112:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469046912
00002000:00100000:0.0:1651532196.513128:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d30:0x0] (4194304->8388607)  req@0000000095abdb29 x1731754469046912/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.513132:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095abdb29 with x1731754469046912 ext(4194304->8388607)
00002000:00010000:0.0:1651532196.513134:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000095abdb29
00000100:00100000:0.0:1651532196.513146:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5466
00000100:00100000:0.0:1651532196.513148:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469046912:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.516946:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095abdb29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469046912:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3793us (3859us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.516956:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5466
00002000:00100000:0.0:1651532196.516962:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d30:0x0] (4194304->8388607)  req@0000000095abdb29 x1731754469046912/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.516967:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095abdb29 with x1731754469046912 ext(4194304->8388607)
00002000:00010000:0.0:1651532196.516970:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000095abdb29
00000100:00100000:0.0:1651532196.522634:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.522646:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469047232
00002000:00100000:0.0:1651532196.522660:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d31:0x0] (4194304->8388607)  req@0000000008949cbb x1731754469047232/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.522664:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008949cbb with x1731754469047232 ext(4194304->8388607)
00002000:00010000:0.0:1651532196.522666:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000008949cbb
00000100:00100000:0.0:1651532196.522679:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5467
00000100:00100000:0.0:1651532196.522681:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008949cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469047232:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.526383:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008949cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469047232:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3697us (3746us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.526390:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5467
00002000:00100000:0.0:1651532196.526395:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d31:0x0] (4194304->8388607)  req@0000000008949cbb x1731754469047232/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.526400:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008949cbb with x1731754469047232 ext(4194304->8388607)
00002000:00010000:0.0:1651532196.526403:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000008949cbb
00000100:00100000:0.0:1651532196.538225:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.538249:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469047424
00002000:00100000:0.0:1651532196.538275:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d30:0x0] (8388608->12582911)  req@000000008f9bc190 x1731754469047424/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.538289:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008f9bc190 with x1731754469047424 ext(8388608->12582911)
00002000:00010000:0.0:1651532196.538292:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008f9bc190
00000100:00100000:0.0:1651532196.538352:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5468
00000100:00100000:0.0:1651532196.538355:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f9bc190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469047424:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.538391:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.538401:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469047488
00002000:00100000:1.0:1651532196.538412:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d30:0x0] (12582912->16777215)  req@000000000cad9353 x1731754469047488/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532196.538417:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000cad9353 with x1731754469047488 ext(12582912->16777215)
00002000:00010000:1.0:1651532196.538419:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000cad9353
00000100:00100000:1.0:1651532196.538430:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5469
00000100:00100000:1.0:1651532196.538432:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469047488:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.542565:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f9bc190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469047424:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4204us (4340us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.542572:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5468
00002000:00100000:0.0:1651532196.542580:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d30:0x0] (8388608->12582911)  req@000000008f9bc190 x1731754469047424/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.542586:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008f9bc190 with x1731754469047424 ext(8388608->12582911)
00002000:00010000:0.0:1651532196.542590:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008f9bc190
00000100:00100000:1.0:1651532196.545344:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cad9353 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469047488:12345-10.240.43.64@tcp:3:diff.0 Request processed in 6908us (6951us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.545351:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5469
00002000:00100000:1.0:1651532196.545357:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d30:0x0] (12582912->16777215)  req@000000000cad9353 x1731754469047488/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.545362:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000cad9353 with x1731754469047488 ext(12582912->16777215)
00002000:00010000:1.0:1651532196.545365:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000cad9353
00000100:00100000:0.0:1651532196.554275:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.554293:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.554306:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469048192
00000100:00100000:0.0:1651532196.554306:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469048128
00002000:00100000:1.0:1651532196.554322:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d31:0x0] (12582912->16777215)  req@00000000a698c7e5 x1731754469048192/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.554323:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d31:0x0] (8388608->12582911)  req@00000000180d5285 x1731754469048128/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532196.554327:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a698c7e5 with x1731754469048192 ext(12582912->16777215)
00002000:00100000:0.0:1651532196.554327:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000180d5285 with x1731754469048128 ext(8388608->12582911)
00002000:00010000:1.0:1651532196.554329:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a698c7e5
00002000:00010000:0.0:1651532196.554329:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000180d5285
00000100:00100000:1.0:1651532196.554346:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5470
00000100:00100000:1.0:1651532196.554349:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469048192:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.554349:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5471
00000100:00100000:0.0:1651532196.554351:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469048128:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.560581:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000180d5285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469048128:12345-10.240.43.64@tcp:3:diff.0 Request processed in 6225us (6284us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.560608:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5471
00002000:00100000:0.0:1651532196.560616:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d31:0x0] (8388608->12582911)  req@00000000180d5285 x1731754469048128/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.560622:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000180d5285 with x1731754469048128 ext(8388608->12582911)
00002000:00010000:0.0:1651532196.560626:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000180d5285
00000100:00100000:1.0:1651532196.561399:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a698c7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469048192:12345-10.240.43.64@tcp:3:diff.0 Request processed in 7047us (7124us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.561404:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5470
00002000:00100000:1.0:1651532196.561408:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d31:0x0] (12582912->16777215)  req@00000000a698c7e5 x1731754469048192/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.561413:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a698c7e5 with x1731754469048192 ext(12582912->16777215)
00002000:00010000:1.0:1651532196.561415:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a698c7e5
00000100:00100000:0.0:1651532196.581476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.581495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.581512:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469048448
00000100:00100000:1.0:1651532196.581514:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469048512
00002000:00100000:1.0:1651532196.581532:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d30:0x0] (20971520->25165823)  req@000000006f4482c3 x1731754469048512/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.581532:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d30:0x0] (16777216->20971519)  req@0000000040f5dcf1 x1731754469048448/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.581537:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000040f5dcf1 with x1731754469048448 ext(16777216->20971519)
00002000:00100000:1.0:1651532196.581540:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006f4482c3 with x1731754469048512 ext(20971520->25165823)
00002000:00010000:0.0:1651532196.581540:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000040f5dcf1
00002000:00010000:1.0:1651532196.581542:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006f4482c3
00000100:00100000:0.0:1651532196.581559:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5472
00000100:00100000:1.0:1651532196.581562:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5473
00000100:00100000:0.0:1651532196.581562:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469048448:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.581564:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469048512:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.585398:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.585431:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.585442:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469049216
00000100:00100000:0.0:1651532196.585444:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469049152
00002000:00100000:0.0:1651532196.585464:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d31:0x0] (16777216->20971519)  req@00000000c833384d x1731754469049152/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532196.585466:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d31:0x0] (20971520->25165823)  req@000000002fe8a0a6 x1731754469049216/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532196.585471:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002fe8a0a6 with x1731754469049216 ext(20971520->25165823)
00002000:00100000:0.0:1651532196.585471:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c833384d with x1731754469049152 ext(16777216->20971519)
00002000:00010000:1.0:1651532196.585474:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002fe8a0a6
00002000:00010000:0.0:1651532196.585474:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c833384d
00000100:00100000:0.0:1651532196.585483:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5474
00000100:00100000:0.0:1651532196.585486:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469049152:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.585487:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5475
00000100:00100000:1.0:1651532196.585490:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469049216:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.586759:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f4482c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469048512:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5189us (5259us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.586766:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5473
00002000:00100000:1.0:1651532196.586777:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d30:0x0] (20971520->25165823)  req@000000006f4482c3 x1731754469048512/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.586782:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006f4482c3 with x1731754469048512 ext(20971520->25165823)
00002000:00010000:1.0:1651532196.586785:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006f4482c3
00000100:00100000:1.0:1651532196.586925:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f5dcf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469048448:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5362us (5452us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.586928:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5472
00002000:00100000:1.0:1651532196.586931:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d30:0x0] (16777216->20971519)  req@0000000040f5dcf1 x1731754469048448/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.586940:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000040f5dcf1 with x1731754469048448 ext(16777216->20971519)
00002000:00010000:1.0:1651532196.586942:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000040f5dcf1
00000100:00100000:1.0:1651532196.591054:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002fe8a0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469049216:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5558us (5655us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.591064:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5475
00002000:00100000:1.0:1651532196.591072:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d31:0x0] (20971520->25165823)  req@000000002fe8a0a6 x1731754469049216/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.591077:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002fe8a0a6 with x1731754469049216 ext(20971520->25165823)
00002000:00010000:1.0:1651532196.591080:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002fe8a0a6
00000100:00100000:0.0:1651532196.592251:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c833384d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469049152:12345-10.240.43.64@tcp:3:diff.0 Request processed in 6762us (6818us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.592260:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5474
00002000:00100000:0.0:1651532196.592265:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d31:0x0] (16777216->20971519)  req@00000000c833384d x1731754469049152/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.592270:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c833384d with x1731754469049152 ext(16777216->20971519)
00002000:00010000:0.0:1651532196.592272:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c833384d
00000100:00100000:1.0:1651532196.610237:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.610270:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469049472
00002000:00100000:0.0:1651532196.610295:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d30:0x0] (25165824->29360127)  req@0000000009f237b6 x1731754469049472/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.610336:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000009f237b6 with x1731754469049472 ext(25165824->29360127)
00002000:00010000:0.0:1651532196.610339:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000009f237b6
00000100:00100000:0.0:1651532196.610353:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5476
00000100:00100000:0.0:1651532196.610355:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469049472:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.610391:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.610399:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469049536
00002000:00100000:1.0:1651532196.610410:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d30:0x0] (29360128->33554431)  req@00000000f7e624d2 x1731754469049536/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532196.610414:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7e624d2 with x1731754469049536 ext(29360128->33554431)
00002000:00010000:1.0:1651532196.610415:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f7e624d2
00000100:00100000:1.0:1651532196.610422:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5477
00000100:00100000:1.0:1651532196.610424:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469049536:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.615314:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009f237b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469049472:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4954us (5077us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.615321:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5476
00002000:00100000:0.0:1651532196.615327:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d30:0x0] (25165824->29360127)  req@0000000009f237b6 x1731754469049472/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.615332:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000009f237b6 with x1731754469049472 ext(25165824->29360127)
00002000:00010000:0.0:1651532196.615335:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000009f237b6
00000100:00100000:1.0:1651532196.616567:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.616608:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469050112
00002000:00100000:0.0:1651532196.616629:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d31:0x0] (25165824->29360127)  req@00000000bfe211fa x1731754469050112/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.616634:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bfe211fa with x1731754469050112 ext(25165824->29360127)
00002000:00010000:0.0:1651532196.616636:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bfe211fa
00000100:00100000:0.0:1651532196.616646:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5478
00000100:00100000:0.0:1651532196.616649:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469050112:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.616656:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e624d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469049536:12345-10.240.43.64@tcp:3:diff.0 Request processed in 6231us (6265us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.616662:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5477
00002000:00100000:1.0:1651532196.616666:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d30:0x0] (29360128->33554431)  req@00000000f7e624d2 x1731754469049536/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.616670:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7e624d2 with x1731754469049536 ext(29360128->33554431)
00002000:00010000:1.0:1651532196.616673:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f7e624d2
00000100:00100000:1.0:1651532196.616690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.616726:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469050176
00002000:00100000:1.0:1651532196.616733:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d31:0x0] (29360128->33554431)  req@00000000adaac499 x1731754469050176/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/0 e 0 to 0 dl 1651532239 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532196.616737:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000adaac499 with x1731754469050176 ext(29360128->33554431)
00002000:00010000:1.0:1651532196.616738:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000adaac499
00000100:00100000:1.0:1651532196.616744:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5479
00000100:00100000:1.0:1651532196.616746:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469050176:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.620863:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe211fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469050112:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4209us (4295us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.620872:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5478
00002000:00100000:0.0:1651532196.620880:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d31:0x0] (25165824->29360127)  req@00000000bfe211fa x1731754469050112/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.620885:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bfe211fa with x1731754469050112 ext(25165824->29360127)
00002000:00010000:0.0:1651532196.620888:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bfe211fa
00000100:00100000:1.0:1651532196.622265:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000adaac499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469050176:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5516us (5573us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.622272:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5479
00002000:00100000:1.0:1651532196.622276:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d31:0x0] (29360128->33554431)  req@00000000adaac499 x1731754469050176/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:694/0 lens 488/440 e 0 to 0 dl 1651532239 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.622281:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000adaac499 with x1731754469050176 ext(29360128->33554431)
00002000:00010000:1.0:1651532196.622283:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000adaac499
00000100:00100000:1.0:1651532197.088185:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532197.088217:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951234816
00000100:00100000:0.0:1651532197.088244:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 75
00000100:00100000:0.0:1651532197.088247:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951234816:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532197.088266:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 359060032 pending 0 free 81113686016 avail 76942974976
00000100:00100000:0.0:1651532197.088293:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068386896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951234816:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 46us (111us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532197.088297:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 75
00000400:00000080:0.0:1651532198.026575:0:330717:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532198.026578:0:330717:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398e: O_Direct open cleared by fcntl doesn't cause hang ========================================================== 22:56:37 (1651532197)
00000100:00100000:1.0:1651532198.053191:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532198.053218:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951234944
00000100:00100000:0.0:1651532198.053245:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6805
00000100:00100000:0.0:1651532198.053248:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:330935:x1731745951234944:12345-10.240.43.61@tcp:5:osp-pre-0-0.0
00002000:00080000:0.0:1651532198.053287:0:328039:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x0 at 216386
00000100:00100000:1.0:1651532198.053837:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532198.053845:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469052160
00000100:00100000:1.0:1651532198.053861:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6806
00000100:00100000:1.0:1651532198.053863:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469052160:12345-10.240.43.64@tcp:2:touch.0
00000100:00100000:1.0:1651532198.053959:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469052160:12345-10.240.43.64@tcp:2:touch.0 Request processed in 94us (122us total) trans 158913794399 rc 0/0
00000100:00100000:1.0:1651532198.053963:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6806
00000100:00100000:0.0:1651532198.054212:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:330935:x1731745951234944:12345-10.240.43.61@tcp:5:osp-pre-0-0.0 Request processed in 962us (1023us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532198.054216:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6805
00000100:00100000:1.0:1651532198.058201:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532198.058223:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469052800
00000100:00100000:0.0:1651532198.058237:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6807
00000100:00100000:0.0:1651532198.058239:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:682801:x1731754469052800:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532198.058244:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532198.058254:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41755a lrc: 2/0,0 mode: --/PW res: [0x34d32:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fbee expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532198.058262:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d32:0x0] initial LVB size: 0, mtime: 0x627061a6, atime: 0x627061a6, ctime: 0x627061a6, blocks: 0x0
00010000:00010000:0.0:1651532198.058270:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532198.058271:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532198.058274:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41755a lrc: 3/0,0 mode: PW/PW res: [0x34d32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fbee expref: 9 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.058282:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e80ae9/0xa29a79078f41755a lrc: 3/0,0 mode: PW/PW res: [0x34d32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fbee expref: 9 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.058287:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5e80ae9, rc 0)
00000100:00100000:0.0:1651532198.058304:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:682801:x1731754469052800:12345-10.240.43.64@tcp:101:dd.0 Request processed in 64us (103us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532198.058307:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6807
00000100:00100000:1.0:1651532198.058528:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532198.058538:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469052864
00002000:00010000:1.0:1651532198.058546:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216370/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532198.058547:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000049ffa392 with x1731754469052864 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532198.058552:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000049ffa392.
00000100:00100000:1.0:1651532198.058564:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5480
00000100:00100000:1.0:1651532198.058566:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469052864:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532198.058592:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d32:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532198.058594:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d32:0x0] updating lvb mtime from disk: 1651532198 -> 1651532198
00002000:00010000:1.0:1651532198.058595:0:330058:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d32:0x0] updating lvb atime from disk: 1651532198 -> 1651532198
00002000:00010000:1.0:1651532198.058596:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d32:0x0] updating lvb ctime from disk: 1651532198 -> 1651532198
00002000:00010000:1.0:1651532198.058597:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d32:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532198.058609:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049ffa392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469052864:12345-10.240.43.64@tcp:10:dd.0 Request processed in 43us (81us total) trans 158913794400 rc 0/0
00000100:00100000:1.0:1651532198.058612:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5480
00002000:00010000:1.0:1651532198.058614:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216370/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532198.058614:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000049ffa392 with x1731754469052864 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532198.058616:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000049ffa392.
00000100:00100000:1.0:1651532198.059193:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532198.059202:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469052928
00002000:00100000:1.0:1651532198.059210:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d32:0x0] (0->1233)  req@0000000031e726bc x1731754469052928/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 1728/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532198.059215:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000031e726bc with x1731754469052928 ext(0->1233)
00002000:00010000:1.0:1651532198.059217:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000031e726bc
00000100:00100000:1.0:1651532198.059228:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5481
00000100:00100000:1.0:1651532198.059230:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469052928:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532198.059488:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e726bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469052928:12345-10.240.43.64@tcp:4:dd.0 Request processed in 257us (295us total) trans 158913794401 rc 0/0
00000100:00100000:1.0:1651532198.059492:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5481
00002000:00100000:1.0:1651532198.059495:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d32:0x0] (0->1233)  req@0000000031e726bc x1731754469052928/t158913794401(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 1728/448 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532198.059499:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000031e726bc with x1731754469052928 ext(0->1233)
00002000:00010000:1.0:1651532198.059501:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000031e726bc
00000100:00100000:1.0:1651532198.141971:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532198.141997:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235072
00000100:00100000:0.0:1651532198.142018:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6808
00000100:00100000:0.0:1651532198.142020:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951235072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:0.0:1651532198.142028:0:328039:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216368 count 1
00010000:00010000:0.0:1651532198.142036:0:328039:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 3/0,1 mode: --/PW res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.142043:0:328039:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41754c lrc: 2/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb69 expref: 11 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532198.142047:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532198.142048:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532198.142048:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 4/0,1 mode: --/PW res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.142061:0:328039:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41754c lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb69 expref: 11 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532198.142066:0:328039:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41754c lrc: 4/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb69 expref: 11 pid: 328039 timeout: 15947 lvb_type: 1
00000100:00100000:0.0:1651532198.142096:0:328039:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000099f308e0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966864128:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532198.142119:0:328039:0:(client.c:2492:ptlrpc_set_wait()) set 0000000051b2456d going to sleep for 6 seconds
00000100:00100000:1.0:1651532198.142126:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532198.142165:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469053056
00000100:00100000:1.0:1651532198.142175:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6809
00000100:00100000:1.0:1651532198.142177:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469053056:12345-10.240.43.64@tcp:16:dd.0
00000100:00100000:0.0:1651532198.142443:0:328039:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000099f308e0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966864128:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532198.142451:0:328039:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 3/0,1 mode: --/PW res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532198.142465:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532198.142477:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469053120
00010000:00010000:1.0:1651532198.142486:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41754c lrc: 4/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb69 expref: 13 pid: 328039 timeout: 15947 lvb_type: 1
00000100:00100000:1.0:1651532198.142501:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 295
00000100:00100000:1.0:1651532198.142503:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469053120:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651532198.142509:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532198.142511:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41754c lrc: 4/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb69 expref: 13 pid: 328039 timeout: 15947 lvb_type: 1
00010000:00010000:1.0:1651532198.142517:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41754c lrc: 3/0,0 mode: PR/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb69 expref: 13 pid: 328039 timeout: 15947 lvb_type: 1
00010000:00010000:1.0:1651532198.142525:0:323259:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41754c lrc: 0/0,0 mode: --/PR res: [0x34d30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb69 expref: 13 pid: 328039 timeout: 15947 lvb_type: 1
00010000:00010000:1.0:1651532198.142529:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532198.142530:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532198.142531:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 3/0,1 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142534:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 4/0,1 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142543:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532198.142550:0:328039:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 3/0,1 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532198.142554:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469053120:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 50us (91us total) trans 0 rc 0/0
00010000:00010000:0.0:1651532198.142556:0:328039:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 3/0,1 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532198.142558:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 295
00010000:00010000:0.0:1651532198.142567:0:328039:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 3/0,1 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.142572:0:328039:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 2/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142601:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 2/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142606:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532198.142607:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 2/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142611:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 3/0,0 mode: PW/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142617:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 1/0,0 mode: --/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142620:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417561 lrc: 0/0,0 mode: --/PW res: [0x34d30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532198.145439:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951235072:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3416us (3467us total) trans 158913794402 rc 0/0
00000100:00100000:0.0:1651532198.145443:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6808
00000001:00080000:0.0:1651532198.211965:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794401 is committed
00000001:00080000:0.0:1651532198.211970:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794398 is committed
00000100:00100000:1.0:1651532198.212013:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469053056:12345-10.240.43.64@tcp:16:dd.0 Request processed in 69834us (69886us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532198.212018:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6809
00000400:00000080:0.0:1651532199.837228:0:330935:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532199.837230:0:330935:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398f: verify aio handles ll_direct_rw_pages errors correctly ========================================================== 22:56:39 (1651532199)
00000100:00100000:1.0:1651532199.956410:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532199.956432:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469054848
00000100:00100000:1.0:1651532199.956460:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6810
00000100:00100000:1.0:1651532199.956462:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:683392:x1731754469054848:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532199.956473:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532199.956487:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417568 lrc: 2/0,0 mode: --/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fc2d expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532199.956510:0:323276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532199.956521:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532199.956522:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532199.956526:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417568 lrc: 3/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc2d expref: 8 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532199.956537:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417568 lrc: 3/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc2d expref: 8 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532199.956542:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006121da6f, rc 0)
00000100:00100000:1.0:1651532199.956566:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:683392:x1731754469054848:12345-10.240.43.64@tcp:101:dd.0 Request processed in 103us (161us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532199.956570:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6810
00000100:00100000:1.0:1651532199.957369:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532199.957388:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469054976
00002000:00010000:1.0:1651532199.957397:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216371/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532199.957399:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004f25df55 with x1731754469054976 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532199.957402:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004f25df55.
00000100:00100000:1.0:1651532199.957414:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5482
00000100:00100000:1.0:1651532199.957416:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469054976:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532199.957480:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d33:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532199.957482:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d33:0x0] updating lvb mtime from disk: 0 -> 1651532199
00002000:00010000:1.0:1651532199.957483:0:330058:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d33:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532199.957484:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d33:0x0] updating lvb ctime from disk: 0 -> 1651532199
00002000:00010000:1.0:1651532199.957485:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d33:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532199.957497:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f25df55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469054976:12345-10.240.43.64@tcp:10:dd.0 Request processed in 80us (129us total) trans 158913794403 rc 0/0
00000100:00100000:1.0:1651532199.957500:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5482
00002000:00010000:1.0:1651532199.957501:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216371/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532199.957502:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004f25df55 with x1731754469054976 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532199.957504:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004f25df55.
00000100:00100000:1.0:1651532199.988456:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532199.988467:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469055168
00002000:00100000:1.0:1651532199.988478:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (0->4194303)  req@000000006dabb25f x1731754469055168/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:697/0 lens 488/0 e 0 to 0 dl 1651532242 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532199.988483:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006dabb25f with x1731754469055168 ext(0->4194303)
00002000:00010000:1.0:1651532199.988485:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006dabb25f
00000100:00100000:1.0:1651532199.988497:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5483
00000100:00100000:1.0:1651532199.988499:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469055168:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532200.000334:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dabb25f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469055168:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11831us (11875us total) trans 158913794404 rc 0/0
00000100:00100000:1.0:1651532200.000342:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5483
00002000:00100000:1.0:1651532200.000348:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (0->4194303)  req@000000006dabb25f x1731754469055168/t158913794404(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:697/0 lens 488/448 e 0 to 0 dl 1651532242 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532200.000353:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006dabb25f with x1731754469055168 ext(0->4194303)
00002000:00010000:1.0:1651532200.000357:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006dabb25f
00000100:00100000:1.0:1651532200.027503:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.027520:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469055424
00002000:00100000:1.0:1651532200.027540:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (4194304->8388607)  req@00000000f1b49a53 x1731754469055424/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/0 e 0 to 0 dl 1651532243 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532200.027545:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f1b49a53 with x1731754469055424 ext(4194304->8388607)
00002000:00010000:1.0:1651532200.027548:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f1b49a53
00000100:00100000:1.0:1651532200.027563:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5484
00000100:00100000:1.0:1651532200.027565:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469055424:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532200.032387:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b49a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469055424:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4807us (4873us total) trans 158913794405 rc 0/0
00000100:00100000:1.0:1651532200.032395:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5484
00002000:00100000:1.0:1651532200.032401:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (4194304->8388607)  req@00000000f1b49a53 x1731754469055424/t158913794405(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/448 e 0 to 0 dl 1651532243 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532200.032406:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f1b49a53 with x1731754469055424 ext(4194304->8388607)
00002000:00010000:1.0:1651532200.032409:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f1b49a53
00000100:00100000:1.0:1651532200.065468:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.065484:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469055680
00002000:00100000:1.0:1651532200.065504:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (8388608->12582911)  req@0000000089d73ea0 x1731754469055680/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/0 e 0 to 0 dl 1651532243 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532200.065509:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000089d73ea0 with x1731754469055680 ext(8388608->12582911)
00002000:00010000:1.0:1651532200.065511:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000089d73ea0
00000100:00100000:1.0:1651532200.065526:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5485
00000100:00100000:1.0:1651532200.065529:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469055680:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532200.079913:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d73ea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469055680:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14379us (14443us total) trans 158913794406 rc 0/0
00000100:00100000:0.0:1651532200.079921:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5485
00002000:00100000:0.0:1651532200.079928:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (8388608->12582911)  req@0000000089d73ea0 x1731754469055680/t158913794406(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/448 e 0 to 0 dl 1651532243 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532200.079934:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000089d73ea0 with x1731754469055680 ext(8388608->12582911)
00002000:00010000:0.0:1651532200.079937:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000089d73ea0
00000100:00100000:1.0:1651532200.111517:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532200.111548:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469056000
00002000:00100000:0.0:1651532200.111572:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (12582912->16777215)  req@00000000450327b4 x1731754469056000/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/0 e 0 to 0 dl 1651532243 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532200.111577:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000450327b4 with x1731754469056000 ext(12582912->16777215)
00002000:00010000:0.0:1651532200.111580:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000450327b4
00000100:00100000:0.0:1651532200.111590:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5486
00000100:00100000:0.0:1651532200.111593:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469056000:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532200.122968:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000450327b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469056000:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11370us (11450us total) trans 158913794407 rc 0/0
00000100:00100000:0.0:1651532200.122975:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5486
00002000:00100000:0.0:1651532200.122981:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (12582912->16777215)  req@00000000450327b4 x1731754469056000/t158913794407(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/448 e 0 to 0 dl 1651532243 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532200.122987:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000450327b4 with x1731754469056000 ext(12582912->16777215)
00002000:00010000:0.0:1651532200.122990:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000450327b4
00000100:00100000:1.0:1651532200.143463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532200.143486:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469056192
00002000:00100000:0.0:1651532200.143505:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (16777216->20971519)  req@0000000031f35ffc x1731754469056192/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/0 e 0 to 0 dl 1651532243 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532200.143510:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000031f35ffc with x1731754469056192 ext(16777216->20971519)
00002000:00010000:0.0:1651532200.143512:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000031f35ffc
00000100:00100000:0.0:1651532200.143526:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5487
00000100:00100000:0.0:1651532200.143529:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469056192:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532200.157734:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031f35ffc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469056192:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14201us (14268us total) trans 158913794408 rc 0/0
00000100:00100000:0.0:1651532200.157741:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5487
00002000:00100000:0.0:1651532200.157749:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (16777216->20971519)  req@0000000031f35ffc x1731754469056192/t158913794408(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/448 e 0 to 0 dl 1651532243 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532200.157755:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000031f35ffc with x1731754469056192 ext(16777216->20971519)
00002000:00010000:0.0:1651532200.157759:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000031f35ffc
00000100:00100000:1.0:1651532200.181441:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532200.181468:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469056448
00002000:00100000:0.0:1651532200.181485:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (20971520->25165823)  req@00000000aac2ab5c x1731754469056448/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/0 e 0 to 0 dl 1651532243 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532200.181490:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aac2ab5c with x1731754469056448 ext(20971520->25165823)
00002000:00010000:0.0:1651532200.181492:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aac2ab5c
00000100:00100000:0.0:1651532200.181505:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5488
00000100:00100000:0.0:1651532200.181507:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469056448:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532200.195971:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aac2ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469056448:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14459us (14528us total) trans 158913794409 rc 0/0
00000100:00100000:0.0:1651532200.195979:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5488
00002000:00100000:0.0:1651532200.195987:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (20971520->25165823)  req@00000000aac2ab5c x1731754469056448/t158913794409(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/448 e 0 to 0 dl 1651532243 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532200.195992:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aac2ab5c with x1731754469056448 ext(20971520->25165823)
00002000:00010000:0.0:1651532200.195996:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aac2ab5c
00000100:00100000:1.0:1651532200.220463:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532200.220491:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469056704
00002000:00100000:0.0:1651532200.220508:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (25165824->29360127)  req@000000003d0d5d41 x1731754469056704/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/0 e 0 to 0 dl 1651532243 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532200.220512:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003d0d5d41 with x1731754469056704 ext(25165824->29360127)
00002000:00010000:0.0:1651532200.220514:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003d0d5d41
00000100:00100000:0.0:1651532200.220526:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5489
00000100:00100000:0.0:1651532200.220528:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469056704:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532200.234887:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0d5d41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754469056704:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14354us (14422us total) trans 158913794410 rc 0/0
00000100:00100000:0.0:1651532200.234896:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5489
00002000:00100000:0.0:1651532200.234903:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (25165824->29360127)  req@000000003d0d5d41 x1731754469056704/t158913794410(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/448 e 0 to 0 dl 1651532243 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532200.234908:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003d0d5d41 with x1731754469056704 ext(25165824->29360127)
00002000:00010000:0.0:1651532200.234911:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003d0d5d41
00000100:00100000:1.0:1651532200.265705:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532200.265733:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469057152
00002000:00100000:0.0:1651532200.265751:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (29360128->33554431)  req@000000006f38c3f6 x1731754469057152/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/0 e 0 to 0 dl 1651532243 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532200.265756:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006f38c3f6 with x1731754469057152 ext(29360128->33554431)
00002000:00010000:0.0:1651532200.265758:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006f38c3f6
00000100:00100000:0.0:1651532200.265771:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5490
00000100:00100000:0.0:1651532200.265773:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f38c3f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754469057152:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532200.272035:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f38c3f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754469057152:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6257us (6329us total) trans 158913794411 rc 0/0
00000100:00100000:0.0:1651532200.272042:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5490
00002000:00100000:0.0:1651532200.272048:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d33:0x0] (29360128->33554431)  req@000000006f38c3f6 x1731754469057152/t158913794411(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:698/0 lens 488/448 e 0 to 0 dl 1651532243 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532200.272053:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006f38c3f6 with x1731754469057152 ext(29360128->33554431)
00002000:00010000:0.0:1651532200.272056:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006f38c3f6
00000100:00100000:1.0:1651532200.298452:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.298467:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469057856
00000100:00100000:1.0:1651532200.298490:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6811
00000100:00100000:1.0:1651532200.298492:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c207e8e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754469057856:12345-10.240.43.64@tcp:101:diff.0
00010000:00010000:1.0:1651532200.298502:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532200.298523:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41756f lrc: 2/0,0 mode: --/PR res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fc5e expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532200.298536:0:323276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532200.298545:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532200.298546:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532200.298550:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41756f lrc: 3/0,0 mode: PR/PR res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc5e expref: 26 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532200.298557:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41756f lrc: 3/0,0 mode: PR/PR res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc5e expref: 26 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532200.298563:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000187bb4a8, rc 0)
00000100:00100000:1.0:1651532200.298576:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c207e8e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438146:x1731754469057856:12345-10.240.43.64@tcp:101:diff.0 Request processed in 83us (126us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532200.298579:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6811
00000100:00100000:0.0:1651532200.636885:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1651532200.636899:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047562140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966864192:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532200.637289:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047562140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966864192:10.240.43.61@tcp:400:kworker/u4:0.0
00000400:00000080:1.0:1651532201.645061:0:331153:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651532201.645064:0:331153:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398g: verify parallel dio async RPC submission ========================================================== 22:56:41 (1651532201)
00000100:00100000:1.0:1651532201.682235:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532201.682254:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469059648
00000100:00100000:1.0:1651532201.682278:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6812
00000100:00100000:1.0:1651532201.682281:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000843fdbf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+26:683988:x1731754469059648:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532201.682310:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532201.682326:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417576 lrc: 2/0,0 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fc8f expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532201.682345:0:323276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532201.682363:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532201.682364:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532201.682368:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417576 lrc: 3/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc8f expref: 27 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.682386:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417576 lrc: 3/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc8f expref: 27 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.682391:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00000100:00100000:1.0:1651532201.682415:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000843fdbf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:683988:x1731754469059648:12345-10.240.43.64@tcp:101:dd.0 Request processed in 133us (182us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532201.682418:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6812
00000100:00100000:1.0:1651532201.682668:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532201.682676:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469059712
00000100:00100000:1.0:1651532201.682690:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6813
00000100:00100000:1.0:1651532201.682692:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090f29ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:683988:x1731754469059712:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532201.682696:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532201.682708:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41757d lrc: 2/0,0 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fc96 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532201.682714:0:323276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532201.682718:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532201.682719:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532201.682720:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41757d lrc: 3/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc96 expref: 28 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.682728:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41757d lrc: 3/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc96 expref: 28 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.682732:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:1.0:1651532201.682743:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090f29ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+28:683988:x1731754469059712:12345-10.240.43.64@tcp:101:dd.0 Request processed in 50us (75us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532201.682746:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6813
00000100:00100000:1.0:1651532201.682964:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532201.682976:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532201.682986:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469059776
00000100:00100000:1.0:1651532201.682992:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469059840
00002000:00010000:1.0:1651532201.683000:0:330280:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216374/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532201.683002:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c83d56fd with x1731754469059840 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532201.683004:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216373/0 (0->18446744073709551615)
00002000:00010000:1.0:1651532201.683006:0:330280:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c83d56fd.
00002000:00100000:0.0:1651532201.683006:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073c8f72e with x1731754469059776 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532201.683010:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000073c8f72e.
00000100:00100000:1.0:1651532201.683012:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5491
00000100:00100000:1.0:1651532201.683014:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c83d56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438146:x1731754469059840:12345-10.240.43.64@tcp:10:dd.0
00000100:00100000:0.0:1651532201.683026:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5492
00000100:00100000:0.0:1651532201.683028:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073c8f72e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438146:x1731754469059776:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:0.0:1651532201.683090:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d35:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532201.683091:0:330280:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d36:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532201.683092:0:330280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d36:0x0] updating lvb mtime from disk: 0 -> 1651532201
00002000:00010000:0.0:1651532201.683092:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d35:0x0] updating lvb mtime from disk: 0 -> 1651532201
00002000:00010000:1.0:1651532201.683093:0:330280:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d36:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532201.683093:0:330058:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d35:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532201.683094:0:330280:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d36:0x0] updating lvb ctime from disk: 0 -> 1651532201
00002000:00010000:0.0:1651532201.683094:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d35:0x0] updating lvb ctime from disk: 0 -> 1651532201
00002000:00010000:1.0:1651532201.683095:0:330280:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d36:0x0] updating lvb blocks from disk: 0 -> 0
00002000:00010000:0.0:1651532201.683095:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d35:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532201.683107:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c83d56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438146:x1731754469059840:12345-10.240.43.64@tcp:10:dd.0 Request processed in 92us (130us total) trans 158913794412 rc 0/0
00000100:00100000:0.0:1651532201.683109:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073c8f72e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438146:x1731754469059776:12345-10.240.43.64@tcp:10:dd.0 Request processed in 80us (146us total) trans 158913794413 rc 0/0
00000100:00100000:1.0:1651532201.683110:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5491
00002000:00010000:1.0:1651532201.683112:0:330280:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216374/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532201.683113:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c83d56fd with x1731754469059840 ext(0->18446744073709551615)
00000100:00100000:0.0:1651532201.683113:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5492
00002000:00010000:0.0:1651532201.683114:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216373/0 (0->18446744073709551615)
00002000:00010000:1.0:1651532201.683115:0:330280:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c83d56fd.
00002000:00100000:0.0:1651532201.683115:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073c8f72e with x1731754469059776 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532201.683117:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000073c8f72e.
00000100:00100000:1.0:1651532201.720072:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532201.720088:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532201.720097:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469060032
00000100:00100000:1.0:1651532201.720101:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469059968
00000100:00100000:0.0:1651532201.720116:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5493
00000100:00100000:0.0:1651532201.720118:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057711e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754469060032:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532201.720122:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5494
00000100:00100000:1.0:1651532201.720124:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0d9497 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754469059968:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532201.720129:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 3/0,1 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.720132:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 3/0,1 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.720138:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417576 lrc: 2/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc8f expref: 31 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.720138:0:323281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41757d lrc: 2/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc96 expref: 31 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.720141:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532201.720142:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532201.720143:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 4/0,1 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.720144:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532201.720145:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532201.720146:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 4/0,1 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.720155:0:330058:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417576 lrc: 3/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc8f expref: 31 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.720155:0:323281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41757d lrc: 3/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc96 expref: 31 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.720160:0:330058:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417576 lrc: 4/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc8f expref: 31 pid: 323276 timeout: 15951 lvb_type: 0
00010000:00010000:0.0:1651532201.720160:0:323281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41757d lrc: 4/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc96 expref: 31 pid: 323276 timeout: 15951 lvb_type: 0
00000100:00100000:1.0:1651532201.720166:0:330058:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008de65be0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:330058:1731745966864256:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532201.720166:0:323281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000099f308e0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:323281:1731745966864320:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532201.720190:0:323281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d33e8e7f going to sleep for 6 seconds
00000100:00100000:1.0:1651532201.720195:0:330058:0:(client.c:2492:ptlrpc_set_wait()) set 0000000086af9759 going to sleep for 6 seconds
00000100:00100000:1.0:1651532201.720729:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532201.720742:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532201.720752:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469060288
00000100:00100000:0.0:1651532201.720767:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469060224
00000100:00100000:0.0:1651532201.720776:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5495
00000100:00100000:0.0:1651532201.720778:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000937d196b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438149:x1731754469060288:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532201.720785:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 3/0,1 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532201.720787:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5496
00000100:00100000:1.0:1651532201.720789:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438149:x1731754469060224:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532201.720790:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532201.720791:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532201.720791:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 3/0,1 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.720798:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 3/0,1 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.720815:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532201.720816:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532201.720816:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 3/0,1 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.720820:0:323284:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 3/0,1 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.720834:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 3/0,1 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532201.720872:0:330058:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008de65be0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:330058:1731745966864256:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532201.720872:0:323281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000099f308e0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:323281:1731745966864320:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532201.720877:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 3/0,1 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.720877:0:323281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 3/0,1 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532201.720953:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532201.720968:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532201.720979:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469060416
00010000:00010000:0.0:1651532201.720986:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41757d lrc: 4/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc96 expref: 34 pid: 323276 timeout: 15951 lvb_type: 0
00000100:00100000:0.0:1651532201.721010:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469060480
00010000:00010000:0.0:1651532201.721014:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417576 lrc: 4/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc8f expref: 35 pid: 323276 timeout: 15951 lvb_type: 0
00000100:00100000:0.0:1651532201.721022:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 296
00000100:00100000:0.0:1651532201.721023:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438146:x1731754469060416:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651532201.721027:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651532201.721031:0:323263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 297
00000100:00100000:1.0:1651532201.721033:0:323263:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438148:x1731754469060480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651532201.721033:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41757d lrc: 4/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc96 expref: 35 pid: 323276 timeout: 15951 lvb_type: 0
00010000:00010000:0.0:1651532201.721037:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41757d lrc: 3/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc96 expref: 35 pid: 323276 timeout: 15951 lvb_type: 0
00010000:00010000:1.0:1651532201.721038:0:323263:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532201.721043:0:323263:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417576 lrc: 4/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc8f expref: 35 pid: 323276 timeout: 15951 lvb_type: 0
00010000:00010000:1.0:1651532201.721048:0:323263:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417576 lrc: 3/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc8f expref: 35 pid: 323276 timeout: 15951 lvb_type: 0
00010000:00010000:0.0:1651532201.721051:0:323259:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41757d lrc: 0/0,0 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc96 expref: 35 pid: 323276 timeout: 15951 lvb_type: 0
00010000:00010000:0.0:1651532201.721056:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532201.721057:0:323263:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417576 lrc: 0/0,0 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc8f expref: 34 pid: 323276 timeout: 15951 lvb_type: 0
00010000:00010000:0.0:1651532201.721057:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532201.721058:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.721061:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532201.721061:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 4/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.721062:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532201.721063:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.721064:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532201.721065:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532201.721065:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.721066:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 4/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.721068:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 4/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.721069:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532201.721070:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532201.721071:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.721073:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 4/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.721079:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532201.721090:0:323263:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532201.721099:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438146:x1731754469060416:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 74us (145us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532201.721102:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 296
00000100:00100000:1.0:1651532201.721104:0:323263:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754469060480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 70us (135us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532201.721107:0:323263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 297
00010000:00010000:1.0:1651532201.721116:0:323284:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.721119:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.721120:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.721123:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.721319:0:323281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532201.721322:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.721508:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532201.721512:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532202.208155:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532202.208170:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532202.208188:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235392
00000100:00100000:1.0:1651532202.208197:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235456
00000100:00100000:0.0:1651532202.208209:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 76
00000100:00100000:0.0:1651532202.208211:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951235392:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00000100:00100000:1.0:1651532202.208222:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 4
00000100:00100000:1.0:1651532202.208224:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951235456:12345-10.240.43.61@tcp:400:kworker/u4:0.0
00002000:00000024:0.0:1651532202.208231:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 401395392 pending 42336256 free 81113681920 avail 76942970880
00000100:00100000:1.0:1651532202.208252:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951235456:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 28us (82us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532202.208252:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099f308e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951235392:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 40us (100us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532202.208255:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 4
00000100:00100000:0.0:1651532202.208256:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 76
00000001:00080000:0.0:1651532202.441284:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794414 is committed
00000001:00080000:0.0:1651532202.441298:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794402 is committed
00002000:00010000:1.0:1651532202.441386:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d35:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:1.0:1651532202.441389:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d35:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:1.0:1651532202.441395:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.441401:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 2/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.441427:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 2/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532202.441437:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000937d196b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754469060288:12345-10.240.43.64@tcp:4:dd.0 Request processed in 720656us (720707us total) trans 158913794414 rc 0/0
00010000:00010000:0.0:1651532202.441438:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a925ecb already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532202.441440:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 2/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532202.441442:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5495
00010000:00010000:0.0:1651532202.441445:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 3/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.441456:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 1/0,0 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.441459:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417592 lrc: 0/0,0 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532202.466547:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794417 is committed
00002000:00010000:1.0:1651532202.466627:0:323284:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d36:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:1.0:1651532202.466629:0:323284:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d36:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:1.0:1651532202.466632:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.466637:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 2/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532202.466660:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046f3c421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469060224:12345-10.240.43.64@tcp:4:dd.0 Request processed in 745870us (745917us total) trans 158913794415 rc 0/0
00000100:00100000:1.0:1651532202.466664:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5496
00010000:00010000:1.0:1651532202.466672:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 2/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.466675:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532202.466677:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 2/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.466680:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 3/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.466686:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 1/0,0 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.466688:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417599 lrc: 0/0,0 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.466733:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.466736:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 2/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532202.466761:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057711e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469060032:12345-10.240.43.64@tcp:4:dd.0 Request processed in 746643us (746691us total) trans 158913794416 rc 0/0
00010000:00010000:0.0:1651532202.466763:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 2/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532202.466764:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5493
00010000:00010000:0.0:1651532202.466768:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532202.466769:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 2/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.466772:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 3/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.466777:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 1/0,0 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.466780:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417584 lrc: 0/0,0 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.466830:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.466834:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 2/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.466845:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 3/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.466850:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532202.466851:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 2/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.466853:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 3/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.466858:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 1/0,0 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.466862:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f41758b lrc: 0/0,0 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532202.466863:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0d9497 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469059968:12345-10.240.43.64@tcp:4:dd.0 Request processed in 746738us (746775us total) trans 158913794417 rc 0/0
00000100:00100000:1.0:1651532202.466866:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5494
00000100:00100000:0.0:1651532202.488908:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.488918:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.488933:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469060736
00000100:00100000:1.0:1651532202.488940:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469060800
00000100:00100000:0.0:1651532202.488950:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6814
00000100:00100000:0.0:1651532202.488953:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469060736:12345-10.240.43.64@tcp:101:rm.0
00000100:00100000:1.0:1651532202.488957:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6815
00000100:00100000:1.0:1651532202.488959:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469060800:12345-10.240.43.64@tcp:101:rm.0
00010000:00010000:0.0:1651532202.488961:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532202.488963:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532202.488967:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4175a0 lrc: 2/0,0 mode: --/PR res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fca4 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532202.488968:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4175a7 lrc: 2/0,0 mode: --/PR res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fcab expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532202.488974:0:323276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d36:0x0] initial LVB size: 4194304, mtime: 0x627061a9, atime: 0x0, ctime: 0x627061a9, blocks: 0x2000
00002000:00010000:0.0:1651532202.488974:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d35:0x0] initial LVB size: 4194304, mtime: 0x627061a9, atime: 0x0, ctime: 0x627061a9, blocks: 0x2000
00010000:00010000:1.0:1651532202.488982:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532202.488982:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532202.488983:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532202.488983:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532202.488987:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4175a7 lrc: 3/0,0 mode: PR/PR res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcab expref: 12 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532202.488987:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4175a0 lrc: 3/0,0 mode: PR/PR res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fca4 expref: 12 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532202.488993:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4175a7 lrc: 3/0,0 mode: PR/PR res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcab expref: 12 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532202.488993:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4175a0 lrc: 3/0,0 mode: PR/PR res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fca4 expref: 12 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532202.488998:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6be4665, rc 0)
00010000:00010000:0.0:1651532202.488998:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9816573, rc 0)
00000100:00100000:1.0:1651532202.489014:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469060800:12345-10.240.43.64@tcp:101:rm.0 Request processed in 55us (96us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532202.489017:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6815
00000100:00100000:0.0:1651532202.489020:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469060736:12345-10.240.43.64@tcp:101:rm.0 Request processed in 66us (113us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532202.489023:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6814
00000100:00100000:0.0:1651532202.692871:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.692889:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469061952
00000100:00100000:0.0:1651532202.692915:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6816
00000100:00100000:0.0:1651532202.692918:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:684007:x1731754469061952:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532202.692928:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532202.692949:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4175ae lrc: 2/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fcd5 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532202.692961:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532202.692971:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532202.692972:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532202.692975:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4175ae lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcd5 expref: 12 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.692983:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4175ae lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcd5 expref: 12 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.692988:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00000100:00100000:0.0:1651532202.693015:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:684007:x1731754469061952:12345-10.240.43.64@tcp:101:dd.0 Request processed in 97us (147us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532202.693019:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6816
00000100:00100000:0.0:1651532202.693252:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.693260:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062016
00000100:00100000:0.0:1651532202.693273:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6817
00000100:00100000:0.0:1651532202.693275:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:684007:x1731754469062016:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532202.693279:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532202.693284:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4175b5 lrc: 2/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fcdc expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532202.693292:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532202.693297:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532202.693297:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532202.693299:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4175b5 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcdc expref: 13 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.693303:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4175b5 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcdc expref: 13 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532202.693307:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b7f071c, rc 0)
00000100:00100000:0.0:1651532202.693322:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:684007:x1731754469062016:12345-10.240.43.64@tcp:101:dd.0 Request processed in 46us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532202.693325:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6817
00000100:00100000:0.0:1651532202.693570:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.693593:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532202.693594:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062080
00002000:00010000:1.0:1651532202.693612:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216375/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532202.693614:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000042fc7b82 with x1731754469062080 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532202.693619:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000042fc7b82.
00000100:00100000:1.0:1651532202.693626:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062144
00002000:00010000:1.0:1651532202.693629:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216376/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532202.693629:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000998a5f5f with x1731754469062144 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532202.693631:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000998a5f5f.
00000100:00100000:1.0:1651532202.693637:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5497
00000100:00100000:1.0:1651532202.693639:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469062080:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532202.693705:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532202.693707:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb mtime from disk: 0 -> 1651532202
00002000:00010000:1.0:1651532202.693708:0:330058:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532202.693709:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb ctime from disk: 0 -> 1651532202
00002000:00010000:1.0:1651532202.693710:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532202.693725:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042fc7b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469062080:12345-10.240.43.64@tcp:10:dd.0 Request processed in 85us (155us total) trans 158913794418 rc 0/0
00000100:00100000:1.0:1651532202.693728:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5497
00002000:00010000:1.0:1651532202.693729:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216375/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532202.693730:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000042fc7b82 with x1731754469062080 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532202.693732:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000042fc7b82.
00000100:00100000:1.0:1651532202.693738:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5498
00000100:00100000:1.0:1651532202.693740:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469062144:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532202.693762:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532202.693763:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb mtime from disk: 0 -> 1651532202
00002000:00010000:1.0:1651532202.693764:0:330058:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532202.693765:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb ctime from disk: 0 -> 1651532202
00002000:00010000:1.0:1651532202.693766:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532202.693773:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998a5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469062144:12345-10.240.43.64@tcp:10:dd.0 Request processed in 32us (180us total) trans 158913794419 rc 0/0
00000100:00100000:1.0:1651532202.693776:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5498
00002000:00010000:1.0:1651532202.693777:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216376/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532202.693778:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000998a5f5f with x1731754469062144 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532202.693780:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000998a5f5f.
00000100:00100000:0.0:1651532202.731130:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.731140:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.731150:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532202.731156:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062336
00000100:00100000:0.0:1651532202.731158:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.731166:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.731174:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532202.731182:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062464
00000100:00100000:0.0:1651532202.731185:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062592
00000100:00100000:1.0:1651532202.731189:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062272
00000100:00100000:1.0:1651532202.731194:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062400
00000100:00100000:0.0:1651532202.731198:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062528
00000100:00100000:1.0:1651532202.731204:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5499
00000100:00100000:1.0:1651532202.731206:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469062336:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:1.0:1651532202.731211:0:330281:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:0.0:1651532202.731211:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5500
00000100:00100000:0.0:1651532202.731213:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469062464:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:0.0:1651532202.731217:0:330280:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:0.0:1651532202.731223:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5501
00000100:00100000:0.0:1651532202.731224:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469062272:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:0.0:1651532202.731226:0:330282:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:0.0:1651532202.731231:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5502
00000100:00100000:0.0:1651532202.731232:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469062592:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:0.0:1651532202.731234:0:330057:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:0.0:1651532202.731238:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5503
00000100:00100000:0.0:1651532202.731239:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469062400:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:0.0:1651532202.731241:0:330278:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:0.0:1651532202.731252:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5504
00000100:00100000:0.0:1651532202.731253:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469062528:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:0.0:1651532202.731255:0:330055:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:0.0:1651532202.733321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.733340:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532202.733347:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062848
00000100:00100000:0.0:1651532202.733357:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062784
00000100:00100000:0.0:1651532202.733362:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5505
00000100:00100000:0.0:1651532202.733364:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa3ce2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754469062848:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:0.0:1651532202.733367:0:330279:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:0.0:1651532202.733370:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5506
00000100:00100000:0.0:1651532202.733372:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754469062784:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:0.0:1651532202.733374:0:330054:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000001:00020000:0.0:1651532204.812849:0:330055:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00000001:00020000:1.0:1651532204.812854:0:330282:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00010000:00010000:1.0:1651532204.812868:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.812878:0:330282:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4175ae lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcd5 expref: 22 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.812886:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.812887:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.812887:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 4/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.812902:0:330282:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4175ae lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcd5 expref: 22 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.812908:0:330282:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4175ae lrc: 4/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcd5 expref: 22 pid: 328039 timeout: 15954 lvb_type: 0
00000100:00100000:1.0:1651532204.812914:0:330282:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000062a8af64 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_012:lustre-OST0000_UUID:330282:1731745966864384:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532204.812942:0:330282:0:(client.c:2492:ptlrpc_set_wait()) set 0000000030f0bbe2 going to sleep for 6 seconds
00000001:00020000:1.0:1651532204.812947:0:330279:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00010000:00010000:1.0:1651532204.812952:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.812957:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4175b5 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcdc expref: 22 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.812960:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.812961:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.812961:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 4/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.812968:0:330279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4175b5 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcdc expref: 22 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.812975:0:330279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4175b5 lrc: 4/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcdc expref: 22 pid: 328039 timeout: 15954 lvb_type: 0
00000100:00100000:1.0:1651532204.812979:0:330279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047562140 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:330279:1731745966864448:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532204.812986:0:330279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b60669ec going to sleep for 6 seconds
00000001:00020000:1.0:1651532204.812989:0:330280:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00010000:00010000:1.0:1651532204.812993:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.812996:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.812997:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.812998:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.813001:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000001:00020000:1.0:1651532204.813005:0:330281:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00010000:00010000:1.0:1651532204.813008:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.813011:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.813012:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.813012:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.813015:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00020000:1.0:1651532204.813026:0:330057:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00010000:00010000:1.0:1651532204.813029:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.813032:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.813033:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.813033:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.813036:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00020000:1.0:1651532204.813040:0:330054:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00010000:00010000:1.0:1651532204.813042:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.813045:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.813046:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.813046:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.813049:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00020000:1.0:1651532204.813054:0:330278:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00010000:00010000:1.0:1651532204.813057:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.813060:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.813060:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532204.813061:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.813064:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.816506:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.816516:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532204.816517:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532204.816518:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.816521:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532204.816938:0:330282:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000062a8af64 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_012:lustre-OST0000_UUID:330282:1731745966864384:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532204.816938:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532204.816945:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532204.816948:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532204.816958:0:330279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047562140 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:330279:1731745966864448:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532204.816958:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469062976
00010000:00010000:1.0:1651532204.816961:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.816967:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4175ae lrc: 4/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcd5 expref: 23 pid: 328039 timeout: 15954 lvb_type: 0
00000100:00100000:1.0:1651532204.816970:0:323263:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469063040
00010000:00010000:1.0:1651532204.816975:0:323263:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4175b5 lrc: 4/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcdc expref: 24 pid: 328039 timeout: 15954 lvb_type: 0
00000100:00100000:0.0:1651532204.816978:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 298
00000100:00100000:0.0:1651532204.816980:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438147:x1731754469062976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00000100:00100000:1.0:1651532204.816989:0:323263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 299
00000100:00100000:1.0:1651532204.816991:0:323263:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754469063040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651532204.816991:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532204.816995:0:323263:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532204.816999:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4175ae lrc: 4/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcd5 expref: 24 pid: 328039 timeout: 15954 lvb_type: 0
00010000:00010000:1.0:1651532204.817000:0:323263:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4175b5 lrc: 4/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcdc expref: 24 pid: 328039 timeout: 15954 lvb_type: 0
00010000:00010000:0.0:1651532204.817004:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4175ae lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcd5 expref: 24 pid: 328039 timeout: 15954 lvb_type: 0
00010000:00010000:1.0:1651532204.817005:0:323263:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4175b5 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcdc expref: 24 pid: 328039 timeout: 15954 lvb_type: 0
00010000:00010000:0.0:1651532204.817013:0:323261:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4175ae lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcd5 expref: 24 pid: 328039 timeout: 15954 lvb_type: 0
00010000:00010000:1.0:1651532204.817014:0:323263:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4175b5 lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcdc expref: 24 pid: 328039 timeout: 15954 lvb_type: 0
00010000:00010000:1.0:1651532204.817018:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532204.817019:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532204.817020:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817020:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532204.817020:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532204.817021:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817024:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 4/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817025:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 4/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817028:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532204.817028:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532204.817028:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532204.817029:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817029:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532204.817029:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817031:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 4/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817032:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 4/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817034:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532204.817034:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532204.817035:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817035:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532204.817035:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532204.817036:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817038:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 4/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817039:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 4/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817040:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532204.817041:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532204.817041:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532204.817042:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817042:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532204.817042:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817045:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 4/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817045:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 4/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817054:0:323263:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532204.817058:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532204.817070:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754469062976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 89us (133us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532204.817071:0:323263:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec21899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469063040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 78us (122us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532204.817073:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 298
00000100:00100000:1.0:1651532204.817075:0:323263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 299
00010000:00010000:1.0:1651532204.817092:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817096:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817107:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817111:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817315:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817319:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817347:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817351:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817534:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817538:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817602:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532204.817607:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817729:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817734:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817960:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532204.817971:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532205.220495:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794420 is committed
00002000:00010000:1.0:1651532205.220611:0:330278:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:1.0:1651532205.220613:0:330278:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:1.0:1651532205.220619:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.220626:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.220673:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093443a8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438146:x1731754469062400:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2489431us (2489505us total) trans 158913794420 rc 0/0
00000100:00100000:1.0:1651532205.220679:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5503
00010000:00010000:1.0:1651532205.220693:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.220697:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532205.220698:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.220705:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.220715:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 1/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.220718:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4175e6 lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532205.257637:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794427 is committed
00010000:00010000:1.0:1651532205.257673:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257677:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.257705:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061b08122 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754469062784:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2524332us (2524364us total) trans 158913794424 rc 0/0
00010000:00010000:0.0:1651532205.257707:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.257709:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5506
00010000:00010000:0.0:1651532205.257714:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532205.257715:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257720:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257727:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 1/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257730:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4175df lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532205.257735:0:330280:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:1.0:1651532205.257736:0:330280:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:1.0:1651532205.257739:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257742:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.257761:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f32e66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754469062464:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2526547us (2526621us total) trans 158913794426 rc 0/0
00010000:00010000:0.0:1651532205.257769:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257773:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532205.257774:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257777:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257781:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 1/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257784:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4175ca lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.257787:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5500
00010000:00010000:1.0:1651532205.257832:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257836:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.257852:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f79d7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754469062592:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2526619us (2526702us total) trans 158913794421 rc 0/0
00000100:00100000:1.0:1651532205.257855:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5502
00010000:00010000:0.0:1651532205.257859:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257861:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257864:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532205.257866:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257866:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257869:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257874:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 1/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257877:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4175d8 lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257881:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257883:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532205.257884:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257887:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532205.257888:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abdc55f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469062272:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2526662us (2526729us total) trans 158913794425 rc 0/0
00010000:00010000:1.0:1651532205.257890:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 1/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532205.257892:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5501
00010000:00010000:1.0:1651532205.257893:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175bc lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257923:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.257927:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.257944:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa3ce2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469062848:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2524580us (2524623us total) trans 158913794423 rc 0/0
00000100:00100000:1.0:1651532205.257948:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5505
00010000:00010000:0.0:1651532205.257950:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257954:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532205.257972:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c2e3b49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469062528:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2526718us (2526797us total) trans 158913794422 rc 0/0
00000100:00100000:0.0:1651532205.257975:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5504
00010000:00010000:0.0:1651532205.257983:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257986:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532205.257987:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257990:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257995:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 1/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.257998:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4175c3 lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.258001:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.258004:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532205.258005:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.258007:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.258011:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 1/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.258013:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175ed lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.258040:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.258046:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.258068:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003544a27f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754469062336:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2526861us (2526940us total) trans 158913794427 rc 0/0
00000100:00100000:1.0:1651532205.258071:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5499
00010000:00010000:0.0:1651532205.258078:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.258082:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532205.258083:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.258086:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.258091:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 1/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.258094:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f4175d1 lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.282856:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532205.282871:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532205.282879:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532205.282882:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235648
00000100:00100000:1.0:1651532205.282886:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532205.282894:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235840
00000100:00100000:0.0:1651532205.282895:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235968
00000100:00100000:0.0:1651532205.282898:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235904
00000100:00100000:0.0:1651532205.282903:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6818
00000100:00100000:0.0:1651532205.282905:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951235648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00000100:00100000:1.0:1651532205.282907:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6819
00000100:00100000:1.0:1651532205.282909:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047562140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745951235968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:1.0:1651532205.282918:0:323273:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216373 count 1
00002000:00080000:0.0:1651532205.282918:0:328039:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216369 count 1
00010000:00010000:1.0:1651532205.282925:0:323273:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 3/0,1 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.282925:0:328039:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 3/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.282933:0:323273:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4175a0 lrc: 2/0,0 mode: PR/PR res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fca4 expref: 10 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532205.282933:0:328039:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417553 lrc: 2/0,0 mode: PR/PR res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb85 expref: 10 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532205.282937:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.282937:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532205.282938:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.282938:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532205.282939:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 4/0,1 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.282939:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 4/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.282951:0:323273:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4175a0 lrc: 3/0,0 mode: PR/PR res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fca4 expref: 10 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532205.282951:0:328039:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417553 lrc: 3/0,0 mode: PR/PR res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb85 expref: 10 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532205.282957:0:328039:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417553 lrc: 4/0,0 mode: PR/PR res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb85 expref: 10 pid: 328039 timeout: 15954 lvb_type: 1
00010000:00010000:1.0:1651532205.282959:0:323273:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4175a0 lrc: 4/0,0 mode: PR/PR res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fca4 expref: 10 pid: 328039 timeout: 15954 lvb_type: 1
00000100:00100000:1.0:1651532205.282965:0:323273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000559fc8e2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966864576:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532205.282966:0:328039:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001404cba pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966864512:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532205.282985:0:328039:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e2a26397 going to sleep for 6 seconds
00000100:00100000:1.0:1651532205.282986:0:323273:0:(client.c:2492:ptlrpc_set_wait()) set 000000005a985280 going to sleep for 6 seconds
00000100:00100000:1.0:1651532205.292683:0:323273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000559fc8e2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966864576:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532205.292684:0:328039:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001404cba pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966864512:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532205.292690:0:323273:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 3/0,1 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.292690:0:328039:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 3/0,1 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532205.292769:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532205.292783:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532205.292791:0:323263:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469063360
00000100:00100000:0.0:1651532205.292792:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469063424
00010000:00010000:1.0:1651532205.292799:0:323263:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417553 lrc: 4/0,0 mode: PR/PR res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb85 expref: 12 pid: 328039 timeout: 15954 lvb_type: 1
00010000:00010000:0.0:1651532205.292799:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4175a0 lrc: 4/0,0 mode: PR/PR res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fca4 expref: 12 pid: 328039 timeout: 15954 lvb_type: 1
00000100:00100000:1.0:1651532205.292822:0:323263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 300
00000100:00100000:1.0:1651532205.292824:0:323263:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469063360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00000100:00100000:0.0:1651532205.292828:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 301
00010000:00010000:1.0:1651532205.292829:0:323263:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532205.292830:0:323263:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417553 lrc: 4/0,0 mode: PR/PR res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb85 expref: 12 pid: 328039 timeout: 15954 lvb_type: 1
00000100:00100000:0.0:1651532205.292830:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469063424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651532205.292834:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532205.292835:0:323263:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417553 lrc: 3/0,0 mode: PR/PR res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb85 expref: 12 pid: 328039 timeout: 15954 lvb_type: 1
00010000:00010000:0.0:1651532205.292836:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4175a0 lrc: 4/0,0 mode: PR/PR res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fca4 expref: 12 pid: 328039 timeout: 15954 lvb_type: 1
00010000:00010000:0.0:1651532205.292840:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4175a0 lrc: 3/0,0 mode: PR/PR res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fca4 expref: 12 pid: 328039 timeout: 15954 lvb_type: 1
00010000:00010000:1.0:1651532205.292843:0:323263:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417553 lrc: 0/0,0 mode: --/PR res: [0x34d31:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb85 expref: 12 pid: 328039 timeout: 15954 lvb_type: 1
00010000:00010000:0.0:1651532205.292846:0:323259:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4175a0 lrc: 0/0,0 mode: --/PR res: [0x34d35:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fca4 expref: 12 pid: 328039 timeout: 15954 lvb_type: 1
00010000:00010000:1.0:1651532205.292850:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532205.292851:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532205.292852:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.292853:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.292853:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.292854:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.292856:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 4/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.292859:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 4/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.292865:0:323263:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532205.292878:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532205.292881:0:323263:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469063360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (107us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532205.292884:0:323263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 300
00000100:00100000:0.0:1651532205.292887:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469063424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (104us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532205.292890:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 301
00010000:00010000:1.0:1651532205.292892:0:323273:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.292895:0:323273:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.292899:0:323273:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 3/0,1 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.292901:0:323273:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 2/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.292901:0:328039:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.292905:0:328039:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.292910:0:328039:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 3/0,1 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.292913:0:328039:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.293395:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047562140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745951235968:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 10484us (10514us total) trans 158913794429 rc 0/0
00000100:00100000:1.0:1651532205.293398:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6819
00000100:00100000:1.0:1651532205.293405:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6820
00000100:00100000:1.0:1651532205.293406:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745951235840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:1.0:1651532205.293412:0:323273:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216371 count 1
00010000:00010000:1.0:1651532205.293417:0:323273:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 3/0,1 mode: --/PW res: [0x34d33:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293422:0:323273:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417568 lrc: 2/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc2d expref: 8 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293426:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532205.293426:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532205.293427:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 4/0,1 mode: --/PW res: [0x34d33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293434:0:323273:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417568 lrc: 3/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc2d expref: 8 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293438:0:323273:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417568 lrc: 4/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc2d expref: 8 pid: 323276 timeout: 15954 lvb_type: 0
00000100:00100000:1.0:1651532205.293443:0:323273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000559fc8e2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966864640:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532205.293452:0:323273:0:(client.c:2492:ptlrpc_set_wait()) set 000000005a985280 going to sleep for 6 seconds
00010000:00010000:1.0:1651532205.293458:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 2/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293461:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532205.293462:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 2/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293466:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 3/0,0 mode: PW/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293470:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 1/0,0 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293473:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f4175fb lrc: 0/0,0 mode: --/PW res: [0x34d35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293478:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293481:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532205.293481:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 2/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293484:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 3/0,0 mode: PW/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293487:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 1/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.293490:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4175f4 lrc: 0/0,0 mode: --/PW res: [0x34d31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.294258:0:323273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000559fc8e2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966864640:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532205.294263:0:323273:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 3/0,1 mode: --/PW res: [0x34d33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.295238:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532205.295668:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745951235648:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 12762us (12812us total) trans 158913794428 rc 0/0
00000100:00100000:0.0:1651532205.295672:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6818
00000100:00100000:0.0:1651532205.295678:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6821
00000100:00100000:0.0:1651532205.295680:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951235904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:0.0:1651532205.295686:0:328039:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216372 count 1
00010000:00010000:0.0:1651532205.295691:0:328039:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 3/0,1 mode: --/PW res: [0x34d34:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.295697:0:328039:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41756f lrc: 2/0,0 mode: PR/PR res: [0x34d34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc5e expref: 8 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532205.295701:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.295702:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.295702:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 4/0,1 mode: --/PW res: [0x34d34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.295708:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469063488
00010000:00010000:0.0:1651532205.295710:0:328039:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41756f lrc: 3/0,0 mode: PR/PR res: [0x34d34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc5e expref: 9 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532205.295714:0:328039:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41756f lrc: 4/0,0 mode: PR/PR res: [0x34d34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc5e expref: 9 pid: 323276 timeout: 15954 lvb_type: 1
00010000:00010000:1.0:1651532205.295715:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417568 lrc: 4/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc2d expref: 9 pid: 323276 timeout: 15954 lvb_type: 0
00000100:00100000:0.0:1651532205.295718:0:328039:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d3e95e17 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966864704:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532205.295727:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 302
00000100:00100000:1.0:1651532205.295729:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469063488:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651532205.295732:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532205.295734:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417568 lrc: 4/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc2d expref: 9 pid: 323276 timeout: 15954 lvb_type: 0
00010000:00010000:1.0:1651532205.295738:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417568 lrc: 3/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc2d expref: 9 pid: 323276 timeout: 15954 lvb_type: 0
00010000:00010000:1.0:1651532205.295749:0:323261:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417568 lrc: 0/0,0 mode: --/PW res: [0x34d33:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc2d expref: 9 pid: 323276 timeout: 15954 lvb_type: 0
00010000:00010000:1.0:1651532205.295753:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532205.295754:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532205.295754:0:328039:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d33e8e7f going to sleep for 6 seconds
00010000:00010000:1.0:1651532205.295755:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 3/0,1 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.295758:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 4/0,1 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.295767:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532205.295775:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469063488:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 45us (537us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532205.295778:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 302
00010000:00010000:1.0:1651532205.295784:0:323273:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 3/0,1 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.295824:0:323273:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 3/0,1 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.295828:0:323273:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 3/0,1 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.295831:0:323273:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 2/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.295842:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 2/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.295846:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532205.295848:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 2/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.295851:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 3/0,0 mode: PW/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.295857:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 1/0,0 mode: --/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.295860:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417602 lrc: 0/0,0 mode: --/PW res: [0x34d33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.298521:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745951235840:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 5113us (15649us total) trans 158913794430 rc 0/0
00000100:00100000:1.0:1651532205.298525:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6820
00000100:00100000:0.0:1651532205.298558:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532205.298572:0:328039:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d3e95e17 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966864704:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532205.298577:0:328039:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 3/0,1 mode: --/PW res: [0x34d34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.298582:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469063552
00010000:00010000:1.0:1651532205.298588:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41756f lrc: 4/0,0 mode: PR/PR res: [0x34d34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc5e expref: 8 pid: 323276 timeout: 15954 lvb_type: 1
00000100:00100000:1.0:1651532205.298600:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 303
00000100:00100000:1.0:1651532205.298602:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469063552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651532205.298607:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532205.298608:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41756f lrc: 4/0,0 mode: PR/PR res: [0x34d34:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc5e expref: 8 pid: 323276 timeout: 15954 lvb_type: 1
00010000:00010000:1.0:1651532205.298612:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41756f lrc: 3/0,0 mode: PR/PR res: [0x34d34:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc5e expref: 8 pid: 323276 timeout: 15954 lvb_type: 1
00010000:00010000:1.0:1651532205.298618:0:323261:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41756f lrc: 0/0,0 mode: --/PR res: [0x34d34:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc5e expref: 8 pid: 323276 timeout: 15954 lvb_type: 1
00010000:00010000:1.0:1651532205.298622:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532205.298622:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532205.298623:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 3/0,1 mode: PW/PW res: [0x34d34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.298626:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 4/0,1 mode: PW/PW res: [0x34d34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.298635:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532205.298637:0:328039:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 3/0,1 mode: PW/PW res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.298642:0:328039:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 3/0,1 mode: PW/PW res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.298645:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469063552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (88us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532205.298648:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 303
00010000:00010000:0.0:1651532205.298650:0:328039:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 3/0,1 mode: PW/PW res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.298653:0:328039:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 2/0,0 mode: PW/PW res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.298679:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 2/0,0 mode: PW/PW res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.298683:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a925ecb already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532205.298684:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 2/0,0 mode: PW/PW res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.298687:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 3/0,0 mode: PW/PW res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.298692:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 1/0,0 mode: --/PW res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.298694:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417609 lrc: 0/0,0 mode: --/PW res: [0x34d34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532205.298723:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745951235904:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3042us (15836us total) trans 158913794431 rc 0/0
00000100:00100000:0.0:1651532205.298727:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6821
00000100:00100000:0.0:1651532205.301164:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532205.301171:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469063872
00000100:00100000:0.0:1651532205.301186:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6822
00000100:00100000:0.0:1651532205.301188:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:684021:x1731754469063872:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532205.301193:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532205.301198:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417610 lrc: 2/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fcea expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532205.301204:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d37:0x0] initial LVB size: 4194304, mtime: 0x627061aa, atime: 0x0, ctime: 0x627061aa, blocks: 0x2000
00010000:00010000:0.0:1651532205.301210:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.301210:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.301212:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417610 lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcea expref: 8 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.301217:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417610 lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcea expref: 8 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.301221:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9816573, rc 0)
00000100:00100000:0.0:1651532205.301236:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:684021:x1731754469063872:12345-10.240.43.64@tcp:101:dd.0 Request processed in 47us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532205.301239:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6822
00000100:00100000:0.0:1651532205.301484:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532205.301493:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469063936
00000100:00100000:0.0:1651532205.301504:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6823
00000100:00100000:0.0:1651532205.301506:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:684021:x1731754469063936:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532205.301510:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532205.301514:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417617 lrc: 2/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fcf1 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532205.301518:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d38:0x0] initial LVB size: 4194304, mtime: 0x627061aa, atime: 0x0, ctime: 0x627061aa, blocks: 0x2000
00010000:00010000:0.0:1651532205.301522:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.301523:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.301525:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417617 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcf1 expref: 9 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.301529:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417617 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcf1 expref: 9 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.301533:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00000100:00100000:0.0:1651532205.301547:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:684021:x1731754469063936:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (63us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532205.301549:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6823
00000100:00100000:0.0:1651532205.301769:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532205.301781:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532205.301790:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469064000
00000100:00100000:0.0:1651532205.301790:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469064064
00002000:00010000:1.0:1651532205.301796:0:330281:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216375/0 (0->18446744073709551615)
00002000:00010000:0.0:1651532205.301796:0:330055:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216376/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532205.301797:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c4ccf174 with x1731754469064000 ext(0->18446744073709551615)
00002000:00100000:0.0:1651532205.301797:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d1b9b597 with x1731754469064064 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532205.301800:0:330055:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d1b9b597.
00002000:00010000:1.0:1651532205.301801:0:330281:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c4ccf174.
00000100:00100000:1.0:1651532205.301818:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5507
00000100:00100000:1.0:1651532205.301820:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469064000:12345-10.240.43.64@tcp:10:dd.0
00000100:00100000:0.0:1651532205.301821:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5508
00000100:00100000:0.0:1651532205.301823:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b9b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469064064:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532205.302202:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb size from disk: 4194304 -> 0
00002000:00010000:1.0:1651532205.302204:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb mtime from disk: 1651532202 -> 1651532205
00002000:00010000:1.0:1651532205.302205:0:330281:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532205.302205:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb size from disk: 4194304 -> 0
00002000:00010000:1.0:1651532205.302206:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb ctime from disk: 1651532202 -> 1651532205
00002000:00010000:1.0:1651532205.302207:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb blocks from disk: 8192 -> 0
00002000:00010000:0.0:1651532205.302207:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb mtime from disk: 1651532202 -> 1651532205
00002000:00010000:0.0:1651532205.302208:0:330055:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532205.302209:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb ctime from disk: 1651532202 -> 1651532205
00002000:00010000:0.0:1651532205.302210:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb blocks from disk: 8192 -> 0
00000100:00100000:1.0:1651532205.302219:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ccf174 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469064000:12345-10.240.43.64@tcp:10:dd.0 Request processed in 398us (450us total) trans 158913794432 rc 0/0
00000100:00100000:0.0:1651532205.302219:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b9b597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469064064:12345-10.240.43.64@tcp:10:dd.0 Request processed in 395us (437us total) trans 158913794433 rc 0/0
00000100:00100000:1.0:1651532205.302222:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5507
00002000:00010000:1.0:1651532205.302224:0:330281:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216375/0 (0->18446744073709551615)
00000100:00100000:0.0:1651532205.302224:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5508
00002000:00100000:1.0:1651532205.302225:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c4ccf174 with x1731754469064000 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532205.302225:0:330055:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216376/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532205.302226:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d1b9b597 with x1731754469064064 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532205.302228:0:330055:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d1b9b597.
00002000:00010000:1.0:1651532205.302236:0:330281:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c4ccf174.
00000100:00100000:0.0:1651532205.338515:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532205.338539:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469064192
00000100:00100000:1.0:1651532205.338558:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5509
00000100:00100000:1.0:1651532205.338561:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754469064192:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:1.0:1651532205.338565:0:330281:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:1.0:1651532207.328156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532207.328168:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236096
00000100:00100000:1.0:1651532207.328186:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 77
00000100:00100000:1.0:1651532207.328188:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745951236096:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532207.328199:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 5365760 granted 350768832 pending 0 free 81176596480 avail 77005885440
00000100:00100000:1.0:1651532207.328219:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096be24eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745951236096:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 30us (65us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532207.328222:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 77
00000001:00020000:1.0:1651532207.420841:0:330281:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00010000:00010000:1.0:1651532207.422648:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.422658:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417610 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcea expref: 11 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.422662:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532207.422663:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532207.422664:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 4/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.422677:0:330281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417610 lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcea expref: 11 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.422686:0:330281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417610 lrc: 4/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcea expref: 11 pid: 328039 timeout: 15957 lvb_type: 0
00000100:00100000:1.0:1651532207.422692:0:330281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004eea19a9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:330281:1731745966864768:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532207.422710:0:330281:0:(client.c:2492:ptlrpc_set_wait()) set 000000005a985280 going to sleep for 6 seconds
00000100:00100000:0.0:1651532207.423051:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532207.423061:0:330281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004eea19a9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:330281:1731745966864768:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532207.423068:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532207.423076:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469064256
00010000:00010000:1.0:1651532207.423083:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417610 lrc: 4/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcea expref: 12 pid: 328039 timeout: 15957 lvb_type: 0
00000100:00100000:1.0:1651532207.423098:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 304
00000100:00100000:1.0:1651532207.423101:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469064256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651532207.423104:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532207.423111:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417610 lrc: 4/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcea expref: 12 pid: 328039 timeout: 15957 lvb_type: 0
00010000:00010000:1.0:1651532207.423115:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417610 lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcea expref: 12 pid: 328039 timeout: 15957 lvb_type: 0
00010000:00010000:1.0:1651532207.423124:0:323261:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417610 lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcea expref: 12 pid: 328039 timeout: 15957 lvb_type: 0
00010000:00010000:1.0:1651532207.423131:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532207.423131:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532207.423133:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.423136:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 4/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.423143:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532207.423153:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469064256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (104us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532207.423156:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 304
00010000:00010000:1.0:1651532207.423184:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.423196:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532207.559403:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794434 is committed
00000001:00080000:1.0:1651532207.559409:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794431 is committed
00002000:00010000:1.0:1651532207.559434:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb size from disk: 0 -> 1048576
00002000:00010000:1.0:1651532207.559436:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb blocks from disk: 0 -> 2048
00010000:00010000:1.0:1651532207.559440:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.559445:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532207.559476:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf2d45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469064192:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2220913us (2220961us total) trans 158913794434 rc 0/0
00000100:00100000:1.0:1651532207.559480:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5509
00010000:00010000:1.0:1651532207.559489:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.559493:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532207.559495:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.559498:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.559503:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 1/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532207.559506:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41761e lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532207.560077:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532207.560086:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469064384
00000100:00100000:1.0:1651532207.560105:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5510
00000100:00100000:1.0:1651532207.560107:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469064384:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:1.0:1651532207.560111:0:330281:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000001:00020000:1.0:1651532209.644822:0:330281:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00010000:00010000:1.0:1651532209.646616:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.646627:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417617 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcf1 expref: 8 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.646631:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532209.646632:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532209.646633:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 4/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.646644:0:330281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417617 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcf1 expref: 8 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.646649:0:330281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417617 lrc: 4/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcf1 expref: 8 pid: 328039 timeout: 15959 lvb_type: 0
00000100:00100000:1.0:1651532209.646654:0:330281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea8b3a9b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:330281:1731745966864832:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532209.646676:0:330281:0:(client.c:2492:ptlrpc_set_wait()) set 000000005a985280 going to sleep for 6 seconds
00000100:00100000:1.0:1651532209.646993:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532209.647001:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469064448
00010000:00010000:1.0:1651532209.647008:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417617 lrc: 5/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcf1 expref: 9 pid: 328039 timeout: 15959 lvb_type: 0
00000100:00100000:1.0:1651532209.647024:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 305
00000100:00100000:1.0:1651532209.647027:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469064448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651532209.647031:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532209.647036:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417617 lrc: 5/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcf1 expref: 9 pid: 328039 timeout: 15959 lvb_type: 0
00010000:00010000:1.0:1651532209.647043:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417617 lrc: 4/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcf1 expref: 9 pid: 328039 timeout: 15959 lvb_type: 0
00010000:00010000:1.0:1651532209.647051:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532209.647051:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532209.647052:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.647055:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 4/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.647061:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532209.647076:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469064448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532209.647079:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 305
00010000:00010000:1.0:1651532209.647091:0:330281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417617 lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcf1 expref: 8 pid: 328039 timeout: 15959 lvb_type: 0
00000100:00100000:1.0:1651532209.647096:0:330281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea8b3a9b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:330281:1731745966864832:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532209.647100:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.647113:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.647116:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532209.731662:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794435 is committed
00002000:00010000:1.0:1651532209.731690:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb size from disk: 0 -> 1048576
00002000:00010000:1.0:1651532209.731692:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb mtime from disk: 1651532205 -> 1651532207
00002000:00010000:1.0:1651532209.731693:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb ctime from disk: 1651532205 -> 1651532207
00002000:00010000:1.0:1651532209.731694:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb blocks from disk: 0 -> 2048
00010000:00010000:1.0:1651532209.731697:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.731701:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532209.731728:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004eea19a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469064384:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2171619us (2171650us total) trans 158913794435 rc 0/0
00000100:00100000:1.0:1651532209.731732:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5510
00010000:00010000:1.0:1651532209.731740:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.731744:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532209.731746:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.731749:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.731754:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 1/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532209.731760:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417625 lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532209.732244:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532209.732252:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469064576
00000100:00100000:1.0:1651532209.732272:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5511
00000100:00100000:1.0:1651532209.732274:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469064576:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:1.0:1651532209.732277:0:330281:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:0.0:1651532211.466938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532211.466948:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236352
00000100:00100000:0.0:1651532211.466966:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6824
00000100:00100000:0.0:1651532211.466968:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951236352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:0.0:1651532211.466976:0:328039:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216374 count 1
00010000:00010000:0.0:1651532211.466984:0:328039:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 3/0,1 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532211.466992:0:328039:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4175a7 lrc: 2/0,0 mode: PR/PR res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcab expref: 7 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532211.466996:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532211.466997:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532211.466998:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 4/0,1 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532211.467008:0:328039:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4175a7 lrc: 3/0,0 mode: PR/PR res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcab expref: 7 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532211.467012:0:328039:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4175a7 lrc: 4/0,0 mode: PR/PR res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcab expref: 7 pid: 323276 timeout: 15961 lvb_type: 1
00000100:00100000:0.0:1651532211.467018:0:328039:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078cad74e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966864896:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532211.467038:0:328039:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d33e8e7f going to sleep for 6 seconds
00000100:00100000:0.0:1651532211.467302:0:328039:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078cad74e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966864896:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532211.467308:0:328039:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 3/0,1 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532211.467421:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532211.467431:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469064896
00010000:00010000:1.0:1651532211.467440:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4175a7 lrc: 4/0,0 mode: PR/PR res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcab expref: 8 pid: 323276 timeout: 15961 lvb_type: 1
00000100:00100000:1.0:1651532211.467457:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 306
00000100:00100000:1.0:1651532211.467459:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf059cd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469064896:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651532211.467464:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532211.467465:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4175a7 lrc: 4/0,0 mode: PR/PR res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcab expref: 8 pid: 323276 timeout: 15961 lvb_type: 1
00010000:00010000:1.0:1651532211.467470:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4175a7 lrc: 3/0,0 mode: PR/PR res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcab expref: 8 pid: 323276 timeout: 15961 lvb_type: 1
00010000:00010000:1.0:1651532211.467478:0:323261:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4175a7 lrc: 0/0,0 mode: --/PR res: [0x34d36:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcab expref: 8 pid: 323276 timeout: 15961 lvb_type: 1
00010000:00010000:1.0:1651532211.467485:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532211.467486:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532211.467487:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467490:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 4/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467500:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532211.467505:0:328039:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532211.467512:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf059cd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469064896:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 52us (92us total) trans 0 rc 0/0
00010000:00010000:0.0:1651532211.467514:0:328039:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532211.467515:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 306
00010000:00010000:0.0:1651532211.467518:0:328039:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 3/0,1 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532211.467521:0:328039:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 2/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467543:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 2/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467547:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532211.467549:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 2/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467552:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 3/0,0 mode: PW/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467556:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 1/0,0 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467560:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41762c lrc: 0/0,0 mode: --/PW res: [0x34d36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532211.467997:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951236352:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1027us (1059us total) trans 158913794436 rc 0/0
00000100:00100000:0.0:1651532211.468001:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6824
00000001:00020000:1.0:1651532211.812836:0:330281:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00002000:00010000:1.0:1651532211.814700:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d37:0x0] initial LVB size: 1048576, mtime: 0x627061ad, atime: 0x0, ctime: 0x627061ad, blocks: 0x800
00010000:00010000:1.0:1651532211.814703:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417633 lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.814708:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532211.814708:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532211.814709:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417633 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.814713:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417633 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532212.016239:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794437 is committed
00000001:00080000:1.0:1651532212.016243:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794436 is committed
00002000:00010000:1.0:1651532212.016274:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb size from disk: 1048576 -> 2097152
00002000:00010000:1.0:1651532212.016276:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb mtime from disk: 1651532205 -> 1651532209
00002000:00010000:1.0:1651532212.016277:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb ctime from disk: 1651532205 -> 1651532209
00002000:00010000:1.0:1651532212.016277:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb blocks from disk: 2048 -> 4096
00010000:00010000:1.0:1651532212.016281:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417633 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532212.016286:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417633 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532212.016308:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8b3a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469064576:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2284033us (2284064us total) trans 158913794437 rc 0/0
00000100:00100000:1.0:1651532212.016314:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5511
00010000:00010000:1.0:1651532212.016322:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417633 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532212.016326:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532212.016327:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417633 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532212.016331:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417633 lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532212.016336:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417633 lrc: 1/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532212.016339:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417633 lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532212.016878:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532212.016886:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469065024
00000100:00100000:1.0:1651532212.016915:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5512
00000100:00100000:1.0:1651532212.016918:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469065024:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:1.0:1651532212.016921:0:330281:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:1.0:1651532212.448099:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532212.448109:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236480
00000100:00100000:1.0:1651532212.448123:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 78
00000100:00100000:1.0:1651532212.448125:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951236480:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532212.448133:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350621376 pending 0 free 81178693632 avail 77006909440
00000100:00100000:1.0:1651532212.448146:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000688cfc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951236480:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 20us (48us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532212.448149:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 78
00000001:00020000:1.0:1651532214.100828:0:330281:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00002000:00010000:1.0:1651532214.100843:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d38:0x0] initial LVB size: 1048576, mtime: 0x627061af, atime: 0x0, ctime: 0x627061af, blocks: 0x800
00010000:00010000:1.0:1651532214.100846:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41763a lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532214.100852:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532214.100853:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532214.100855:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41763a lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532214.100860:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41763a lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532214.356748:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794438 is committed
00002000:00010000:1.0:1651532214.356781:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb size from disk: 1048576 -> 2097152
00002000:00010000:1.0:1651532214.356783:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb mtime from disk: 1651532207 -> 1651532212
00002000:00010000:1.0:1651532214.356784:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb ctime from disk: 1651532207 -> 1651532212
00002000:00010000:1.0:1651532214.356785:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb blocks from disk: 2048 -> 4096
00010000:00010000:1.0:1651532214.356789:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41763a lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532214.356794:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41763a lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532214.356829:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41763a lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532214.356836:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532214.356837:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41763a lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532214.356842:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41763a lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532214.356844:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003722c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469065024:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2339924us (2339965us total) trans 158913794438 rc 0/0
00000100:00100000:1.0:1651532214.356849:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5512
00010000:00010000:0.0:1651532214.356850:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41763a lrc: 1/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532214.356853:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41763a lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532214.357422:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532214.357432:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469065152
00000100:00100000:1.0:1651532214.357453:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5513
00000100:00100000:1.0:1651532214.357455:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469065152:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:1.0:1651532214.357460:0:330281:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000001:00020000:1.0:1651532216.444837:0:330281:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00002000:00010000:1.0:1651532216.448494:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d37:0x0] initial LVB size: 2097152, mtime: 0x627061b1, atime: 0x0, ctime: 0x627061b1, blocks: 0x1000
00010000:00010000:1.0:1651532216.448498:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417641 lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532216.448512:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532216.448512:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532216.448514:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417641 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532216.448519:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417641 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532216.585199:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794439 is committed
00002000:00010000:1.0:1651532216.585227:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb size from disk: 2097152 -> 3145728
00002000:00010000:1.0:1651532216.585228:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb mtime from disk: 1651532209 -> 1651532214
00002000:00010000:1.0:1651532216.585229:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb ctime from disk: 1651532209 -> 1651532214
00002000:00010000:1.0:1651532216.585230:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb blocks from disk: 4096 -> 6144
00010000:00010000:1.0:1651532216.585234:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417641 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532216.585239:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417641 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532216.585264:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417641 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532216.585268:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cb203b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469065152:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2227811us (2227845us total) trans 158913794439 rc 0/0
00010000:00010000:0.0:1651532216.585270:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532216.585271:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417641 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532216.585272:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5513
00010000:00010000:0.0:1651532216.585275:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417641 lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532216.585282:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417641 lrc: 1/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532216.585285:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417641 lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532216.585802:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532216.585824:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469065280
00000100:00100000:1.0:1651532216.585842:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5514
00000100:00100000:1.0:1651532216.585845:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469065280:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:1.0:1651532216.585848:0:330281:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:1.0:1651532217.568107:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532217.568118:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236544
00000100:00100000:1.0:1651532217.568134:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 79
00000100:00100000:1.0:1651532217.568136:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951236544:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532217.568143:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350621376 pending 0 free 81176596480 avail 77004812288
00000100:00100000:1.0:1651532217.568157:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2fdd008 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951236544:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 20us (51us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532217.568160:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 79
00000100:00100000:0.0:1651532218.044877:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078cad74e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966864960:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532218.045158:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078cad74e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966864960:10.240.43.61@tcp:400:kworker/u4:2.0
00000001:00020000:1.0:1651532218.668835:0:330281:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00002000:00010000:1.0:1651532218.668860:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d38:0x0] initial LVB size: 2097152, mtime: 0x627061b4, atime: 0x0, ctime: 0x627061b4, blocks: 0x1000
00010000:00010000:1.0:1651532218.668863:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417648 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532218.668872:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532218.668873:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532218.668874:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417648 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532218.668879:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417648 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532218.841097:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794440 is committed
00002000:00010000:1.0:1651532218.841122:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb size from disk: 2097152 -> 3145728
00002000:00010000:1.0:1651532218.841123:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb mtime from disk: 1651532212 -> 1651532216
00002000:00010000:1.0:1651532218.841124:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb ctime from disk: 1651532212 -> 1651532216
00002000:00010000:1.0:1651532218.841125:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb blocks from disk: 4096 -> 6144
00010000:00010000:1.0:1651532218.841128:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417648 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532218.841133:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417648 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532218.841158:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417648 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532218.841160:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ba3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469065280:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2255314us (2255358us total) trans 158913794440 rc 0/0
00010000:00010000:0.0:1651532218.841164:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532218.841165:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5514
00010000:00010000:0.0:1651532218.841166:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417648 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532218.841169:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417648 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532218.841176:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417648 lrc: 1/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532218.841179:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417648 lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532218.841736:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532218.841746:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469065408
00000100:00100000:1.0:1651532218.841765:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5515
00000100:00100000:1.0:1651532218.841767:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469065408:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:1.0:1651532218.841772:0:330281:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000001:00020000:1.0:1651532220.924841:0:330281:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00002000:00010000:1.0:1651532220.924858:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d37:0x0] initial LVB size: 3145728, mtime: 0x627061b6, atime: 0x0, ctime: 0x627061b6, blocks: 0x1800
00010000:00010000:1.0:1651532220.924861:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41764f lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532220.924866:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532220.924867:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532220.924868:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41764f lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532220.924873:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41764f lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532221.050911:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794441 is committed
00002000:00010000:1.0:1651532221.050935:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb size from disk: 3145728 -> 4194304
00002000:00010000:1.0:1651532221.050937:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb mtime from disk: 1651532214 -> 1651532218
00002000:00010000:1.0:1651532221.050938:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb ctime from disk: 1651532214 -> 1651532218
00002000:00010000:1.0:1651532221.050938:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d37:0x0] updating lvb blocks from disk: 6144 -> 8192
00010000:00010000:1.0:1651532221.050942:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41764f lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532221.050946:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41764f lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532221.050970:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41764f lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532221.050973:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080230724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469065408:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2209205us (2209237us total) trans 158913794441 rc 0/0
00000100:00100000:1.0:1651532221.050977:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5515
00010000:00010000:0.0:1651532221.050979:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532221.050980:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41764f lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532221.050984:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41764f lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532221.050991:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41764f lrc: 1/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532221.050993:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f41764f lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532221.051558:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532221.051567:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469065536
00000100:00100000:1.0:1651532221.051586:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5516
00000100:00100000:1.0:1651532221.051588:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469065536:12345-10.240.43.64@tcp:4:dd.0
00000001:00020000:1.0:1651532221.051591:0:330281:0:(fail.c:138:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 2000ms
00000100:00100000:1.0:1651532222.688151:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532222.688162:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236672
00000100:00100000:1.0:1651532222.688179:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 80
00000100:00100000:1.0:1651532222.688181:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951236672:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532222.688190:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350621376 pending 0 free 81173450752 avail 77002739712
00000100:00100000:1.0:1651532222.688204:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000559fc8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951236672:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 22us (54us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532222.688207:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 80
00000001:00020000:1.0:1651532223.132857:0:330281:0:(fail.c:149:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake
00002000:00010000:1.0:1651532223.132881:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d38:0x0] initial LVB size: 3145728, mtime: 0x627061b8, atime: 0x0, ctime: 0x627061b8, blocks: 0x1800
00010000:00010000:1.0:1651532223.132884:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417656 lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532223.132889:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532223.132890:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532223.132891:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417656 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532223.132896:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417656 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532223.418677:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794442 is committed
00002000:00010000:1.0:1651532223.418701:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb size from disk: 3145728 -> 4194304
00002000:00010000:1.0:1651532223.418703:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb mtime from disk: 1651532216 -> 1651532221
00002000:00010000:1.0:1651532223.418704:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb ctime from disk: 1651532216 -> 1651532221
00002000:00010000:1.0:1651532223.418705:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d38:0x0] updating lvb blocks from disk: 6144 -> 8192
00010000:00010000:1.0:1651532223.418708:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417656 lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532223.418713:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417656 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532223.418734:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c33e55de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469065536:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2367145us (2367176us total) trans 158913794442 rc 0/0
00000100:00100000:1.0:1651532223.418738:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5516
00010000:00010000:1.0:1651532223.418746:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417656 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532223.418749:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532223.418751:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417656 lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532223.418754:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417656 lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532223.418760:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417656 lrc: 1/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532223.418762:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417656 lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532224.458215:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532224.458234:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532224.458246:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469065920
00000100:00100000:0.0:1651532224.458247:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469065856
00000100:00100000:0.0:1651532224.458272:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6825
00000100:00100000:1.0:1651532224.458275:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6826
00000100:00100000:0.0:1651532224.458275:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469065920:12345-10.240.43.64@tcp:101:rm.0
00000100:00100000:1.0:1651532224.458277:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469065856:12345-10.240.43.64@tcp:101:rm.0
00010000:00010000:1.0:1651532224.458285:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532224.458285:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532224.458298:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417664 lrc: 2/0,0 mode: --/PR res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fcff expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532224.458298:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41765d lrc: 2/0,0 mode: --/PR res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fd06 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532224.458311:0:323273:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d37:0x0] initial LVB size: 4194304, mtime: 0x627061ba, atime: 0x0, ctime: 0x627061ba, blocks: 0x2000
00002000:00010000:0.0:1651532224.458311:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d38:0x0] initial LVB size: 4194304, mtime: 0x627061bd, atime: 0x0, ctime: 0x627061bd, blocks: 0x2000
00010000:00010000:1.0:1651532224.458320:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532224.458320:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532224.458321:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532224.458321:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532224.458325:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417664 lrc: 3/0,0 mode: PR/PR res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcff expref: 9 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532224.458325:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41765d lrc: 3/0,0 mode: PR/PR res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd06 expref: 9 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532224.458333:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417664 lrc: 3/0,0 mode: PR/PR res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcff expref: 9 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532224.458333:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41765d lrc: 3/0,0 mode: PR/PR res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd06 expref: 9 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532224.458338:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00010000:00010000:0.0:1651532224.458338:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e1e35d6a, rc 0)
00000100:00100000:1.0:1651532224.458361:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469065856:12345-10.240.43.64@tcp:101:rm.0 Request processed in 83us (150us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532224.458361:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469065920:12345-10.240.43.64@tcp:101:rm.0 Request processed in 86us (127us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532224.458364:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6826
00000100:00100000:0.0:1651532224.458366:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6825
00000400:00000080:0.0:1651532224.973248:0:331480:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532224.973251:0:331480:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398h: verify correctness of read
00000100:00100000:1.0:1651532225.332142:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532225.332162:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469067840
00000100:00100000:1.0:1651532225.332184:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6827
00000100:00100000:1.0:1651532225.332187:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee5ce04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:684632:x1731754469067840:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532225.332197:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532225.332218:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41766b lrc: 2/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fd53 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532225.332236:0:323276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532225.332247:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532225.332248:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532225.332252:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41766b lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd53 expref: 9 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.332259:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41766b lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd53 expref: 9 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.332265:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532225.332287:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee5ce04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:684632:x1731754469067840:12345-10.240.43.64@tcp:101:dd.0 Request processed in 100us (148us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532225.332290:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6827
00000100:00100000:1.0:1651532225.333042:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532225.333052:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469067968
00002000:00010000:1.0:1651532225.333061:0:330281:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216377/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532225.333063:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d3e95e17 with x1731754469067968 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532225.333067:0:330281:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d3e95e17.
00000100:00100000:1.0:1651532225.333079:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5517
00000100:00100000:1.0:1651532225.333081:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469067968:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532225.333148:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532225.333150:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb mtime from disk: 0 -> 1651532225
00002000:00010000:1.0:1651532225.333151:0:330281:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532225.333152:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb ctime from disk: 0 -> 1651532225
00002000:00010000:1.0:1651532225.333153:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532225.333166:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e95e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469067968:12345-10.240.43.64@tcp:10:dd.0 Request processed in 84us (125us total) trans 158913794443 rc 0/0
00000100:00100000:1.0:1651532225.333169:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5517
00002000:00010000:1.0:1651532225.333170:0:330281:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216377/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532225.333171:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d3e95e17 with x1731754469067968 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532225.333173:0:330281:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d3e95e17.
00000100:00100000:1.0:1651532225.370612:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532225.370622:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469068224
00000100:00100000:1.0:1651532225.370642:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5518
00000100:00100000:1.0:1651532225.370644:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469068224:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532225.370655:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.370662:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41766b lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd53 expref: 10 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.370666:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532225.370666:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532225.370667:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 4/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.370679:0:330281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41766b lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd53 expref: 10 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.370685:0:330281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41766b lrc: 4/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd53 expref: 10 pid: 323276 timeout: 15975 lvb_type: 0
00000100:00100000:1.0:1651532225.370692:0:330281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4292754 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:330281:1731745966865024:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532225.370711:0:330281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000502d9ec5 going to sleep for 6 seconds
00000100:00100000:1.0:1651532225.371040:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532225.371050:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469068480
00010000:00010000:1.0:1651532225.371056:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41766b lrc: 5/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd53 expref: 11 pid: 323276 timeout: 15975 lvb_type: 0
00000100:00100000:1.0:1651532225.371071:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 307
00000100:00100000:1.0:1651532225.371073:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469068480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651532225.371078:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532225.371083:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41766b lrc: 5/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd53 expref: 11 pid: 323276 timeout: 15975 lvb_type: 0
00010000:00010000:1.0:1651532225.371087:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41766b lrc: 4/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd53 expref: 11 pid: 323276 timeout: 15975 lvb_type: 0
00010000:00010000:1.0:1651532225.371096:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532225.371097:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532225.371098:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.371101:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 4/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.371108:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532225.371118:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469068480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (79us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532225.371122:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 307
00010000:00010000:1.0:1651532225.371166:0:330281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f41766b lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd53 expref: 10 pid: 323276 timeout: 15975 lvb_type: 0
00000100:00100000:1.0:1651532225.371171:0:330281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4292754 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:330281:1731745966865024:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532225.371176:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.371181:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.371183:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532225.866436:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794444 is committed
00002000:00010000:1.0:1651532225.866514:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:1.0:1651532225.866517:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:1.0:1651532225.866524:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.866530:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532225.866572:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001404cba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469068224:12345-10.240.43.64@tcp:4:dd.0 Request processed in 495925us (495958us total) trans 158913794444 rc 0/0
00000100:00100000:1.0:1651532225.866577:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5518
00010000:00010000:1.0:1651532225.866591:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.866595:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532225.866597:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.866600:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.866609:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.866612:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417672 lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532225.904024:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532225.904036:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469068736
00000100:00100000:1.0:1651532225.904063:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5519
00000100:00100000:1.0:1651532225.904065:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469068736:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532225.904081:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d39:0x0] initial LVB size: 4194304, mtime: 0x627061c1, atime: 0x0, ctime: 0x627061c1, blocks: 0x2000
00010000:00010000:1.0:1651532225.904084:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417679 lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.904090:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532225.904091:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532225.904093:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417679 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.904098:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417679 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532225.904577:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532225.904602:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469069120
00000100:00100000:0.0:1651532225.904621:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5520
00000100:00100000:0.0:1651532225.904623:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469069120:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532225.904634:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417680 lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532225.904640:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532225.904641:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532225.904642:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417680 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532225.904647:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417680 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532226.201161:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794445 is committed
00002000:00010000:0.0:1651532226.201253:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb size from disk: 4194304 -> 8388608
00002000:00010000:0.0:1651532226.201256:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb blocks from disk: 8192 -> 16384
00010000:00010000:0.0:1651532226.201263:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417679 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.201269:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417679 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.201300:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417679 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.201307:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532226.201309:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417679 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532226.201316:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4292754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469068736:12345-10.240.43.64@tcp:4:dd.0 Request processed in 297249us (297291us total) trans 158913794445 rc 0/0
00010000:00010000:1.0:1651532226.201318:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417679 lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532226.201322:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5519
00010000:00010000:1.0:1651532226.201329:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417679 lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.201332:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417679 lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532226.236646:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794446 is committed
00010000:00010000:0.0:1651532226.236685:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417680 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.236690:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417680 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532226.236713:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4170e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469069120:12345-10.240.43.64@tcp:4:dd.0 Request processed in 332089us (332136us total) trans 158913794446 rc 0/0
00000100:00100000:0.0:1651532226.236717:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5520
00010000:00010000:0.0:1651532226.236725:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417680 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.236728:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532226.236729:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417680 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.236732:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417680 lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.236738:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417680 lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.236741:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417680 lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532226.236876:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078cad74e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4117a37c-db10-4766-b60a-8aa6e5558d6b:39028:1731745966865088:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532226.237228:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078cad74e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4117a37c-db10-4766-b60a-8aa6e5558d6b:39028:1731745966865088:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532226.272966:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532226.272977:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469069376
00000100:00100000:0.0:1651532226.272996:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5521
00000100:00100000:0.0:1651532226.272998:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469069376:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532226.273015:0:330279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d39:0x0] initial LVB size: 8388608, mtime: 0x627061c1, atime: 0x0, ctime: 0x627061c1, blocks: 0x4000
00010000:00010000:0.0:1651532226.273017:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417687 lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.273023:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532226.273024:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532226.273026:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417687 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.273031:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417687 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532226.274116:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532226.274157:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469069824
00000100:00100000:0.0:1651532226.274172:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5522
00000100:00100000:0.0:1651532226.274174:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469069824:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532226.274193:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41768e lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.274202:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532226.274202:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532226.274203:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41768e lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.274208:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41768e lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532226.570094:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794447 is committed
00002000:00010000:0.0:1651532226.570168:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb size from disk: 8388608 -> 12582912
00002000:00010000:0.0:1651532226.570171:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb mtime from disk: 1651532225 -> 1651532226
00002000:00010000:0.0:1651532226.570172:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb ctime from disk: 1651532225 -> 1651532226
00002000:00010000:0.0:1651532226.570172:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb blocks from disk: 16384 -> 24576
00010000:00010000:0.0:1651532226.570179:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417687 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.570185:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417687 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.570227:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417687 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532226.570228:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078cad74e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469069376:12345-10.240.43.64@tcp:4:dd.0 Request processed in 297227us (297261us total) trans 158913794447 rc 0/0
00000100:00100000:0.0:1651532226.570233:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5521
00010000:00010000:1.0:1651532226.570234:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532226.570235:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417687 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.570243:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417687 lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.570253:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417687 lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.570256:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417687 lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532226.610008:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794448 is committed
00010000:00010000:1.0:1651532226.610048:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41768e lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.610052:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41768e lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.610075:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41768e lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.610080:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532226.610081:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abbd560e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469069824:12345-10.240.43.64@tcp:4:dd.0 Request processed in 335905us (335965us total) trans 158913794448 rc 0/0
00010000:00010000:0.0:1651532226.610081:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41768e lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.610085:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5522
00010000:00010000:0.0:1651532226.610088:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41768e lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.610095:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41768e lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.610097:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41768e lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532226.647004:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532226.647031:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469070080
00000100:00100000:1.0:1651532226.647057:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5523
00000100:00100000:1.0:1651532226.647060:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469070080:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532226.647075:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d39:0x0] initial LVB size: 12582912, mtime: 0x627061c2, atime: 0x0, ctime: 0x627061c2, blocks: 0x6000
00010000:00010000:1.0:1651532226.647078:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417695 lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.647086:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532226.647087:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532226.647089:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417695 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.647094:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417695 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532226.943017:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794449 is committed
00002000:00010000:1.0:1651532226.943087:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb size from disk: 12582912 -> 16777216
00002000:00010000:1.0:1651532226.943089:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb blocks from disk: 24576 -> 32768
00010000:00010000:1.0:1651532226.943097:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417695 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.943103:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417695 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.943149:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083c0dd3a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469070080:12345-10.240.43.64@tcp:4:dd.0 Request processed in 296087us (296145us total) trans 158913794449 rc 0/0
00000100:00100000:1.0:1651532226.943155:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5523
00010000:00010000:1.0:1651532226.943171:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417695 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.943174:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532226.943176:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417695 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.943183:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417695 lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.943201:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417695 lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.943204:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417695 lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.979983:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532226.979995:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469070464
00000100:00100000:1.0:1651532226.980021:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5524
00000100:00100000:1.0:1651532226.980023:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469070464:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532226.980039:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d39:0x0] initial LVB size: 16777216, mtime: 0x627061c2, atime: 0x0, ctime: 0x627061c2, blocks: 0x8000
00010000:00010000:1.0:1651532226.980041:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41769c lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.980046:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532226.980047:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532226.980049:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41769c lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.980054:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41769c lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.981079:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532226.981168:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469070912
00000100:00100000:0.0:1651532226.981226:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5525
00000100:00100000:0.0:1651532226.981228:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469070912:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532226.981239:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176a3 lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.981246:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532226.981246:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532226.981248:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176a3 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.981253:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176a3 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532227.217028:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794450 is committed
00002000:00010000:0.0:1651532227.217110:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb size from disk: 16777216 -> 20971520
00002000:00010000:0.0:1651532227.217113:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb blocks from disk: 32768 -> 40960
00010000:00010000:0.0:1651532227.217119:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41769c lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.217126:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41769c lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.217170:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92969af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469070464:12345-10.240.43.64@tcp:4:dd.0 Request processed in 237144us (237186us total) trans 158913794450 rc 0/0
00010000:00010000:1.0:1651532227.217174:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41769c lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.217175:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5524
00010000:00010000:1.0:1651532227.217181:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532227.217182:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41769c lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.217187:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41769c lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.217198:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41769c lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.217201:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41769c lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->18874367] (req 16777216->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532227.259484:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794451 is committed
00010000:00010000:0.0:1651532227.259533:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176a3 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.259538:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176a3 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.259563:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b44cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469070912:12345-10.240.43.64@tcp:4:dd.0 Request processed in 278333us (278484us total) trans 158913794451 rc 0/0
00000100:00100000:0.0:1651532227.259566:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5525
00010000:00010000:0.0:1651532227.259574:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176a3 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.259578:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532227.259579:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176a3 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.259582:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176a3 lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.259588:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176a3 lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.259591:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176a3 lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->20971519] (req 18874368->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.295959:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532227.295971:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469071168
00000100:00100000:0.0:1651532227.295992:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5526
00000100:00100000:0.0:1651532227.295994:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f315f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469071168:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532227.296009:0:330279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d39:0x0] initial LVB size: 20971520, mtime: 0x627061c2, atime: 0x0, ctime: 0x627061c2, blocks: 0xa000
00010000:00010000:0.0:1651532227.296012:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176aa lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.296017:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.296018:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.296020:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176aa lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.296025:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176aa lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.297349:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532227.297359:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469071616
00000100:00100000:0.0:1651532227.297408:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5527
00000100:00100000:0.0:1651532227.297411:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469071616:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532227.297438:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176b1 lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.297447:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.297447:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.297448:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176b1 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.297453:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176b1 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532227.525818:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794452 is committed
00002000:00010000:0.0:1651532227.525892:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb size from disk: 20971520 -> 25165824
00002000:00010000:0.0:1651532227.525894:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb mtime from disk: 1651532226 -> 1651532227
00002000:00010000:0.0:1651532227.525895:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb ctime from disk: 1651532226 -> 1651532227
00002000:00010000:0.0:1651532227.525896:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb blocks from disk: 40960 -> 49152
00010000:00010000:0.0:1651532227.525902:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176aa lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.525909:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176aa lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.525951:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176aa lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.525951:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f315f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469071168:12345-10.240.43.64@tcp:4:dd.0 Request processed in 229955us (229991us total) trans 158913794452 rc 0/0
00010000:00010000:1.0:1651532227.525957:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532227.525957:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5526
00010000:00010000:1.0:1651532227.525959:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176aa lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.525964:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176aa lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.525973:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176aa lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.525976:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4176aa lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->23068671] (req 20971520->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532227.567565:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794453 is committed
00010000:00010000:1.0:1651532227.567607:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176b1 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.567611:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176b1 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.567635:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176b1 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.567640:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469071616:12345-10.240.43.64@tcp:4:dd.0 Request processed in 270228us (270291us total) trans 158913794453 rc 0/0
00010000:00010000:0.0:1651532227.567640:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532227.567641:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176b1 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.567644:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5527
00010000:00010000:0.0:1651532227.567648:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176b1 lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.567654:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176b1 lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.567657:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176b1 lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [23068672->25165823] (req 23068672->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.603951:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532227.603979:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469071872
00000100:00100000:1.0:1651532227.604004:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5528
00000100:00100000:1.0:1651532227.604007:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469071872:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532227.604022:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d39:0x0] initial LVB size: 25165824, mtime: 0x627061c3, atime: 0x0, ctime: 0x627061c3, blocks: 0xc000
00010000:00010000:1.0:1651532227.604025:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176b8 lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.604030:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.604031:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.604034:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176b8 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->27262975] (req 25165824->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.604039:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176b8 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->27262975] (req 25165824->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.605248:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532227.605580:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469072320
00000100:00100000:0.0:1651532227.605601:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5529
00000100:00100000:0.0:1651532227.605619:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469072320:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532227.605638:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176bf lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.605644:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.605645:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.605646:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176bf lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->29360127] (req 27262976->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.605650:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176bf lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->29360127] (req 27262976->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.808193:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532227.808221:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951237056
00000100:00100000:1.0:1651532227.808245:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 81
00000100:00100000:1.0:1651532227.808248:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951237056:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532227.808259:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 357060288 pending 4292608 free 81147236352 avail 76976525312
00000100:00100000:1.0:1651532227.808281:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d1c2eac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951237056:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 33us (91us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532227.808285:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 81
00000001:00080000:1.0:1651532227.924322:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794454 is committed
00002000:00010000:0.0:1651532227.924416:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb size from disk: 25165824 -> 29360128
00002000:00010000:0.0:1651532227.924418:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb blocks from disk: 49152 -> 57344
00010000:00010000:0.0:1651532227.924424:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176b8 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->27262975] (req 25165824->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.924429:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176b8 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->27262975] (req 25165824->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.924459:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a6a1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469071872:12345-10.240.43.64@tcp:4:dd.0 Request processed in 320451us (320509us total) trans 158913794454 rc 0/0
00000100:00100000:0.0:1651532227.924463:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5528
00010000:00010000:1.0:1651532227.924466:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176b8 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->27262975] (req 25165824->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.924473:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532227.924474:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176b8 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->27262975] (req 25165824->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.924478:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176b8 lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->27262975] (req 25165824->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.924488:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176b8 lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->27262975] (req 25165824->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.924491:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176b8 lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->27262975] (req 25165824->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.961874:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532227.961886:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532227.961894:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951237120
00000100:00100000:1.0:1651532227.961908:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951237184
00000100:00100000:1.0:1651532227.961913:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6828
00000100:00100000:1.0:1651532227.961915:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951237120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00000100:00100000:0.0:1651532227.961923:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6829
00002000:00080000:1.0:1651532227.961924:0:323275:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216375 count 1
00000100:00100000:0.0:1651532227.961926:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951237184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00010000:00010000:1.0:1651532227.961931:0:323275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 3/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00002000:00080000:0.0:1651532227.961933:0:328039:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216376 count 1
00010000:00010000:1.0:1651532227.961938:0:323275:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417664 lrc: 2/0,0 mode: PR/PR res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcff expref: 11 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532227.961940:0:328039:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.961942:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.961943:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.961944:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 4/0,1 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.961946:0:328039:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41765d lrc: 2/0,0 mode: PR/PR res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd06 expref: 11 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532227.961950:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.961950:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.961951:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 4/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.961957:0:323275:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417664 lrc: 3/0,0 mode: PR/PR res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcff expref: 11 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532227.961960:0:328039:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41765d lrc: 3/0,0 mode: PR/PR res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd06 expref: 11 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532227.961963:0:323275:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417664 lrc: 4/0,0 mode: PR/PR res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcff expref: 11 pid: 323273 timeout: 15977 lvb_type: 1
00010000:00010000:0.0:1651532227.961964:0:328039:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41765d lrc: 4/0,0 mode: PR/PR res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd06 expref: 11 pid: 328039 timeout: 15977 lvb_type: 1
00000100:00100000:1.0:1651532227.961969:0:323275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001268fb09 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:323275:1731745966865152:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532227.961990:0:323275:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057b5dfc9 going to sleep for 6 seconds
00000100:00100000:0.0:1651532227.961997:0:328039:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008245d82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966865216:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532227.962009:0:328039:0:(client.c:2492:ptlrpc_set_wait()) set 0000000003c3ab84 going to sleep for 6 seconds
00000100:00100000:1.0:1651532227.962377:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532227.962386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532227.962403:0:328039:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008245d82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966865216:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532227.962405:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469072512
00010000:00010000:0.0:1651532227.962410:0:328039:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 3/0,1 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.962413:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41765d lrc: 4/0,0 mode: PR/PR res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd06 expref: 12 pid: 328039 timeout: 15977 lvb_type: 1
00000100:00100000:0.0:1651532227.962420:0:330056:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469072448
00000100:00100000:1.0:1651532227.962425:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 308
00000100:00100000:1.0:1651532227.962427:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469072512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651532227.962431:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532227.962431:0:330056:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417664 lrc: 5/0,0 mode: PR/PR res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcff expref: 13 pid: 323273 timeout: 15977 lvb_type: 1
00010000:00010000:1.0:1651532227.962433:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41765d lrc: 4/0,0 mode: PR/PR res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd06 expref: 13 pid: 328039 timeout: 15977 lvb_type: 1
00010000:00010000:1.0:1651532227.962437:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41765d lrc: 3/0,0 mode: PR/PR res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd06 expref: 13 pid: 328039 timeout: 15977 lvb_type: 1
00000100:00100000:0.0:1651532227.962444:0:330056:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 309
00000100:00100000:0.0:1651532227.962446:0:330056:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469072448:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651532227.962449:0:330056:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532227.962451:0:323261:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41765d lrc: 0/0,0 mode: --/PR res: [0x34d38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd06 expref: 13 pid: 328039 timeout: 15977 lvb_type: 1
00010000:00010000:0.0:1651532227.962451:0:330056:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417664 lrc: 5/0,0 mode: PR/PR res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcff expref: 13 pid: 323273 timeout: 15977 lvb_type: 1
00010000:00010000:1.0:1651532227.962455:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.962455:0:330056:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417664 lrc: 4/0,0 mode: PR/PR res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcff expref: 12 pid: 323273 timeout: 15977 lvb_type: 1
00010000:00010000:1.0:1651532227.962456:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.962457:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.962461:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 4/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.962462:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.962462:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.962463:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.962466:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 4/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.962470:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532227.962480:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469072512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (104us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532227.962483:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 308
00010000:00010000:0.0:1651532227.962483:0:330056:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532227.962492:0:330056:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754469072448:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 45us (106us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532227.962495:0:330056:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 309
00010000:00010000:1.0:1651532227.962496:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417664 lrc: 0/0,0 mode: --/PR res: [0x34d37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fcff expref: 11 pid: 323273 timeout: 15977 lvb_type: 1
00010000:00010000:0.0:1651532227.962504:0:328039:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.962507:0:328039:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.962510:0:323275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001268fb09 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:323275:1731745966865152:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532227.962511:0:328039:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 3/0,1 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.962513:0:328039:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.962514:0:323275:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.962518:0:323275:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.962521:0:323275:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.962530:0:323275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 3/0,1 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.962534:0:323275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.963027:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d04f6051 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951237120:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1110us (1152us total) trans 158913794457 rc 0/0
00000100:00100000:0.0:1651532227.963027:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1d507 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745951237184:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1100us (1140us total) trans 158913794456 rc 0/0
00000100:00100000:0.0:1651532227.963030:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6829
00000100:00100000:1.0:1651532227.963032:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6828
00010000:00010000:0.0:1651532227.963039:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.963040:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.963043:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532227.963043:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532227.963044:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 2/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.963045:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 2/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.963050:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 3/0,0 mode: PW/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.963051:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 3/0,0 mode: PW/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.963055:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 1/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.963056:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 1/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.963058:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176c6 lrc: 0/0,0 mode: --/PW res: [0x34d37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.963058:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176cd lrc: 0/0,0 mode: --/PW res: [0x34d38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532227.974255:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794455 is committed
00010000:00010000:0.0:1651532227.974306:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176bf lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [27262976->29360127] (req 27262976->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.974311:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176bf lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [27262976->29360127] (req 27262976->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.974334:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176bf lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [27262976->29360127] (req 27262976->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.974335:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c908915d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469072320:12345-10.240.43.64@tcp:4:dd.0 Request processed in 368715us (369087us total) trans 158913794455 rc 0/0
00000100:00100000:0.0:1651532227.974338:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5529
00010000:00010000:1.0:1651532227.974339:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532227.974340:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176bf lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [27262976->29360127] (req 27262976->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.974343:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176bf lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [27262976->29360127] (req 27262976->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.974348:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176bf lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [27262976->29360127] (req 27262976->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.974351:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4176bf lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [27262976->29360127] (req 27262976->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.010938:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.010962:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469072704
00000100:00100000:0.0:1651532228.010979:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5530
00000100:00100000:0.0:1651532228.010981:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469072704:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532228.010994:0:330279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d39:0x0] initial LVB size: 29360128, mtime: 0x627061c3, atime: 0x0, ctime: 0x627061c3, blocks: 0xe000
00010000:00010000:0.0:1651532228.010997:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176d4 lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.011001:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.011002:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.011004:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176d4 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.011008:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176d4 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532228.307544:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794458 is committed
00000001:00080000:1.0:1651532228.307550:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794457 is committed
00002000:00010000:0.0:1651532228.307652:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb size from disk: 29360128 -> 33554432
00002000:00010000:0.0:1651532228.307655:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb mtime from disk: 1651532227 -> 1651532228
00002000:00010000:0.0:1651532228.307656:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb ctime from disk: 1651532227 -> 1651532228
00002000:00010000:0.0:1651532228.307657:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d39:0x0] updating lvb blocks from disk: 57344 -> 65536
00010000:00010000:0.0:1651532228.307665:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176d4 lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.307671:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176d4 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.307721:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001268fb09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469072704:12345-10.240.43.64@tcp:4:dd.0 Request processed in 296737us (296782us total) trans 158913794458 rc 0/0
00000100:00100000:0.0:1651532228.307727:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5530
00010000:00010000:0.0:1651532228.307742:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176d4 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.307746:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532228.307748:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176d4 lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.307752:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176d4 lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.307762:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176d4 lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.307765:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176d4 lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.319131:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.319162:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469073600
00000100:00100000:1.0:1651532228.319185:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6830
00000100:00100000:1.0:1651532228.319188:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:684635:x1731754469073600:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532228.319196:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532228.319205:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176db lrc: 2/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fd7d expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532228.319213:0:323275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532228.319222:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.319223:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.319227:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176db lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd7d expref: 7 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.319233:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176db lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd7d expref: 7 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.319238:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532228.319252:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008245d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:684635:x1731754469073600:12345-10.240.43.64@tcp:101:dd.0 Request processed in 64us (122us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532228.319255:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6830
00000100:00100000:0.0:1651532228.319489:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.319497:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469073728
00002000:00010000:0.0:1651532228.319506:0:330279:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216378/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532228.319507:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a60b6df5 with x1731754469073728 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532228.319511:0:330279:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a60b6df5.
00000100:00100000:0.0:1651532228.319518:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5531
00000100:00100000:0.0:1651532228.319520:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469073728:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:0.0:1651532228.319571:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532228.319572:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb mtime from disk: 0 -> 1651532228
00002000:00010000:0.0:1651532228.319573:0:330279:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532228.319574:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb ctime from disk: 0 -> 1651532228
00002000:00010000:0.0:1651532228.319575:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651532228.319593:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b6df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469073728:12345-10.240.43.64@tcp:10:dd.0 Request processed in 72us (104us total) trans 158913794459 rc 0/0
00000100:00100000:0.0:1651532228.319596:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5531
00002000:00010000:0.0:1651532228.319597:0:330279:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216378/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532228.319598:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a60b6df5 with x1731754469073728 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532228.319600:0:330279:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a60b6df5.
00000100:00100000:0.0:1651532228.319947:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.319968:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469073792
00000100:00100000:1.0:1651532228.319981:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6831
00000100:00100000:1.0:1651532228.319982:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d529e503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469073792:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532228.319986:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532228.319990:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4176e2 lrc: 2/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fd84 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532228.319996:0:323275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d39:0x0] initial LVB size: 33554432, mtime: 0x627061c4, atime: 0x0, ctime: 0x627061c4, blocks: 0x10000
00010000:00010000:1.0:1651532228.320000:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.320001:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.320003:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4176e2 lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd84 expref: 9 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532228.320008:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4176e2 lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd84 expref: 9 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532228.320012:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa60b9cc, rc 0)
00000100:00100000:1.0:1651532228.320023:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d529e503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469073792:12345-10.240.43.64@tcp:101:dd.0 Request processed in 40us (77us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532228.320026:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6831
00000100:00100000:0.0:1651532228.323328:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.323337:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469074048
00000100:00100000:0.0:1651532228.323351:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5532
00000100:00100000:0.0:1651532228.323353:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469074048:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532228.323363:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176e9 lrc: 3/1,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.323368:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.323369:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.323370:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176e9 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.323375:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176e9 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.327456:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176e9 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.327465:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176e9 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.327493:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176e9 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.327500:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532228.327502:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176e9 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.327506:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176e9 lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.327508:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469074048:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4154us (4180us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532228.327513:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5532
00010000:00010000:1.0:1651532228.327518:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176e9 lrc: 1/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.327520:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176e9 lrc: 0/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.329917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.329942:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469074560
00000100:00100000:0.0:1651532228.329962:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5533
00000100:00100000:0.0:1651532228.329964:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469074560:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532228.329979:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 3/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.329987:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176db lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd7d expref: 9 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.329991:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532228.329992:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532228.329993:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 4/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.330006:0:330281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176db lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd7d expref: 9 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.330011:0:330281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176db lrc: 4/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd7d expref: 9 pid: 323275 timeout: 15977 lvb_type: 0
00000100:00100000:0.0:1651532228.330017:0:330281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d23405d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:330281:1731745966865280:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532228.330036:0:330281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000003c3ab84 going to sleep for 6 seconds
00000100:00100000:1.0:1651532228.330276:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.330289:0:330281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d23405d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:330281:1731745966865280:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532228.330295:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 3/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.330304:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469074752
00010000:00010000:0.0:1651532228.330310:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176db lrc: 4/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd7d expref: 10 pid: 323275 timeout: 15977 lvb_type: 0
00000100:00100000:0.0:1651532228.330323:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 310
00000100:00100000:0.0:1651532228.330325:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469074752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651532228.330328:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532228.330336:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176db lrc: 4/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd7d expref: 10 pid: 323275 timeout: 15977 lvb_type: 0
00010000:00010000:0.0:1651532228.330340:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176db lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd7d expref: 10 pid: 323275 timeout: 15977 lvb_type: 0
00010000:00010000:0.0:1651532228.330348:0:323259:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f4176db lrc: 0/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd7d expref: 10 pid: 323275 timeout: 15977 lvb_type: 0
00010000:00010000:0.0:1651532228.330352:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.330352:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.330354:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.330357:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 4/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.330364:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532228.330373:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469074752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532228.330376:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 310
00010000:00010000:0.0:1651532228.330384:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.330390:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532228.730103:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794460 is committed
00002000:00010000:0.0:1651532228.730194:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:0.0:1651532228.730197:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:0.0:1651532228.730204:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.730211:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.730252:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9581c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469074560:12345-10.240.43.64@tcp:4:dd.0 Request processed in 400285us (400333us total) trans 158913794460 rc 0/0
00000100:00100000:0.0:1651532228.730257:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5533
00010000:00010000:0.0:1651532228.730270:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.730274:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532228.730276:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.730280:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.730288:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 1/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.730291:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176f0 lrc: 0/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.732258:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.732280:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469074944
00000100:00100000:0.0:1651532228.732300:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5534
00000100:00100000:0.0:1651532228.732302:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469074944:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532228.732315:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176f7 lrc: 3/1,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.732320:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.732321:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.732323:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176f7 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.732328:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176f7 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.735625:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176f7 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.735634:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176f7 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.735665:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176f7 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.735672:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532228.735674:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176f7 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.735681:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f07ba42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469074944:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3376us (3423us total) trans 0 rc 4194304/4194304
00010000:00010000:1.0:1651532228.735683:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176f7 lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.735687:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5534
00010000:00010000:1.0:1651532228.735695:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176f7 lrc: 1/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.735698:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4176f7 lrc: 0/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.738205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.738216:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469075328
00000100:00100000:0.0:1651532228.738235:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5535
00000100:00100000:0.0:1651532228.738237:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d23405d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469075328:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532228.738257:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3a:0x0] initial LVB size: 4194304, mtime: 0x627061c4, atime: 0x0, ctime: 0x627061c4, blocks: 0x2000
00010000:00010000:0.0:1651532228.738259:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176fe lrc: 3/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.738265:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.738266:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.738268:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176fe lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.738273:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176fe lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532228.971944:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794461 is committed
00002000:00010000:0.0:1651532228.972043:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb size from disk: 4194304 -> 8388608
00002000:00010000:0.0:1651532228.972046:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb blocks from disk: 8192 -> 16384
00010000:00010000:0.0:1651532228.972053:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176fe lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.972060:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176fe lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.972090:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176fe lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.972096:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532228.972098:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176fe lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.972105:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176fe lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.972108:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d23405d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469075328:12345-10.240.43.64@tcp:4:dd.0 Request processed in 233869us (233901us total) trans 158913794461 rc 0/0
00000100:00100000:0.0:1651532228.972114:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5535
00010000:00010000:1.0:1651532228.972116:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176fe lrc: 1/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.972119:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4176fe lrc: 0/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.974323:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.974333:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469075712
00000100:00100000:0.0:1651532228.974353:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5536
00000100:00100000:0.0:1651532228.974355:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007513dfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469075712:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532228.974369:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417705 lrc: 3/1,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.974375:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.974376:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.974378:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417705 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.974384:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417705 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.978042:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417705 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.978052:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417705 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.978089:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007513dfdd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469075712:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3732us (3765us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532228.978095:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5536
00010000:00010000:0.0:1651532228.978109:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417705 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.978113:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532228.978114:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417705 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.978118:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417705 lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.978129:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417705 lrc: 1/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.978131:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417705 lrc: 0/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.980436:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.980446:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469076096
00000100:00100000:0.0:1651532228.980465:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5537
00000100:00100000:0.0:1651532228.980467:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fef8a7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469076096:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532228.980487:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3a:0x0] initial LVB size: 8388608, mtime: 0x627061c4, atime: 0x0, ctime: 0x627061c4, blocks: 0x4000
00010000:00010000:0.0:1651532228.980489:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41770c lrc: 3/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.980494:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.980495:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.980498:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41770c lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.980502:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41770c lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532229.247209:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794462 is committed
00002000:00010000:0.0:1651532229.247287:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb size from disk: 8388608 -> 12582912
00002000:00010000:0.0:1651532229.247290:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb blocks from disk: 16384 -> 24576
00010000:00010000:0.0:1651532229.247297:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41770c lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.247306:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41770c lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.247335:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41770c lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.247341:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532229.247343:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41770c lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.247347:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41770c lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.247354:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fef8a7c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469076096:12345-10.240.43.64@tcp:4:dd.0 Request processed in 266884us (266917us total) trans 158913794462 rc 0/0
00010000:00010000:1.0:1651532229.247357:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41770c lrc: 1/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.247360:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41770c lrc: 0/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.247360:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5537
00000100:00100000:0.0:1651532229.249830:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532229.249840:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469076480
00000100:00100000:0.0:1651532229.249865:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5538
00000100:00100000:0.0:1651532229.249867:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7789e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469076480:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532229.249880:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417713 lrc: 3/1,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.249886:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.249887:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.249889:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417713 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.249894:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417713 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.253634:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417713 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.253643:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417713 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.253675:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417713 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.253681:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532229.253683:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417713 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.253690:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7789e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469076480:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3821us (3860us total) trans 0 rc 4194304/4194304
00010000:00010000:1.0:1651532229.253692:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417713 lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.253696:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5538
00010000:00010000:1.0:1651532229.253703:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417713 lrc: 1/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.253706:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417713 lrc: 0/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.256028:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532229.256039:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469076864
00000100:00100000:0.0:1651532229.256062:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5539
00000100:00100000:0.0:1651532229.256065:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e415d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469076864:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532229.256084:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3a:0x0] initial LVB size: 12582912, mtime: 0x627061c4, atime: 0x0, ctime: 0x627061c4, blocks: 0x6000
00010000:00010000:0.0:1651532229.256086:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41771a lrc: 3/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.256091:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.256092:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.256094:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41771a lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.256100:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41771a lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532229.595199:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794463 is committed
00002000:00010000:0.0:1651532229.595280:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb size from disk: 12582912 -> 16777216
00002000:00010000:0.0:1651532229.595283:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb mtime from disk: 1651532228 -> 1651532229
00002000:00010000:0.0:1651532229.595284:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb ctime from disk: 1651532228 -> 1651532229
00002000:00010000:0.0:1651532229.595285:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb blocks from disk: 24576 -> 32768
00010000:00010000:0.0:1651532229.595293:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41771a lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.595302:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41771a lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.595330:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41771a lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.595336:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532229.595338:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41771a lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.595342:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41771a lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.595348:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e415d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469076864:12345-10.240.43.64@tcp:4:dd.0 Request processed in 339281us (339319us total) trans 158913794463 rc 0/0
00010000:00010000:1.0:1651532229.595352:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41771a lrc: 1/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.595354:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5539
00010000:00010000:1.0:1651532229.595358:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f41771a lrc: 0/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.597487:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532229.597498:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469077440
00000100:00100000:0.0:1651532229.597524:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5540
00000100:00100000:0.0:1651532229.597526:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469077440:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532229.597538:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417721 lrc: 3/1,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.597544:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.597545:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.597547:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417721 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.597553:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417721 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.601236:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417721 lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.601262:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417721 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.601294:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417721 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.601300:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532229.601301:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417721 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.601305:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417721 lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.601312:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000897360af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469077440:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3783us (3824us total) trans 0 rc 4194304/4194304
00010000:00010000:1.0:1651532229.601315:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417721 lrc: 1/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.601318:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417721 lrc: 0/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.601318:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5540
00000100:00100000:0.0:1651532229.603681:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532229.603691:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469077824
00000100:00100000:0.0:1651532229.603716:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5541
00000100:00100000:0.0:1651532229.603719:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469077824:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532229.603739:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3a:0x0] initial LVB size: 16777216, mtime: 0x627061c5, atime: 0x0, ctime: 0x627061c5, blocks: 0x8000
00010000:00010000:0.0:1651532229.603742:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417728 lrc: 3/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.603747:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.603748:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.603750:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417728 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.603755:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417728 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532229.916485:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794464 is committed
00002000:00010000:0.0:1651532229.916561:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb size from disk: 16777216 -> 20971520
00002000:00010000:0.0:1651532229.916564:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb blocks from disk: 32768 -> 40960
00010000:00010000:0.0:1651532229.916571:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417728 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.916577:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417728 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.916629:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007e733e68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469077824:12345-10.240.43.64@tcp:4:dd.0 Request processed in 312908us (312947us total) trans 158913794464 rc 0/0
00000100:00100000:0.0:1651532229.916635:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5541
00010000:00010000:0.0:1651532229.916651:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417728 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.916655:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532229.916657:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417728 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.916661:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417728 lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.916682:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417728 lrc: 1/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.916686:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417728 lrc: 0/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.918892:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532229.918902:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469078208
00000100:00100000:0.0:1651532229.918928:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5542
00000100:00100000:0.0:1651532229.918931:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cefde237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469078208:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532229.918943:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41772f lrc: 3/1,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.918951:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.918952:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.918954:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41772f lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.918959:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41772f lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.922696:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41772f lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.922705:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41772f lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.922736:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41772f lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.922748:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532229.922748:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cefde237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469078208:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3815us (3855us total) trans 0 rc 4194304/4194304
00010000:00010000:1.0:1651532229.922750:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41772f lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.922752:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5542
00010000:00010000:1.0:1651532229.922758:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41772f lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.922769:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41772f lrc: 1/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.922772:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41772f lrc: 0/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532229.925074:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532229.925084:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469078592
00000100:00100000:0.0:1651532229.925108:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5543
00000100:00100000:0.0:1651532229.925110:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469078592:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532229.925130:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3a:0x0] initial LVB size: 20971520, mtime: 0x627061c5, atime: 0x0, ctime: 0x627061c5, blocks: 0xa000
00010000:00010000:0.0:1651532229.925132:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417736 lrc: 3/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.925137:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.925139:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532229.925141:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417736 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.925146:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417736 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532230.306371:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794465 is committed
00002000:00010000:0.0:1651532230.306455:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb size from disk: 20971520 -> 25165824
00002000:00010000:0.0:1651532230.306458:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb blocks from disk: 40960 -> 49152
00010000:00010000:0.0:1651532230.306465:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417736 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.306472:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417736 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.306500:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417736 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.306506:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532230.306508:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417736 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.306512:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417736 lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532230.306518:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000effe202c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469078592:12345-10.240.43.64@tcp:4:dd.0 Request processed in 381405us (381443us total) trans 158913794465 rc 0/0
00010000:00010000:1.0:1651532230.306522:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417736 lrc: 1/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532230.306524:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5543
00010000:00010000:1.0:1651532230.306525:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417736 lrc: 0/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532230.308986:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.308996:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469078976
00000100:00100000:0.0:1651532230.309021:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5544
00000100:00100000:0.0:1651532230.309023:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c4207f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469078976:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532230.309037:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41773d lrc: 3/1,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.309042:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532230.309043:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532230.309046:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41773d lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.309054:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41773d lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.312619:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41773d lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.312628:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41773d lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532230.312665:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c4207f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469078976:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3639us (3678us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.312671:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5544
00010000:00010000:0.0:1651532230.312685:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41773d lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.312689:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532230.312691:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41773d lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.312694:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41773d lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.312704:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41773d lrc: 1/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.312706:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41773d lrc: 0/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532230.315023:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.315034:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469079360
00000100:00100000:0.0:1651532230.315060:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5545
00000100:00100000:0.0:1651532230.315062:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469079360:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532230.315082:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3a:0x0] initial LVB size: 25165824, mtime: 0x627061c5, atime: 0x0, ctime: 0x627061c5, blocks: 0xc000
00010000:00010000:0.0:1651532230.315085:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417744 lrc: 3/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.315089:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532230.315090:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532230.315092:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417744 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.315097:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417744 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532230.534694:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794466 is committed
00002000:00010000:0.0:1651532230.534766:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb size from disk: 25165824 -> 29360128
00002000:00010000:0.0:1651532230.534769:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb mtime from disk: 1651532229 -> 1651532230
00002000:00010000:0.0:1651532230.534770:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb ctime from disk: 1651532229 -> 1651532230
00002000:00010000:0.0:1651532230.534771:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb blocks from disk: 49152 -> 57344
00010000:00010000:0.0:1651532230.534778:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417744 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.534784:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417744 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.534814:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417744 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.534820:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a925ecb already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532230.534822:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417744 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.534826:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417744 lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.534835:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417744 lrc: 1/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.534837:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417744 lrc: 0/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532230.534844:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ba7116c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469079360:12345-10.240.43.64@tcp:4:dd.0 Request processed in 219780us (219819us total) trans 158913794466 rc 0/0
00000100:00100000:0.0:1651532230.534850:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5545
00000100:00100000:0.0:1651532230.537100:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.537111:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469079744
00000100:00100000:0.0:1651532230.537134:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5546
00000100:00100000:0.0:1651532230.537137:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469079744:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532230.537150:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41774b lrc: 3/1,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.537156:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532230.537157:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532230.537159:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41774b lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.537164:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41774b lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.540237:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41774b lrc: 3/1,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.540245:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41774b lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532230.540286:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ca2757 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469079744:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3148us (3186us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.540293:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5546
00010000:00010000:0.0:1651532230.540308:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41774b lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.540312:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532230.540314:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41774b lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.540318:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41774b lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.540326:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41774b lrc: 1/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.540329:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41774b lrc: 0/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532230.542601:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.542611:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469080128
00000100:00100000:0.0:1651532230.542637:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5547
00000100:00100000:0.0:1651532230.542639:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469080128:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532230.542659:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3a:0x0] initial LVB size: 29360128, mtime: 0x627061c6, atime: 0x0, ctime: 0x627061c6, blocks: 0xe000
00010000:00010000:0.0:1651532230.542661:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417752 lrc: 3/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.542666:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532230.542667:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532230.542669:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417752 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.542674:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417752 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532230.840481:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794467 is committed
00002000:00010000:0.0:1651532230.840554:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb size from disk: 29360128 -> 33554432
00002000:00010000:0.0:1651532230.840557:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3a:0x0] updating lvb blocks from disk: 57344 -> 65536
00010000:00010000:0.0:1651532230.840564:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417752 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.840570:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417752 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.840599:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417752 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.840605:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532230.840607:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417752 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.840612:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417752 lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532230.840620:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073b42bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469080128:12345-10.240.43.64@tcp:4:dd.0 Request processed in 297978us (298018us total) trans 158913794467 rc 0/0
00000100:00100000:0.0:1651532230.840626:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5547
00010000:00010000:1.0:1651532230.840628:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417752 lrc: 1/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.840634:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417752 lrc: 0/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532230.847637:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.847666:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469080576
00000100:00100000:1.0:1651532230.847689:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6832
00000100:00100000:1.0:1651532230.847692:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469080576:12345-10.240.43.64@tcp:101:diff.0
00010000:00010000:1.0:1651532230.847700:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532230.847708:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417759 lrc: 2/0,0 mode: --/PR res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fda7 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532230.847715:0:323275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3a:0x0] initial LVB size: 33554432, mtime: 0x627061c6, atime: 0x0, ctime: 0x627061c6, blocks: 0x10000
00010000:00010000:1.0:1651532230.847723:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532230.847724:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532230.847728:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417759 lrc: 3/0,0 mode: PR/PR res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda7 expref: 8 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532230.847734:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417759 lrc: 3/0,0 mode: PR/PR res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda7 expref: 8 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532230.847739:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000afe85794, rc 0)
00000100:00100000:1.0:1651532230.847758:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043fbdb71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469080576:12345-10.240.43.64@tcp:101:diff.0 Request processed in 65us (121us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532230.847761:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6832
00000100:00100000:0.0:1651532230.850171:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.850180:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469080896
00002000:00100000:0.0:1651532230.850192:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d39:0x0] (0->2097151)  req@000000003d32eafd x1731754469080896/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.850197:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003d32eafd with x1731754469080896 ext(0->2097151)
00002000:00010000:0.0:1651532230.850199:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003d32eafd
00000100:00100000:0.0:1651532230.850212:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5548
00000100:00100000:0.0:1651532230.850214:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469080896:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.851792:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d32eafd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469080896:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1575us (1619us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532230.851798:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5548
00002000:00100000:0.0:1651532230.851818:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d39:0x0] (0->2097151)  req@000000003d32eafd x1731754469080896/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532230.851823:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003d32eafd with x1731754469080896 ext(0->2097151)
00002000:00010000:0.0:1651532230.851825:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003d32eafd
00000100:00100000:0.0:1651532230.857151:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.857162:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469081216
00002000:00100000:0.0:1651532230.857175:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3a:0x0] (0->2097151)  req@0000000098606df5 x1731754469081216/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.857179:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000098606df5 with x1731754469081216 ext(0->2097151)
00002000:00010000:0.0:1651532230.857181:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000098606df5
00000100:00100000:0.0:1651532230.857194:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5549
00000100:00100000:0.0:1651532230.857197:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098606df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081216:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.858630:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098606df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081216:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1431us (1478us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532230.858635:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5549
00002000:00100000:0.0:1651532230.858640:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3a:0x0] (0->2097151)  req@0000000098606df5 x1731754469081216/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532230.858644:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000098606df5 with x1731754469081216 ext(0->2097151)
00002000:00010000:0.0:1651532230.858646:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000098606df5
00000100:00100000:0.0:1651532230.864273:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.864284:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469081408
00002000:00100000:0.0:1651532230.864298:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d39:0x0] (2097152->4194303)  req@00000000165838fe x1731754469081408/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.864328:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000165838fe with x1731754469081408 ext(2097152->4194303)
00002000:00010000:0.0:1651532230.864330:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000165838fe
00000100:00100000:0.0:1651532230.864344:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5550
00000100:00100000:0.0:1651532230.864347:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081408:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.865852:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000165838fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081408:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1502us (1578us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532230.865856:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5550
00002000:00100000:0.0:1651532230.865861:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d39:0x0] (2097152->4194303)  req@00000000165838fe x1731754469081408/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532230.865865:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000165838fe with x1731754469081408 ext(2097152->4194303)
00002000:00010000:0.0:1651532230.865867:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000165838fe
00000100:00100000:0.0:1651532230.869491:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.869500:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469081728
00002000:00100000:0.0:1651532230.869513:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3a:0x0] (2097152->4194303)  req@0000000009ace046 x1731754469081728/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.869517:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000009ace046 with x1731754469081728 ext(2097152->4194303)
00002000:00010000:0.0:1651532230.869518:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000009ace046
00000100:00100000:0.0:1651532230.869529:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5551
00000100:00100000:0.0:1651532230.869532:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081728:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.870938:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009ace046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081728:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1404us (1446us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532230.870943:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5551
00002000:00100000:0.0:1651532230.870972:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3a:0x0] (2097152->4194303)  req@0000000009ace046 x1731754469081728/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532230.870976:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000009ace046 with x1731754469081728 ext(2097152->4194303)
00002000:00010000:0.0:1651532230.870978:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000009ace046
00000100:00100000:0.0:1651532230.876813:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.876825:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469081920
00002000:00100000:0.0:1651532230.876839:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d39:0x0] (4194304->8388607)  req@0000000073eec7ed x1731754469081920/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.876843:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073eec7ed with x1731754469081920 ext(4194304->8388607)
00002000:00010000:0.0:1651532230.876844:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000073eec7ed
00000100:00100000:0.0:1651532230.876858:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5552
00000100:00100000:0.0:1651532230.876861:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073eec7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081920:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.879576:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073eec7ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081920:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2712us (2770us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.879583:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5552
00002000:00100000:0.0:1651532230.879589:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d39:0x0] (4194304->8388607)  req@0000000073eec7ed x1731754469081920/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.879593:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073eec7ed with x1731754469081920 ext(4194304->8388607)
00002000:00010000:0.0:1651532230.879596:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000073eec7ed
00000100:00100000:0.0:1651532230.885380:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.885391:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469082240
00002000:00100000:0.0:1651532230.885415:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3a:0x0] (4194304->8388607)  req@00000000d4c10389 x1731754469082240/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.885419:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d4c10389 with x1731754469082240 ext(4194304->8388607)
00002000:00010000:0.0:1651532230.885421:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d4c10389
00000100:00100000:0.0:1651532230.885435:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5553
00000100:00100000:0.0:1651532230.885437:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469082240:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.888017:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c10389 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469082240:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2576us (2634us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.888023:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5553
00002000:00100000:0.0:1651532230.888029:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3a:0x0] (4194304->8388607)  req@00000000d4c10389 x1731754469082240/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.888034:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d4c10389 with x1731754469082240 ext(4194304->8388607)
00002000:00010000:0.0:1651532230.888036:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d4c10389
00000100:00100000:0.0:1651532230.900330:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.900343:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.900362:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469082432
00000100:00100000:1.0:1651532230.900377:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469082496
00002000:00100000:0.0:1651532230.900380:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d39:0x0] (8388608->12582911)  req@000000001b5d2182 x1731754469082432/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.900386:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001b5d2182 with x1731754469082432 ext(8388608->12582911)
00002000:00010000:0.0:1651532230.900388:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001b5d2182
00002000:00100000:1.0:1651532230.900391:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d39:0x0] (12582912->16777215)  req@000000002292cef9 x1731754469082496/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:0.0:1651532230.900411:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5554
00000100:00100000:0.0:1651532230.900414:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469082432:12345-10.240.43.64@tcp:3:diff.0
00002000:00100000:1.0:1651532230.900416:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002292cef9 with x1731754469082496 ext(12582912->16777215)
00002000:00010000:1.0:1651532230.900419:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002292cef9
00000100:00100000:1.0:1651532230.900431:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5555
00000100:00100000:1.0:1651532230.900433:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469082496:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.905361:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b5d2182 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469082432:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4943us (5030us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.905369:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5554
00002000:00100000:0.0:1651532230.905376:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d39:0x0] (8388608->12582911)  req@000000001b5d2182 x1731754469082432/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.905384:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001b5d2182 with x1731754469082432 ext(8388608->12582911)
00002000:00010000:0.0:1651532230.905387:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001b5d2182
00000100:00100000:1.0:1651532230.905632:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002292cef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469082496:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5197us (5288us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.905637:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5555
00002000:00100000:1.0:1651532230.905640:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d39:0x0] (12582912->16777215)  req@000000002292cef9 x1731754469082496/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.905644:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002292cef9 with x1731754469082496 ext(12582912->16777215)
00002000:00010000:1.0:1651532230.905646:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002292cef9
00000100:00100000:0.0:1651532230.914714:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.914738:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.914746:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469083200
00002000:00100000:1.0:1651532230.914764:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3a:0x0] (12582912->16777215)  req@000000000de3b5b0 x1731754469083200/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.914768:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000de3b5b0 with x1731754469083200 ext(12582912->16777215)
00002000:00010000:1.0:1651532230.914770:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000de3b5b0
00000100:00100000:1.0:1651532230.914782:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469083136
00002000:00100000:1.0:1651532230.914787:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3a:0x0] (8388608->12582911)  req@00000000eeac2f5c x1731754469083136/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.914790:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000eeac2f5c with x1731754469083136 ext(8388608->12582911)
00002000:00010000:1.0:1651532230.914791:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000eeac2f5c
00000100:00100000:1.0:1651532230.914797:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5556
00000100:00100000:1.0:1651532230.914799:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469083200:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.914800:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5557
00000100:00100000:0.0:1651532230.914812:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469083136:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.919579:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eeac2f5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469083136:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4772us (4837us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.919587:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5557
00002000:00100000:0.0:1651532230.919593:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3a:0x0] (8388608->12582911)  req@00000000eeac2f5c x1731754469083136/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.919598:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000eeac2f5c with x1731754469083136 ext(8388608->12582911)
00002000:00010000:0.0:1651532230.919601:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000eeac2f5c
00000100:00100000:1.0:1651532230.919859:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000de3b5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469083200:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5057us (5145us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.919864:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5556
00002000:00100000:1.0:1651532230.919867:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3a:0x0] (12582912->16777215)  req@000000000de3b5b0 x1731754469083200/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.919871:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000de3b5b0 with x1731754469083200 ext(12582912->16777215)
00002000:00010000:1.0:1651532230.919873:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000de3b5b0
00000100:00100000:0.0:1651532230.939175:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.939205:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469083456
00002000:00100000:1.0:1651532230.939229:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d39:0x0] (16777216->20971519)  req@000000002bba3579 x1731754469083456/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.939234:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002bba3579 with x1731754469083456 ext(16777216->20971519)
00002000:00010000:1.0:1651532230.939237:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002bba3579
00000100:00100000:1.0:1651532230.939252:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5558
00000100:00100000:1.0:1651532230.939255:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469083456:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.939518:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.939844:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469083520
00002000:00100000:1.0:1651532230.939854:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d39:0x0] (20971520->25165823)  req@000000004020883b x1731754469083520/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.939858:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004020883b with x1731754469083520 ext(20971520->25165823)
00002000:00010000:1.0:1651532230.939859:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004020883b
00000100:00100000:1.0:1651532230.939875:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5559
00000100:00100000:1.0:1651532230.939877:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469083520:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.944010:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bba3579 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469083456:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4749us (4834us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.944020:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5558
00002000:00100000:1.0:1651532230.944027:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d39:0x0] (16777216->20971519)  req@000000002bba3579 x1731754469083456/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.944038:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002bba3579 with x1731754469083456 ext(16777216->20971519)
00002000:00010000:1.0:1651532230.944042:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002bba3579
00000100:00100000:0.0:1651532230.945774:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.945787:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.945819:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469084096
00000100:00100000:0.0:1651532230.945820:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469084160
00002000:00100000:1.0:1651532230.945840:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3a:0x0] (16777216->20971519)  req@000000008116432e x1731754469084096/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.945840:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3a:0x0] (20971520->25165823)  req@000000009234d2c1 x1731754469084160/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.945845:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008116432e with x1731754469084096 ext(16777216->20971519)
00002000:00100000:0.0:1651532230.945845:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009234d2c1 with x1731754469084160 ext(20971520->25165823)
00002000:00010000:1.0:1651532230.945848:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008116432e
00002000:00010000:0.0:1651532230.945848:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009234d2c1
00000100:00100000:1.0:1651532230.945866:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5560
00000100:00100000:1.0:1651532230.945869:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754469084096:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.945869:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5561
00000100:00100000:0.0:1651532230.945872:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754469084160:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.946174:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004020883b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469083520:12345-10.240.43.64@tcp:3:diff.0 Request processed in 6288us (6648us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.946179:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5559
00002000:00100000:1.0:1651532230.946182:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d39:0x0] (20971520->25165823)  req@000000004020883b x1731754469083520/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.946186:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004020883b with x1731754469083520 ext(20971520->25165823)
00002000:00010000:1.0:1651532230.946188:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004020883b
00000100:00100000:1.0:1651532230.951455:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008116432e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469084096:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5581us (5680us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.951463:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5560
00002000:00100000:1.0:1651532230.951470:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3a:0x0] (16777216->20971519)  req@000000008116432e x1731754469084096/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.951486:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008116432e with x1731754469084096 ext(16777216->20971519)
00002000:00010000:1.0:1651532230.951489:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008116432e
00000100:00100000:0.0:1651532230.951694:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009234d2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469084160:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5821us (5906us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.951699:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5561
00002000:00100000:0.0:1651532230.951703:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3a:0x0] (20971520->25165823)  req@000000009234d2c1 x1731754469084160/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.951707:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009234d2c1 with x1731754469084160 ext(20971520->25165823)
00002000:00010000:0.0:1651532230.951709:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009234d2c1
00000100:00100000:0.0:1651532230.970499:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.970511:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.970533:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469084480
00002000:00100000:0.0:1651532230.970553:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d39:0x0] (25165824->29360127)  req@000000000d09c893 x1731754469084480/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.970559:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000d09c893 with x1731754469084480 ext(25165824->29360127)
00002000:00010000:0.0:1651532230.970561:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000d09c893
00000100:00100000:1.0:1651532230.970573:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469084544
00000100:00100000:0.0:1651532230.970573:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5562
00000100:00100000:0.0:1651532230.970576:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469084480:12345-10.240.43.64@tcp:3:diff.0
00002000:00100000:1.0:1651532230.970591:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d39:0x0] (29360128->33554431)  req@0000000047f3a4b3 x1731754469084544/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.970597:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000047f3a4b3 with x1731754469084544 ext(29360128->33554431)
00002000:00010000:1.0:1651532230.970599:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000047f3a4b3
00000100:00100000:1.0:1651532230.970612:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5563
00000100:00100000:1.0:1651532230.970615:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469084544:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.972876:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.972901:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.972924:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469085248
00002000:00100000:0.0:1651532230.972947:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3a:0x0] (29360128->33554431)  req@00000000ec50a138 x1731754469085248/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.972953:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ec50a138 with x1731754469085248 ext(29360128->33554431)
00002000:00010000:0.0:1651532230.972956:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ec50a138
00000100:00100000:0.0:1651532230.972965:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469085184
00002000:00100000:0.0:1651532230.972969:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3a:0x0] (25165824->29360127)  req@000000002ecc4dda x1731754469085184/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/0 e 0 to 0 dl 1651532273 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.972972:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ecc4dda with x1731754469085184 ext(25165824->29360127)
00002000:00010000:0.0:1651532230.972973:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002ecc4dda
00000100:00100000:0.0:1651532230.972982:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5564
00000100:00100000:0.0:1651532230.972985:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469085248:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.973235:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5565
00000100:00100000:0.0:1651532230.973237:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469085184:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.974259:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d09c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469084480:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3681us (3762us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.974263:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5562
00002000:00100000:0.0:1651532230.974267:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d39:0x0] (25165824->29360127)  req@000000000d09c893 x1731754469084480/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.974271:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000d09c893 with x1731754469084480 ext(25165824->29360127)
00002000:00010000:0.0:1651532230.974273:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000d09c893
00000100:00100000:1.0:1651532230.977934:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047f3a4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469084544:12345-10.240.43.64@tcp:3:diff.0 Request processed in 7314us (7417us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.977945:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5563
00002000:00100000:1.0:1651532230.977953:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d39:0x0] (29360128->33554431)  req@0000000047f3a4b3 x1731754469084544/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.977961:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000047f3a4b3 with x1731754469084544 ext(29360128->33554431)
00002000:00010000:1.0:1651532230.977965:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000047f3a4b3
00000100:00100000:0.0:1651532230.981181:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec50a138 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469085248:12345-10.240.43.64@tcp:3:diff.0 Request processed in 8191us (8305us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.981189:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5564
00002000:00100000:0.0:1651532230.981195:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3a:0x0] (29360128->33554431)  req@00000000ec50a138 x1731754469085248/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.981200:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ec50a138 with x1731754469085248 ext(29360128->33554431)
00002000:00010000:0.0:1651532230.981203:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ec50a138
00000100:00100000:0.0:1651532230.984309:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ecc4dda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469085184:12345-10.240.43.64@tcp:3:diff.0 Request processed in 11067us (11404us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.984316:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5565
00002000:00100000:0.0:1651532230.984321:0:330057:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x34d3a:0x0] (25165824->29360127)  req@000000002ecc4dda x1731754469085184/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:728/0 lens 488/440 e 0 to 0 dl 1651532273 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.984325:0:330057:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ecc4dda with x1731754469085184 ext(25165824->29360127)
00002000:00010000:0.0:1651532230.984328:0:330057:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002ecc4dda
00000100:00100000:0.0:1651532231.904869:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532231.904891:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951237312
00000100:00100000:0.0:1651532231.904912:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 5
00000100:00100000:0.0:1651532231.904914:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951237312:12345-10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532231.904946:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086797856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951237312:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 31us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532231.904950:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 5
00000400:00000080:0.0:1651532232.353167:0:331699:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532232.353170:0:331699:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398i: verify parallel dio handles ll_direct_rw_pages errors correctly ========================================================== 22:57:12 (1651532232)
00000100:00100000:0.0:1651532232.384779:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532232.384796:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469087488
00000100:00100000:0.0:1651532232.384834:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6833
00000100:00100000:0.0:1651532232.384837:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:685226:x1731754469087488:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532232.384847:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532232.384859:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417760 lrc: 2/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fded expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532232.384870:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532232.384880:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.384882:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.384886:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417760 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fded expref: 9 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.384894:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417760 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fded expref: 9 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.384899:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9816573, rc 0)
00000100:00100000:0.0:1651532232.384921:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004065b6d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:685226:x1731754469087488:12345-10.240.43.64@tcp:101:dd.0 Request processed in 84us (146us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532232.384925:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6833
00000100:00100000:0.0:1651532232.385663:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532232.385673:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469087616
00002000:00010000:0.0:1651532232.385682:0:330057:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216379/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532232.385684:0:330057:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005a37be9f with x1731754469087616 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532232.385688:0:330057:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005a37be9f.
00000100:00100000:0.0:1651532232.385695:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5566
00000100:00100000:0.0:1651532232.385697:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469087616:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:0.0:1651532232.385762:0:330057:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532232.385764:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb mtime from disk: 0 -> 1651532232
00002000:00010000:0.0:1651532232.385765:0:330057:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532232.385766:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb ctime from disk: 0 -> 1651532232
00002000:00010000:0.0:1651532232.385767:0:330057:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651532232.385779:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a37be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469087616:12345-10.240.43.64@tcp:10:dd.0 Request processed in 81us (116us total) trans 158913794468 rc 0/0
00000100:00100000:0.0:1651532232.385782:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5566
00002000:00010000:0.0:1651532232.385783:0:330057:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216379/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532232.385785:0:330057:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005a37be9f with x1731754469087616 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532232.385786:0:330057:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005a37be9f.
00000100:00100000:0.0:1651532232.423112:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532232.423122:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469087872
00000100:00100000:0.0:1651532232.423136:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5567
00000100:00100000:0.0:1651532232.423138:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469087872:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532232.423149:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423156:0:330281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417760 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fded expref: 10 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423160:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532232.423161:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532232.423162:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 4/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423173:0:330281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417760 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fded expref: 10 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423179:0:330281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417760 lrc: 4/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fded expref: 10 pid: 328039 timeout: 15982 lvb_type: 0
00000100:00100000:0.0:1651532232.423185:0:330281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002df48e45 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:330281:1731745966865344:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532232.423204:0:330281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e2a26397 going to sleep for 6 seconds
00000100:00100000:0.0:1651532232.423534:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532232.423543:0:330056:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469088256
00010000:00010000:0.0:1651532232.423550:0:330056:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417760 lrc: 5/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fded expref: 11 pid: 328039 timeout: 15982 lvb_type: 0
00000100:00100000:0.0:1651532232.423560:0:330056:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 311
00000100:00100000:0.0:1651532232.423562:0:330056:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e4ba846 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469088256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651532232.423566:0:330056:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532232.423571:0:330056:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417760 lrc: 5/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fded expref: 11 pid: 328039 timeout: 15982 lvb_type: 0
00010000:00010000:0.0:1651532232.423576:0:330056:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417760 lrc: 4/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fded expref: 11 pid: 328039 timeout: 15982 lvb_type: 0
00010000:00010000:0.0:1651532232.423584:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.423584:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.423585:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423589:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 4/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423595:0:330056:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532232.423605:0:330056:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e4ba846 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469088256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (71us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532232.423608:0:330056:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 311
00010000:00010000:0.0:1651532232.423644:0:330281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417760 lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fded expref: 10 pid: 328039 timeout: 15982 lvb_type: 0
00000100:00100000:0.0:1651532232.423649:0:330281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002df48e45 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0000_UUID:330281:1731745966865344:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532232.423656:0:330281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423660:0:330281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423663:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532232.753640:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794469 is committed
00002000:00010000:0.0:1651532232.753730:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:0.0:1651532232.753733:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:0.0:1651532232.753741:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.753747:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.753778:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.753787:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532232.753789:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.753797:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532232.753797:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063a3723d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469087872:12345-10.240.43.64@tcp:4:dd.0 Request processed in 330656us (330683us total) trans 158913794469 rc 0/0
00000100:00100000:0.0:1651532232.753815:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5567
00010000:00010000:1.0:1651532232.753819:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.753823:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417767 lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532232.863011:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532232.863023:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469088512
00000100:00100000:0.0:1651532232.863044:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5568
00000100:00100000:0.0:1651532232.863047:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ebfb7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469088512:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532232.863063:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3b:0x0] initial LVB size: 4194304, mtime: 0x627061c8, atime: 0x0, ctime: 0x627061c8, blocks: 0x2000
00010000:00010000:0.0:1651532232.863066:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41776e lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.863074:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.863075:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.863077:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41776e lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.863083:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41776e lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532232.863983:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532232.863991:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469088960
00000100:00100000:0.0:1651532232.864009:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5569
00000100:00100000:0.0:1651532232.864011:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000923e9c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469088960:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532232.864018:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417775 lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.864023:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.864024:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.864025:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417775 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.864029:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417775 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532232.928197:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532232.928211:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951237568
00000100:00100000:1.0:1651532232.928236:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 82
00000100:00100000:1.0:1651532232.928238:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951237568:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532232.928250:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 357060288 pending 4292608 free 81113681920 avail 76938678272
00000100:00100000:1.0:1651532232.928277:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010191686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951237568:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 38us (83us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532232.928280:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 82
00000001:00080000:1.0:1651532233.134773:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794470 is committed
00002000:00010000:0.0:1651532233.134842:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb size from disk: 4194304 -> 8388608
00002000:00010000:0.0:1651532233.134845:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb blocks from disk: 8192 -> 16384
00010000:00010000:0.0:1651532233.134851:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41776e lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.134860:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41776e lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.134894:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41776e lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.134894:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ebfb7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469088512:12345-10.240.43.64@tcp:4:dd.0 Request processed in 271846us (271883us total) trans 158913794470 rc 0/0
00000100:00100000:0.0:1651532233.134898:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5568
00010000:00010000:1.0:1651532233.134914:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532233.134916:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41776e lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.134923:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41776e lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.134937:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41776e lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.134941:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41776e lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532233.220457:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794471 is committed
00010000:00010000:0.0:1651532233.220512:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417775 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.220519:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417775 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.220544:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000923e9c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469088960:12345-10.240.43.64@tcp:4:dd.0 Request processed in 356532us (356561us total) trans 158913794471 rc 0/0
00000100:00100000:0.0:1651532233.220548:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5569
00010000:00010000:0.0:1651532233.220557:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417775 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.220560:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b7f071c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532233.220562:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417775 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.220565:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417775 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.220571:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417775 lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.220574:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417775 lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.256985:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532233.256997:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469089216
00000100:00100000:0.0:1651532233.257016:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5570
00000100:00100000:0.0:1651532233.257018:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068d4eb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469089216:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532233.257033:0:330057:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3b:0x0] initial LVB size: 8388608, mtime: 0x627061c8, atime: 0x0, ctime: 0x627061c8, blocks: 0x4000
00010000:00010000:0.0:1651532233.257036:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41777c lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.257042:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532233.257043:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532233.257044:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41777c lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.257050:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41777c lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.258183:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532233.258198:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469089472
00000100:00100000:1.0:1651532233.258367:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5571
00000100:00100000:1.0:1651532233.258370:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058137681 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469089472:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532233.258382:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417783 lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.258394:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532233.258403:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532233.258404:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417783 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.258410:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417783 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532233.620481:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794472 is committed
00002000:00010000:0.0:1651532233.620549:0:330057:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb size from disk: 8388608 -> 12582912
00002000:00010000:0.0:1651532233.620551:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb mtime from disk: 1651532232 -> 1651532233
00002000:00010000:0.0:1651532233.620553:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb ctime from disk: 1651532232 -> 1651532233
00002000:00010000:0.0:1651532233.620553:0:330057:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb blocks from disk: 16384 -> 24576
00010000:00010000:0.0:1651532233.620560:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41777c lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.620567:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41777c lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.620597:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41777c lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.620603:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b7f071c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532233.620605:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41777c lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.620611:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068d4eb68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469089216:12345-10.240.43.64@tcp:4:dd.0 Request processed in 363590us (363626us total) trans 158913794472 rc 0/0
00010000:00010000:1.0:1651532233.620613:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41777c lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.620616:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5570
00010000:00010000:1.0:1651532233.620638:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41777c lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.620641:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f41777c lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532233.663534:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794473 is committed
00010000:00010000:1.0:1651532233.663581:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417783 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.663585:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417783 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532233.663617:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058137681 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469089472:12345-10.240.43.64@tcp:4:dd.0 Request processed in 405246us (405435us total) trans 158913794473 rc 0/0
00010000:00010000:0.0:1651532233.663619:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417783 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532233.663622:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5571
00010000:00010000:0.0:1651532233.663625:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532233.663626:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417783 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.663630:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417783 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.663637:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417783 lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.663639:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417783 lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.700035:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532233.700062:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469089856
00000100:00100000:1.0:1651532233.700088:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5572
00000100:00100000:1.0:1651532233.700091:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087214ada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469089856:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532233.700106:0:330279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3b:0x0] initial LVB size: 12582912, mtime: 0x627061c9, atime: 0x0, ctime: 0x627061c9, blocks: 0x6000
00010000:00010000:1.0:1651532233.700109:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41778a lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.700117:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532233.700118:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532233.700120:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41778a lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.700126:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41778a lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.700782:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532233.700795:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469090240
00000100:00100000:0.0:1651532233.700833:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5573
00000100:00100000:0.0:1651532233.700836:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d34441ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469090240:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532233.700849:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417791 lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.700924:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532233.700940:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532233.700942:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417791 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.700951:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417791 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532233.962897:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794474 is committed
00002000:00010000:0.0:1651532233.962980:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb size from disk: 12582912 -> 16777216
00002000:00010000:0.0:1651532233.962983:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb blocks from disk: 24576 -> 32768
00010000:00010000:0.0:1651532233.962989:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41778a lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.962996:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41778a lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.963042:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087214ada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469089856:12345-10.240.43.64@tcp:4:dd.0 Request processed in 262949us (263006us total) trans 158913794474 rc 0/0
00010000:00010000:1.0:1651532233.963043:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41778a lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.963048:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5572
00010000:00010000:1.0:1651532233.963050:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532233.963052:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41778a lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.963056:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41778a lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.963067:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41778a lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.963070:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41778a lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532234.026833:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794475 is committed
00010000:00010000:0.0:1651532234.026881:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417791 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.026886:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417791 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.026913:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417791 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.026914:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d34441ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469090240:12345-10.240.43.64@tcp:4:dd.0 Request processed in 326078us (326133us total) trans 158913794475 rc 0/0
00000100:00100000:0.0:1651532234.026918:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5573
00010000:00010000:1.0:1651532234.026920:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b7f071c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532234.026922:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417791 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.026925:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417791 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.026930:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417791 lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.026933:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417791 lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.063020:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532234.063032:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469090624
00000100:00100000:0.0:1651532234.063053:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5574
00000100:00100000:0.0:1651532234.063056:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3487fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469090624:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532234.063073:0:330057:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3b:0x0] initial LVB size: 16777216, mtime: 0x627061c9, atime: 0x0, ctime: 0x627061c9, blocks: 0x8000
00010000:00010000:0.0:1651532234.063076:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417798 lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.063081:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.063082:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.063084:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417798 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.063090:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417798 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.064150:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532234.064164:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469090880
00000100:00100000:1.0:1651532234.064307:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5575
00000100:00100000:1.0:1651532234.064310:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd4c4f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469090880:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532234.064319:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41779f lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.064324:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.064330:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.064331:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41779f lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.064335:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41779f lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532234.307127:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794476 is committed
00002000:00010000:0.0:1651532234.307189:0:330057:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb size from disk: 16777216 -> 20971520
00002000:00010000:0.0:1651532234.307191:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb mtime from disk: 1651532233 -> 1651532234
00002000:00010000:0.0:1651532234.307193:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb ctime from disk: 1651532233 -> 1651532234
00002000:00010000:0.0:1651532234.307194:0:330057:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb blocks from disk: 32768 -> 40960
00010000:00010000:0.0:1651532234.307200:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417798 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.307207:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417798 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.307245:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3487fd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469090624:12345-10.240.43.64@tcp:4:dd.0 Request processed in 244187us (244225us total) trans 158913794476 rc 0/0
00000100:00100000:0.0:1651532234.307251:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5574
00010000:00010000:0.0:1651532234.307265:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417798 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.307269:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532234.307271:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417798 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.307274:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417798 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.307283:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417798 lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.307286:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417798 lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532234.344819:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794477 is committed
00010000:00010000:1.0:1651532234.344857:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41779f lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.344862:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41779f lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532234.344892:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd4c4f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469090880:12345-10.240.43.64@tcp:4:dd.0 Request processed in 280582us (280742us total) trans 158913794477 rc 0/0
00000100:00100000:1.0:1651532234.344896:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5575
00010000:00010000:1.0:1651532234.344905:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41779f lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.344909:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532234.344910:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41779f lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.344913:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41779f lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.344919:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41779f lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.344922:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f41779f lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.382038:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532234.382062:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469091264
00000100:00100000:1.0:1651532234.382088:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5576
00000100:00100000:1.0:1651532234.382090:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e7181f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469091264:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532234.382105:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3b:0x0] initial LVB size: 20971520, mtime: 0x627061ca, atime: 0x0, ctime: 0x627061ca, blocks: 0xa000
00010000:00010000:1.0:1651532234.382108:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177a6 lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.382113:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.382114:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.382116:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177a6 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.382122:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177a6 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532234.687282:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794478 is committed
00002000:00010000:1.0:1651532234.687332:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb size from disk: 20971520 -> 25165824
00002000:00010000:1.0:1651532234.687334:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb blocks from disk: 40960 -> 49152
00010000:00010000:1.0:1651532234.687342:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177a6 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.687348:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177a6 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.687377:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177a6 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.687384:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532234.687387:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177a6 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532234.687395:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e7181f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469091264:12345-10.240.43.64@tcp:4:dd.0 Request processed in 305302us (305356us total) trans 158913794478 rc 0/0
00010000:00010000:0.0:1651532234.687407:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177a6 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532234.687410:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5576
00010000:00010000:0.0:1651532234.687418:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177a6 lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.687421:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177a6 lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.700216:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532234.700230:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951237760
00000100:00100000:0.0:1651532234.700247:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6834
00000100:00100000:0.0:1651532234.700249:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a43237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951237760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:0.0:1651532234.700262:0:323275:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216377 count 1
00010000:00010000:0.0:1651532234.700271:0:323275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 3/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.700279:0:323275:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4176e2 lrc: 2/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd84 expref: 7 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532234.700283:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.700283:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.700284:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 4/0,1 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.700298:0:323275:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4176e2 lrc: 3/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd84 expref: 7 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532234.700303:0:323275:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4176e2 lrc: 4/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd84 expref: 7 pid: 323275 timeout: 15984 lvb_type: 1
00000100:00100000:0.0:1651532234.700309:0:323275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a01a12cd pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:323275:1731745966865408:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532234.700337:0:323275:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b15f8a89 going to sleep for 6 seconds
00000100:00100000:0.0:1651532234.700969:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532234.700978:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469091648
00010000:00010000:0.0:1651532234.700985:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4176e2 lrc: 5/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd84 expref: 8 pid: 323275 timeout: 15984 lvb_type: 1
00000100:00100000:0.0:1651532234.700995:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 312
00000100:00100000:0.0:1651532234.700997:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469091648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651532234.701002:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532234.701003:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4176e2 lrc: 5/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd84 expref: 8 pid: 323275 timeout: 15984 lvb_type: 1
00010000:00010000:0.0:1651532234.701007:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4176e2 lrc: 4/0,0 mode: PR/PR res: [0x34d39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd84 expref: 8 pid: 323275 timeout: 15984 lvb_type: 1
00010000:00010000:0.0:1651532234.701015:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.701016:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.701017:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.701020:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 4/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.701027:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532234.701044:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469091648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532234.701047:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 312
00010000:00010000:0.0:1651532234.701064:0:323275:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4176e2 lrc: 0/0,0 mode: --/PR res: [0x34d39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd84 expref: 7 pid: 323275 timeout: 15984 lvb_type: 1
00000100:00100000:0.0:1651532234.701068:0:323275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a01a12cd pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:323275:1731745966865408:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532234.701074:0:323275:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.701080:0:323275:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.701085:0:323275:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.701089:0:323275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 3/0,1 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.701092:0:323275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.701117:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.701122:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532234.701123:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 2/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.701127:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 3/0,0 mode: PW/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.701133:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 1/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.701136:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4177ad lrc: 0/0,0 mode: --/PW res: [0x34d39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.703881:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a43237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951237760:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3630us (3665us total) trans 158913794479 rc 0/0
00000100:00100000:0.0:1651532234.703887:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6834
00000100:00100000:1.0:1651532234.725095:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532234.725105:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469091840
00000100:00100000:1.0:1651532234.725124:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5577
00000100:00100000:1.0:1651532234.725127:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469091840:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532234.725140:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3b:0x0] initial LVB size: 25165824, mtime: 0x627061ca, atime: 0x0, ctime: 0x627061ca, blocks: 0xc000
00010000:00010000:1.0:1651532234.725142:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177b4 lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.725147:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.725147:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.725148:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177b4 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.725153:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177b4 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532234.992345:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794480 is committed
00000001:00080000:1.0:1651532234.992351:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794479 is committed
00002000:00010000:1.0:1651532234.992438:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb size from disk: 25165824 -> 29360128
00002000:00010000:1.0:1651532234.992440:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb blocks from disk: 49152 -> 57344
00010000:00010000:1.0:1651532234.992448:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177b4 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.992454:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177b4 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532234.992503:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422a85f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469091840:12345-10.240.43.64@tcp:4:dd.0 Request processed in 267374us (267407us total) trans 158913794480 rc 0/0
00000100:00100000:1.0:1651532234.992509:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5577
00010000:00010000:1.0:1651532234.992524:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177b4 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.992528:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532234.992530:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177b4 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.992534:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177b4 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.992543:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177b4 lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.992557:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177b4 lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532235.071094:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532235.071105:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469092352
00000100:00100000:1.0:1651532235.071131:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5578
00000100:00100000:1.0:1651532235.071133:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469092352:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532235.071149:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3b:0x0] initial LVB size: 29360128, mtime: 0x627061ca, atime: 0x0, ctime: 0x627061ca, blocks: 0xe000
00010000:00010000:1.0:1651532235.071151:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177bb lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.071157:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532235.071158:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532235.071160:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177bb lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.071165:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177bb lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532235.071412:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532235.071423:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469092736
00000100:00100000:0.0:1651532235.071439:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5579
00000100:00100000:0.0:1651532235.071441:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469092736:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532235.071452:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4177c2 lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.071458:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532235.071459:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532235.071460:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4177c2 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.071465:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4177c2 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532235.379396:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794481 is committed
00002000:00010000:0.0:1651532235.379508:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb size from disk: 29360128 -> 33554432
00002000:00010000:0.0:1651532235.379511:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb mtime from disk: 1651532234 -> 1651532235
00002000:00010000:0.0:1651532235.379512:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb ctime from disk: 1651532234 -> 1651532235
00002000:00010000:0.0:1651532235.379513:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3b:0x0] updating lvb blocks from disk: 57344 -> 65536
00010000:00010000:0.0:1651532235.379520:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177bb lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.379526:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177bb lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532235.379572:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aab58ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469092352:12345-10.240.43.64@tcp:4:dd.0 Request processed in 308437us (308477us total) trans 158913794481 rc 0/0
00000100:00100000:0.0:1651532235.379579:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5578
00010000:00010000:0.0:1651532235.379596:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177bb lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.379600:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532235.379602:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177bb lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.379606:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177bb lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.379616:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177bb lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.379619:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f4177bb lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532235.419733:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794482 is committed
00010000:00010000:0.0:1651532235.419786:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4177c2 lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.419791:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4177c2 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.419816:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4177c2 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.419823:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532235.419824:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4177c2 lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.419828:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4177c2 lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532235.419829:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a01a12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469092736:12345-10.240.43.64@tcp:4:dd.0 Request processed in 348386us (348418us total) trans 158913794482 rc 0/0
00000100:00100000:0.0:1651532235.419833:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5579
00010000:00010000:1.0:1651532235.419835:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4177c2 lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.419838:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4177c2 lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532235.433241:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532235.433267:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469093504
00000100:00100000:0.0:1651532235.433284:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6835
00000100:00100000:0.0:1651532235.433286:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:685230:x1731754469093504:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532235.433294:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532235.433302:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4177c9 lrc: 2/0,0 mode: --/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fe17 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532235.433308:0:323275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532235.433317:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532235.433317:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532235.433321:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4177c9 lrc: 3/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe17 expref: 8 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.433327:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4177c9 lrc: 3/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe17 expref: 8 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.433332:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000413f87ac, rc 0)
00000100:00100000:0.0:1651532235.433344:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068c2e1a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:685230:x1731754469093504:12345-10.240.43.64@tcp:101:dd.0 Request processed in 57us (105us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532235.433347:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6835
00000100:00100000:1.0:1651532235.433625:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532235.433648:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469093632
00002000:00010000:0.0:1651532235.433656:0:330057:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216380/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532235.433658:0:330057:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000984b42d with x1731754469093632 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532235.433662:0:330057:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000984b42d.
00000100:00100000:0.0:1651532235.433668:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5580
00000100:00100000:0.0:1651532235.433670:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469093632:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:0.0:1651532235.433714:0:330057:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3c:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532235.433715:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3c:0x0] updating lvb mtime from disk: 0 -> 1651532235
00002000:00010000:0.0:1651532235.433717:0:330057:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d3c:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532235.433717:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3c:0x0] updating lvb ctime from disk: 0 -> 1651532235
00002000:00010000:0.0:1651532235.433718:0:330057:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3c:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651532235.433730:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000984b42d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469093632:12345-10.240.43.64@tcp:10:dd.0 Request processed in 60us (105us total) trans 158913794483 rc 0/0
00000100:00100000:0.0:1651532235.433734:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5580
00002000:00010000:0.0:1651532235.433735:0:330057:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216380/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532235.433736:0:330057:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000984b42d with x1731754469093632 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532235.433737:0:330057:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000984b42d.
00000100:00100000:1.0:1651532235.434081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532235.434102:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469093696
00000100:00100000:0.0:1651532235.434112:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6836
00000100:00100000:0.0:1651532235.434114:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469093696:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532235.434117:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532235.434122:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4177d0 lrc: 2/0,0 mode: --/PR res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fe1e expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532235.434127:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3b:0x0] initial LVB size: 33554432, mtime: 0x627061cb, atime: 0x0, ctime: 0x627061cb, blocks: 0x10000
00010000:00010000:0.0:1651532235.434131:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532235.434132:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532235.434134:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4177d0 lrc: 3/0,0 mode: PR/PR res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe1e expref: 10 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532235.434139:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4177d0 lrc: 3/0,0 mode: PR/PR res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe1e expref: 10 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532235.434143:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00000100:00100000:0.0:1651532235.434154:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088d651f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469093696:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (74us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532235.434157:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6836
00000400:00000080:1.0:1651532236.783493:0:331917:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651532236.783495:0:331917:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398j: test parallel dio where stripe size > rpc_size ========================================================== 22:57:16 (1651532236)
00000100:00100000:1.0:1651532236.835998:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532236.836029:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469096320
00000100:00100000:0.0:1651532236.836054:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6837
00000100:00100000:0.0:1651532236.836056:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:685825:x1731754469096320:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532236.836067:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532236.836080:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4177d7 lrc: 2/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fe79 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532236.836092:0:323275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532236.836103:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.836104:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.836108:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4177d7 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe79 expref: 11 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.836115:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4177d7 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe79 expref: 11 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.836121:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b80df6d8, rc 0)
00000100:00100000:0.0:1651532236.836145:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac010c44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:685825:x1731754469096320:12345-10.240.43.64@tcp:101:dd.0 Request processed in 88us (151us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532236.836149:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6837
00000100:00100000:1.0:1651532236.836423:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532236.836439:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469096384
00000100:00100000:0.0:1651532236.836449:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6838
00000100:00100000:0.0:1651532236.836451:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c207e8e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:685825:x1731754469096384:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532236.836454:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532236.836459:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4177de lrc: 2/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fe80 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532236.836465:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532236.836469:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.836470:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.836472:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4177de lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe80 expref: 12 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.836476:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4177de lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe80 expref: 12 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.836480:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032e8427e, rc 0)
00000100:00100000:0.0:1651532236.836491:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c207e8e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:685825:x1731754469096384:12345-10.240.43.64@tcp:101:dd.0 Request processed in 40us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532236.836494:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6838
00000100:00100000:1.0:1651532236.836757:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532236.836768:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532236.836781:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469096448
00002000:00010000:0.0:1651532236.836791:0:330281:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216381/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532236.836792:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000843fdbf4 with x1731754469096448 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532236.836796:0:330281:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000843fdbf4.
00000100:00100000:0.0:1651532236.836815:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469096512
00002000:00010000:0.0:1651532236.836819:0:330281:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216382/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532236.836820:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000090f29ce2 with x1731754469096512 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532236.836821:0:330281:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000090f29ce2.
00000100:00100000:0.0:1651532236.836827:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5581
00000100:00100000:0.0:1651532236.836829:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000843fdbf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469096448:12345-10.240.43.64@tcp:10:dd.0
00000100:00100000:1.0:1651532236.836831:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5582
00000100:00100000:1.0:1651532236.836834:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090f29ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469096512:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:0.0:1651532236.836893:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532236.836895:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb mtime from disk: 0 -> 1651532236
00002000:00010000:0.0:1651532236.836896:0:330281:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532236.836897:0:330057:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532236.836897:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb ctime from disk: 0 -> 1651532236
00002000:00010000:0.0:1651532236.836898:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb blocks from disk: 0 -> 0
00002000:00010000:1.0:1651532236.836899:0:330057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb mtime from disk: 0 -> 1651532236
00002000:00010000:1.0:1651532236.836900:0:330057:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532236.836901:0:330057:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb ctime from disk: 0 -> 1651532236
00002000:00010000:1.0:1651532236.836901:0:330057:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651532236.836910:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000843fdbf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469096448:12345-10.240.43.64@tcp:10:dd.0 Request processed in 80us (154us total) trans 158913794485 rc 0/0
00000100:00100000:1.0:1651532236.836913:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090f29ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469096512:12345-10.240.43.64@tcp:10:dd.0 Request processed in 79us (145us total) trans 158913794484 rc 0/0
00000100:00100000:0.0:1651532236.836913:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5581
00002000:00010000:0.0:1651532236.836915:0:330281:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216381/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532236.836916:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000843fdbf4 with x1731754469096448 ext(0->18446744073709551615)
00000100:00100000:1.0:1651532236.836917:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5582
00002000:00010000:0.0:1651532236.836917:0:330281:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000843fdbf4.
00002000:00010000:1.0:1651532236.836918:0:330057:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216382/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532236.836919:0:330057:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000090f29ce2 with x1731754469096512 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532236.836922:0:330057:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000090f29ce2.
00000100:00100000:1.0:1651532236.877030:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532236.877041:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532236.877054:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469096704
00000100:00100000:0.0:1651532236.877064:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469096640
00000100:00100000:1.0:1651532236.877072:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5583
00000100:00100000:1.0:1651532236.877074:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047562140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469096704:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532236.877081:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5584
00000100:00100000:0.0:1651532236.877083:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469096640:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532236.877085:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.877090:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.877093:0:330057:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4177d7 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe79 expref: 15 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.877097:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532236.877098:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532236.877099:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 4/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.877103:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532236.877104:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532236.877105:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.877109:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.877116:0:330057:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4177d7 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe79 expref: 15 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.877121:0:330057:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4177d7 lrc: 4/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe79 expref: 15 pid: 323275 timeout: 15986 lvb_type: 0
00000100:00100000:1.0:1651532236.877130:0:330057:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0d4cada pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:330057:1731745966865472:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532236.877155:0:330057:0:(client.c:2492:ptlrpc_set_wait()) set 0000000086af9759 going to sleep for 6 seconds
00000100:00100000:1.0:1651532236.877963:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532236.877978:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532236.877986:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532236.877992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532236.878001:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532236.878001:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469096896
00000100:00100000:1.0:1651532236.878010:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532236.878023:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097024
00000100:00100000:0.0:1651532236.878029:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097152
00000100:00100000:0.0:1651532236.878035:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469096960
00000100:00100000:0.0:1651532236.878039:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097088
00000100:00100000:0.0:1651532236.878045:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097216
00000100:00100000:0.0:1651532236.878049:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5585
00000100:00100000:0.0:1651532236.878051:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754469096896:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532236.878058:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878062:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532236.878063:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532236.878064:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532236.878067:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5586
00010000:00010000:0.0:1651532236.878067:0:330280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532236.878070:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754469097024:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532236.878075:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5587
00000100:00100000:0.0:1651532236.878077:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754469097152:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532236.878079:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878081:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.878087:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532236.878088:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532236.878089:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.878092:0:330054:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878101:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4177de lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe80 expref: 21 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532236.878102:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5588
00000100:00100000:1.0:1651532236.878104:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754469096960:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532236.878104:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532236.878105:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532236.878106:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 4/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.878109:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878115:0:330055:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4177de lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe80 expref: 21 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878122:0:330055:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4177de lrc: 4/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe80 expref: 21 pid: 328039 timeout: 15986 lvb_type: 0
00010000:00010000:1.0:1651532236.878126:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651532236.878126:0:330055:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002df48e45 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:330055:1731745966865536:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532236.878127:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532236.878127:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.878130:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532236.878144:0:330055:0:(client.c:2492:ptlrpc_set_wait()) set 0000000003c3ab84 going to sleep for 6 seconds
00000100:00100000:1.0:1651532236.878149:0:330057:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0d4cada pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:330057:1731745966865472:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532236.878153:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5589
00000100:00100000:0.0:1651532236.878154:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754469097088:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532236.878156:0:330057:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878161:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878165:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532236.878166:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532236.878167:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878170:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532236.878174:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532236.878177:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5590
00000100:00100000:0.0:1651532236.878178:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754469097216:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532236.878190:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878193:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532236.878194:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532236.878195:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878198:0:330059:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532236.878209:0:330056:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097344
00010000:00010000:0.0:1651532236.878215:0:330056:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4177d7 lrc: 4/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe79 expref: 22 pid: 323275 timeout: 15986 lvb_type: 0
00000100:00100000:0.0:1651532236.878223:0:330056:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 313
00000100:00100000:0.0:1651532236.878225:0:330056:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f54597d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754469097344:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651532236.878229:0:330056:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532236.878234:0:330056:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4177d7 lrc: 4/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe79 expref: 22 pid: 323275 timeout: 15986 lvb_type: 0
00010000:00010000:0.0:1651532236.878238:0:330056:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4177d7 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe79 expref: 22 pid: 323275 timeout: 15986 lvb_type: 0
00010000:00010000:0.0:1651532236.878246:0:330056:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4177d7 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe79 expref: 22 pid: 323275 timeout: 15986 lvb_type: 0
00010000:00010000:0.0:1651532236.878250:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878250:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878251:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878254:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 4/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878258:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878259:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878259:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878262:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 4/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878265:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878265:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878266:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878268:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 4/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878271:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878271:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878272:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878274:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 4/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878291:0:330056:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532236.878302:0:330056:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f54597d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754469097344:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 76us (128us total) trans 0 rc 0/0
00010000:00010000:1.0:1651532236.878304:0:330054:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532236.878305:0:330056:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 313
00010000:00010000:1.0:1651532236.878308:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878344:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878349:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878576:0:330280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878580:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532236.878605:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532236.878649:0:330057:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.878663:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532236.878758:0:330055:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002df48e45 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:330055:1731745966865536:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532236.878762:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532236.878770:0:330056:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097408
00010000:00010000:0.0:1651532236.878774:0:330056:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4177de lrc: 4/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe80 expref: 24 pid: 328039 timeout: 15986 lvb_type: 0
00000100:00100000:0.0:1651532236.878784:0:330056:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 314
00000100:00100000:0.0:1651532236.878786:0:330056:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754469097408:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651532236.878789:0:330056:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532236.878793:0:330056:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4177de lrc: 4/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe80 expref: 24 pid: 328039 timeout: 15986 lvb_type: 0
00010000:00010000:0.0:1651532236.878843:0:330056:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4177de lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe80 expref: 24 pid: 328039 timeout: 15986 lvb_type: 0
00010000:00010000:0.0:1651532236.878853:0:330056:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4177de lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe80 expref: 24 pid: 328039 timeout: 15986 lvb_type: 0
00010000:00010000:0.0:1651532236.878857:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878857:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878858:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878861:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 4/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878864:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878865:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878865:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878868:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 4/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878871:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878871:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878872:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878874:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 4/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878877:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878877:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532236.878878:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878881:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 4/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878892:0:330056:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532236.878901:0:330056:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754469097408:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 114us (297us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532236.878904:0:330056:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 314
00010000:00010000:0.0:1651532236.878944:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.878948:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.878968:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532236.878982:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.879195:0:330059:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.879226:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.879392:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532236.879396:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532237.271566:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794486 is committed
00002000:00010000:0.0:1651532237.271659:0:330054:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:0.0:1651532237.271662:0:330054:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:0.0:1651532237.271669:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.271676:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.271708:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.271715:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.271717:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.271730:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008eeecdba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754469097024:12345-10.240.43.64@tcp:4:dd.0 Request processed in 393657us (393750us total) trans 158913794486 rc 0/0
00000100:00100000:0.0:1651532237.271736:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5586
00010000:00010000:1.0:1651532237.271743:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.271755:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.271759:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4177fa lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532237.310244:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794493 is committed
00002000:00010000:0.0:1651532237.310300:0:330059:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:0.0:1651532237.310302:0:330059:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:0.0:1651532237.310305:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310310:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.310333:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f6dd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754469097216:12345-10.240.43.64@tcp:4:dd.0 Request processed in 432154us (432323us total) trans 158913794491 rc 0/0
00010000:00010000:1.0:1651532237.310335:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.310337:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5590
00010000:00010000:1.0:1651532237.310339:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.310341:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310357:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310364:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310366:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417816 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310370:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310374:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.310388:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b34099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754469097152:12345-10.240.43.64@tcp:4:dd.0 Request processed in 432310us (432401us total) trans 158913794493 rc 0/0
00000100:00100000:0.0:1651532237.310391:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5587
00010000:00010000:0.0:1651532237.310412:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310415:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532237.310417:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310422:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310432:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310436:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417801 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310497:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310501:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310502:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310507:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.310525:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062a8af64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754469096896:12345-10.240.43.64@tcp:4:dd.0 Request processed in 432473us (432563us total) trans 158913794488 rc 0/0
00000100:00100000:0.0:1651532237.310528:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5585
00000100:00100000:1.0:1651532237.310537:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f715c5e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469097088:12345-10.240.43.64@tcp:4:dd.0 Request processed in 432381us (432534us total) trans 158913794489 rc 0/0
00000100:00100000:1.0:1651532237.310541:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5589
00010000:00010000:1.0:1651532237.310550:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310554:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.310555:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310558:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310563:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310566:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310567:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310569:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4177f3 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310572:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310575:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.310575:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310578:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.310580:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a49a4ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469096960:12345-10.240.43.64@tcp:4:dd.0 Request processed in 432476us (432588us total) trans 158913794492 rc 0/0
00010000:00010000:1.0:1651532237.310581:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.310583:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5588
00010000:00010000:1.0:1651532237.310584:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f41780f lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310587:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310589:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.310590:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310593:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310596:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310599:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417808 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310616:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310619:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.310633:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047562140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469096704:12345-10.240.43.64@tcp:4:dd.0 Request processed in 433558us (433603us total) trans 158913794490 rc 0/0
00000100:00100000:0.0:1651532237.310635:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5583
00010000:00010000:1.0:1651532237.310637:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.310640:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310641:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310645:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532237.310646:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310649:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.310654:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008de65be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469096640:12345-10.240.43.64@tcp:4:dd.0 Request processed in 433571us (433613us total) trans 158913794487 rc 0/0
00010000:00010000:0.0:1651532237.310654:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310657:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f4177e5 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.310658:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5584
00010000:00010000:0.0:1651532237.310660:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310663:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532237.310664:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310666:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310669:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.310672:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4177ec lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.347937:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.347949:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.347960:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.347969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.347975:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.347984:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532237.347985:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097600
00000100:00100000:1.0:1651532237.347992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.348003:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.348014:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097728
00000100:00100000:0.0:1651532237.348023:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097856
00000100:00100000:0.0:1651532237.348032:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097984
00000100:00100000:1.0:1651532237.348041:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097536
00000100:00100000:0.0:1651532237.348043:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097664
00000100:00100000:1.0:1651532237.348051:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097792
00000100:00100000:0.0:1651532237.348055:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469097920
00000100:00100000:1.0:1651532237.348056:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5591
00000100:00100000:1.0:1651532237.348058:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469097600:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532237.348061:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5592
00000100:00100000:0.0:1651532237.348063:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469097856:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532237.348074:0:330282:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3e:0x0] initial LVB size: 4194304, mtime: 0x627061cc, atime: 0x0, ctime: 0x627061cc, blocks: 0x2000
00010000:00010000:1.0:1651532237.348077:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41781d lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348077:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417824 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.348082:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.348083:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.348085:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41781d lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.348090:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41781d lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348092:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.348092:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.348094:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417824 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348098:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417824 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.348298:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5593
00000100:00100000:1.0:1651532237.348300:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469097728:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532237.348301:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5594
00000100:00100000:0.0:1651532237.348303:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469097984:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532237.348307:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41782b lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348310:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417832 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.348311:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.348311:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.348312:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41782b lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.348316:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41782b lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348316:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.348317:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.348318:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417832 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348322:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417832 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.348522:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5595
00000100:00100000:1.0:1651532237.348524:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469097536:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532237.348527:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5596
00000100:00100000:0.0:1651532237.348530:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469097664:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532237.348533:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3d:0x0] initial LVB size: 4194304, mtime: 0x627061cc, atime: 0x0, ctime: 0x627061cc, blocks: 0x2000
00010000:00010000:1.0:1651532237.348535:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417839 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348536:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417840 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.348539:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.348539:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.348540:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417839 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.348544:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417839 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348544:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.348545:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.348546:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417840 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348550:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417840 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.348746:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5597
00000100:00100000:1.0:1651532237.348748:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469097792:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532237.348750:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5598
00000100:00100000:0.0:1651532237.348752:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469097920:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532237.348754:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417847 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.348758:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.348758:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.348758:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41784e lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.348760:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417847 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.348763:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417847 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348763:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.348764:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.348765:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41784e lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.348769:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41784e lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532237.594059:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794501 is committed
00002000:00010000:1.0:1651532237.594117:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb size from disk: 4194304 -> 8388608
00002000:00010000:0.0:1651532237.594117:0:323281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb size from disk: 4194304 -> 8388608
00002000:00010000:1.0:1651532237.594119:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb mtime from disk: 1651532236 -> 1651532237
00002000:00010000:0.0:1651532237.594119:0:323281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb mtime from disk: 1651532236 -> 1651532237
00002000:00010000:1.0:1651532237.594120:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb ctime from disk: 1651532236 -> 1651532237
00002000:00010000:1.0:1651532237.594121:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb blocks from disk: 8192 -> 16384
00002000:00010000:0.0:1651532237.594121:0:323281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb ctime from disk: 1651532236 -> 1651532237
00002000:00010000:0.0:1651532237.594121:0:323281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb blocks from disk: 8192 -> 16384
00010000:00010000:1.0:1651532237.594127:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41782b lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594127:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41784e lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594133:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41782b lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594133:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41784e lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.594176:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7299e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469097728:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245873us (246225us total) trans 158913794496 rc 0/0
00000100:00100000:0.0:1651532237.594176:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d4cada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469097920:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245421us (246170us total) trans 158913794501 rc 0/0
00000100:00100000:0.0:1651532237.594182:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5598
00000100:00100000:1.0:1651532237.594186:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5593
00010000:00010000:1.0:1651532237.594198:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41782b lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594202:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.594203:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41782b lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594207:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41782b lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594218:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41782b lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594223:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417832 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594224:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f41782b lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594227:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417832 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594228:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41784e lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594231:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.594231:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41784e lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594234:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41784e lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594238:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41784e lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594241:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f41784e lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.594242:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000338c863b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469097984:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245938us (246272us total) trans 158913794497 rc 0/0
00010000:00010000:1.0:1651532237.594244:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417832 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.594245:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5594
00010000:00010000:1.0:1651532237.594246:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.594247:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417832 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594249:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417832 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594253:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417832 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594256:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417832 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594271:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417840 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594275:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417840 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.594287:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000500aabe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469097664:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245757us (246303us total) trans 158913794498 rc 0/0
00000100:00100000:0.0:1651532237.594290:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5596
00010000:00010000:1.0:1651532237.594292:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41781d lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594295:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41781d lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594295:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417840 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594299:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532237.594300:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417840 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594303:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417840 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594310:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417840 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.594311:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012bf6c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469097600:12345-10.240.43.64@tcp:4:dd.0 Request processed in 246251us (246374us total) trans 158913794494 rc 0/0
00010000:00010000:0.0:1651532237.594312:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417840 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.594314:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5591
00010000:00010000:0.0:1651532237.594317:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41781d lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594319:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000012a81dbf already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532237.594320:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41781d lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594323:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41781d lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594326:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41781d lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594329:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f41781d lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594349:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417839 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594355:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417839 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.594376:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa99a384 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469097536:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245851us (246400us total) trans 158913794499 rc 0/0
00000100:00100000:0.0:1651532237.594381:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5595
00010000:00010000:0.0:1651532237.594437:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417847 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594444:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417847 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594479:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417839 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594484:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.594485:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417839 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594488:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417839 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594494:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417839 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594500:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417839 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594509:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417847 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594512:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.594513:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417847 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594516:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417847 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.594518:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009758188b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469097792:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245768us (246525us total) trans 158913794500 rc 0/0
00010000:00010000:1.0:1651532237.594519:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417847 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.594521:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417847 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.594521:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5597
00010000:00010000:0.0:1651532237.594560:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417824 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594564:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417824 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.594606:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e1e3a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469097856:12345-10.240.43.64@tcp:4:dd.0 Request processed in 246542us (246644us total) trans 158913794495 rc 0/0
00000100:00100000:0.0:1651532237.594610:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5592
00010000:00010000:0.0:1651532237.594617:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417824 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594626:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532237.594628:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417824 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594633:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417824 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594638:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417824 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.594641:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417824 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.631931:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.631946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.631952:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.631961:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532237.631967:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098240
00000100:00100000:1.0:1651532237.631968:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.631977:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.631985:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.631993:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532237.632002:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098368
00000100:00100000:1.0:1651532237.632005:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098496
00000100:00100000:0.0:1651532237.632009:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098624
00000100:00100000:0.0:1651532237.632014:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098176
00000100:00100000:1.0:1651532237.632020:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098304
00000100:00100000:1.0:1651532237.632025:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098432
00000100:00100000:0.0:1651532237.632026:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098560
00000100:00100000:1.0:1651532237.632029:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5599
00000100:00100000:1.0:1651532237.632031:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e36e2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469098240:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532237.632033:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5600
00000100:00100000:0.0:1651532237.632035:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd50a695 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469098368:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532237.632047:0:330279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3e:0x0] initial LVB size: 8388608, mtime: 0x627061cd, atime: 0x0, ctime: 0x627061cd, blocks: 0x4000
00010000:00010000:1.0:1651532237.632050:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417855 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.632052:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f41785c lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.632055:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.632056:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.632058:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417855 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.632063:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417855 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.632064:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.632065:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.632066:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f41785c lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.632073:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f41785c lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.632273:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5601
00000100:00100000:1.0:1651532237.632275:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469098624:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532237.632276:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5602
00000100:00100000:0.0:1651532237.632278:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469098496:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532237.632281:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417863 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.632284:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41786a lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.632285:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.632286:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.632287:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417863 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.632291:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417863 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.632291:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.632292:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.632293:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41786a lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.632297:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41786a lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.632513:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5603
00000100:00100000:0.0:1651532237.632515:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469098176:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532237.632524:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3d:0x0] initial LVB size: 8388608, mtime: 0x627061cd, atime: 0x0, ctime: 0x627061cd, blocks: 0x4000
00010000:00010000:0.0:1651532237.632526:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417871 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.632530:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.632531:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.632532:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417871 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.632542:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417871 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.632552:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5604
00000100:00100000:1.0:1651532237.632554:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469098304:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532237.632562:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417878 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.632566:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.632567:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.632568:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417878 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.632572:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417878 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.632781:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5605
00000100:00100000:1.0:1651532237.632783:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469098432:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532237.632795:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41787f lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.632799:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.632799:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.632800:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41787f lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.632824:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41787f lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.633004:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5606
00000100:00100000:1.0:1651532237.633006:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469098560:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532237.633012:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417886 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.633016:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.633017:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.633018:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417886 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.633021:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417886 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532237.951561:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794509 is committed
00002000:00010000:1.0:1651532237.951614:0:330059:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb size from disk: 8388608 -> 12582912
00002000:00010000:0.0:1651532237.951614:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb size from disk: 8388608 -> 12582912
00002000:00010000:1.0:1651532237.951616:0:330059:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb blocks from disk: 16384 -> 24576
00002000:00010000:0.0:1651532237.951616:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb blocks from disk: 16384 -> 24576
00010000:00010000:1.0:1651532237.951622:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41786a lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951622:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417871 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951628:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41786a lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951628:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417871 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.951666:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c022b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469098496:12345-10.240.43.64@tcp:4:dd.0 Request processed in 319385us (319711us total) trans 158913794506 rc 0/0
00000100:00100000:0.0:1651532237.951666:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e2d023 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469098176:12345-10.240.43.64@tcp:4:dd.0 Request processed in 319148us (319695us total) trans 158913794509 rc 0/0
00000100:00100000:0.0:1651532237.951671:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5603
00000100:00100000:1.0:1651532237.951675:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5602
00010000:00010000:1.0:1651532237.951685:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417871 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951685:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41786a lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951689:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532237.951689:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.951691:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417871 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951691:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41786a lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951694:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417871 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951694:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41786a lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951703:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417871 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951703:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41786a lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951706:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417871 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951709:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f41786a lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951736:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417878 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951739:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417878 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951744:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41787f lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951747:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41787f lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.951761:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a28769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469098304:12345-10.240.43.64@tcp:4:dd.0 Request processed in 319200us (319777us total) trans 158913794505 rc 0/0
00000100:00100000:1.0:1651532237.951765:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5604
00000100:00100000:0.0:1651532237.951767:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f37603ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469098432:12345-10.240.43.64@tcp:4:dd.0 Request processed in 318984us (319782us total) trans 158913794507 rc 0/0
00000100:00100000:0.0:1651532237.951771:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5605
00010000:00010000:1.0:1651532237.951772:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417878 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951775:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.951776:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417878 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951779:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417878 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951784:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417878 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951787:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417878 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951790:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41787f lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951793:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.951794:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41787f lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951795:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417886 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951799:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417886 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951801:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41787f lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951819:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41787f lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951822:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f41787f lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951825:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417886 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951827:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532237.951827:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf64494b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469098560:12345-10.240.43.64@tcp:4:dd.0 Request processed in 318820us (319833us total) trans 158913794508 rc 0/0
00010000:00010000:1.0:1651532237.951828:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417886 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.951830:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5606
00010000:00010000:1.0:1651532237.951831:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417886 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951834:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417886 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951837:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417886 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951867:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417863 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951870:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417863 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951877:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417855 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951880:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417855 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.951886:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e37b80ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469098624:12345-10.240.43.64@tcp:4:dd.0 Request processed in 319610us (319925us total) trans 158913794504 rc 0/0
00000100:00100000:0.0:1651532237.951889:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5601
00010000:00010000:0.0:1651532237.951895:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417863 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.951896:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e36e2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469098240:12345-10.240.43.64@tcp:4:dd.0 Request processed in 319864us (319966us total) trans 158913794502 rc 0/0
00010000:00010000:0.0:1651532237.951898:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532237.951899:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5599
00010000:00010000:0.0:1651532237.951899:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417863 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951902:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417863 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951906:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417855 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951907:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417863 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951909:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.951910:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417855 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951910:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417863 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951913:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417855 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951921:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417855 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.951923:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417855 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951946:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f41785c lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.951949:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f41785c lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.951967:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd50a695 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469098368:12345-10.240.43.64@tcp:4:dd.0 Request processed in 319932us (320021us total) trans 158913794503 rc 0/0
00000100:00100000:0.0:1651532237.951973:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5600
00010000:00010000:1.0:1651532237.952022:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f41785c lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.952026:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532237.952027:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f41785c lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.952030:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f41785c lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.952035:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f41785c lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.952037:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f41785c lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.989079:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532237.989116:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532237.989128:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532237.989136:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.989139:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098880
00000100:00100000:0.0:1651532237.989144:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099008
00000100:00100000:0.0:1651532237.989159:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098816
00000100:00100000:1.0:1651532237.989161:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469098944
00000100:00100000:0.0:1651532237.989169:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5607
00000100:00100000:0.0:1651532237.989177:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469099008:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532237.989178:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5608
00000100:00100000:1.0:1651532237.989180:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469098880:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532237.989192:0:330279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3d:0x0] initial LVB size: 12582912, mtime: 0x627061cd, atime: 0x0, ctime: 0x627061cd, blocks: 0x6000
00010000:00010000:1.0:1651532237.989195:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41788d lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.989196:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417894 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.989200:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.989201:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.989203:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41788d lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.989209:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41788d lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.989209:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.989210:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.989211:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417894 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.989215:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417894 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.989426:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5609
00000100:00100000:1.0:1651532237.989428:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469098816:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532237.989435:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41789b lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.989439:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.989440:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.989441:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41789b lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.989445:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41789b lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.989499:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5610
00000100:00100000:0.0:1651532237.989502:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469098944:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532237.989510:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4178a2 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.989514:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.989515:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.989516:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4178a2 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.989520:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4178a2 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.989628:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.989642:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.989657:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532237.989691:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532237.989708:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099264
00000100:00100000:0.0:1651532237.989723:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099392
00000100:00100000:1.0:1651532237.989724:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099200
00000100:00100000:0.0:1651532237.989735:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099328
00000100:00100000:0.0:1651532237.989740:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5611
00000100:00100000:0.0:1651532237.989742:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469099264:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532237.989744:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5612
00000100:00100000:1.0:1651532237.989746:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469099392:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532237.989751:0:330054:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3e:0x0] initial LVB size: 12582912, mtime: 0x627061cd, atime: 0x0, ctime: 0x627061cd, blocks: 0x6000
00010000:00010000:1.0:1651532237.989753:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4178b0 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.989753:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178a9 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.989757:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.989758:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.989759:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178a9 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.989763:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.989763:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178a9 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.989764:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.989765:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4178b0 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.989769:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4178b0 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532237.989999:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5613
00000100:00100000:1.0:1651532237.990001:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469099200:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532237.990008:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178b7 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.990012:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.990013:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532237.990014:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178b7 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532237.990017:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178b7 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532237.990467:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5614
00000100:00100000:0.0:1651532237.990470:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754469099328:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532237.990483:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4178be lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.990526:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.990528:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532237.990550:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4178be lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532237.990558:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4178be lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.048137:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532238.048152:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951237952
00000100:00100000:1.0:1651532238.048176:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 83
00000100:00100000:1.0:1651532238.048179:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951237952:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532238.048191:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 7512064 granted 359648960 pending 8585216 free 81113681920 avail 76917215232
00000100:00100000:1.0:1651532238.048218:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a1c329c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951237952:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 38us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532238.048221:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 83
00000001:00080000:1.0:1651532238.202164:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794517 is committed
00002000:00010000:1.0:1651532238.202209:0:330057:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb size from disk: 12582912 -> 16777216
00002000:00010000:1.0:1651532238.202211:0:330057:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb blocks from disk: 24576 -> 32768
00010000:00010000:1.0:1651532238.202217:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4178be lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202223:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4178be lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532238.202223:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb size from disk: 12582912 -> 16777216
00002000:00010000:0.0:1651532238.202225:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb blocks from disk: 24576 -> 32768
00010000:00010000:0.0:1651532238.202229:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417894 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202241:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417894 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.202256:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076bab229 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469099328:12345-10.240.43.64@tcp:4:dd.0 Request processed in 211780us (212558us total) trans 158913794517 rc 0/0
00000100:00100000:1.0:1651532238.202260:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5614
00000100:00100000:0.0:1651532238.202267:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0daa6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469099008:12345-10.240.43.64@tcp:4:dd.0 Request processed in 213094us (213150us total) trans 158913794511 rc 0/0
00000100:00100000:0.0:1651532238.202271:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5607
00010000:00010000:1.0:1651532238.202287:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4178a2 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202291:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4178a2 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202294:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178a9 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202299:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178a9 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.202306:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000030de6082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469098944:12345-10.240.43.64@tcp:4:dd.0 Request processed in 212804us (213169us total) trans 158913794513 rc 0/0
00000100:00100000:1.0:1651532238.202309:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5610
00000100:00100000:0.0:1651532238.202310:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035758393 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469099264:12345-10.240.43.64@tcp:4:dd.0 Request processed in 212568us (212683us total) trans 158913794516 rc 0/0
00000100:00100000:0.0:1651532238.202313:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5611
00010000:00010000:1.0:1651532238.202317:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4178be lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202321:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.202321:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417894 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202323:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4178be lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202325:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.202326:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417894 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202327:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4178be lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202329:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417894 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202336:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4178be lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202336:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417894 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202339:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f4178be lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202339:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417894 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202343:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4178a2 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202343:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178a9 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202346:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.202346:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532238.202347:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4178a2 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202347:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178a9 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202349:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4178a2 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202349:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178a9 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202353:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4178a2 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202353:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178a9 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202355:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f4178a2 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202356:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178a9 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202378:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41789b lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202382:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41789b lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202383:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4178b0 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202386:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4178b0 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.202396:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009239a66b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469098816:12345-10.240.43.64@tcp:4:dd.0 Request processed in 212967us (213267us total) trans 158913794512 rc 0/0
00000100:00100000:1.0:1651532238.202414:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5609
00000100:00100000:0.0:1651532238.202414:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c769a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469099392:12345-10.240.43.64@tcp:4:dd.0 Request processed in 212667us (212772us total) trans 158913794514 rc 0/0
00000100:00100000:0.0:1651532238.202418:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5612
00010000:00010000:1.0:1651532238.202422:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41789b lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202425:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.202425:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4178b0 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202426:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41789b lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202429:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41789b lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202429:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.202430:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4178b0 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202433:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4178b0 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202434:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41789b lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202436:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f41789b lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202437:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4178b0 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202440:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f4178b0 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202459:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178b7 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202463:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41788d lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.202465:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178b7 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202469:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41788d lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.202482:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002939767f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469099200:12345-10.240.43.64@tcp:4:dd.0 Request processed in 212480us (212825us total) trans 158913794515 rc 0/0
00000100:00100000:0.0:1651532238.202485:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5613
00000100:00100000:1.0:1651532238.202491:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002df48e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469098880:12345-10.240.43.64@tcp:4:dd.0 Request processed in 213310us (213413us total) trans 158913794510 rc 0/0
00000100:00100000:1.0:1651532238.202494:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5608
00010000:00010000:1.0:1651532238.202501:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178b7 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202504:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532238.202505:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178b7 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202508:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178b7 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202512:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178b7 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202515:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178b7 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202519:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41788d lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202522:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532238.202523:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41788d lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202526:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41788d lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202529:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41788d lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.202539:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f41788d lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.239994:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532238.240019:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099648
00000100:00100000:0.0:1651532238.240033:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532238.240044:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099776
00000100:00100000:0.0:1651532238.240050:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532238.240052:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5615
00000100:00100000:1.0:1651532238.240054:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469099648:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532238.240063:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00010000:1.0:1651532238.240072:0:330279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3e:0x0] initial LVB size: 16777216, mtime: 0x627061cd, atime: 0x0, ctime: 0x627061cd, blocks: 0x8000
00000100:00100000:0.0:1651532238.240073:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532238.240075:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178c5 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.240080:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532238.240080:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532238.240081:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.240087:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178c5 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.240088:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532238.240093:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178c5 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.240096:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532238.240104:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099904
00000100:00100000:0.0:1651532238.240116:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100032
00000100:00100000:0.0:1651532238.240122:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099584
00000100:00100000:0.0:1651532238.240126:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099712
00000100:00100000:0.0:1651532238.240130:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099840
00000100:00100000:0.0:1651532238.240133:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469099968
00000100:00100000:0.0:1651532238.240137:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5616
00000100:00100000:0.0:1651532238.240139:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e4ba846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469099776:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532238.240147:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178cc lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.240152:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.240153:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.240155:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178cc lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.240159:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178cc lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.240284:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5617
00000100:00100000:1.0:1651532238.240286:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469099904:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532238.240293:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178d3 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.240297:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.240298:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.240299:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178d3 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.240303:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178d3 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.240347:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5618
00000100:00100000:0.0:1651532238.240349:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075d1f493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469100032:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532238.240356:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4178da lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.240360:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.240360:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.240362:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4178da lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.240365:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4178da lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.240516:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5619
00000100:00100000:1.0:1651532238.240518:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f5ccc672 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469099584:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532238.240527:0:330057:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3d:0x0] initial LVB size: 16777216, mtime: 0x627061cd, atime: 0x0, ctime: 0x627061cd, blocks: 0x8000
00010000:00010000:1.0:1651532238.240529:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4178e1 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.240533:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.240533:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.240534:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4178e1 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.240538:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4178e1 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.240570:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5620
00000100:00100000:0.0:1651532238.240572:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000233e36cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469099712:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532238.240578:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4178e8 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.240582:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.240583:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.240584:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4178e8 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.240598:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4178e8 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.240701:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5621
00000100:00100000:1.0:1651532238.240703:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a668175 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469099840:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532238.240710:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4178ef lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.240713:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.240714:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.240715:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4178ef lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.240718:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4178ef lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.240769:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5622
00000100:00100000:0.0:1651532238.240772:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055254516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469099968:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532238.240778:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4178f6 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.240781:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.240782:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.240783:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4178f6 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.240786:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4178f6 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532238.727135:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794525 is committed
00002000:00010000:1.0:1651532238.727185:0:330282:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb size from disk: 16777216 -> 20971520
00002000:00010000:0.0:1651532238.727185:0:323284:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb size from disk: 16777216 -> 20971520
00002000:00010000:1.0:1651532238.727187:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb mtime from disk: 1651532237 -> 1651532238
00002000:00010000:1.0:1651532238.727188:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb ctime from disk: 1651532237 -> 1651532238
00002000:00010000:0.0:1651532238.727188:0:323284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb mtime from disk: 1651532237 -> 1651532238
00002000:00010000:1.0:1651532238.727189:0:330282:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb blocks from disk: 32768 -> 40960
00002000:00010000:0.0:1651532238.727189:0:323284:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb ctime from disk: 1651532237 -> 1651532238
00002000:00010000:0.0:1651532238.727190:0:323284:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb blocks from disk: 32768 -> 40960
00010000:00010000:1.0:1651532238.727195:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4178da lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727195:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4178f6 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727201:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4178da lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727201:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4178f6 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.727244:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055254516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469099968:12345-10.240.43.64@tcp:4:dd.0 Request processed in 486469us (487146us total) trans 158913794525 rc 0/0
00000100:00100000:1.0:1651532238.727246:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075d1f493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469100032:12345-10.240.43.64@tcp:4:dd.0 Request processed in 486895us (487182us total) trans 158913794522 rc 0/0
00000100:00100000:0.0:1651532238.727250:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5622
00000100:00100000:1.0:1651532238.727253:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5618
00010000:00010000:1.0:1651532238.727283:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178cc lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727285:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4178e8 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727289:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4178e8 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727290:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178cc lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.727303:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e4ba846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469099776:12345-10.240.43.64@tcp:4:dd.0 Request processed in 487164us (487271us total) trans 158913794520 rc 0/0
00000100:00100000:0.0:1651532238.727305:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000233e36cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469099712:12345-10.240.43.64@tcp:4:dd.0 Request processed in 486733us (487225us total) trans 158913794524 rc 0/0
00000100:00100000:1.0:1651532238.727306:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5616
00000100:00100000:0.0:1651532238.727309:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5620
00010000:00010000:1.0:1651532238.727315:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4178f6 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727316:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4178da lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727319:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.727320:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532238.727321:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4178f6 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727321:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4178da lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727324:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4178f6 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727324:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4178da lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727333:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4178f6 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727333:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4178da lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727335:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f4178f6 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727336:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4178da lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727339:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4178e8 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727340:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178cc lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727342:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532238.727343:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4178e8 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727343:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.727344:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178cc lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727347:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4178e8 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727347:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178cc lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727350:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178cc lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727351:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4178e8 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727353:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f4178e8 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727353:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4178cc lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727377:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178d3 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727380:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178d3 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727385:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178c5 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727396:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178c5 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.727398:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dc25e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469099904:12345-10.240.43.64@tcp:4:dd.0 Request processed in 487111us (487348us total) trans 158913794519 rc 0/0
00000100:00100000:0.0:1651532238.727411:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5617
00010000:00010000:0.0:1651532238.727426:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178d3 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.727427:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d89679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469099648:12345-10.240.43.64@tcp:4:dd.0 Request processed in 487372us (487434us total) trans 158913794518 rc 0/0
00000100:00100000:1.0:1651532238.727430:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5615
00010000:00010000:0.0:1651532238.727430:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.727431:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178d3 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727434:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178d3 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727438:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178c5 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727439:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178d3 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727441:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.727442:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f4178d3 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727443:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178c5 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727445:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178c5 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727450:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178c5 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.727453:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178c5 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727463:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4178e1 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727467:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4178e1 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.727486:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f5ccc672 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469099584:12345-10.240.43.64@tcp:4:dd.0 Request processed in 486967us (487412us total) trans 158913794521 rc 0/0
00000100:00100000:0.0:1651532238.727489:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5619
00010000:00010000:0.0:1651532238.727511:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4178ef lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727514:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4178ef lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.727532:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a668175 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469099840:12345-10.240.43.64@tcp:4:dd.0 Request processed in 486828us (487443us total) trans 158913794523 rc 0/0
00000100:00100000:0.0:1651532238.727535:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5621
00010000:00010000:0.0:1651532238.727541:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4178e1 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727545:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.727546:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4178e1 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727548:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4178e1 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727553:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4178e1 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727555:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f4178e1 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727559:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4178ef lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727561:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532238.727562:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4178ef lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727565:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4178ef lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727568:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4178ef lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.727574:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4178ef lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.765094:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532238.765104:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532238.765124:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532238.765136:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532238.765142:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532238.765149:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532238.765150:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100288
00000100:00100000:0.0:1651532238.765158:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532238.765168:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532238.765176:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100416
00000100:00100000:1.0:1651532238.765181:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100544
00000100:00100000:1.0:1651532238.765187:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100672
00000100:00100000:0.0:1651532238.765193:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100224
00000100:00100000:1.0:1651532238.765198:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100352
00000100:00100000:0.0:1651532238.765201:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100480
00000100:00100000:0.0:1651532238.765204:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100608
00000100:00100000:1.0:1651532238.765209:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5623
00000100:00100000:1.0:1651532238.765211:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d0b5369 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469100288:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532238.765212:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5624
00000100:00100000:0.0:1651532238.765214:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000128e28a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469100544:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532238.765226:0:330279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3e:0x0] initial LVB size: 20971520, mtime: 0x627061ce, atime: 0x0, ctime: 0x627061ce, blocks: 0xa000
00010000:00010000:1.0:1651532238.765228:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178fd lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765228:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417904 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.765234:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.765235:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.765237:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178fd lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.765242:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178fd lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765243:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.765244:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.765245:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417904 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765249:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417904 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.765481:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5625
00000100:00100000:1.0:1651532238.765484:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b620b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469100416:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532238.765484:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5626
00000100:00100000:0.0:1651532238.765486:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b752f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469100672:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532238.765491:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41790b lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765494:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417912 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.765495:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.765496:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.765497:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41790b lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.765501:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41790b lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765501:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.765502:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.765503:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417912 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765507:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417912 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.765691:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5627
00000100:00100000:1.0:1651532238.765693:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009b15349 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469100224:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532238.765696:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5628
00000100:00100000:0.0:1651532238.765698:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011e7c1fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469100480:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532238.765700:0:323281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3d:0x0] initial LVB size: 20971520, mtime: 0x627061ce, atime: 0x0, ctime: 0x627061ce, blocks: 0xa000
00010000:00010000:1.0:1651532238.765702:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417919 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765704:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417920 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.765706:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.765706:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.765707:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417919 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.765711:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417919 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765711:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.765712:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.765713:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417920 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765716:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417920 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532238.765930:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5629
00000100:00100000:1.0:1651532238.765932:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003fd96a04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469100352:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532238.765937:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5630
00010000:00010000:1.0:1651532238.765938:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417927 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532238.765940:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000efec411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469100608:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532238.765944:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.765945:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532238.765946:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417927 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765946:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41792e lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532238.765949:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417927 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765950:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.765951:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532238.765952:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41792e lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532238.765956:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41792e lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532239.010714:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794533 is committed
00002000:00010000:1.0:1651532239.010765:0:323284:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb size from disk: 20971520 -> 25165824
00002000:00010000:0.0:1651532239.010765:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb size from disk: 20971520 -> 25165824
00002000:00010000:1.0:1651532239.010767:0:323284:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb blocks from disk: 40960 -> 49152
00002000:00010000:0.0:1651532239.010768:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb blocks from disk: 40960 -> 49152
00010000:00010000:1.0:1651532239.010773:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417912 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010773:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41792e lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010780:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417912 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010780:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41792e lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.010831:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b752f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469100672:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245342us (245693us total) trans 158913794529 rc 0/0
00000100:00100000:0.0:1651532239.010831:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000efec411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469100608:12345-10.240.43.64@tcp:4:dd.0 Request processed in 244889us (245660us total) trans 158913794533 rc 0/0
00000100:00100000:0.0:1651532239.010837:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5630
00000100:00100000:1.0:1651532239.010840:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5626
00010000:00010000:1.0:1651532239.010865:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417920 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010869:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417920 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010885:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417904 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.010886:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011e7c1fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469100480:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245188us (245728us total) trans 158913794531 rc 0/0
00010000:00010000:0.0:1651532239.010889:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417904 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.010890:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5628
00010000:00010000:1.0:1651532239.010899:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417912 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010902:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.010904:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417912 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.010906:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000128e28a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469100544:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245691us (245783us total) trans 158913794527 rc 0/0
00010000:00010000:1.0:1651532239.010908:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417912 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.010910:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5624
00010000:00010000:1.0:1651532239.010918:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417912 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010918:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41792e lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010920:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417912 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010921:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532239.010923:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41792e lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010924:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417920 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010926:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41792e lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010927:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.010928:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417920 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010931:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417920 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010932:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41792e lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010934:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41792e lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010935:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417920 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010938:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417920 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010938:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417904 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010941:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532239.010942:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417904 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010945:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417904 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010949:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417904 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010951:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417904 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010965:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178fd lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.010968:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178fd lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010978:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41790b lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.010981:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41790b lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.010983:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d0b5369 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469100288:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245772us (245891us total) trans 158913794526 rc 0/0
00000100:00100000:1.0:1651532239.010987:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5623
00010000:00010000:1.0:1651532239.011000:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178fd lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.011001:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b620b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469100416:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245517us (245897us total) trans 158913794528 rc 0/0
00010000:00010000:1.0:1651532239.011004:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532239.011004:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5625
00010000:00010000:1.0:1651532239.011005:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178fd lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011008:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178fd lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011012:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178fd lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011015:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4178fd lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011021:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41790b lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011023:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.011024:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41790b lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011027:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41790b lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.011027:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417919 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011030:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41790b lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.011030:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417919 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011032:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f41790b lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011037:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417919 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011039:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.011040:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417919 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.011042:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417919 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.011043:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009b15349 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469100224:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245350us (245900us total) trans 158913794530 rc 0/0
00010000:00010000:1.0:1651532239.011045:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417919 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.011046:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5627
00010000:00010000:1.0:1651532239.011049:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417919 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.011064:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417927 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.011070:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417927 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.011082:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003fd96a04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469100352:12345-10.240.43.64@tcp:4:dd.0 Request processed in 245150us (245933us total) trans 158913794532 rc 0/0
00000100:00100000:0.0:1651532239.011085:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5629
00010000:00010000:0.0:1651532239.011090:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417927 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.011094:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532239.011095:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417927 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.011099:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417927 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.011106:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417927 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.011111:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417927 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.048609:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.048643:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.048658:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.048665:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.048676:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.048683:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.048692:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.048694:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100928
00000100:00100000:0.0:1651532239.048701:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.048709:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101056
00000100:00100000:1.0:1651532239.048722:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101184
00000100:00100000:0.0:1651532239.048732:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101312
00000100:00100000:1.0:1651532239.048733:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100864
00000100:00100000:0.0:1651532239.048742:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469100992
00000100:00100000:0.0:1651532239.048745:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101120
00000100:00100000:1.0:1651532239.048748:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101248
00000100:00100000:0.0:1651532239.048750:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5631
00000100:00100000:0.0:1651532239.048752:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015c62649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469100928:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.048753:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5632
00000100:00100000:1.0:1651532239.048755:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015dbd6fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469101056:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532239.048767:0:330279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3e:0x0] initial LVB size: 25165824, mtime: 0x627061ce, atime: 0x0, ctime: 0x627061ce, blocks: 0xc000
00010000:00010000:1.0:1651532239.048770:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417935 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.048770:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41793c lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.048775:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.048776:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.048778:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417935 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.048783:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417935 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.048784:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.048785:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.048786:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41793c lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.048790:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41793c lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.049005:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5633
00000100:00100000:1.0:1651532239.049008:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900d92a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469101184:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532239.049009:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5634
00000100:00100000:0.0:1651532239.049011:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef99e01b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469101312:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532239.049014:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417943 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.049018:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.049018:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41794a lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.049019:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.049020:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417943 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.049024:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417943 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.049024:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.049025:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.049026:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41794a lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.049032:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41794a lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.049223:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5635
00000100:00100000:1.0:1651532239.049225:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a54ec90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469100864:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532239.049234:0:330057:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3d:0x0] initial LVB size: 25165824, mtime: 0x627061ce, atime: 0x0, ctime: 0x627061ce, blocks: 0xc000
00010000:00010000:1.0:1651532239.049235:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417951 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.049239:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532239.049239:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5636
00010000:00010000:1.0:1651532239.049240:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.049240:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417951 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.049241:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090d07c4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469100992:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532239.049244:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417951 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.049247:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417958 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.049251:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.049251:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.049252:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417958 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.049255:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417958 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.049477:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5637
00000100:00100000:1.0:1651532239.049479:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b19d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469101120:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532239.049486:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41795f lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.049489:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5638
00010000:00010000:1.0:1651532239.049490:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.049490:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532239.049491:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003eb9d666 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469101248:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532239.049492:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41795f lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.049495:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41795f lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.049497:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417966 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.049501:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.049502:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.049503:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417966 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.049506:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417966 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532239.437722:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794541 is committed
00002000:00010000:1.0:1651532239.437768:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb size from disk: 25165824 -> 29360128
00002000:00010000:1.0:1651532239.437770:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb mtime from disk: 1651532238 -> 1651532239
00002000:00010000:1.0:1651532239.437771:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb ctime from disk: 1651532238 -> 1651532239
00002000:00010000:1.0:1651532239.437772:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb blocks from disk: 49152 -> 57344
00010000:00010000:1.0:1651532239.437778:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417958 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.437784:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417958 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437789:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417966 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437795:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417966 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.437837:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090d07c4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469100992:12345-10.240.43.64@tcp:4:dd.0 Request processed in 388594us (389151us total) trans 158913794539 rc 0/0
00000100:00100000:0.0:1651532239.437837:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003eb9d666 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469101248:12345-10.240.43.64@tcp:4:dd.0 Request processed in 388343us (389133us total) trans 158913794541 rc 0/0
00000100:00100000:0.0:1651532239.437842:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5638
00000100:00100000:1.0:1651532239.437846:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5636
00002000:00010000:1.0:1651532239.437875:0:330059:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb size from disk: 25165824 -> 29360128
00002000:00010000:1.0:1651532239.437877:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb mtime from disk: 1651532238 -> 1651532239
00002000:00010000:1.0:1651532239.437878:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb ctime from disk: 1651532238 -> 1651532239
00002000:00010000:1.0:1651532239.437879:0:330059:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb blocks from disk: 49152 -> 57352
00010000:00010000:1.0:1651532239.437881:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41794a lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.437885:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41794a lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437890:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41793c lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437902:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41793c lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.437904:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef99e01b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469101312:12345-10.240.43.64@tcp:4:dd.0 Request processed in 388893us (389239us total) trans 158913794537 rc 0/0
00000100:00100000:1.0:1651532239.437908:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5634
00010000:00010000:1.0:1651532239.437916:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417958 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.437917:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015c62649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469100928:12345-10.240.43.64@tcp:4:dd.0 Request processed in 389164us (389309us total) trans 158913794535 rc 0/0
00010000:00010000:1.0:1651532239.437920:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532239.437920:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5631
00010000:00010000:1.0:1651532239.437922:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417958 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.437925:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417958 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437928:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417966 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437935:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.437936:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417958 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437936:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417966 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.437939:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417958 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437939:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417966 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.437943:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41794a lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.437946:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532239.437946:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417966 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.437947:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41794a lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.437949:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41794a lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437949:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417966 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437952:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41793c lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.437954:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41794a lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437955:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.437956:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f41794a lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437956:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41793c lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437959:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41793c lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437962:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41793c lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437965:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f41793c lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437988:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417943 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.437991:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417943 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.438022:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900d92a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469101184:12345-10.240.43.64@tcp:4:dd.0 Request processed in 389014us (389364us total) trans 158913794536 rc 0/0
00000100:00100000:0.0:1651532239.438026:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5633
00010000:00010000:0.0:1651532239.438053:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41795f lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.438058:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41795f lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438064:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417951 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438068:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417951 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.438093:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a54ec90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469100864:12345-10.240.43.64@tcp:4:dd.0 Request processed in 388867us (389416us total) trans 158913794538 rc 0/0
00000100:00100000:1.0:1651532239.438096:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5635
00010000:00010000:1.0:1651532239.438104:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417943 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438107:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.438109:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417943 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438111:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417943 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438116:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417943 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438122:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417943 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438125:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41795f lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.438127:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b19d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469101120:12345-10.240.43.64@tcp:4:dd.0 Request processed in 388647us (389434us total) trans 158913794540 rc 0/0
00010000:00010000:1.0:1651532239.438128:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.438129:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41795f lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438131:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41795f lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.438131:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5637
00010000:00010000:1.0:1651532239.438134:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41795f lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438137:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f41795f lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.438139:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417951 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.438143:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532239.438144:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417951 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.438147:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417951 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.438152:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417951 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.438155:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417951 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438164:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417935 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438167:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417935 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.438181:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015dbd6fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469101056:12345-10.240.43.64@tcp:4:dd.0 Request processed in 389425us (389538us total) trans 158913794534 rc 0/0
00000100:00100000:1.0:1651532239.438186:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5632
00010000:00010000:1.0:1651532239.438192:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417935 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438217:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.438223:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417935 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438226:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417935 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438231:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417935 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.438233:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417935 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.475090:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.475099:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.475120:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.475127:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101568
00000100:00100000:1.0:1651532239.475130:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.475141:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101696
00000100:00100000:0.0:1651532239.475153:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101504
00000100:00100000:1.0:1651532239.475154:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101632
00000100:00100000:0.0:1651532239.475164:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5639
00000100:00100000:0.0:1651532239.475171:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eda72de9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469101568:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.475172:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5640
00000100:00100000:1.0:1651532239.475174:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000058cbfc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469101696:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532239.475186:0:330057:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3d:0x0] initial LVB size: 29360128, mtime: 0x627061cf, atime: 0x0, ctime: 0x627061cf, blocks: 0xe000
00010000:00010000:1.0:1651532239.475188:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41796d lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.475190:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417974 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.475194:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.475195:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.475197:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41796d lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.475202:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41796d lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.475203:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.475203:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.475205:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417974 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.475209:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417974 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.475428:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5641
00000100:00100000:0.0:1651532239.475430:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b70a5ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469101504:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532239.475436:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41797b lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.475440:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651532239.475441:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5642
00010000:00010000:0.0:1651532239.475441:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.475442:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41797b lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.475443:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfba227b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469101632:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532239.475446:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41797b lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.475450:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417982 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.475454:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.475455:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.475456:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417982 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.475460:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417982 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.475686:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.475700:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.475709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.475727:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101952
00000100:00100000:0.0:1651532239.475742:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469102080
00000100:00100000:1.0:1651532239.475743:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.475756:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469101888
00000100:00100000:0.0:1651532239.475763:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469102016
00000100:00100000:0.0:1651532239.475769:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5643
00000100:00100000:0.0:1651532239.475772:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018a40554 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469101952:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.475779:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5644
00000100:00100000:1.0:1651532239.475781:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015b71dae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469102080:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532239.475785:0:330281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3e:0x0] initial LVB size: 29360128, mtime: 0x627061cf, atime: 0x0, ctime: 0x627061cf, blocks: 0xe008
00010000:00010000:0.0:1651532239.475788:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417989 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.475789:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417990 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.475792:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.475793:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.475793:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417989 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.475797:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417989 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.475800:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.475801:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.475812:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417990 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.475817:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417990 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.476002:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5645
00000100:00100000:1.0:1651532239.476004:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f60f15c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469101888:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532239.476010:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417997 lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.476014:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.476015:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.476015:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417997 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.476019:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417997 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.476224:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5646
00000100:00100000:1.0:1651532239.476226:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000856f2b99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469102016:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532239.476236:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41799e lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.476249:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.476250:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.476251:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41799e lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.476254:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41799e lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532239.787702:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794549 is committed
00002000:00010000:1.0:1651532239.787753:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb size from disk: 29360128 -> 33554432
00002000:00010000:1.0:1651532239.787755:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3e:0x0] updating lvb blocks from disk: 57352 -> 65544
00010000:00010000:1.0:1651532239.787761:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417990 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532239.787765:0:330057:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb size from disk: 29360128 -> 33554432
00010000:00010000:1.0:1651532239.787767:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417990 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532239.787768:0:330057:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3d:0x0] updating lvb blocks from disk: 57344 -> 65536
00010000:00010000:0.0:1651532239.787772:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41796d lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787783:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41796d lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.787825:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015b71dae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469102080:12345-10.240.43.64@tcp:4:dd.0 Request processed in 312041us (312122us total) trans 158913794546 rc 0/0
00000100:00100000:0.0:1651532239.787827:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000058cbfc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469101696:12345-10.240.43.64@tcp:4:dd.0 Request processed in 312651us (312727us total) trans 158913794543 rc 0/0
00000100:00100000:1.0:1651532239.787830:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5644
00000100:00100000:0.0:1651532239.787832:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5640
00010000:00010000:1.0:1651532239.787845:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41796d lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787845:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417990 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787849:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532239.787849:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005cd99c96 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.787850:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41796d lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787850:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417990 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787854:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417990 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787856:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41796d lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787863:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41796d lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787863:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417990 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787866:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f41796d lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787866:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd99c96/0xa29a79078f417990 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787886:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41799e lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787889:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41799e lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787893:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417997 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787897:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417997 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.787911:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000856f2b99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469102016:12345-10.240.43.64@tcp:4:dd.0 Request processed in 311677us (312161us total) trans 158913794549 rc 0/0
00000100:00100000:1.0:1651532239.787914:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5646
00000100:00100000:0.0:1651532239.787915:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f60f15c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469101888:12345-10.240.43.64@tcp:4:dd.0 Request processed in 311910us (312206us total) trans 158913794547 rc 0/0
00000100:00100000:0.0:1651532239.787918:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5645
00010000:00010000:1.0:1651532239.787921:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41799e lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787924:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.787925:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41799e lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787928:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41799e lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787933:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41799e lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787936:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f41799e lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787940:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417997 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787942:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.787943:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417997 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787943:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417982 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787945:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417997 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787947:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417982 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787949:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417997 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787951:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417997 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787954:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417982 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787956:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.787957:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417982 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787960:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417982 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.787960:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfba227b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469101632:12345-10.240.43.64@tcp:4:dd.0 Request processed in 312516us (312829us total) trans 158913794545 rc 0/0
00010000:00010000:1.0:1651532239.787963:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417982 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.787963:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5642
00010000:00010000:1.0:1651532239.787966:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417982 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787983:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417989 lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.787986:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417989 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787995:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41797b lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.787998:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41797b lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.787999:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018a40554 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469101952:12345-10.240.43.64@tcp:4:dd.0 Request processed in 312227us (312314us total) trans 158913794548 rc 0/0
00000100:00100000:0.0:1651532239.788001:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5643
00010000:00010000:0.0:1651532239.788007:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417989 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.788010:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b7f071c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532239.788011:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417989 lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.788013:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b70a5ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469101504:12345-10.240.43.64@tcp:4:dd.0 Request processed in 312583us (312893us total) trans 158913794544 rc 0/0
00010000:00010000:0.0:1651532239.788014:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417989 lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.788016:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5641
00010000:00010000:0.0:1651532239.788019:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417989 lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.788022:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f417989 lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788023:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41797b lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788026:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.788027:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41797b lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788030:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41797b lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788035:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41797b lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788037:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f41797b lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788061:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417974 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788064:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417974 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.788089:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eda72de9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469101568:12345-10.240.43.64@tcp:4:dd.0 Request processed in 312919us (313000us total) trans 158913794542 rc 0/0
00000100:00100000:1.0:1651532239.788093:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5639
00010000:00010000:1.0:1651532239.788133:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417974 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788137:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000601104c8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.788138:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417974 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788146:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417974 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788152:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417974 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.788157:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f417974 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.799210:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.799233:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469102912
00000100:00100000:0.0:1651532239.799248:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6839
00000100:00100000:0.0:1651532239.799251:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000810b719e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:685828:x1731754469102912:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532239.799258:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532239.799278:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4179a5 lrc: 2/0,0 mode: --/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fe9c expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532239.799292:0:323275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532239.799301:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.799302:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.799306:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4179a5 lrc: 3/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe9c expref: 10 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.799312:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4179a5 lrc: 3/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe9c expref: 10 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.799317:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b7f071c, rc 0)
00000100:00100000:0.0:1651532239.799330:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000810b719e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:685828:x1731754469102912:12345-10.240.43.64@tcp:101:dd.0 Request processed in 78us (121us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532239.799333:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6839
00000100:00100000:1.0:1651532239.799584:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.799596:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469102976
00000100:00100000:0.0:1651532239.799605:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6840
00000100:00100000:0.0:1651532239.799607:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008166f701 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:685828:x1731754469102976:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532239.799611:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532239.799615:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4179ac lrc: 2/0,0 mode: --/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fea3 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532239.799621:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532239.799625:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.799626:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.799627:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4179ac lrc: 3/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fea3 expref: 11 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.799632:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4179ac lrc: 3/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fea3 expref: 11 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.799636:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000601104c8, rc 0)
00000100:00100000:0.0:1651532239.799646:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008166f701 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:685828:x1731754469102976:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (63us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532239.799649:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6840
00000100:00100000:1.0:1651532239.799902:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.799910:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.799916:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103040
00002000:00010000:1.0:1651532239.799925:0:330282:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216383/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532239.799927:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a6d24e11 with x1731754469103040 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532239.799931:0:330282:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a6d24e11.
00000100:00100000:1.0:1651532239.799941:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103104
00002000:00010000:1.0:1651532239.799944:0:330282:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216384/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532239.799945:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b63c49aa with x1731754469103104 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532239.799946:0:330282:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b63c49aa.
00000100:00100000:1.0:1651532239.799953:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5647
00000100:00100000:1.0:1651532239.799955:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d24e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469103040:12345-10.240.43.64@tcp:10:dd.0
00000100:00100000:0.0:1651532239.799960:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5648
00000100:00100000:0.0:1651532239.799963:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b63c49aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469103104:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532239.799997:0:330282:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d3f:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532239.799999:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d3f:0x0] updating lvb mtime from disk: 0 -> 1651532239
00002000:00010000:1.0:1651532239.800000:0:330282:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d3f:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532239.800001:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d3f:0x0] updating lvb ctime from disk: 0 -> 1651532239
00002000:00010000:1.0:1651532239.800001:0:330282:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d3f:0x0] updating lvb blocks from disk: 0 -> 0
00002000:00010000:0.0:1651532239.800003:0:330281:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d40:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532239.800004:0:330281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d40:0x0] updating lvb mtime from disk: 0 -> 1651532239
00002000:00010000:0.0:1651532239.800005:0:330281:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d40:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532239.800006:0:330281:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d40:0x0] updating lvb ctime from disk: 0 -> 1651532239
00002000:00010000:0.0:1651532239.800007:0:330281:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d40:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532239.800016:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d24e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469103040:12345-10.240.43.64@tcp:10:dd.0 Request processed in 61us (115us total) trans 158913794550 rc 0/0
00000100:00100000:1.0:1651532239.800019:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5647
00002000:00010000:1.0:1651532239.800021:0:330282:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216383/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532239.800022:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a6d24e11 with x1731754469103040 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532239.800024:0:330282:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a6d24e11.
00000100:00100000:0.0:1651532239.800024:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b63c49aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469103104:12345-10.240.43.64@tcp:10:dd.0 Request processed in 61us (114us total) trans 158913794551 rc 0/0
00000100:00100000:0.0:1651532239.800029:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5648
00002000:00010000:0.0:1651532239.800030:0:330281:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216384/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532239.800031:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b63c49aa with x1731754469103104 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532239.800034:0:330281:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b63c49aa.
00000100:00100000:1.0:1651532239.800410:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.800424:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.800436:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103168
00000100:00100000:0.0:1651532239.800450:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103232
00000100:00100000:0.0:1651532239.800454:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6841
00000100:00100000:0.0:1651532239.800456:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa6fac63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469103168:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532239.800460:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532239.800464:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6842
00010000:00010000:0.0:1651532239.800464:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4179b3 lrc: 2/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44feaa expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.800466:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f8870fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469103232:12345-10.240.43.64@tcp:101:dd.0
00002000:00010000:0.0:1651532239.800469:0:323275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3d:0x0] initial LVB size: 33554432, mtime: 0x627061cf, atime: 0x0, ctime: 0x627061cf, blocks: 0x10000
00010000:00010000:1.0:1651532239.800471:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532239.800473:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.800474:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.800476:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4179ba lrc: 2/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44feb1 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.800476:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4179b3 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feaa expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532239.800480:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4179b3 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feaa expref: 15 pid: 323275 timeout: 0 lvb_type: 1
00002000:00010000:1.0:1651532239.800481:0:323276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d3e:0x0] initial LVB size: 33554432, mtime: 0x627061cf, atime: 0x0, ctime: 0x627061cf, blocks: 0x10008
00010000:00010000:0.0:1651532239.800484:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9816573, rc 0)
00010000:00010000:1.0:1651532239.800486:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.800487:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.800489:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4179ba lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feb1 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532239.800494:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4179ba lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feb1 expref: 16 pid: 323276 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532239.800496:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa6fac63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469103168:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (97us total) trans 0 rc 0/0
00010000:00010000:1.0:1651532239.800498:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a000b3c, rc 0)
00000100:00100000:0.0:1651532239.800499:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6841
00000100:00100000:1.0:1651532239.800507:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f8870fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469103232:12345-10.240.43.64@tcp:101:dd.0 Request processed in 40us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532239.800509:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6842
00000100:00100000:1.0:1651532239.803904:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.803924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.803931:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103424
00000100:00100000:1.0:1651532239.803932:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.803939:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.803945:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.803947:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103552
00000100:00100000:1.0:1651532239.803951:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.803964:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103680
00000100:00100000:1.0:1651532239.803969:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.803978:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103808
00000100:00100000:1.0:1651532239.803982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.803985:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103360
00000100:00100000:0.0:1651532239.803993:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103488
00000100:00100000:0.0:1651532239.803996:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103616
00000100:00100000:1.0:1651532239.803998:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469103744
00000100:00100000:0.0:1651532239.804001:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5649
00000100:00100000:0.0:1651532239.804003:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077ccef79 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469103424:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:1.0:1651532239.804009:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5650
00000100:00100000:1.0:1651532239.804010:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd1777e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754469103552:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.804013:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4179c1 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804018:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4179c8 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.804018:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.804019:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.804020:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4179c1 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804025:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.804025:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4179c1 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804026:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.804027:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4179c8 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804031:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4179c8 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.804103:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5651
00000100:00100000:0.0:1651532239.804105:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f39f154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754469103680:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:1.0:1651532239.804106:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5652
00000100:00100000:1.0:1651532239.804108:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa68e3d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754469103808:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.804111:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4179cf lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804114:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4179d6 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.804115:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.804116:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.804117:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4179cf lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804120:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.804120:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4179cf lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804121:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.804122:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4179d6 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804128:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4179d6 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.804179:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5653
00000100:00100000:0.0:1651532239.804181:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d7e4386 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754469103360:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.804186:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4179dd lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.804187:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5654
00000100:00100000:1.0:1651532239.804189:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057009169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754469103488:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.804190:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.804190:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.804191:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4179dd lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804193:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4179e4 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.804194:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4179dd lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804197:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.804198:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.804198:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4179e4 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804202:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4179e4 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.804256:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5655
00000100:00100000:0.0:1651532239.804258:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000984e96db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438148:x1731754469103616:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:1.0:1651532239.804260:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5656
00000100:00100000:1.0:1651532239.804262:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074800103 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438148:x1731754469103744:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.804263:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4179eb lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.804266:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.804267:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f2 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.804267:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.804268:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4179eb lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804271:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.804271:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4179eb lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804272:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.804273:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f2 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.804276:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f2 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806427:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4179c8 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806432:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4179c8 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.806462:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd1777e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754469103552:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2451us (2538us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.806466:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5650
00010000:00010000:1.0:1651532239.806501:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4179c1 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806514:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4179c1 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.806530:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077ccef79 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438148:x1731754469103424:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2526us (2627us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.806533:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5649
00010000:00010000:1.0:1651532239.806539:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4179c8 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806543:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.806545:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4179c8 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806548:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4179c8 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806555:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4179c8 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806558:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f4179c8 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806562:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4179c1 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806564:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.806565:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4179c1 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806568:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4179c1 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806571:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4179c1 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.806580:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f4179c1 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.807306:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4179cf lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.807310:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4179cf lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.807336:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f39f154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754469103680:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3230us (3403us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.807340:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5651
00010000:00010000:1.0:1651532239.807346:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4179cf lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.807350:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.807351:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4179cf lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.807353:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4179cf lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.807359:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4179cf lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.807362:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f4179cf lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.808024:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4179d6 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.808028:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4179d6 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.808043:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa68e3d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754469103808:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3934us (4103us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.808055:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5652
00010000:00010000:1.0:1651532239.808062:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4179d6 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.808065:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.808066:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4179d6 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.808069:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4179d6 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.808074:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4179d6 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.808076:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f4179d6 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.809827:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4179dd lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.809831:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4179dd lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.809856:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d7e4386 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469103360:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5674us (5910us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.809859:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5653
00010000:00010000:1.0:1651532239.809866:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4179dd lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.809870:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.809871:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4179dd lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.809874:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4179dd lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.809879:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4179dd lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.809881:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f4179dd lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.809957:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4179e4 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.809961:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4179e4 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.809983:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057009169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469103488:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5794us (6032us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.809986:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5654
00010000:00010000:1.0:1651532239.809992:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4179e4 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.809996:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.809997:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4179e4 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.810000:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4179e4 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.810005:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4179e4 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.810008:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f4179e4 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.811657:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4179eb lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.811701:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4179eb lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.811726:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4179eb lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.811731:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.811732:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4179eb lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.811735:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4179eb lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.811737:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000984e96db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469103616:12345-10.240.43.64@tcp:3:dd.0 Request processed in 7477us (7766us total) trans 0 rc 1048576/1048576
00010000:00010000:1.0:1651532239.811740:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4179eb lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.811741:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5655
00010000:00010000:1.0:1651532239.811743:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f4179eb lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.811760:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f2 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.811780:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f2 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.811797:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074800103 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469103744:12345-10.240.43.64@tcp:3:dd.0 Request processed in 7534us (7815us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.811800:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5656
00010000:00010000:1.0:1651532239.811826:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f2 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.811830:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.811831:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f2 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.811834:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f2 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.811839:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f2 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.811842:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f2 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.826733:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.826756:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.826759:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104064
00000100:00100000:0.0:1651532239.826766:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104000
00002000:00100000:1.0:1651532239.826777:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3f:0x0] (1048576->2097151)  req@00000000945e8611 x1731754469104064/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532239.826777:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3f:0x0] (0->1048575)  req@0000000005884eb4 x1731754469104000/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.826782:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000945e8611 with x1731754469104064 ext(1048576->2097151)
00002000:00100000:0.0:1651532239.826782:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000005884eb4 with x1731754469104000 ext(0->1048575)
00002000:00010000:1.0:1651532239.826784:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000945e8611
00002000:00010000:0.0:1651532239.826784:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000005884eb4
00000100:00100000:0.0:1651532239.826795:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5657
00000100:00100000:0.0:1651532239.826798:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000005884eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469104000:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.826800:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5658
00000100:00100000:1.0:1651532239.826812:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000945e8611 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469104064:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.838917:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.838927:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.838937:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104320
00002000:00100000:1.0:1651532239.838951:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3f:0x0] (3145728->4194303)  req@000000005d659110 x1731754469104320/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.838956:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005d659110 with x1731754469104320 ext(3145728->4194303)
00002000:00010000:1.0:1651532239.838958:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005d659110
00000100:00100000:1.0:1651532239.838965:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104256
00002000:00100000:1.0:1651532239.838968:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3f:0x0] (2097152->3145727)  req@0000000000d1f5fc x1731754469104256/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.838971:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000000d1f5fc with x1731754469104256 ext(2097152->3145727)
00002000:00010000:1.0:1651532239.838973:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000000d1f5fc
00000100:00100000:1.0:1651532239.838977:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5659
00000100:00100000:1.0:1651532239.838979:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d659110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754469104320:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.839142:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5660
00000100:00100000:1.0:1651532239.839144:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000d1f5fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469104256:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.841933:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000945e8611 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754469104064:12345-10.240.43.64@tcp:4:dd.0 Request processed in 15128us (15199us total) trans 158913794552 rc 0/0
00000100:00100000:1.0:1651532239.841937:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5658
00002000:00100000:1.0:1651532239.841942:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3f:0x0] (1048576->2097151)  req@00000000945e8611 x1731754469104064/t158913794552(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.841949:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000945e8611 with x1731754469104064 ext(1048576->2097151)
00002000:00010000:1.0:1651532239.841951:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000945e8611
00000100:00100000:1.0:1651532239.843822:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000005884eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754469104000:12345-10.240.43.64@tcp:4:dd.0 Request processed in 17023us (17065us total) trans 158913794553 rc 0/0
00000100:00100000:1.0:1651532239.843826:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5657
00002000:00100000:1.0:1651532239.843829:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3f:0x0] (0->1048575)  req@0000000005884eb4 x1731754469104000/t158913794553(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.843833:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000005884eb4 with x1731754469104000 ext(0->1048575)
00002000:00010000:1.0:1651532239.843834:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000005884eb4
00000100:00100000:1.0:1651532239.844364:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.844374:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104512
00002000:00100000:1.0:1651532239.844384:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d40:0x0] (0->1048575)  req@0000000035216b4b x1731754469104512/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.844388:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000035216b4b with x1731754469104512 ext(0->1048575)
00002000:00010000:1.0:1651532239.844390:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000035216b4b
00000100:00100000:1.0:1651532239.844396:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5661
00000100:00100000:1.0:1651532239.844398:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035216b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754469104512:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.845611:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d659110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754469104320:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6630us (6696us total) trans 158913794554 rc 0/0
00000100:00100000:1.0:1651532239.845616:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5659
00002000:00100000:1.0:1651532239.845619:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3f:0x0] (3145728->4194303)  req@000000005d659110 x1731754469104320/t158913794554(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.845623:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005d659110 with x1731754469104320 ext(3145728->4194303)
00002000:00010000:1.0:1651532239.845625:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005d659110
00000100:00100000:1.0:1651532239.846277:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.846286:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104576
00002000:00100000:1.0:1651532239.846294:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d40:0x0] (1048576->2097151)  req@00000000aea4c9e4 x1731754469104576/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.846298:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aea4c9e4 with x1731754469104576 ext(1048576->2097151)
00002000:00010000:1.0:1651532239.846299:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aea4c9e4
00000100:00100000:1.0:1651532239.846305:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5662
00000100:00100000:1.0:1651532239.846306:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aea4c9e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754469104576:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.847975:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000d1f5fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438148:x1731754469104256:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8829us (9047us total) trans 158913794555 rc 0/0
00000100:00100000:1.0:1651532239.847980:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5660
00002000:00100000:1.0:1651532239.847983:0:330057:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x34d3f:0x0] (2097152->3145727)  req@0000000000d1f5fc x1731754469104256/t158913794555(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.847987:0:330057:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000000d1f5fc with x1731754469104256 ext(2097152->3145727)
00002000:00010000:1.0:1651532239.847989:0:330057:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000000d1f5fc
00000100:00100000:1.0:1651532239.848973:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.848982:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.848992:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.848999:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.849016:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.849025:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.849034:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104640
00002000:00100000:1.0:1651532239.849044:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d40:0x0] (2097152->3145727)  req@00000000b2658ee3 x1731754469104640/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.849051:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b2658ee3 with x1731754469104640 ext(2097152->3145727)
00002000:00010000:1.0:1651532239.849052:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b2658ee3
00000100:00100000:1.0:1651532239.849058:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104768
00000100:00100000:1.0:1651532239.849063:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104896
00000100:00100000:1.0:1651532239.849068:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104704
00002000:00100000:1.0:1651532239.849072:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d40:0x0] (3145728->4194303)  req@0000000055fe6623 x1731754469104704/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.849075:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000055fe6623 with x1731754469104704 ext(3145728->4194303)
00002000:00010000:1.0:1651532239.849076:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000055fe6623
00000100:00100000:1.0:1651532239.849083:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104832
00000100:00100000:1.0:1651532239.849090:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469104960
00000100:00100000:1.0:1651532239.849095:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5663
00000100:00100000:1.0:1651532239.849096:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2658ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754469104640:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.849336:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5664
00000100:00100000:1.0:1651532239.849338:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005faf2d59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438148:x1731754469104768:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.849352:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f9 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.849360:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.849361:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.849364:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f9 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.849370:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f9 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.849457:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5665
00000100:00100000:1.0:1651532239.849459:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4979a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754469104896:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.849465:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a00 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.849469:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.849470:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.849471:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a00 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.849474:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a00 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.849535:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5666
00000100:00100000:1.0:1651532239.849537:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055fe6623 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754469104704:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.849680:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5667
00000100:00100000:1.0:1651532239.849682:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4189a02 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438148:x1731754469104832:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.849687:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a07 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.849691:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.849692:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.849693:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a07 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.849696:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a07 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.849755:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5668
00000100:00100000:1.0:1651532239.849757:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047c22d32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754469104960:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.849762:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a0e lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.849766:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.849766:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.849767:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a0e lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.849770:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a0e lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.849880:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035216b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754469104512:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5481us (5516us total) trans 158913794556 rc 0/0
00000100:00100000:1.0:1651532239.849884:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5661
00002000:00100000:1.0:1651532239.849886:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d40:0x0] (0->1048575)  req@0000000035216b4b x1731754469104512/t158913794556(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.849890:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000035216b4b with x1731754469104512 ext(0->1048575)
00002000:00010000:1.0:1651532239.849891:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000035216b4b
00000100:00100000:1.0:1651532239.849930:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532239.851084:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f9 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.851094:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f9 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.851154:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005faf2d59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754469104768:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1812us (2169us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532239.851160:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5664
00000100:00100000:0.0:1651532239.851172:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469105024
00000100:00100000:0.0:1651532239.851200:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5669
00000100:00100000:0.0:1651532239.851203:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000718dd59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438147:x1731754469105024:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.851293:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a15 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.851301:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.851303:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.851305:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a15 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.851312:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a15 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852240:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f9 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852246:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.852248:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f9 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852252:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f9 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852276:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f9 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852284:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f4179f9 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852310:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a00 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852313:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a00 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.852335:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4979a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754469104896:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2875us (3342us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.852339:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5665
00010000:00010000:1.0:1651532239.852348:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a00 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852351:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.852352:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a00 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852355:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a00 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852371:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a00 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.852374:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a00 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853076:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a07 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853081:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a07 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.853099:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a0e lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.853102:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4189a02 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438148:x1731754469104832:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3419us (4086us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.853106:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5667
00010000:00010000:0.0:1651532239.853106:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a0e lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853129:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a07 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853133:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.853134:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a07 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853137:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a07 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853143:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a07 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853154:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a07 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853158:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a0e lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853161:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.853162:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a0e lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853164:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a0e lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.853165:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047c22d32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754469104960:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3406us (4138us total) trans 0 rc 1048576/1048576
00010000:00010000:1.0:1651532239.853168:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a0e lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.853169:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5668
00010000:00010000:1.0:1651532239.853170:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a0e lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.853703:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.853712:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532239.853744:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a15 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.853749:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a15 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.853753:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469105152
00000100:00100000:0.0:1651532239.853773:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000718dd59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438147:x1731754469105024:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2570us (3851us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532239.853777:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5669
00000100:00100000:1.0:1651532239.853779:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469105216
00000100:00100000:0.0:1651532239.853784:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5670
00000100:00100000:1.0:1651532239.853786:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5671
00000100:00100000:0.0:1651532239.853786:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003208350c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438148:x1731754469105152:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:1.0:1651532239.853788:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fedfc73a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438148:x1731754469105216:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.853798:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a1c lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.853798:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a23 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853817:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.853818:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.853820:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a1c lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853825:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a1c lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.853826:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.853827:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.853828:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a23 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.853833:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a23 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.853921:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2658ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754469104640:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4824us (4948us total) trans 158913794557 rc 0/0
00000100:00100000:1.0:1651532239.853925:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5663
00002000:00100000:1.0:1651532239.853929:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d40:0x0] (2097152->3145727)  req@00000000b2658ee3 x1731754469104640/t158913794557(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.853943:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b2658ee3 with x1731754469104640 ext(2097152->3145727)
00002000:00010000:1.0:1651532239.853945:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b2658ee3
00010000:00010000:1.0:1651532239.853953:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a15 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853956:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.853958:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a15 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853961:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a15 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853966:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a15 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.853969:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a15 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.854391:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.854408:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469105280
00000100:00100000:1.0:1651532239.854419:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5672
00000100:00100000:1.0:1651532239.854421:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1c5c51a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754469105280:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.854428:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a2a lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.854433:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.854433:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.854434:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a2a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.854439:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a2a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.854583:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aea4c9e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754469104576:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8276us (8306us total) trans 158913794558 rc 0/0
00000100:00100000:1.0:1651532239.854587:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5662
00002000:00100000:1.0:1651532239.854590:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d40:0x0] (1048576->2097151)  req@00000000aea4c9e4 x1731754469104576/t158913794558(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.854593:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aea4c9e4 with x1731754469104576 ext(1048576->2097151)
00002000:00010000:1.0:1651532239.854595:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aea4c9e4
00010000:00010000:1.0:1651532239.854730:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a1c lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.854735:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a1c lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.854759:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fedfc73a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754469105216:12345-10.240.43.64@tcp:3:dd.0 Request processed in 970us (1047us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.854763:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5671
00010000:00010000:1.0:1651532239.854769:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a1c lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.854773:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.854774:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a1c lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.854777:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a1c lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.854783:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a1c lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.854786:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a1c lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.855324:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055fe6623 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438148:x1731754469104704:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5786us (6325us total) trans 158913794559 rc 0/0
00000100:00100000:1.0:1651532239.855328:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5666
00002000:00100000:1.0:1651532239.855331:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d40:0x0] (3145728->4194303)  req@0000000055fe6623 x1731754469104704/t158913794559(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.855335:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000055fe6623 with x1731754469104704 ext(3145728->4194303)
00002000:00010000:1.0:1651532239.855336:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000055fe6623
00010000:00010000:0.0:1651532239.855792:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a23 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.855799:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a23 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.855828:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a23 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.855833:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.855834:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a23 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.855837:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a23 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.855841:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003208350c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754469105152:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2054us (2138us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532239.855845:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5670
00010000:00010000:1.0:1651532239.855849:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a23 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.855852:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a23 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.856045:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a2a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.856050:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a2a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.856066:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1c5c51a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438148:x1731754469105280:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1644us (1676us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.856069:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5672
00010000:00010000:1.0:1651532239.856075:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a2a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.856078:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.856080:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a2a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.856082:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a2a lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.856087:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a2a lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.856090:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a2a lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.872576:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.872591:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.872601:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469105408
00000100:00100000:0.0:1651532239.872601:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469105472
00002000:00100000:1.0:1651532239.872615:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3f:0x0] (4194304->5242879)  req@00000000af25bc23 x1731754469105408/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532239.872615:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3f:0x0] (5242880->6291455)  req@000000004bbf821d x1731754469105472/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.872620:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000af25bc23 with x1731754469105408 ext(4194304->5242879)
00002000:00100000:0.0:1651532239.872620:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004bbf821d with x1731754469105472 ext(5242880->6291455)
00002000:00010000:1.0:1651532239.872621:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000af25bc23
00002000:00010000:0.0:1651532239.872622:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004bbf821d
00000100:00100000:1.0:1651532239.872629:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5673
00000100:00100000:0.0:1651532239.872635:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5674
00000100:00100000:1.0:1651532239.872637:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af25bc23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438146:x1731754469105408:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532239.872637:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bbf821d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438146:x1731754469105472:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.875129:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af25bc23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438146:x1731754469105408:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2496us (2537us total) trans 158913794560 rc 0/0
00000100:00100000:1.0:1651532239.875134:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5673
00002000:00100000:1.0:1651532239.875137:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3f:0x0] (4194304->5242879)  req@00000000af25bc23 x1731754469105408/t158913794560(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.875141:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000af25bc23 with x1731754469105408 ext(4194304->5242879)
00002000:00010000:1.0:1651532239.875143:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000af25bc23
00000100:00100000:0.0:1651532239.875871:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bbf821d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438146:x1731754469105472:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3232us (3295us total) trans 158913794561 rc 0/0
00000100:00100000:0.0:1651532239.875876:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5674
00002000:00100000:0.0:1651532239.875879:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3f:0x0] (5242880->6291455)  req@000000004bbf821d x1731754469105472/t158913794561(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532239.875883:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004bbf821d with x1731754469105472 ext(5242880->6291455)
00002000:00010000:0.0:1651532239.875885:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004bbf821d
00000100:00100000:1.0:1651532239.883459:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.883473:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.883482:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469105728
00000100:00100000:0.0:1651532239.883483:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469105664
00002000:00100000:1.0:1651532239.883493:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3f:0x0] (7340032->8388607)  req@000000005b170f9a x1731754469105728/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532239.883494:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3f:0x0] (6291456->7340031)  req@00000000df47c44b x1731754469105664/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.883497:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005b170f9a with x1731754469105728 ext(7340032->8388607)
00002000:00010000:1.0:1651532239.883498:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005b170f9a
00002000:00100000:0.0:1651532239.883498:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000df47c44b with x1731754469105664 ext(6291456->7340031)
00002000:00010000:0.0:1651532239.883499:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000df47c44b
00000100:00100000:1.0:1651532239.883505:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5675
00000100:00100000:1.0:1651532239.883513:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b170f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754469105728:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532239.883513:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5676
00000100:00100000:0.0:1651532239.883515:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df47c44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754469105664:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.885648:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b170f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438146:x1731754469105728:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2132us (2188us total) trans 158913794562 rc 0/0
00000100:00100000:1.0:1651532239.885652:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5675
00002000:00100000:1.0:1651532239.885656:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3f:0x0] (7340032->8388607)  req@000000005b170f9a x1731754469105728/t158913794562(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.885660:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005b170f9a with x1731754469105728 ext(7340032->8388607)
00002000:00010000:1.0:1651532239.885662:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005b170f9a
00000100:00100000:0.0:1651532239.886367:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df47c44b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438146:x1731754469105664:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2849us (2892us total) trans 158913794563 rc 0/0
00000100:00100000:0.0:1651532239.886373:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5676
00002000:00100000:0.0:1651532239.886376:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3f:0x0] (6291456->7340031)  req@00000000df47c44b x1731754469105664/t158913794563(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532239.886380:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000df47c44b with x1731754469105664 ext(6291456->7340031)
00002000:00010000:0.0:1651532239.886382:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000df47c44b
00000100:00100000:1.0:1651532239.890310:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.890330:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469105920
00002000:00100000:0.0:1651532239.890342:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d40:0x0] (4194304->5242879)  req@00000000218a7f6b x1731754469105920/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532239.890346:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000218a7f6b with x1731754469105920 ext(4194304->5242879)
00002000:00010000:0.0:1651532239.890348:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000218a7f6b
00000100:00100000:0.0:1651532239.890360:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5677
00000100:00100000:0.0:1651532239.890362:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000218a7f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438146:x1731754469105920:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532239.892259:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000218a7f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438146:x1731754469105920:12345-10.240.43.64@tcp:4:dd.0 Request processed in 1895us (1948us total) trans 158913794564 rc 0/0
00000100:00100000:0.0:1651532239.892263:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5677
00002000:00100000:0.0:1651532239.892266:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d40:0x0] (4194304->5242879)  req@00000000218a7f6b x1731754469105920/t158913794564(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532239.892270:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000218a7f6b with x1731754469105920 ext(4194304->5242879)
00002000:00010000:0.0:1651532239.892272:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000218a7f6b
00000100:00100000:0.0:1651532239.895328:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.895341:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.895361:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.895364:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106112
00000100:00100000:1.0:1651532239.895410:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106240
00002000:00100000:1.0:1651532239.895416:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d40:0x0] (6291456->7340031)  req@000000009f6fadea x1731754469106240/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.895420:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009f6fadea with x1731754469106240 ext(6291456->7340031)
00002000:00010000:1.0:1651532239.895421:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009f6fadea
00000100:00100000:1.0:1651532239.895427:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106368
00000100:00100000:0.0:1651532239.895429:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.895440:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106496
00000100:00100000:0.0:1651532239.895441:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.895451:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106624
00000100:00100000:0.0:1651532239.895455:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.895463:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106048
00002000:00100000:1.0:1651532239.895468:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d40:0x0] (5242880->6291455)  req@0000000085f41293 x1731754469106048/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.895471:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000085f41293 with x1731754469106048 ext(5242880->6291455)
00002000:00010000:1.0:1651532239.895472:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000085f41293
00000100:00100000:0.0:1651532239.895474:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.895484:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106176
00000100:00100000:1.0:1651532239.895489:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5678
00000100:00100000:0.0:1651532239.895489:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.895491:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006350a4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754469106112:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:0.0:1651532239.895495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.895503:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106304
00010000:00010000:1.0:1651532239.895505:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a31 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.895512:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651532239.895512:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106432
00010000:00010000:1.0:1651532239.895513:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.895515:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a31 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00002000:00100000:0.0:1651532239.895516:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d40:0x0] (7340032->8388607)  req@000000009543c085 x1731754469106432/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532239.895520:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009543c085 with x1731754469106432 ext(7340032->8388607)
00010000:00010000:1.0:1651532239.895522:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a31 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532239.895522:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009543c085
00000100:00100000:0.0:1651532239.895524:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5679
00000100:00100000:0.0:1651532239.895526:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f6fadea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438146:x1731754469106240:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.895594:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5680
00000100:00100000:1.0:1651532239.895596:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004abc6eda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438146:x1731754469106368:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.895602:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a38 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.895606:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.895607:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.895607:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a38 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.895611:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a38 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.895674:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5681
00000100:00100000:1.0:1651532239.895675:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d905882 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+52:438146:x1731754469106496:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:0.0:1651532239.895678:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5682
00000100:00100000:0.0:1651532239.895680:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a90117d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+52:438146:x1731754469106624:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.895681:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a3f lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.895684:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.895685:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.895686:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a3f lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.895688:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417a46 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.895689:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a3f lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.895694:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.895694:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.895696:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417a46 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.895700:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417a46 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.895748:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5683
00000100:00100000:1.0:1651532239.895750:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085f41293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+54:438146:x1731754469106048:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532239.895762:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5684
00000100:00100000:0.0:1651532239.895765:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005eaaf57a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+54:438146:x1731754469106176:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.895770:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417a4d lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.895774:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.895775:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.895776:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417a4d lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.895779:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417a4d lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.895857:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5685
00000100:00100000:0.0:1651532239.895860:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023cfaf75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+55:438146:x1731754469106304:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.895866:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a54 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.895869:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.895870:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.895871:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a54 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.895874:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a54 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.895924:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5686
00000100:00100000:1.0:1651532239.895926:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009543c085 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438146:x1731754469106432:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532239.897425:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a31 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.897432:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a31 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.897489:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006350a4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438146:x1731754469106112:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1996us (2161us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.897493:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5678
00010000:00010000:1.0:1651532239.897506:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a31 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.897518:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.897520:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a31 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.897524:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a31 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.897533:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a31 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.897536:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a31 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898209:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a38 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898214:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a38 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.898233:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004abc6eda pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438146:x1731754469106368:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2636us (2873us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.898238:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5680
00010000:00010000:1.0:1651532239.898246:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a38 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898249:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.898250:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a38 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898253:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a38 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898259:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a38 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898262:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a38 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.898461:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.898517:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106688
00000100:00100000:1.0:1651532239.898535:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5687
00000100:00100000:1.0:1651532239.898537:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d829981e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438146:x1731754469106688:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.898550:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a5b lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898556:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.898557:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.898559:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a5b lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898567:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a5b lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898796:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a3f lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898801:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a3f lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.898837:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d905882 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754469106496:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3161us (3408us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.898848:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5681
00010000:00010000:1.0:1651532239.898856:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a3f lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898860:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.898861:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a3f lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898864:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a3f lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898876:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a3f lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.898879:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a3f lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.899010:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.899018:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106752
00000100:00100000:1.0:1651532239.899028:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5688
00000100:00100000:1.0:1651532239.899030:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d153fc51 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754469106752:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.899036:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a62 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.899040:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.899040:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.899041:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a62 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.899045:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a62 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.899713:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085f41293 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754469106048:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3956us (4251us total) trans 158913794565 rc 0/0
00000100:00100000:1.0:1651532239.899716:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5683
00002000:00100000:1.0:1651532239.899722:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d40:0x0] (5242880->6291455)  req@0000000085f41293 x1731754469106048/t158913794565(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.899727:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000085f41293 with x1731754469106048 ext(5242880->6291455)
00002000:00010000:1.0:1651532239.899735:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000085f41293
00000100:00100000:1.0:1651532239.900441:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009543c085 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754469106432:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4513us (4945us total) trans 158913794566 rc 0/0
00000100:00100000:1.0:1651532239.900445:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5686
00002000:00100000:1.0:1651532239.900448:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d40:0x0] (7340032->8388607)  req@000000009543c085 x1731754469106432/t158913794566(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.900452:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009543c085 with x1731754469106432 ext(7340032->8388607)
00002000:00010000:1.0:1651532239.900454:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009543c085
00010000:00010000:1.0:1651532239.901150:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a5b lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901156:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a5b lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.901194:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d829981e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438146:x1731754469106688:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2656us (2734us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.901205:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5687
00010000:00010000:1.0:1651532239.901213:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a5b lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901217:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.901218:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a5b lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901222:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a5b lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901230:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a5b lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901233:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a5b lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.901265:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f6fadea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+55:438146:x1731754469106240:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5738us (5923us total) trans 158913794567 rc 0/0
00000100:00100000:1.0:1651532239.901268:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5679
00002000:00100000:1.0:1651532239.901278:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d40:0x0] (6291456->7340031)  req@000000009f6fadea x1731754469106240/t158913794567(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.901281:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009f6fadea with x1731754469106240 ext(6291456->7340031)
00002000:00010000:1.0:1651532239.901283:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009f6fadea
00010000:00010000:0.0:1651532239.901756:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417a46 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.901785:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417a46 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.901827:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a90117d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438146:x1731754469106624:12345-10.240.43.64@tcp:3:dd.0 Request processed in 6146us (6385us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532239.901832:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5682
00010000:00010000:1.0:1651532239.901835:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a62 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901839:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a62 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.901854:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d153fc51 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438146:x1731754469106752:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2823us (2844us total) trans 0 rc 1048576/1048576
00010000:00010000:0.0:1651532239.901856:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417a4d lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.901857:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5688
00010000:00010000:0.0:1651532239.901860:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417a4d lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901864:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417a46 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901874:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.901875:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417a46 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.901878:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005eaaf57a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438146:x1731754469106176:12345-10.240.43.64@tcp:3:dd.0 Request processed in 6113us (6404us total) trans 0 rc 1048576/1048576
00010000:00010000:1.0:1651532239.901879:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417a46 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.901881:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5684
00010000:00010000:1.0:1651532239.901887:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417a46 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901890:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417a46 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901893:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a62 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901896:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.901897:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a62 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901900:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a62 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.901901:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a54 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901903:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a62 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901905:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a62 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.901905:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a54 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901909:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417a4d lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901911:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.901912:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417a4d lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.901915:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023cfaf75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754469106304:12345-10.240.43.64@tcp:3:dd.0 Request processed in 6055us (6426us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532239.901918:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5685
00010000:00010000:1.0:1651532239.901935:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417a4d lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901939:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417a4d lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901942:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417a4d lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901945:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a54 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901948:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.901968:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a54 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901976:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a54 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901980:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a54 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.901983:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417a54 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.917907:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.917921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.917933:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106944
00000100:00100000:1.0:1651532239.917935:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469106880
00002000:00100000:1.0:1651532239.917948:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3f:0x0] (8388608->9437183)  req@00000000ccbec0b9 x1731754469106880/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532239.917949:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d3f:0x0] (9437184->10485759)  req@000000001578386a x1731754469106944/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.917953:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ccbec0b9 with x1731754469106880 ext(8388608->9437183)
00002000:00100000:0.0:1651532239.917953:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001578386a with x1731754469106944 ext(9437184->10485759)
00002000:00010000:1.0:1651532239.917954:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ccbec0b9
00002000:00010000:0.0:1651532239.917955:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001578386a
00000100:00100000:1.0:1651532239.917961:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5689
00000100:00100000:1.0:1651532239.917963:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccbec0b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754469106880:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532239.917964:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5690
00000100:00100000:0.0:1651532239.917965:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001578386a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754469106944:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.920086:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccbec0b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438147:x1731754469106880:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2121us (2163us total) trans 158913794568 rc 0/0
00000100:00100000:1.0:1651532239.920090:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5689
00002000:00100000:1.0:1651532239.920093:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3f:0x0] (8388608->9437183)  req@00000000ccbec0b9 x1731754469106880/t158913794568(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.920097:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ccbec0b9 with x1731754469106880 ext(8388608->9437183)
00002000:00010000:1.0:1651532239.920099:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ccbec0b9
00000100:00100000:0.0:1651532239.920843:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001578386a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438147:x1731754469106944:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2875us (2936us total) trans 158913794569 rc 0/0
00000100:00100000:0.0:1651532239.920847:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5690
00002000:00100000:0.0:1651532239.920850:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d3f:0x0] (9437184->10485759)  req@000000001578386a x1731754469106944/t158913794569(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532239.920854:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001578386a with x1731754469106944 ext(9437184->10485759)
00002000:00010000:0.0:1651532239.920856:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001578386a
00000100:00100000:1.0:1651532239.929431:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.929457:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107200
00000100:00100000:1.0:1651532239.929460:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.929469:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107136
00002000:00100000:0.0:1651532239.929470:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d3f:0x0] (11534336->12582911)  req@00000000a1aa41e4 x1731754469107200/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532239.929474:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a1aa41e4 with x1731754469107200 ext(11534336->12582911)
00002000:00010000:0.0:1651532239.929475:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a1aa41e4
00002000:00100000:1.0:1651532239.929477:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3f:0x0] (10485760->11534335)  req@00000000cac984c2 x1731754469107136/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:0.0:1651532239.929485:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5691
00002000:00100000:1.0:1651532239.929487:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cac984c2 with x1731754469107136 ext(10485760->11534335)
00000100:00100000:0.0:1651532239.929487:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1aa41e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+52:438147:x1731754469107200:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532239.929488:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000cac984c2
00000100:00100000:1.0:1651532239.929494:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5692
00000100:00100000:1.0:1651532239.929496:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cac984c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+52:438147:x1731754469107136:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.931934:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1aa41e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438147:x1731754469107200:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2445us (2503us total) trans 158913794570 rc 0/0
00000100:00100000:1.0:1651532239.931940:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5691
00002000:00100000:1.0:1651532239.931943:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d3f:0x0] (11534336->12582911)  req@00000000a1aa41e4 x1731754469107200/t158913794570(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.931947:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a1aa41e4 with x1731754469107200 ext(11534336->12582911)
00002000:00010000:1.0:1651532239.931949:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a1aa41e4
00000100:00100000:1.0:1651532239.932632:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cac984c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+55:438147:x1731754469107136:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3135us (3171us total) trans 158913794571 rc 0/0
00000100:00100000:1.0:1651532239.932635:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5692
00002000:00100000:1.0:1651532239.932638:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3f:0x0] (10485760->11534335)  req@00000000cac984c2 x1731754469107136/t158913794571(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.932641:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cac984c2 with x1731754469107136 ext(10485760->11534335)
00002000:00010000:1.0:1651532239.932643:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000cac984c2
00000100:00100000:1.0:1651532239.940370:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.940378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.940384:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.940392:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.940411:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107456
00000100:00100000:1.0:1651532239.940427:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107584
00002000:00100000:1.0:1651532239.940431:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d40:0x0] (9437184->10485759)  req@00000000aa7525f6 x1731754469107584/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.940435:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aa7525f6 with x1731754469107584 ext(9437184->10485759)
00002000:00010000:1.0:1651532239.940436:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aa7525f6
00000100:00100000:1.0:1651532239.940440:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107712
00000100:00100000:1.0:1651532239.940444:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107968
00000100:00100000:1.0:1651532239.940450:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5693
00000100:00100000:1.0:1651532239.940452:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000096b3da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438147:x1731754469107456:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.940475:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a69 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.940481:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532239.940483:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.940484:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.940492:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a69 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.940499:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a69 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.940523:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.940542:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.940562:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.940573:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.940583:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107392
00000100:00100000:1.0:1651532239.940587:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107520
00002000:00100000:0.0:1651532239.940593:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d40:0x0] (8388608->9437183)  req@000000001352f0e5 x1731754469107392/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:1.0:1651532239.940594:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107648
00000100:00100000:1.0:1651532239.940598:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107776
00002000:00100000:0.0:1651532239.940601:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001352f0e5 with x1731754469107392 ext(8388608->9437183)
00002000:00100000:1.0:1651532239.940602:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d40:0x0] (10485760->11534335)  req@00000000d71329bf x1731754469107776/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00010000:0.0:1651532239.940603:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001352f0e5
00002000:00100000:1.0:1651532239.940605:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d71329bf with x1731754469107776 ext(10485760->11534335)
00002000:00010000:1.0:1651532239.940607:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d71329bf
00000100:00100000:0.0:1651532239.940607:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469107904
00000100:00100000:1.0:1651532239.940609:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5694
00000100:00100000:1.0:1651532239.940611:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa7525f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438147:x1731754469107584:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532239.940612:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5695
00000100:00100000:0.0:1651532239.940614:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f34773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438147:x1731754469107712:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.940624:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a70 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.940629:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.940630:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.940631:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a70 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.940636:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a70 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.940704:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5696
00000100:00100000:0.0:1651532239.940705:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b90dde1c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438147:x1731754469107968:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.940712:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417a77 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.940716:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.940716:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.940717:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417a77 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.940721:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417a77 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.940772:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5697
00000100:00100000:1.0:1651532239.940774:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e6bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438147:x1731754469107520:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.940781:0:330281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a7e lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.940785:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.940786:0:330281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.940788:0:330281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a7e lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.940789:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5698
00000100:00100000:0.0:1651532239.940791:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000747856c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438147:x1731754469107648:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.940792:0:330281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a7e lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.940798:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417a85 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.940801:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.940802:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.940814:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417a85 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.940819:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417a85 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.940860:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5699
00000100:00100000:1.0:1651532239.940862:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001352f0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+69:438147:x1731754469107392:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532239.940876:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5700
00000100:00100000:0.0:1651532239.940878:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d71329bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+69:438147:x1731754469107776:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.941073:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5701
00000100:00100000:1.0:1651532239.941075:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eab267ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+71:438147:x1731754469107904:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.941082:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a8c lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.941085:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.941086:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.941087:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a8c lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.941091:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a8c lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.942893:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a69 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.942906:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a69 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.942944:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000096b3da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438147:x1731754469107456:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2489us (2573us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.942949:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5693
00000100:00100000:1.0:1651532239.943531:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa7525f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438147:x1731754469107584:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2919us (3152us total) trans 158913794572 rc 0/0
00000100:00100000:1.0:1651532239.943535:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5694
00002000:00100000:1.0:1651532239.943541:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d40:0x0] (9437184->10485759)  req@00000000aa7525f6 x1731754469107584/t158913794572(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.943546:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aa7525f6 with x1731754469107584 ext(9437184->10485759)
00002000:00010000:1.0:1651532239.943548:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000aa7525f6
00000100:00100000:1.0:1651532239.943894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.943905:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108032
00000100:00100000:1.0:1651532239.943922:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5702
00000100:00100000:1.0:1651532239.943933:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007078915f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438147:x1731754469108032:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.943949:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a93 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.943961:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.943962:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.943965:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a93 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.943972:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a93 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.944321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.944342:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108096
00002000:00100000:1.0:1651532239.944350:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d40:0x0] (11534336->12582911)  req@00000000f38c63f4 x1731754469108096/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.944354:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f38c63f4 with x1731754469108096 ext(11534336->12582911)
00002000:00010000:1.0:1651532239.944356:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f38c63f4
00000100:00100000:1.0:1651532239.944362:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5703
00000100:00100000:1.0:1651532239.944364:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f38c63f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+75:438147:x1731754469108096:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532239.944652:0:330281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a7e lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.944658:0:330281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a7e lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.944705:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e6bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+75:438147:x1731754469107520:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3930us (4206us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.944715:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5697
00000100:00100000:1.0:1651532239.944745:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001352f0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438147:x1731754469107392:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3882us (4265us total) trans 158913794573 rc 0/0
00000100:00100000:1.0:1651532239.944748:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5699
00002000:00100000:1.0:1651532239.944751:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d40:0x0] (8388608->9437183)  req@000000001352f0e5 x1731754469107392/t158913794573(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.944754:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001352f0e5 with x1731754469107392 ext(8388608->9437183)
00002000:00010000:1.0:1651532239.944756:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001352f0e5
00010000:00010000:1.0:1651532239.944996:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a70 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945001:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a70 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.945030:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f34773 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438147:x1731754469107712:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4415us (4646us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.945034:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5695
00010000:00010000:1.0:1651532239.945052:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a69 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945057:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.945058:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a69 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945062:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a69 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945072:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a69 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945075:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417a69 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 6 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945079:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a7e lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945082:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.945083:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a7e lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945085:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a7e lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945089:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a7e lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945099:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417a7e lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945102:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a70 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945104:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.945105:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a70 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945108:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a70 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945111:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a70 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945114:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417a70 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.945740:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.945758:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108160
00000100:00100000:1.0:1651532239.945775:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5704
00000100:00100000:1.0:1651532239.945777:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094e00edf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+75:438147:x1731754469108160:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.945789:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a9a lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945794:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.945795:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.945797:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a9a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.945828:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a9a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.945938:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d71329bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+75:438147:x1731754469107776:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5059us (5376us total) trans 158913794574 rc 0/0
00000100:00100000:1.0:1651532239.945950:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5700
00002000:00100000:1.0:1651532239.945954:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d40:0x0] (10485760->11534335)  req@00000000d71329bf x1731754469107776/t158913794574(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.945958:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d71329bf with x1731754469107776 ext(10485760->11534335)
00002000:00010000:1.0:1651532239.945960:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d71329bf
00010000:00010000:1.0:1651532239.946017:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a8c lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946021:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a8c lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.946039:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eab267ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438147:x1731754469107904:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4963us (5466us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.946057:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5701
00010000:00010000:1.0:1651532239.946065:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a8c lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946071:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.946073:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a8c lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946081:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a8c lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946086:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a8c lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946089:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417a8c lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946621:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a93 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946626:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a93 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.946642:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007078915f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+71:438147:x1731754469108032:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2717us (2749us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.946645:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5702
00010000:00010000:1.0:1651532239.946652:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a93 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946663:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.946664:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a93 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946668:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a93 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946673:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a93 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.946676:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417a93 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.946699:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f38c63f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+69:438147:x1731754469108096:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2334us (2378us total) trans 158913794575 rc 0/0
00000100:00100000:1.0:1651532239.946710:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5703
00002000:00100000:1.0:1651532239.946712:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d40:0x0] (11534336->12582911)  req@00000000f38c63f4 x1731754469108096/t158913794575(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.946716:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f38c63f4 with x1731754469108096 ext(11534336->12582911)
00002000:00010000:1.0:1651532239.946717:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f38c63f4
00010000:00010000:0.0:1651532239.947256:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417a77 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.947263:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417a77 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947277:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417a77 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947281:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.947282:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417a77 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947285:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417a77 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947293:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417a77 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947296:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417a77 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.947326:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b90dde1c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438147:x1731754469107968:12345-10.240.43.64@tcp:3:dd.0 Request processed in 6618us (6933us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532239.947331:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5696
00010000:00010000:0.0:1651532239.947360:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417a85 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947361:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a9a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947365:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a9a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.947365:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417a85 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.947385:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094e00edf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438147:x1731754469108160:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1607us (1646us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532239.947386:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000747856c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438147:x1731754469107648:12345-10.240.43.64@tcp:3:dd.0 Request processed in 6594us (6844us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.947388:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5704
00000100:00100000:0.0:1651532239.947390:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5698
00010000:00010000:1.0:1651532239.947395:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a9a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947398:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.947399:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a9a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947411:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a9a lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947415:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a9a lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947421:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417a9a lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947424:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417a85 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947427:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.947435:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417a85 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947438:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417a85 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947441:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417a85 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.947444:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417a85 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.964063:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.964080:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.964097:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108352
00000100:00100000:1.0:1651532239.964104:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108288
00002000:00100000:0.0:1651532239.964114:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3f:0x0] (13631488->14680063)  req@000000006110066f x1731754469108352/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.964116:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3f:0x0] (12582912->13631487)  req@00000000a45a91b4 x1731754469108288/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532239.964119:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006110066f with x1731754469108352 ext(13631488->14680063)
00002000:00100000:1.0:1651532239.964120:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a45a91b4 with x1731754469108288 ext(12582912->13631487)
00002000:00010000:1.0:1651532239.964121:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a45a91b4
00002000:00010000:0.0:1651532239.964121:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006110066f
00000100:00100000:0.0:1651532239.964130:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5705
00000100:00100000:0.0:1651532239.964132:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006110066f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438147:x1731754469108352:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.964134:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5706
00000100:00100000:1.0:1651532239.964136:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a45a91b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438147:x1731754469108288:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.966607:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a45a91b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+69:438147:x1731754469108288:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2469us (2526us total) trans 158913794576 rc 0/0
00000100:00100000:1.0:1651532239.966611:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5706
00002000:00100000:1.0:1651532239.966615:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3f:0x0] (12582912->13631487)  req@00000000a45a91b4 x1731754469108288/t158913794576(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.966619:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a45a91b4 with x1731754469108288 ext(12582912->13631487)
00002000:00010000:1.0:1651532239.966620:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a45a91b4
00000100:00100000:0.0:1651532239.967354:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006110066f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438147:x1731754469108352:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3220us (3292us total) trans 158913794577 rc 0/0
00000100:00100000:0.0:1651532239.967358:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5705
00002000:00100000:0.0:1651532239.967362:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3f:0x0] (13631488->14680063)  req@000000006110066f x1731754469108352/t158913794577(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532239.967366:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006110066f with x1731754469108352 ext(13631488->14680063)
00002000:00010000:0.0:1651532239.967368:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006110066f
00000100:00100000:1.0:1651532239.975454:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.975467:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.975476:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108608
00000100:00100000:0.0:1651532239.975479:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108544
00002000:00100000:1.0:1651532239.975487:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3f:0x0] (15728640->16777215)  req@000000006841be1a x1731754469108608/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532239.975489:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3f:0x0] (14680064->15728639)  req@00000000d679d33b x1731754469108544/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.975491:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006841be1a with x1731754469108608 ext(15728640->16777215)
00002000:00010000:1.0:1651532239.975492:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006841be1a
00002000:00100000:0.0:1651532239.975493:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d679d33b with x1731754469108544 ext(14680064->15728639)
00002000:00010000:0.0:1651532239.975494:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d679d33b
00000100:00100000:1.0:1651532239.975502:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5707
00000100:00100000:1.0:1651532239.975510:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006841be1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438147:x1731754469108608:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532239.975512:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5708
00000100:00100000:0.0:1651532239.975514:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d679d33b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438147:x1731754469108544:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.978921:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d679d33b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438147:x1731754469108544:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3406us (3452us total) trans 158913794578 rc 0/0
00000100:00100000:1.0:1651532239.978926:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5708
00002000:00100000:1.0:1651532239.978929:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3f:0x0] (14680064->15728639)  req@00000000d679d33b x1731754469108544/t158913794578(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.978933:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d679d33b with x1731754469108544 ext(14680064->15728639)
00002000:00010000:1.0:1651532239.978935:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d679d33b
00000100:00100000:1.0:1651532239.979656:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006841be1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+71:438147:x1731754469108608:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4150us (4201us total) trans 158913794579 rc 0/0
00000100:00100000:1.0:1651532239.979659:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5707
00002000:00100000:1.0:1651532239.979662:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3f:0x0] (15728640->16777215)  req@000000006841be1a x1731754469108608/t158913794579(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.979665:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006841be1a with x1731754469108608 ext(15728640->16777215)
00002000:00010000:1.0:1651532239.979666:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006841be1a
00000100:00100000:1.0:1651532239.986241:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.986262:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.986280:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.986287:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.986321:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.986321:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108864
00000100:00100000:1.0:1651532239.986330:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.986337:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.986347:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108992
00000100:00100000:1.0:1651532239.986352:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:0.0:1651532239.986353:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d40:0x0] (13631488->14680063)  req@000000008f46e571 x1731754469108992/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532239.986357:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008f46e571 with x1731754469108992 ext(13631488->14680063)
00002000:00010000:0.0:1651532239.986359:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008f46e571
00000100:00100000:0.0:1651532239.986365:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109120
00000100:00100000:1.0:1651532239.986371:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532239.986372:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109376
00000100:00100000:1.0:1651532239.986384:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108800
00000100:00100000:0.0:1651532239.986385:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469108928
00000100:00100000:0.0:1651532239.986389:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109056
00002000:00100000:1.0:1651532239.986392:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d40:0x0] (12582912->13631487)  req@00000000d242dca2 x1731754469108800/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:0.0:1651532239.986393:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109184
00002000:00100000:1.0:1651532239.986396:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d242dca2 with x1731754469108800 ext(12582912->13631487)
00002000:00100000:0.0:1651532239.986396:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d40:0x0] (14680064->15728639)  req@00000000c9095cc8 x1731754469109184/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00010000:1.0:1651532239.986397:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d242dca2
00002000:00100000:0.0:1651532239.986399:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c9095cc8 with x1731754469109184 ext(14680064->15728639)
00002000:00010000:0.0:1651532239.986410:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c9095cc8
00000100:00100000:1.0:1651532239.986411:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109312
00000100:00100000:0.0:1651532239.986414:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5709
00000100:00100000:0.0:1651532239.986416:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000293c460f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438147:x1731754469108864:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:1.0:1651532239.986417:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5710
00000100:00100000:1.0:1651532239.986419:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f46e571 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438147:x1731754469108992:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532239.986432:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417aa1 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.986442:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.986443:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.986445:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417aa1 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.986451:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417aa1 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.986516:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5711
00000100:00100000:0.0:1651532239.986518:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007567ed64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+80:438147:x1731754469109120:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.986524:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417aa8 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.986528:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.986529:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.986530:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417aa8 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.986533:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417aa8 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.986568:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5712
00000100:00100000:1.0:1651532239.986570:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005bc59f55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+82:438147:x1731754469109376:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.986580:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417aaf lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.986585:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.986585:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.986587:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417aaf lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.986588:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5713
00000100:00100000:0.0:1651532239.986590:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053260339 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+82:438147:x1731754469108928:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.986591:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417aaf lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.986595:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417ab6 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.986598:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.986599:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.986600:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417ab6 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.986604:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417ab6 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.986648:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5714
00000100:00100000:1.0:1651532239.986650:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002336f7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+84:438147:x1731754469109056:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.986656:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417abd lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.986657:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5715
00000100:00100000:0.0:1651532239.986658:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d242dca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+84:438147:x1731754469108800:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532239.986660:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.986660:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.986661:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417abd lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.986665:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417abd lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.986717:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5716
00000100:00100000:1.0:1651532239.986719:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9095cc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+85:438147:x1731754469109184:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532239.986903:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5717
00000100:00100000:1.0:1651532239.986905:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081015738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+87:438147:x1731754469109312:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.986912:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ac4 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.986916:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.986917:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.986918:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ac4 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.986922:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ac4 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.991691:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417aaf lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.991707:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417aaf lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.991749:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005bc59f55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+89:438147:x1731754469109376:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5176us (5459us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.991761:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5712
00010000:00010000:1.0:1651532239.991940:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417abd lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.991944:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417abd lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.991963:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002336f7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+89:438147:x1731754469109056:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5312us (5625us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.991977:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5714
00010000:00010000:1.0:1651532239.991986:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417aaf lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.991990:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.991991:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417aaf lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.991995:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417aaf lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992011:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417aaf lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992015:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417aaf lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992019:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417abd lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992022:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.992023:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417abd lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992026:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417abd lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992029:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417abd lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992033:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417abd lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992084:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417aa8 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992088:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417aa8 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.992113:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007567ed64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+87:438147:x1731754469109120:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5594us (5833us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.992117:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5711
00010000:00010000:1.0:1651532239.992261:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417aa1 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992266:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417aa1 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.992301:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000293c460f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+87:438147:x1731754469108864:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5885us (6061us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.992305:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5709
00010000:00010000:1.0:1651532239.992313:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417aa8 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992324:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.992325:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417aa8 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992328:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417aa8 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992334:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417aa8 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992337:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417aa8 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992340:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417aa1 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992343:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.992343:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417aa1 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992346:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417aa1 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992349:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417aa1 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992351:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417aa1 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.992380:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.992391:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109440
00000100:00100000:1.0:1651532239.992428:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5718
00000100:00100000:1.0:1651532239.992430:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f6fdb397 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+87:438147:x1731754469109440:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532239.992442:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417acb lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992448:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.992449:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532239.992451:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417acb lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992456:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417acb lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.992466:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417ab6 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.992508:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417ab6 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992529:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417ab6 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992533:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.992534:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417ab6 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992537:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417ab6 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992542:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417ab6 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.992542:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053260339 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+87:438147:x1731754469108928:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5950us (6210us total) trans 0 rc 1048576/1048576
00010000:00010000:1.0:1651532239.992545:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417ab6 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.992546:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5713
00010000:00010000:1.0:1651532239.992608:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ac4 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992612:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ac4 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.992652:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081015738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+85:438147:x1731754469109312:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5745us (6280us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532239.992655:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5717
00010000:00010000:1.0:1651532239.992662:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ac4 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992666:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532239.992667:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ac4 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992670:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ac4 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992674:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ac4 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532239.992677:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ac4 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.992701:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f46e571 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+83:438147:x1731754469108992:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6281us (6439us total) trans 158913794580 rc 0/0
00000100:00100000:1.0:1651532239.992705:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5710
00002000:00100000:1.0:1651532239.992710:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d40:0x0] (13631488->14680063)  req@000000008f46e571 x1731754469108992/t158913794580(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.992715:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008f46e571 with x1731754469108992 ext(13631488->14680063)
00002000:00010000:1.0:1651532239.992717:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008f46e571
00000100:00100000:1.0:1651532239.993088:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.993097:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.993103:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109504
00002000:00100000:1.0:1651532239.993110:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d40:0x0] (15728640->16777215)  req@00000000e6df582f x1731754469109504/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/0 e 0 to 0 dl 1651532282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532239.993114:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e6df582f with x1731754469109504 ext(15728640->16777215)
00002000:00010000:1.0:1651532239.993115:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e6df582f
00000100:00100000:1.0:1651532239.993125:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109568
00000100:00100000:1.0:1651532239.993131:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5719
00000100:00100000:1.0:1651532239.993133:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6df582f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+84:438147:x1731754469109504:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532239.993200:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5720
00000100:00100000:0.0:1651532239.993203:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023783cd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+84:438147:x1731754469109568:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532239.993214:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad2 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.993219:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.993220:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532239.993221:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad2 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.993228:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad2 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.993348:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417acb lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.993353:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417acb lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.993377:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f6fdb397 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+85:438147:x1731754469109440:12345-10.240.43.64@tcp:3:dd.0 Request processed in 945us (997us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532239.993382:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5718
00010000:00010000:0.0:1651532239.993429:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417acb lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.993436:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008be91647 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532239.993438:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417acb lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.993443:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417acb lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.993453:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417acb lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.993458:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008be91647/0xa29a79078f417acb lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.993846:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9095cc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+83:438147:x1731754469109184:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7125us (7492us total) trans 158913794581 rc 0/0
00000100:00100000:1.0:1651532239.993851:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5716
00002000:00100000:1.0:1651532239.993854:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d40:0x0] (14680064->15728639)  req@00000000c9095cc8 x1731754469109184/t158913794581(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.993858:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c9095cc8 with x1731754469109184 ext(14680064->15728639)
00002000:00010000:1.0:1651532239.993860:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c9095cc8
00010000:00010000:0.0:1651532239.994386:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad2 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.994392:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad2 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532239.994423:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023783cd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+81:438147:x1731754469109568:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1219us (1325us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532239.994426:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5720
00010000:00010000:0.0:1651532239.994436:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad2 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.994439:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532239.994441:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad2 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.994444:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad2 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.994450:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad2 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532239.994455:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad2 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532239.994581:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d242dca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438147:x1731754469108800:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7921us (8259us total) trans 158913794582 rc 0/0
00000100:00100000:1.0:1651532239.994585:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5715
00002000:00100000:1.0:1651532239.994588:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d40:0x0] (12582912->13631487)  req@00000000d242dca2 x1731754469108800/t158913794582(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.994591:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d242dca2 with x1731754469108800 ext(12582912->13631487)
00002000:00010000:1.0:1651532239.994593:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d242dca2
00000100:00100000:1.0:1651532239.995691:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6df582f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438147:x1731754469109504:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2556us (2602us total) trans 158913794583 rc 0/0
00000100:00100000:1.0:1651532239.995694:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5719
00002000:00100000:1.0:1651532239.995697:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d40:0x0] (15728640->16777215)  req@00000000e6df582f x1731754469109504/t158913794583(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:737/0 lens 488/448 e 0 to 0 dl 1651532282 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532239.995701:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e6df582f with x1731754469109504 ext(15728640->16777215)
00002000:00010000:1.0:1651532239.995702:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e6df582f
00000100:00100000:0.0:1651532240.013490:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.013504:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.013510:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.013517:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.013518:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109760
00000100:00100000:0.0:1651532240.013526:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109888
00002000:00100000:1.0:1651532240.013533:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d3f:0x0] (17825792->18874367)  req@000000009b2625a4 x1731754469109760/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.013536:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3f:0x0] (19922944->20971519)  req@00000000fae6e41b x1731754469109888/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.013537:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009b2625a4 with x1731754469109760 ext(17825792->18874367)
00002000:00010000:1.0:1651532240.013538:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009b2625a4
00002000:00100000:0.0:1651532240.013541:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fae6e41b with x1731754469109888 ext(19922944->20971519)
00002000:00010000:0.0:1651532240.013543:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000fae6e41b
00000100:00100000:1.0:1651532240.013545:0:330280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109696
00002000:00100000:1.0:1651532240.013549:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d3f:0x0] (16777216->17825791)  req@000000000d4d1db9 x1731754469109696/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:0.0:1651532240.013549:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469109824
00002000:00100000:1.0:1651532240.013552:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000d4d1db9 with x1731754469109696 ext(16777216->17825791)
00002000:00010000:1.0:1651532240.013553:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000d4d1db9
00002000:00100000:0.0:1651532240.013553:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3f:0x0] (18874368->19922943)  req@0000000037159e1c x1731754469109824/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.013557:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000037159e1c with x1731754469109824 ext(18874368->19922943)
00000100:00100000:1.0:1651532240.013558:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5721
00002000:00010000:0.0:1651532240.013558:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000037159e1c
00000100:00100000:1.0:1651532240.013560:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b2625a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+82:438147:x1731754469109760:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.013567:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5722
00000100:00100000:0.0:1651532240.013569:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fae6e41b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+82:438147:x1731754469109888:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.013824:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5723
00000100:00100000:1.0:1651532240.013826:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d4d1db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+84:438147:x1731754469109696:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.013827:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5724
00000100:00100000:0.0:1651532240.013829:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037159e1c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+84:438147:x1731754469109824:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.017398:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b2625a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+87:438147:x1731754469109760:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3835us (3907us total) trans 158913794584 rc 0/0
00000100:00100000:1.0:1651532240.017412:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5721
00002000:00100000:1.0:1651532240.017417:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d3f:0x0] (17825792->18874367)  req@000000009b2625a4 x1731754469109760/t158913794584(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.017421:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009b2625a4 with x1731754469109760 ext(17825792->18874367)
00002000:00010000:1.0:1651532240.017424:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009b2625a4
00000100:00100000:1.0:1651532240.018789:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fae6e41b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+87:438147:x1731754469109888:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5218us (5284us total) trans 158913794585 rc 0/0
00000100:00100000:1.0:1651532240.018793:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5722
00002000:00100000:1.0:1651532240.018795:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3f:0x0] (19922944->20971519)  req@00000000fae6e41b x1731754469109888/t158913794585(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.018799:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fae6e41b with x1731754469109888 ext(19922944->20971519)
00002000:00010000:1.0:1651532240.018800:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000fae6e41b
00000100:00100000:1.0:1651532240.019964:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d4d1db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+87:438147:x1731754469109696:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6137us (6453us total) trans 158913794586 rc 0/0
00000100:00100000:1.0:1651532240.019968:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5723
00002000:00100000:1.0:1651532240.019971:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3f:0x0] (16777216->17825791)  req@000000000d4d1db9 x1731754469109696/t158913794586(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.019974:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000d4d1db9 with x1731754469109696 ext(16777216->17825791)
00002000:00010000:1.0:1651532240.019976:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000d4d1db9
00000100:00100000:0.0:1651532240.021702:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037159e1c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+87:438147:x1731754469109824:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7870us (8183us total) trans 158913794587 rc 0/0
00000100:00100000:0.0:1651532240.021707:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5724
00002000:00100000:0.0:1651532240.021710:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3f:0x0] (18874368->19922943)  req@0000000037159e1c x1731754469109824/t158913794587(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532240.021715:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000037159e1c with x1731754469109824 ext(18874368->19922943)
00002000:00010000:0.0:1651532240.021717:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000037159e1c
00000100:00100000:0.0:1651532240.033423:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.033440:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.033453:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.033458:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.033467:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.033476:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110144
00000100:00100000:0.0:1651532240.033476:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.033484:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.033493:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.033503:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.033512:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110272
00000100:00100000:0.0:1651532240.033515:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110400
00002000:00100000:1.0:1651532240.033517:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d40:0x0] (17825792->18874367)  req@000000006e784e5c x1731754469110272/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.033521:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006e784e5c with x1731754469110272 ext(17825792->18874367)
00002000:00010000:1.0:1651532240.033523:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006e784e5c
00000100:00100000:0.0:1651532240.033529:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110528
00000100:00100000:0.0:1651532240.033537:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110080
00000100:00100000:1.0:1651532240.033541:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110208
00002000:00100000:0.0:1651532240.033541:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d40:0x0] (16777216->17825791)  req@000000009c678525 x1731754469110080/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:1.0:1651532240.033545:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110336
00002000:00100000:0.0:1651532240.033545:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009c678525 with x1731754469110080 ext(16777216->17825791)
00002000:00010000:0.0:1651532240.033547:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009c678525
00000100:00100000:1.0:1651532240.033548:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110464
00000100:00100000:0.0:1651532240.033549:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110592
00002000:00100000:1.0:1651532240.033552:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d40:0x0] (18874368->19922943)  req@00000000367f8a1a x1731754469110464/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:0.0:1651532240.033554:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5725
00002000:00100000:1.0:1651532240.033556:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000367f8a1a with x1731754469110464 ext(18874368->19922943)
00000100:00100000:0.0:1651532240.033556:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b36b6afb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+95:438149:x1731754469110144:12345-10.240.43.64@tcp:3:dd.0
00002000:00010000:1.0:1651532240.033557:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000367f8a1a
00000100:00100000:1.0:1651532240.033559:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5726
00000100:00100000:1.0:1651532240.033561:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000961ce748 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+95:438149:x1731754469110400:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532240.033572:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ae0 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033572:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad9 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.033580:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.033580:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.033581:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.033581:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.033583:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ae0 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033583:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad9 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.033589:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ae0 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033589:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad9 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.033673:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5727
00000100:00100000:1.0:1651532240.033675:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e784e5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+97:438149:x1731754469110272:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.033676:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5728
00000100:00100000:0.0:1651532240.033678:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000010d203c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+97:438149:x1731754469110528:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.033686:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417ae7 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033689:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.033690:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.033691:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417ae7 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033695:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417ae7 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.033750:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5729
00000100:00100000:0.0:1651532240.033752:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d31b7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+98:438149:x1731754469110208:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.033758:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417aee lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033761:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.033762:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.033763:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417aee lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033766:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417aee lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.033835:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5730
00000100:00100000:0.0:1651532240.033837:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9c15e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+99:438149:x1731754469110336:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.033843:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417af5 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033847:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.033848:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.033848:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417af5 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033852:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417af5 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.033863:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5731
00000100:00100000:1.0:1651532240.033865:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c678525 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+100:438149:x1731754469110080:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.033914:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5732
00000100:00100000:0.0:1651532240.033916:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029b0cc8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+101:438149:x1731754469110592:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.033922:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417afc lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033926:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.033926:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.033927:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417afc lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.033931:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417afc lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.033982:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5733
00000100:00100000:0.0:1651532240.033984:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000367f8a1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+102:438149:x1731754469110464:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532240.038021:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ae0 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038032:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ae0 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.038085:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000961ce748 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+105:438149:x1731754469110400:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4521us (4630us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.038091:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5726
00010000:00010000:1.0:1651532240.038244:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ae0 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038249:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.038251:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ae0 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038255:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ae0 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038266:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ae0 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038269:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417ae0 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038335:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad9 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038339:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad9 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.038363:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b36b6afb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+105:438149:x1731754469110144:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4806us (4941us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.038366:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5725
00010000:00010000:1.0:1651532240.038426:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417ae7 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038430:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417ae7 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.038451:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000010d203c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+103:438149:x1731754469110528:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4772us (4992us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.038454:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5728
00010000:00010000:1.0:1651532240.038489:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad9 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038493:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.038494:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad9 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038497:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad9 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038504:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad9 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038507:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417ad9 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038516:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417ae7 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038519:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.038520:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417ae7 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038523:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417ae7 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038526:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417ae7 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038529:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417ae7 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038697:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417aee lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038701:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417aee lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.038726:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d31b7db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+101:438149:x1731754469110208:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4973us (5250us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.038729:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5729
00010000:00010000:1.0:1651532240.038737:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417aee lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038740:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.038741:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417aee lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038744:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417aee lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038749:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417aee lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038751:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417aee lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038830:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417af5 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038835:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417af5 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.038851:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9c15e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+99:438149:x1731754469110336:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5012us (5366us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.038856:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5730
00010000:00010000:1.0:1651532240.038865:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417af5 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038869:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.038870:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417af5 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038873:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417af5 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038877:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417af5 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.038900:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417af5 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.038926:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e784e5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+97:438149:x1731754469110272:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5250us (5485us total) trans 158913794588 rc 0/0
00000100:00100000:1.0:1651532240.038929:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5727
00002000:00100000:1.0:1651532240.038934:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d40:0x0] (17825792->18874367)  req@000000006e784e5c x1731754469110272/t158913794588(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.038939:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006e784e5c with x1731754469110272 ext(17825792->18874367)
00002000:00010000:1.0:1651532240.038941:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006e784e5c
00010000:00010000:1.0:1651532240.038994:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417afc lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.039001:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417afc lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.039017:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029b0cc8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+95:438149:x1731754469110592:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5100us (5514us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.039020:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5732
00010000:00010000:1.0:1651532240.039026:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417afc lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.039029:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.039030:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417afc lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.039033:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417afc lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.039038:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417afc lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.039040:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417afc lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.039517:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.039526:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.039533:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.039542:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110784
00000100:00100000:1.0:1651532240.039557:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110720
00000100:00100000:1.0:1651532240.039562:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110848
00002000:00100000:1.0:1651532240.039565:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d40:0x0] (19922944->20971519)  req@00000000743d4e8b x1731754469110848/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.039570:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000743d4e8b with x1731754469110848 ext(19922944->20971519)
00002000:00010000:1.0:1651532240.039571:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000743d4e8b
00000100:00100000:1.0:1651532240.039575:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5734
00000100:00100000:1.0:1651532240.039578:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1d78f63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+97:438149:x1731754469110784:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532240.039590:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b03 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.039595:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.039597:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.039598:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b03 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.039603:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b03 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.039685:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5735
00000100:00100000:1.0:1651532240.039688:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bcaaffe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+98:438149:x1731754469110720:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532240.039695:0:323282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b0a lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.039699:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.039699:0:323282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.039700:0:323282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b0a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.039707:0:323282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b0a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.039760:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5736
00000100:00100000:1.0:1651532240.039762:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000743d4e8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+99:438149:x1731754469110848:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.039991:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c678525 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+99:438149:x1731754469110080:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6124us (6523us total) trans 158913794589 rc 0/0
00000100:00100000:1.0:1651532240.039995:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5731
00002000:00100000:1.0:1651532240.039997:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d40:0x0] (16777216->17825791)  req@000000009c678525 x1731754469110080/t158913794589(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.040001:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009c678525 with x1731754469110080 ext(16777216->17825791)
00002000:00010000:1.0:1651532240.040008:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009c678525
00000100:00100000:1.0:1651532240.041357:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000367f8a1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+99:438149:x1731754469110464:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7370us (7862us total) trans 158913794590 rc 0/0
00000100:00100000:1.0:1651532240.041361:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5733
00002000:00100000:1.0:1651532240.041366:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d40:0x0] (18874368->19922943)  req@00000000367f8a1a x1731754469110464/t158913794590(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.041370:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000367f8a1a with x1731754469110464 ext(18874368->19922943)
00002000:00010000:1.0:1651532240.041372:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000367f8a1a
00010000:00010000:1.0:1651532240.041393:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b03 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041398:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b03 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.041426:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1d78f63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+97:438149:x1731754469110784:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1848us (1909us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.041429:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5734
00010000:00010000:1.0:1651532240.041436:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b03 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041440:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.041441:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b03 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041444:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b03 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041451:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b03 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041454:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b03 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041596:0:323282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b0a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041600:0:323282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b0a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.041617:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bcaaffe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+97:438149:x1731754469110720:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1928us (2090us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.041622:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5735
00010000:00010000:1.0:1651532240.041628:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b0a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041631:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.041632:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b0a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041635:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b0a lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041640:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b0a lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.041642:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b0a lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.042424:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000743d4e8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+95:438149:x1731754469110848:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2660us (2889us total) trans 158913794591 rc 0/0
00000100:00100000:0.0:1651532240.042430:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5736
00002000:00100000:0.0:1651532240.042433:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d40:0x0] (19922944->20971519)  req@00000000743d4e8b x1731754469110848/t158913794591(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532240.042438:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000743d4e8b with x1731754469110848 ext(19922944->20971519)
00002000:00010000:0.0:1651532240.042440:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000743d4e8b
00000100:00100000:1.0:1651532240.060734:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.060748:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.060757:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.060765:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469110976
00000100:00100000:0.0:1651532240.060765:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111040
00002000:00100000:1.0:1651532240.060781:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3f:0x0] (20971520->22020095)  req@00000000071ddb82 x1731754469110976/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.060781:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3f:0x0] (22020096->23068671)  req@00000000238fab7c x1731754469111040/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.060785:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000071ddb82 with x1731754469110976 ext(20971520->22020095)
00002000:00100000:0.0:1651532240.060785:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000238fab7c with x1731754469111040 ext(22020096->23068671)
00002000:00010000:1.0:1651532240.060787:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000071ddb82
00002000:00010000:0.0:1651532240.060787:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000238fab7c
00000100:00100000:1.0:1651532240.060794:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111104
00000100:00100000:0.0:1651532240.060799:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5737
00000100:00100000:0.0:1651532240.060802:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000071ddb82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+97:438149:x1731754469110976:12345-10.240.43.64@tcp:4:dd.0
00002000:00100000:1.0:1651532240.060816:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3f:0x0] (23068672->24117247)  req@00000000fc83a695 x1731754469111104/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.060819:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fc83a695 with x1731754469111104 ext(23068672->24117247)
00002000:00010000:1.0:1651532240.060821:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000fc83a695
00000100:00100000:1.0:1651532240.060826:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5738
00000100:00100000:1.0:1651532240.060828:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000238fab7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+97:438149:x1731754469111040:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.061057:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5739
00000100:00100000:1.0:1651532240.061059:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc83a695 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+99:438149:x1731754469111104:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.072110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.072180:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111296
00002000:00100000:0.0:1651532240.072213:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3f:0x0] (24117248->25165823)  req@00000000a99597a3 x1731754469111296/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.072217:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a99597a3 with x1731754469111296 ext(24117248->25165823)
00002000:00010000:0.0:1651532240.072235:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a99597a3
00000100:00100000:0.0:1651532240.072245:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5740
00000100:00100000:0.0:1651532240.072247:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a99597a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+101:438148:x1731754469111296:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.075051:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000071ddb82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+105:438149:x1731754469110976:12345-10.240.43.64@tcp:4:dd.0 Request processed in 14247us (14300us total) trans 158913794592 rc 0/0
00000100:00100000:1.0:1651532240.075057:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5737
00002000:00100000:1.0:1651532240.075061:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3f:0x0] (20971520->22020095)  req@00000000071ddb82 x1731754469110976/t158913794592(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.075066:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000071ddb82 with x1731754469110976 ext(20971520->22020095)
00002000:00010000:1.0:1651532240.075068:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000071ddb82
00000100:00100000:1.0:1651532240.075858:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000238fab7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+103:438149:x1731754469111040:12345-10.240.43.64@tcp:4:dd.0 Request processed in 15028us (15124us total) trans 158913794593 rc 0/0
00000100:00100000:1.0:1651532240.075861:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5738
00002000:00100000:1.0:1651532240.075863:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3f:0x0] (22020096->23068671)  req@00000000238fab7c x1731754469111040/t158913794593(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.075867:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000238fab7c with x1731754469111040 ext(22020096->23068671)
00002000:00010000:1.0:1651532240.075868:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000238fab7c
00000100:00100000:1.0:1651532240.076932:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc83a695 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+103:438149:x1731754469111104:12345-10.240.43.64@tcp:4:dd.0 Request processed in 15871us (16174us total) trans 158913794594 rc 0/0
00000100:00100000:1.0:1651532240.076937:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5739
00002000:00100000:1.0:1651532240.076940:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3f:0x0] (23068672->24117247)  req@00000000fc83a695 x1731754469111104/t158913794594(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.076944:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fc83a695 with x1731754469111104 ext(23068672->24117247)
00002000:00010000:1.0:1651532240.076945:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000fc83a695
00000100:00100000:0.0:1651532240.078243:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a99597a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+103:438148:x1731754469111296:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5993us (6133us total) trans 158913794595 rc 0/0
00000100:00100000:0.0:1651532240.078248:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5740
00002000:00100000:0.0:1651532240.078252:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3f:0x0] (24117248->25165823)  req@00000000a99597a3 x1731754469111296/t158913794595(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532240.078256:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a99597a3 with x1731754469111296 ext(24117248->25165823)
00002000:00010000:0.0:1651532240.078258:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a99597a3
00000100:00100000:0.0:1651532240.081778:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.081795:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.081820:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.081829:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.081838:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.081846:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.081852:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111488
00000100:00100000:0.0:1651532240.081853:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.081862:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.081872:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.081886:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111616
00002000:00100000:1.0:1651532240.081891:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d40:0x0] (22020096->23068671)  req@000000008d33dad4 x1731754469111616/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:0.0:1651532240.081891:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111424
00002000:00100000:1.0:1651532240.081895:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008d33dad4 with x1731754469111616 ext(22020096->23068671)
00002000:00010000:1.0:1651532240.081897:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008d33dad4
00002000:00100000:0.0:1651532240.081900:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d40:0x0] (20971520->22020095)  req@0000000018f1b64f x1731754469111424/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:1.0:1651532240.081902:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111552
00002000:00100000:0.0:1651532240.081904:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000018f1b64f with x1731754469111424 ext(20971520->22020095)
00002000:00010000:0.0:1651532240.081906:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000018f1b64f
00000100:00100000:1.0:1651532240.081907:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111680
00000100:00100000:0.0:1651532240.081915:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111808
00000100:00100000:1.0:1651532240.081919:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111936
00002000:00100000:0.0:1651532240.081919:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d40:0x0] (23068672->24117247)  req@00000000a7f8100b x1731754469111808/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.081922:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a7f8100b with x1731754469111808 ext(23068672->24117247)
00000100:00100000:1.0:1651532240.081923:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469111872
00002000:00010000:0.0:1651532240.081923:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a7f8100b
00000100:00100000:0.0:1651532240.081925:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112000
00002000:00100000:1.0:1651532240.081926:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d40:0x0] (24117248->25165823)  req@00000000b3df5b52 x1731754469111872/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.081930:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b3df5b52 with x1731754469111872 ext(24117248->25165823)
00000100:00100000:0.0:1651532240.081930:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5741
00002000:00010000:1.0:1651532240.081931:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b3df5b52
00000100:00100000:0.0:1651532240.081932:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea1fa543 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+111:438148:x1731754469111488:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:1.0:1651532240.081934:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5742
00000100:00100000:1.0:1651532240.081936:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008d33dad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+111:438148:x1731754469111616:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532240.081950:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417b11 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.081958:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.081959:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.081961:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417b11 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.081967:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417b11 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.082036:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5743
00000100:00100000:0.0:1651532240.082038:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008b294c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+112:438148:x1731754469111552:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.082045:0:330280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417b18 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.082049:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.082050:0:330280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.082051:0:330280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417b18 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.082055:0:330280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417b18 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.082110:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5744
00000100:00100000:1.0:1651532240.082112:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018f1b64f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+114:438148:x1731754469111424:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.082119:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5745
00000100:00100000:0.0:1651532240.082120:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012ec7c39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+114:438148:x1731754469111680:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.082126:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b1f lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.082132:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.082133:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.082134:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b1f lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.082137:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b1f lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.082278:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5746
00000100:00100000:1.0:1651532240.082280:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdcc1c37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+116:438149:x1731754469111936:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532240.082295:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b26 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.082301:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.082302:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.082303:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b26 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.082308:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b26 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.082380:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5747
00000100:00100000:1.0:1651532240.082382:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7f8100b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+117:438148:x1731754469111808:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.082556:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5748
00000100:00100000:1.0:1651532240.082558:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e6ae86b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+118:438149:x1731754469112000:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532240.082565:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b2d lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.082569:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.082569:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.082571:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b2d lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.082574:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b2d lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.082653:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5749
00000100:00100000:1.0:1651532240.082656:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3df5b52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+119:438149:x1731754469111872:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532240.087159:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417b11 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087170:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417b11 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.087210:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea1fa543 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+119:438148:x1731754469111488:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5275us (5431us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.087216:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5741
00010000:00010000:0.0:1651532240.087244:0:330280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417b18 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087248:0:330280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417b18 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.087265:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008b294c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+117:438148:x1731754469111552:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5226us (5435us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.087268:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5743
00010000:00010000:0.0:1651532240.087287:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b1f lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087291:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b1f lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.087307:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012ec7c39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+115:438148:x1731754469111680:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5186us (5469us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.087309:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5745
00010000:00010000:0.0:1651532240.087386:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b26 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087390:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b26 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.087443:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdcc1c37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+113:438149:x1731754469111936:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5161us (5588us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.087447:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5746
00010000:00010000:0.0:1651532240.087835:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417b11 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087840:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.087842:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417b11 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087846:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417b11 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087857:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417b11 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087860:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417b11 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087865:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417b18 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087867:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.087868:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417b18 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087871:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417b18 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087875:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417b18 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087877:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417b18 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330280 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087880:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b1f lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087883:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.087884:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b1f lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087886:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b1f lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087890:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b1f lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087892:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b1f lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087895:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b26 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087898:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.087898:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b26 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087901:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b26 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087904:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b26 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087907:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417b26 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [26214400->27262975] (req 26214400->27262975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087935:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b2d lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.087938:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b2d lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.087962:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e6ae86b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+117:438149:x1731754469112000:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5403us (6089us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.087968:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5748
00010000:00010000:0.0:1651532240.088018:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b2d lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088024:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.088025:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b2d lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088031:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b2d lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088038:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b2d lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088041:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417b2d lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.088061:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.088071:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112128
00000100:00100000:0.0:1651532240.088101:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5750
00000100:00100000:0.0:1651532240.088103:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000633297bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+119:438148:x1731754469112128:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.088116:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b34 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088124:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.088125:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.088127:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b34 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088132:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b34 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.088220:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.088229:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.088235:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112064
00000100:00100000:0.0:1651532240.088245:0:330057:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112192
00000100:00100000:0.0:1651532240.088253:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5751
00000100:00100000:0.0:1651532240.088255:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c031b391 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+122:438148:x1731754469112064:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.088265:0:330057:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b3b lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088271:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.088272:0:330057:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.088273:0:330057:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b3b lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088279:0:330057:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b3b lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.088356:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5752
00000100:00100000:0.0:1651532240.088358:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007b411e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+123:438148:x1731754469112192:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.088370:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b42 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088376:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.088376:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.088378:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b42 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088383:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b42 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.088627:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7f8100b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+123:438148:x1731754469111808:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6243us (6779us total) trans 158913794596 rc 0/0
00000100:00100000:0.0:1651532240.088632:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5747
00002000:00100000:0.0:1651532240.088638:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d40:0x0] (23068672->24117247)  req@00000000a7f8100b x1731754469111808/t158913794596(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532240.088645:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a7f8100b with x1731754469111808 ext(23068672->24117247)
00002000:00010000:0.0:1651532240.088648:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a7f8100b
00010000:00010000:0.0:1651532240.088932:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b34 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088939:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b34 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.088966:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000633297bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+121:438148:x1731754469112128:12345-10.240.43.64@tcp:3:dd.0 Request processed in 862us (905us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.088971:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5750
00010000:00010000:0.0:1651532240.088983:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b34 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088989:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.088991:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b34 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.088996:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b34 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.089005:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b34 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.089034:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b34 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [27262976->28311551] (req 27262976->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.089773:0:330057:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b3b lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.089778:0:330057:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b3b lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.089800:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c031b391 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+119:438148:x1731754469112064:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1544us (1580us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.089817:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5751
00010000:00010000:0.0:1651532240.089875:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b3b lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.089880:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.089881:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b3b lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.089885:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b3b lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.089891:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b3b lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.089894:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b3b lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330057 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.089905:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018f1b64f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+117:438148:x1731754469111424:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7790us (8084us total) trans 158913794597 rc 0/0
00000100:00100000:1.0:1651532240.089910:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5744
00002000:00100000:1.0:1651532240.089914:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d40:0x0] (20971520->22020095)  req@0000000018f1b64f x1731754469111424/t158913794597(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.089919:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000018f1b64f with x1731754469111424 ext(20971520->22020095)
00002000:00010000:1.0:1651532240.089921:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000018f1b64f
00010000:00010000:0.0:1651532240.090028:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b42 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.090032:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b42 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.090050:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007b411e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+115:438148:x1731754469112192:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1691us (1820us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.090053:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5752
00010000:00010000:0.0:1651532240.090060:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b42 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.090063:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.090064:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b42 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.090067:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b42 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.090073:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b42 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.090076:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b42 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.090624:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008d33dad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+113:438148:x1731754469111616:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8687us (8828us total) trans 158913794598 rc 0/0
00000100:00100000:0.0:1651532240.090628:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5742
00002000:00100000:0.0:1651532240.090631:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d40:0x0] (22020096->23068671)  req@000000008d33dad4 x1731754469111616/t158913794598(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532240.090636:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008d33dad4 with x1731754469111616 ext(22020096->23068671)
00002000:00010000:0.0:1651532240.090637:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008d33dad4
00000100:00100000:1.0:1651532240.091345:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3df5b52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+111:438149:x1731754469111872:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8688us (9481us total) trans 158913794599 rc 0/0
00000100:00100000:1.0:1651532240.091348:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5749
00002000:00100000:1.0:1651532240.091351:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d40:0x0] (24117248->25165823)  req@00000000b3df5b52 x1731754469111872/t158913794599(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.091355:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b3df5b52 with x1731754469111872 ext(24117248->25165823)
00002000:00010000:1.0:1651532240.091357:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b3df5b52
00000100:00100000:1.0:1651532240.109529:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.109539:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.109552:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.109562:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.109572:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112384
00000100:00100000:0.0:1651532240.109572:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112512
00002000:00100000:1.0:1651532240.109589:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3f:0x0] (26214400->27262975)  req@000000008a4737e1 x1731754469112384/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.109589:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3f:0x0] (28311552->29360127)  req@0000000062215f65 x1731754469112512/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.109593:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008a4737e1 with x1731754469112384 ext(26214400->27262975)
00002000:00100000:0.0:1651532240.109594:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000062215f65 with x1731754469112512 ext(28311552->29360127)
00002000:00010000:1.0:1651532240.109595:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008a4737e1
00002000:00010000:0.0:1651532240.109595:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000062215f65
00000100:00100000:0.0:1651532240.109604:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112320
00000100:00100000:1.0:1651532240.109609:0:330281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112448
00002000:00100000:1.0:1651532240.109613:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3f:0x0] (27262976->28311551)  req@0000000052d22a3b x1731754469112448/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.109613:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3f:0x0] (25165824->26214399)  req@00000000b63c5751 x1731754469112320/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.109617:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052d22a3b with x1731754469112448 ext(27262976->28311551)
00002000:00100000:0.0:1651532240.109617:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b63c5751 with x1731754469112320 ext(25165824->26214399)
00002000:00010000:1.0:1651532240.109618:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000052d22a3b
00002000:00010000:0.0:1651532240.109618:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b63c5751
00000100:00100000:1.0:1651532240.109625:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5753
00000100:00100000:1.0:1651532240.109627:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062215f65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+114:438148:x1731754469112512:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.109631:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5754
00000100:00100000:0.0:1651532240.109633:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008a4737e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+114:438148:x1731754469112384:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.109873:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5755
00000100:00100000:0.0:1651532240.109875:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052d22a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+116:438148:x1731754469112448:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.109876:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5756
00000100:00100000:1.0:1651532240.109878:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b63c5751 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+116:438148:x1731754469112320:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.118154:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008a4737e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+121:438148:x1731754469112384:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8516us (8624us total) trans 158913794600 rc 0/0
00000100:00100000:0.0:1651532240.118161:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5754
00002000:00100000:0.0:1651532240.118167:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3f:0x0] (26214400->27262975)  req@000000008a4737e1 x1731754469112384/t158913794600(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532240.118171:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008a4737e1 with x1731754469112384 ext(26214400->27262975)
00002000:00010000:0.0:1651532240.118175:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008a4737e1
00000100:00100000:0.0:1651532240.118896:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062215f65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+119:438148:x1731754469112512:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9267us (9355us total) trans 158913794601 rc 0/0
00000100:00100000:0.0:1651532240.118899:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5753
00002000:00100000:0.0:1651532240.118902:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3f:0x0] (28311552->29360127)  req@0000000062215f65 x1731754469112512/t158913794601(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532240.118906:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000062215f65 with x1731754469112512 ext(28311552->29360127)
00002000:00010000:0.0:1651532240.118907:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000062215f65
00000100:00100000:0.0:1651532240.119994:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052d22a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+119:438148:x1731754469112448:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10117us (10431us total) trans 158913794602 rc 0/0
00000100:00100000:0.0:1651532240.119998:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5755
00002000:00100000:0.0:1651532240.120001:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3f:0x0] (27262976->28311551)  req@0000000052d22a3b x1731754469112448/t158913794602(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532240.120004:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052d22a3b with x1731754469112448 ext(27262976->28311551)
00002000:00010000:0.0:1651532240.120006:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000052d22a3b
00000100:00100000:1.0:1651532240.121459:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b63c5751 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+119:438148:x1731754469112320:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11578us (11905us total) trans 158913794603 rc 0/0
00000100:00100000:1.0:1651532240.121464:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5756
00002000:00100000:1.0:1651532240.121467:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3f:0x0] (25165824->26214399)  req@00000000b63c5751 x1731754469112320/t158913794603(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.121471:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b63c5751 with x1731754469112320 ext(25165824->26214399)
00002000:00010000:1.0:1651532240.121473:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b63c5751
00000100:00100000:1.0:1651532240.129666:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.129674:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.129706:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112768
00000100:00100000:1.0:1651532240.129709:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.129729:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.129738:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.129744:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.129758:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.129767:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.129767:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112896
00000100:00100000:1.0:1651532240.129778:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:0.0:1651532240.129778:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d40:0x0] (26214400->27262975)  req@00000000998ce1c9 x1731754469112896/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.129782:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000998ce1c9 with x1731754469112896 ext(26214400->27262975)
00002000:00010000:0.0:1651532240.129784:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000998ce1c9
00000100:00100000:0.0:1651532240.129792:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113024
00000100:00100000:0.0:1651532240.129800:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112704
00000100:00100000:1.0:1651532240.129802:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113152
00002000:00100000:0.0:1651532240.129814:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d40:0x0] (25165824->26214399)  req@0000000003de5a92 x1731754469112704/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.129818:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000003de5a92 with x1731754469112704 ext(25165824->26214399)
00002000:00010000:0.0:1651532240.129819:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000003de5a92
00000100:00100000:1.0:1651532240.129823:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112960
00000100:00100000:0.0:1651532240.129823:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469112832
00000100:00100000:1.0:1651532240.129827:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113216
00000100:00100000:0.0:1651532240.129827:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113088
00002000:00100000:0.0:1651532240.129830:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d40:0x0] (27262976->28311551)  req@00000000b71e5359 x1731754469113088/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:1.0:1651532240.129832:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5757
00002000:00100000:0.0:1651532240.129833:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b71e5359 with x1731754469113088 ext(27262976->28311551)
00000100:00100000:1.0:1651532240.129834:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072c4e687 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+127:438147:x1731754469112768:12345-10.240.43.64@tcp:3:dd.0
00002000:00010000:0.0:1651532240.129834:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b71e5359
00000100:00100000:0.0:1651532240.129837:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5758
00000100:00100000:0.0:1651532240.129839:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000998ce1c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+127:438147:x1731754469112896:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532240.129850:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417b49 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.129858:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.129859:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.129861:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417b49 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.129868:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417b49 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.129936:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5759
00000100:00100000:1.0:1651532240.129938:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b441f43e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+128:438147:x1731754469113024:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532240.129944:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417b50 lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.129948:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.129949:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.129950:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417b50 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.129954:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417b50 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.130015:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5760
00000100:00100000:0.0:1651532240.130017:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4b0424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+130:438147:x1731754469113152:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:1.0:1651532240.130020:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5761
00000100:00100000:1.0:1651532240.130022:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000003de5a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+130:438147:x1731754469112704:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532240.130027:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b57 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.130035:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.130036:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.130037:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b57 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.130041:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b57 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.130098:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5762
00000100:00100000:0.0:1651532240.130099:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000553734b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+131:438147:x1731754469112832:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.130105:0:330054:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b5e lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.130109:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.130110:0:330054:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.130111:0:330054:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b5e lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.130114:0:330054:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b5e lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.130167:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5763
00000100:00100000:0.0:1651532240.130169:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b5466f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+133:438147:x1731754469112960:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:1.0:1651532240.130170:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5764
00000100:00100000:1.0:1651532240.130171:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000527f7db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+133:438147:x1731754469113216:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.130174:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b65 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.130177:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417b6c lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.130178:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.130179:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.130180:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b65 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.130181:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.130182:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.130183:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417b6c lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.130183:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b65 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.130186:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417b6c lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.130238:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5765
00000100:00100000:1.0:1651532240.130239:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b71e5359 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+135:438147:x1731754469113088:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532240.134337:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417b49 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134347:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417b49 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.134391:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072c4e687 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+135:438147:x1731754469112768:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4554us (4725us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.134399:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5757
00010000:00010000:1.0:1651532240.134650:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417b50 lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134655:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417b50 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.134676:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b441f43e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+135:438147:x1731754469113024:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4737us (4967us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.134686:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5759
00010000:00010000:1.0:1651532240.134865:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417b49 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134878:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.134880:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417b49 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134884:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417b49 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134895:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417b49 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134898:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417b49 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134903:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417b50 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134906:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.134907:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417b50 lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134910:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417b50 lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134913:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417b50 lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134915:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417b50 lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 5 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134943:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b57 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.134947:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b57 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.134973:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4b0424 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+135:438147:x1731754469113152:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4955us (5244us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.134976:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5760
00010000:00010000:0.0:1651532240.135138:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b57 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135147:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.135149:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b57 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135155:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b57 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135165:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b57 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135170:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417b57 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135248:0:330054:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b5e lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135255:0:330054:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b5e lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.135289:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000553734b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+135:438147:x1731754469112832:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5187us (5542us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.135321:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5762
00010000:00010000:0.0:1651532240.135335:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b5e lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135342:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.135344:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b5e lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135349:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b5e lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135358:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b5e lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135362:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417b5e lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [29360128->30408703] (req 29360128->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330054 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135451:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417b6c lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135458:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417b6c lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.135512:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000527f7db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+133:438147:x1731754469113216:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5339us (5733us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.135518:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5764
00010000:00010000:0.0:1651532240.135530:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417b6c lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135555:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.135556:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417b6c lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135560:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417b6c lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135566:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417b6c lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135569:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417b6c lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [31457280->32505855] (req 31457280->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.135694:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000003de5a92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+131:438147:x1731754469112704:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5671us (5955us total) trans 158913794604 rc 0/0
00000100:00100000:1.0:1651532240.135698:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5761
00002000:00100000:1.0:1651532240.135704:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d40:0x0] (25165824->26214399)  req@0000000003de5a92 x1731754469112704/t158913794604(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.135709:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000003de5a92 with x1731754469112704 ext(25165824->26214399)
00002000:00010000:1.0:1651532240.135711:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000003de5a92
00000100:00100000:1.0:1651532240.135846:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.135865:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113408
00010000:00010000:0.0:1651532240.135877:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b65 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135881:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b65 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.135886:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5766
00000100:00100000:1.0:1651532240.135888:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028cbc9a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+131:438147:x1731754469113408:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532240.135902:0:323284:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b73 lrc: 3/1,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.135906:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b5466f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+130:438147:x1731754469112960:12345-10.240.43.64@tcp:3:dd.0 Request processed in 5736us (6148us total) trans 0 rc 1048576/1048576
00010000:00010000:1.0:1651532240.135907:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.135908:0:323284:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532240.135910:0:323284:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b73 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.135910:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5763
00010000:00010000:1.0:1651532240.135915:0:323284:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b73 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135917:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b65 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135921:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.135922:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b65 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135925:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b65 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135931:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b65 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.135934:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417b65 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.136151:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.136199:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.136234:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113344
00000100:00100000:0.0:1651532240.136251:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113472
00002000:00100000:0.0:1651532240.136258:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d40:0x0] (28311552->29360127)  req@0000000017e30955 x1731754469113472/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.136265:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000017e30955 with x1731754469113472 ext(28311552->29360127)
00002000:00010000:0.0:1651532240.136267:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000017e30955
00000100:00100000:0.0:1651532240.136281:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5767
00000100:00100000:0.0:1651532240.136284:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c8ee862c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+132:438147:x1731754469113344:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:0.0:1651532240.136296:0:323281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b7a lrc: 3/1,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.136303:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.136304:0:323281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532240.136305:0:323281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b7a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.136341:0:323281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b7a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.136427:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5768
00000100:00100000:1.0:1651532240.136430:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e30955 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+133:438147:x1731754469113472:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.136635:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b71e5359 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+133:438147:x1731754469113088:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6395us (6868us total) trans 158913794605 rc 0/0
00000100:00100000:1.0:1651532240.136639:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5765
00002000:00100000:1.0:1651532240.136641:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d40:0x0] (27262976->28311551)  req@00000000b71e5359 x1731754469113088/t158913794605(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.136646:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b71e5359 with x1731754469113088 ext(27262976->28311551)
00002000:00010000:1.0:1651532240.136647:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b71e5359
00010000:00010000:1.0:1651532240.136688:0:323284:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b73 lrc: 3/1,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.136712:0:323284:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b73 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.136731:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028cbc9a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+131:438147:x1731754469113408:12345-10.240.43.64@tcp:3:dd.0 Request processed in 842us (885us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.136734:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5766
00010000:00010000:1.0:1651532240.136765:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b73 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.136769:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532240.136771:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b73 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.136774:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b73 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.136787:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b73 lrc: 1/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532240.136790:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b73 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323284 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.137559:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000998ce1c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+129:438147:x1731754469112896:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7718us (7883us total) trans 158913794606 rc 0/0
00000100:00100000:1.0:1651532240.137564:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5758
00002000:00100000:1.0:1651532240.137568:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d40:0x0] (26214400->27262975)  req@00000000998ce1c9 x1731754469112896/t158913794606(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.137572:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000998ce1c9 with x1731754469112896 ext(26214400->27262975)
00002000:00010000:1.0:1651532240.137574:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000998ce1c9
00010000:00010000:0.0:1651532240.137857:0:323281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b7a lrc: 3/1,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.137864:0:323281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b7a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532240.137886:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c8ee862c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+127:438147:x1731754469113344:12345-10.240.43.64@tcp:3:dd.0 Request processed in 1601us (1736us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.137890:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5767
00010000:00010000:0.0:1651532240.137898:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b7a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.137902:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532240.137903:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b7a lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.137906:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b7a lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.137912:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b7a lrc: 1/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532240.137915:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b7a lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 323281 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532240.138894:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e30955 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+127:438147:x1731754469113472:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2463us (2695us total) trans 158913794607 rc 0/0
00000100:00100000:1.0:1651532240.138897:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5768
00002000:00100000:1.0:1651532240.138900:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d40:0x0] (28311552->29360127)  req@0000000017e30955 x1731754469113472/t158913794607(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.138904:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000017e30955 with x1731754469113472 ext(28311552->29360127)
00002000:00010000:1.0:1651532240.138905:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000017e30955
00000100:00100000:0.0:1651532240.156498:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.156513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.156520:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.156530:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113664
00000100:00100000:0.0:1651532240.156530:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.156540:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113792
00002000:00100000:0.0:1651532240.156550:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3f:0x0] (32505856->33554431)  req@00000000a04f9856 x1731754469113792/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.156551:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3f:0x0] (30408704->31457279)  req@00000000ddadbd0b x1731754469113664/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.156555:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ddadbd0b with x1731754469113664 ext(30408704->31457279)
00002000:00100000:0.0:1651532240.156555:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a04f9856 with x1731754469113792 ext(32505856->33554431)
00002000:00010000:1.0:1651532240.156557:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ddadbd0b
00002000:00010000:0.0:1651532240.156557:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a04f9856
00000100:00100000:1.0:1651532240.156564:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113600
00002000:00100000:1.0:1651532240.156568:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3f:0x0] (29360128->30408703)  req@00000000e846ebf6 x1731754469113600/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:0.0:1651532240.156568:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469113728
00002000:00100000:1.0:1651532240.156571:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e846ebf6 with x1731754469113600 ext(29360128->30408703)
00002000:00010000:1.0:1651532240.156572:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e846ebf6
00002000:00100000:0.0:1651532240.156572:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3f:0x0] (31457280->32505855)  req@00000000615a35ec x1731754469113728/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.156576:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000615a35ec with x1731754469113728 ext(31457280->32505855)
00000100:00100000:1.0:1651532240.156581:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5769
00000100:00100000:1.0:1651532240.156583:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ddadbd0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+130:438147:x1731754469113664:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532240.156583:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000615a35ec
00000100:00100000:0.0:1651532240.156592:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5770
00000100:00100000:0.0:1651532240.156594:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a04f9856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+130:438147:x1731754469113792:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.156822:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5771
00000100:00100000:1.0:1651532240.156824:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e846ebf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+132:438147:x1731754469113600:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.156825:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5772
00000100:00100000:0.0:1651532240.156827:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615a35ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+132:438147:x1731754469113728:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.160836:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ddadbd0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+135:438147:x1731754469113664:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4249us (4337us total) trans 158913794608 rc 0/0
00000100:00100000:1.0:1651532240.160842:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5769
00002000:00100000:1.0:1651532240.160848:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3f:0x0] (30408704->31457279)  req@00000000ddadbd0b x1731754469113664/t158913794608(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.160852:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ddadbd0b with x1731754469113664 ext(30408704->31457279)
00002000:00010000:1.0:1651532240.160855:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ddadbd0b
00000100:00100000:1.0:1651532240.162922:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a04f9856 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+137:438147:x1731754469113792:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6327us (6408us total) trans 158913794609 rc 0/0
00000100:00100000:1.0:1651532240.162927:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5770
00002000:00100000:1.0:1651532240.162929:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3f:0x0] (32505856->33554431)  req@00000000a04f9856 x1731754469113792/t158913794609(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.162933:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a04f9856 with x1731754469113792 ext(32505856->33554431)
00002000:00010000:1.0:1651532240.162935:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a04f9856
00000100:00100000:1.0:1651532240.163679:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e846ebf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+135:438147:x1731754469113600:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6854us (7157us total) trans 158913794610 rc 0/0
00000100:00100000:1.0:1651532240.163682:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5771
00002000:00100000:1.0:1651532240.163685:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3f:0x0] (29360128->30408703)  req@00000000e846ebf6 x1731754469113600/t158913794610(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.163688:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e846ebf6 with x1731754469113600 ext(29360128->30408703)
00002000:00010000:1.0:1651532240.163690:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e846ebf6
00000100:00100000:0.0:1651532240.165397:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615a35ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+135:438147:x1731754469113728:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8568us (8866us total) trans 158913794611 rc 0/0
00000100:00100000:0.0:1651532240.165411:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5772
00002000:00100000:0.0:1651532240.165415:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3f:0x0] (31457280->32505855)  req@00000000615a35ec x1731754469113728/t158913794611(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532240.165423:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000615a35ec with x1731754469113728 ext(31457280->32505855)
00002000:00010000:0.0:1651532240.165425:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000615a35ec
00000100:00100000:0.0:1651532240.176536:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.176546:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.176558:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.176574:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469114176
00000100:00100000:0.0:1651532240.176576:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.176587:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469114304
00002000:00100000:1.0:1651532240.176593:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d40:0x0] (30408704->31457279)  req@00000000bb0afddd x1731754469114176/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.176596:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d40:0x0] (32505856->33554431)  req@0000000069a09f8f x1731754469114304/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532240.176597:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bb0afddd with x1731754469114176 ext(30408704->31457279)
00002000:00010000:1.0:1651532240.176598:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bb0afddd
00002000:00100000:0.0:1651532240.176600:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000069a09f8f with x1731754469114304 ext(32505856->33554431)
00002000:00010000:0.0:1651532240.176602:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000069a09f8f
00000100:00100000:1.0:1651532240.176609:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469114112
00002000:00100000:1.0:1651532240.176618:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d40:0x0] (29360128->30408703)  req@00000000e4c57532 x1731754469114112/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00000100:00100000:0.0:1651532240.176619:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469114240
00002000:00100000:1.0:1651532240.176621:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e4c57532 with x1731754469114112 ext(29360128->30408703)
00002000:00010000:1.0:1651532240.176622:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e4c57532
00002000:00100000:0.0:1651532240.176624:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d40:0x0] (31457280->32505855)  req@000000005faee585 x1731754469114240/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532240.176627:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005faee585 with x1731754469114240 ext(31457280->32505855)
00000100:00100000:1.0:1651532240.176628:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5773
00002000:00010000:0.0:1651532240.176628:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005faee585
00000100:00100000:1.0:1651532240.176630:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb0afddd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+138:438147:x1731754469114176:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.176636:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5774
00000100:00100000:0.0:1651532240.176638:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000069a09f8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+138:438147:x1731754469114304:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.176887:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5775
00000100:00100000:1.0:1651532240.176889:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4c57532 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+140:438147:x1731754469114112:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532240.176890:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5776
00000100:00100000:0.0:1651532240.176892:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005faee585 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+140:438147:x1731754469114240:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532240.180750:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb0afddd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438147:x1731754469114176:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4117us (4212us total) trans 158913794612 rc 0/0
00000100:00100000:1.0:1651532240.180756:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5773
00002000:00100000:1.0:1651532240.180761:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d40:0x0] (30408704->31457279)  req@00000000bb0afddd x1731754469114176/t158913794612(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.180766:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bb0afddd with x1731754469114176 ext(30408704->31457279)
00002000:00010000:1.0:1651532240.180769:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bb0afddd
00000100:00100000:1.0:1651532240.182830:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000069a09f8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438147:x1731754469114304:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6190us (6283us total) trans 158913794613 rc 0/0
00000100:00100000:1.0:1651532240.182834:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5774
00002000:00100000:1.0:1651532240.182837:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d40:0x0] (32505856->33554431)  req@0000000069a09f8f x1731754469114304/t158913794613(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.182841:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000069a09f8f with x1731754469114304 ext(32505856->33554431)
00002000:00010000:1.0:1651532240.182842:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000069a09f8f
00000100:00100000:1.0:1651532240.184118:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4c57532 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438147:x1731754469114112:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7228us (7559us total) trans 158913794614 rc 0/0
00000100:00100000:1.0:1651532240.184122:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5775
00002000:00100000:1.0:1651532240.184125:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d40:0x0] (29360128->30408703)  req@00000000e4c57532 x1731754469114112/t158913794614(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.184128:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e4c57532 with x1731754469114112 ext(29360128->30408703)
00002000:00010000:1.0:1651532240.184130:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e4c57532
00000100:00100000:1.0:1651532240.184305:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.184316:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.184323:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.184329:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.184339:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469114816
00002000:00100000:1.0:1651532240.184351:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3d:0x0] (1048576->2097151)  req@00000000d6997dbc x1731754469114816/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.184355:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6997dbc with x1731754469114816 ext(1048576->2097151)
00002000:00010000:1.0:1651532240.184357:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d6997dbc
00000100:00100000:1.0:1651532240.184363:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469114944
00002000:00100000:1.0:1651532240.184366:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3d:0x0] (3145728->4194303)  req@000000004b5d3a68 x1731754469114944/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.184369:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004b5d3a68 with x1731754469114944 ext(3145728->4194303)
00002000:00010000:1.0:1651532240.184370:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004b5d3a68
00000100:00100000:1.0:1651532240.184374:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469114752
00002000:00100000:1.0:1651532240.184377:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3d:0x0] (0->1048575)  req@0000000061644194 x1731754469114752/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.184380:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000061644194 with x1731754469114752 ext(0->1048575)
00002000:00010000:1.0:1651532240.184381:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000061644194
00000100:00100000:1.0:1651532240.184385:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469114880
00002000:00100000:1.0:1651532240.184387:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3d:0x0] (2097152->3145727)  req@0000000009e46558 x1731754469114880/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.184390:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000009e46558 with x1731754469114880 ext(2097152->3145727)
00002000:00010000:1.0:1651532240.184391:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000009e46558
00000100:00100000:1.0:1651532240.184396:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5777
00000100:00100000:1.0:1651532240.184398:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6997dbc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+146:438148:x1731754469114816:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.184489:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5778
00000100:00100000:1.0:1651532240.184491:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b5d3a68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438148:x1731754469114944:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.184555:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5779
00000100:00100000:1.0:1651532240.184557:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061644194 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+148:438148:x1731754469114752:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.184630:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5780
00000100:00100000:1.0:1651532240.184633:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009e46558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438148:x1731754469114880:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.185436:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6997dbc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+151:438148:x1731754469114816:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1035us (1129us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.185442:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5777
00002000:00100000:1.0:1651532240.185456:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3d:0x0] (1048576->2097151)  req@00000000d6997dbc x1731754469114816/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.185476:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6997dbc with x1731754469114816 ext(1048576->2097151)
00002000:00010000:1.0:1651532240.185479:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d6997dbc
00000100:00100000:1.0:1651532240.185884:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005faee585 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438147:x1731754469114240:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8990us (9306us total) trans 158913794615 rc 0/0
00000100:00100000:1.0:1651532240.185901:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5776
00002000:00100000:1.0:1651532240.185905:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d40:0x0] (31457280->32505855)  req@000000005faee585 x1731754469114240/t158913794615(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/448 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532240.185911:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005faee585 with x1731754469114240 ext(31457280->32505855)
00002000:00010000:1.0:1651532240.185923:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000005faee585
00000100:00100000:1.0:1651532240.186156:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b5d3a68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438148:x1731754469114944:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1663us (1838us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.186162:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5778
00002000:00100000:1.0:1651532240.186165:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3d:0x0] (3145728->4194303)  req@000000004b5d3a68 x1731754469114944/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.186183:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004b5d3a68 with x1731754469114944 ext(3145728->4194303)
00002000:00010000:1.0:1651532240.186185:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004b5d3a68
00000100:00100000:1.0:1651532240.186612:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061644194 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438148:x1731754469114752:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2052us (2287us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.186629:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5779
00002000:00100000:1.0:1651532240.186633:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (0->1048575)  req@0000000061644194 x1731754469114752/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.186648:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000061644194 with x1731754469114752 ext(0->1048575)
00002000:00010000:1.0:1651532240.186650:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000061644194
00000100:00100000:1.0:1651532240.187110:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009e46558 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438148:x1731754469114880:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2476us (2780us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.187114:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5780
00002000:00100000:1.0:1651532240.187116:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3d:0x0] (2097152->3145727)  req@0000000009e46558 x1731754469114880/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.187120:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000009e46558 with x1731754469114880 ext(2097152->3145727)
00002000:00010000:1.0:1651532240.187121:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000009e46558
00000100:00100000:1.0:1651532240.195361:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.195371:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.195378:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.195395:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.195418:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469115200
00002000:00100000:1.0:1651532240.195436:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (1048576->2097151)  req@00000000e665ac05 x1731754469115200/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.195441:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e665ac05 with x1731754469115200 ext(1048576->2097151)
00002000:00010000:1.0:1651532240.195443:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e665ac05
00000100:00100000:1.0:1651532240.195450:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469115328
00002000:00100000:1.0:1651532240.195453:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (3145728->4194303)  req@0000000081915895 x1731754469115328/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.195456:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000081915895 with x1731754469115328 ext(3145728->4194303)
00002000:00010000:1.0:1651532240.195457:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000081915895
00000100:00100000:1.0:1651532240.195461:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469115136
00002000:00100000:1.0:1651532240.195464:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (0->1048575)  req@0000000080a7ad8d x1731754469115136/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.195467:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080a7ad8d with x1731754469115136 ext(0->1048575)
00002000:00010000:1.0:1651532240.195468:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080a7ad8d
00000100:00100000:1.0:1651532240.195471:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469115264
00002000:00100000:1.0:1651532240.195474:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (2097152->3145727)  req@000000006cfb7ef9 x1731754469115264/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.195477:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006cfb7ef9 with x1731754469115264 ext(2097152->3145727)
00002000:00010000:1.0:1651532240.195478:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006cfb7ef9
00000100:00100000:1.0:1651532240.195483:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5781
00000100:00100000:1.0:1651532240.195485:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e665ac05 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+146:438148:x1731754469115200:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.195578:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5782
00000100:00100000:1.0:1651532240.195580:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081915895 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438148:x1731754469115328:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.195650:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5783
00000100:00100000:1.0:1651532240.195653:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080a7ad8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+148:438148:x1731754469115136:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.195744:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5784
00000100:00100000:1.0:1651532240.195747:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cfb7ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438148:x1731754469115264:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.196498:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e665ac05 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438148:x1731754469115200:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1011us (1138us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.196515:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5781
00002000:00100000:1.0:1651532240.196520:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (1048576->2097151)  req@00000000e665ac05 x1731754469115200/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.196526:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e665ac05 with x1731754469115200 ext(1048576->2097151)
00002000:00010000:1.0:1651532240.196537:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e665ac05
00000100:00100000:1.0:1651532240.197116:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081915895 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438148:x1731754469115328:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1535us (1744us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.197122:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5782
00002000:00100000:1.0:1651532240.197125:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3e:0x0] (3145728->4194303)  req@0000000081915895 x1731754469115328/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.197128:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000081915895 with x1731754469115328 ext(3145728->4194303)
00002000:00010000:1.0:1651532240.197129:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000081915895
00000100:00100000:1.0:1651532240.197855:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080a7ad8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438148:x1731754469115136:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2201us (2476us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.197861:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5783
00002000:00100000:1.0:1651532240.197876:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (0->1048575)  req@0000000080a7ad8d x1731754469115136/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.197880:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080a7ad8d with x1731754469115136 ext(0->1048575)
00002000:00010000:1.0:1651532240.197882:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000080a7ad8d
00000100:00100000:1.0:1651532240.198311:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cfb7ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438148:x1731754469115264:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2563us (2916us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.198315:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5784
00002000:00100000:1.0:1651532240.198317:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3e:0x0] (2097152->3145727)  req@000000006cfb7ef9 x1731754469115264/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.198321:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006cfb7ef9 with x1731754469115264 ext(2097152->3145727)
00002000:00010000:1.0:1651532240.198322:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006cfb7ef9
00000100:00100000:1.0:1651532240.203039:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.203049:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.203055:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.203062:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.203074:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469115584
00002000:00100000:1.0:1651532240.203100:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3d:0x0] (5242880->6291455)  req@0000000060cc3a48 x1731754469115584/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.203104:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000060cc3a48 with x1731754469115584 ext(5242880->6291455)
00002000:00010000:1.0:1651532240.203106:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000060cc3a48
00000100:00100000:1.0:1651532240.203114:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469115712
00002000:00100000:1.0:1651532240.203117:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3d:0x0] (7340032->8388607)  req@00000000752aa435 x1731754469115712/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.203120:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000752aa435 with x1731754469115712 ext(7340032->8388607)
00002000:00010000:1.0:1651532240.203121:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000752aa435
00000100:00100000:1.0:1651532240.203124:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469115520
00002000:00100000:1.0:1651532240.203127:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3d:0x0] (4194304->5242879)  req@0000000000774ebc x1731754469115520/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.203130:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000000774ebc with x1731754469115520 ext(4194304->5242879)
00002000:00010000:1.0:1651532240.203131:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000000774ebc
00000100:00100000:1.0:1651532240.203135:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469115648
00002000:00100000:1.0:1651532240.203137:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3d:0x0] (6291456->7340031)  req@0000000090b4589f x1731754469115648/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.203140:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000090b4589f with x1731754469115648 ext(6291456->7340031)
00002000:00010000:1.0:1651532240.203141:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000090b4589f
00000100:00100000:1.0:1651532240.203146:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5785
00000100:00100000:1.0:1651532240.203148:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060cc3a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+146:438148:x1731754469115584:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.203238:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5786
00000100:00100000:1.0:1651532240.203240:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000752aa435 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438148:x1731754469115712:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.203309:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5787
00000100:00100000:1.0:1651532240.203312:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000774ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+148:438148:x1731754469115520:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.203423:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5788
00000100:00100000:1.0:1651532240.203427:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090b4589f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438148:x1731754469115648:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.204274:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060cc3a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438148:x1731754469115584:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1123us (1235us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.204279:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5785
00002000:00100000:1.0:1651532240.204284:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3d:0x0] (5242880->6291455)  req@0000000060cc3a48 x1731754469115584/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.204301:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000060cc3a48 with x1731754469115584 ext(5242880->6291455)
00002000:00010000:1.0:1651532240.204305:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000060cc3a48
00000100:00100000:1.0:1651532240.204711:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000752aa435 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438148:x1731754469115712:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1470us (1661us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.204715:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5786
00002000:00100000:1.0:1651532240.204717:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (7340032->8388607)  req@00000000752aa435 x1731754469115712/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.204721:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000752aa435 with x1731754469115712 ext(7340032->8388607)
00002000:00010000:1.0:1651532240.204722:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000752aa435
00000100:00100000:1.0:1651532240.205525:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000774ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438148:x1731754469115520:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2211us (2468us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.205530:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5787
00002000:00100000:1.0:1651532240.205534:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3d:0x0] (4194304->5242879)  req@0000000000774ebc x1731754469115520/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.205539:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000000774ebc with x1731754469115520 ext(4194304->5242879)
00002000:00010000:1.0:1651532240.205542:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000000774ebc
00000100:00100000:1.0:1651532240.205762:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090b4589f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438148:x1731754469115648:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2335us (2699us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.205766:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5788
00002000:00100000:1.0:1651532240.205768:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3d:0x0] (6291456->7340031)  req@0000000090b4589f x1731754469115648/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.205772:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000090b4589f with x1731754469115648 ext(6291456->7340031)
00002000:00010000:1.0:1651532240.205773:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000090b4589f
00000100:00100000:0.0:1651532240.209138:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.209170:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469115904
00002000:00100000:1.0:1651532240.209187:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (4194304->5242879)  req@00000000d4f10a2d x1731754469115904/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.209191:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d4f10a2d with x1731754469115904 ext(4194304->5242879)
00002000:00010000:1.0:1651532240.209193:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d4f10a2d
00000100:00100000:1.0:1651532240.209201:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5789
00000100:00100000:1.0:1651532240.209203:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4f10a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438148:x1731754469115904:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.210247:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4f10a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438148:x1731754469115904:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1043us (1111us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.210252:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5789
00002000:00100000:1.0:1651532240.210254:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (4194304->5242879)  req@00000000d4f10a2d x1731754469115904/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.210258:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d4f10a2d with x1731754469115904 ext(4194304->5242879)
00002000:00010000:1.0:1651532240.210260:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d4f10a2d
00000100:00100000:0.0:1651532240.211972:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.211986:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.211992:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.212002:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469116096
00000100:00100000:0.0:1651532240.212010:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469116032
00002000:00100000:1.0:1651532240.212011:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3e:0x0] (6291456->7340031)  req@000000002120b765 x1731754469116096/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.212015:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002120b765 with x1731754469116096 ext(6291456->7340031)
00002000:00010000:1.0:1651532240.212016:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002120b765
00002000:00100000:0.0:1651532240.212021:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (5242880->6291455)  req@000000006819299c x1731754469116032/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:1.0:1651532240.212022:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469116160
00002000:00100000:1.0:1651532240.212026:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3e:0x0] (7340032->8388607)  req@000000001f5d8243 x1731754469116160/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.212026:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006819299c with x1731754469116032 ext(5242880->6291455)
00002000:00010000:0.0:1651532240.212028:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006819299c
00002000:00100000:1.0:1651532240.212029:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001f5d8243 with x1731754469116160 ext(7340032->8388607)
00002000:00010000:1.0:1651532240.212030:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001f5d8243
00000100:00100000:0.0:1651532240.212038:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5790
00000100:00100000:0.0:1651532240.212040:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002120b765 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438148:x1731754469116096:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.212043:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5791
00000100:00100000:1.0:1651532240.212045:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006819299c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438148:x1731754469116032:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.212110:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5792
00000100:00100000:1.0:1651532240.212112:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f5d8243 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438148:x1731754469116160:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.213288:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006819299c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438148:x1731754469116032:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1241us (1301us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.213292:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5791
00002000:00100000:1.0:1651532240.213295:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3e:0x0] (5242880->6291455)  req@000000006819299c x1731754469116032/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.213298:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006819299c with x1731754469116032 ext(5242880->6291455)
00002000:00010000:1.0:1651532240.213300:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000006819299c
00000100:00100000:1.0:1651532240.213649:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002120b765 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438148:x1731754469116096:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1607us (1676us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.213654:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5790
00002000:00100000:1.0:1651532240.213658:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (6291456->7340031)  req@000000002120b765 x1731754469116096/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.213664:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002120b765 with x1731754469116096 ext(6291456->7340031)
00002000:00010000:1.0:1651532240.213677:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002120b765
00000100:00100000:1.0:1651532240.214047:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f5d8243 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438148:x1731754469116160:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1934us (2054us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.214051:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5792
00002000:00100000:1.0:1651532240.214053:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (7340032->8388607)  req@000000001f5d8243 x1731754469116160/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.214057:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001f5d8243 with x1731754469116160 ext(7340032->8388607)
00002000:00010000:1.0:1651532240.214058:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001f5d8243
00000100:00100000:1.0:1651532240.215224:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.215234:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469116352
00002000:00100000:1.0:1651532240.215244:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (8388608->9437183)  req@000000004e3011d3 x1731754469116352/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.215247:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004e3011d3 with x1731754469116352 ext(8388608->9437183)
00002000:00010000:1.0:1651532240.215249:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004e3011d3
00000100:00100000:1.0:1651532240.215254:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5793
00000100:00100000:1.0:1651532240.215256:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e3011d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438149:x1731754469116352:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.217961:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e3011d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438149:x1731754469116352:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2701us (2735us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.217967:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5793
00002000:00100000:1.0:1651532240.217971:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (8388608->9437183)  req@000000004e3011d3 x1731754469116352/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.217975:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004e3011d3 with x1731754469116352 ext(8388608->9437183)
00002000:00010000:1.0:1651532240.217978:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004e3011d3
00000100:00100000:0.0:1651532240.218040:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.218055:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469116480
00002000:00100000:1.0:1651532240.218066:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (9437184->10485759)  req@00000000e3693001 x1731754469116480/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.218069:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e3693001 with x1731754469116480 ext(9437184->10485759)
00002000:00010000:1.0:1651532240.218070:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e3693001
00000100:00100000:1.0:1651532240.218078:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5794
00000100:00100000:1.0:1651532240.218080:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3693001 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438149:x1731754469116480:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.219021:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3693001 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438149:x1731754469116480:12345-10.240.43.64@tcp:3:diff.0 Request processed in 940us (983us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.219025:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5794
00002000:00100000:1.0:1651532240.219028:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (9437184->10485759)  req@00000000e3693001 x1731754469116480/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.219031:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e3693001 with x1731754469116480 ext(9437184->10485759)
00002000:00010000:1.0:1651532240.219033:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e3693001
00000100:00100000:0.0:1651532240.221191:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.221205:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.221211:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.221220:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469116672
00000100:00100000:0.0:1651532240.221220:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:1.0:1651532240.221229:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (8388608->9437183)  req@0000000077849668 x1731754469116672/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:0.0:1651532240.221230:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469116800
00002000:00100000:1.0:1651532240.221233:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000077849668 with x1731754469116672 ext(8388608->9437183)
00002000:00010000:1.0:1651532240.221234:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000077849668
00000100:00100000:1.0:1651532240.221244:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469116608
00002000:00100000:1.0:1651532240.221248:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3d:0x0] (10485760->11534335)  req@00000000c693fce5 x1731754469116608/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.221248:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3e:0x0] (9437184->10485759)  req@00000000ad4b0b98 x1731754469116800/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.221251:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c693fce5 with x1731754469116608 ext(10485760->11534335)
00002000:00010000:1.0:1651532240.221253:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c693fce5
00002000:00100000:0.0:1651532240.221253:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ad4b0b98 with x1731754469116800 ext(9437184->10485759)
00002000:00010000:0.0:1651532240.221255:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ad4b0b98
00000100:00100000:1.0:1651532240.221259:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469116736
00002000:00100000:1.0:1651532240.221262:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3d:0x0] (11534336->12582911)  req@0000000084f389cd x1731754469116736/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:0.0:1651532240.221269:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5795
00002000:00100000:1.0:1651532240.221271:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000084f389cd with x1731754469116736 ext(11534336->12582911)
00000100:00100000:0.0:1651532240.221271:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077849668 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+146:438149:x1731754469116672:12345-10.240.43.64@tcp:3:diff.0
00002000:00010000:1.0:1651532240.221272:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000084f389cd
00000100:00100000:1.0:1651532240.221276:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5796
00000100:00100000:1.0:1651532240.221278:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c693fce5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+146:438149:x1731754469116608:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.221339:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5797
00000100:00100000:1.0:1651532240.221341:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4b0b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+148:438149:x1731754469116800:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.221343:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5798
00000100:00100000:0.0:1651532240.221345:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084f389cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+148:438149:x1731754469116736:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.223036:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077849668 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438149:x1731754469116672:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1763us (1845us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.223042:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5795
00002000:00100000:0.0:1651532240.223047:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3e:0x0] (8388608->9437183)  req@0000000077849668 x1731754469116672/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.223054:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000077849668 with x1731754469116672 ext(8388608->9437183)
00002000:00010000:0.0:1651532240.223056:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000077849668
00000100:00100000:0.0:1651532240.223149:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c693fce5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438149:x1731754469116608:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1869us (1937us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.223154:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5796
00002000:00100000:0.0:1651532240.223158:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3d:0x0] (10485760->11534335)  req@00000000c693fce5 x1731754469116608/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.223163:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c693fce5 with x1731754469116608 ext(10485760->11534335)
00002000:00010000:0.0:1651532240.223165:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c693fce5
00000100:00100000:0.0:1651532240.223864:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4b0b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438149:x1731754469116800:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2522us (2658us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.223869:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5797
00002000:00100000:0.0:1651532240.223873:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3e:0x0] (9437184->10485759)  req@00000000ad4b0b98 x1731754469116800/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.223879:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ad4b0b98 with x1731754469116800 ext(9437184->10485759)
00002000:00010000:0.0:1651532240.223881:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ad4b0b98
00000100:00100000:0.0:1651532240.224347:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084f389cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438149:x1731754469116736:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3000us (3126us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.224351:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5798
00002000:00100000:0.0:1651532240.224353:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3d:0x0] (11534336->12582911)  req@0000000084f389cd x1731754469116736/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.224357:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000084f389cd with x1731754469116736 ext(11534336->12582911)
00002000:00010000:0.0:1651532240.224359:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000084f389cd
00000100:00100000:0.0:1651532240.227376:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.227389:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469116992
00002000:00100000:0.0:1651532240.227415:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3e:0x0] (10485760->11534335)  req@00000000f8de88a4 x1731754469116992/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.227420:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f8de88a4 with x1731754469116992 ext(10485760->11534335)
00002000:00010000:0.0:1651532240.227421:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f8de88a4
00000100:00100000:0.0:1651532240.227429:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5799
00000100:00100000:0.0:1651532240.227432:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8de88a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438147:x1731754469116992:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.228430:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8de88a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438147:x1731754469116992:12345-10.240.43.64@tcp:3:diff.0 Request processed in 997us (1054us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.228434:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5799
00002000:00100000:0.0:1651532240.228437:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3e:0x0] (10485760->11534335)  req@00000000f8de88a4 x1731754469116992/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.228441:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f8de88a4 with x1731754469116992 ext(10485760->11534335)
00002000:00010000:0.0:1651532240.228443:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f8de88a4
00000100:00100000:0.0:1651532240.231013:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.231032:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.231040:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.231046:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.231053:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.231066:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117184
00002000:00100000:0.0:1651532240.231074:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3d:0x0] (12582912->13631487)  req@000000002782cbc3 x1731754469117184/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:1.0:1651532240.231077:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117312
00002000:00100000:0.0:1651532240.231078:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002782cbc3 with x1731754469117184 ext(12582912->13631487)
00002000:00010000:0.0:1651532240.231080:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002782cbc3
00000100:00100000:0.0:1651532240.231086:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117120
00002000:00100000:0.0:1651532240.231089:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3e:0x0] (11534336->12582911)  req@00000000f0cabd54 x1731754469117120/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.231090:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (14680064->15728639)  req@00000000f12fb34e x1731754469117312/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.231093:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f0cabd54 with x1731754469117120 ext(11534336->12582911)
00002000:00010000:0.0:1651532240.231094:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f0cabd54
00002000:00100000:1.0:1651532240.231095:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f12fb34e with x1731754469117312 ext(14680064->15728639)
00002000:00010000:1.0:1651532240.231096:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f12fb34e
00000100:00100000:0.0:1651532240.231100:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117248
00002000:00100000:0.0:1651532240.231103:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3d:0x0] (13631488->14680063)  req@00000000ef51eb0e x1731754469117248/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.231106:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ef51eb0e with x1731754469117248 ext(13631488->14680063)
00002000:00010000:0.0:1651532240.231107:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ef51eb0e
00000100:00100000:1.0:1651532240.231109:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117376
00000100:00100000:0.0:1651532240.231114:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5800
00000100:00100000:0.0:1651532240.231116:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002782cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438147:x1731754469117184:12345-10.240.43.64@tcp:3:diff.0
00002000:00100000:1.0:1651532240.231118:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (15728640->16777215)  req@00000000c52fd307 x1731754469117376/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.231122:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c52fd307 with x1731754469117376 ext(15728640->16777215)
00002000:00010000:1.0:1651532240.231123:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c52fd307
00000100:00100000:1.0:1651532240.231132:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5801
00000100:00100000:1.0:1651532240.231134:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0cabd54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438147:x1731754469117120:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.231187:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5802
00000100:00100000:0.0:1651532240.231188:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f12fb34e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438147:x1731754469117312:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.231212:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5803
00000100:00100000:1.0:1651532240.231214:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef51eb0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438147:x1731754469117248:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.231240:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5804
00000100:00100000:0.0:1651532240.231242:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c52fd307 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+150:438147:x1731754469117376:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.232169:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002782cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+151:438147:x1731754469117184:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1050us (1155us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.232174:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5800
00002000:00100000:0.0:1651532240.232178:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3d:0x0] (12582912->13631487)  req@000000002782cbc3 x1731754469117184/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.232184:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002782cbc3 with x1731754469117184 ext(12582912->13631487)
00002000:00010000:0.0:1651532240.232187:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002782cbc3
00000100:00100000:0.0:1651532240.232894:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0cabd54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438147:x1731754469117120:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1758us (1852us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.232900:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5801
00002000:00100000:0.0:1651532240.232905:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (11534336->12582911)  req@00000000f0cabd54 x1731754469117120/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.232911:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f0cabd54 with x1731754469117120 ext(11534336->12582911)
00002000:00010000:0.0:1651532240.232913:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f0cabd54
00000100:00100000:0.0:1651532240.233455:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f12fb34e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438147:x1731754469117312:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2265us (2421us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.233459:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5802
00002000:00100000:0.0:1651532240.233461:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3d:0x0] (14680064->15728639)  req@00000000f12fb34e x1731754469117312/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.233466:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f12fb34e with x1731754469117312 ext(14680064->15728639)
00002000:00010000:0.0:1651532240.233468:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f12fb34e
00000100:00100000:1.0:1651532240.234714:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef51eb0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438147:x1731754469117248:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3498us (3666us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.234722:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5803
00002000:00100000:1.0:1651532240.234727:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3d:0x0] (13631488->14680063)  req@00000000ef51eb0e x1731754469117248/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.234733:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ef51eb0e with x1731754469117248 ext(13631488->14680063)
00002000:00010000:1.0:1651532240.234736:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ef51eb0e
00000100:00100000:0.0:1651532240.234847:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c52fd307 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438147:x1731754469117376:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3604us (3793us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.234851:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5804
00002000:00100000:0.0:1651532240.234854:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3d:0x0] (15728640->16777215)  req@00000000c52fd307 x1731754469117376/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.234858:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c52fd307 with x1731754469117376 ext(15728640->16777215)
00002000:00010000:0.0:1651532240.234859:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c52fd307
00000100:00100000:1.0:1651532240.240847:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.240870:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.240878:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.240879:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117632
00000100:00100000:1.0:1651532240.240888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.240907:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:0.0:1651532240.240909:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3d:0x0] (16777216->17825791)  req@00000000268d6d1f x1731754469117632/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:1.0:1651532240.240917:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:0.0:1651532240.240923:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000268d6d1f with x1731754469117632 ext(16777216->17825791)
00002000:00010000:0.0:1651532240.240926:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000268d6d1f
00000100:00100000:1.0:1651532240.240928:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.240940:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117760
00000100:00100000:0.0:1651532240.240942:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117888
00002000:00100000:0.0:1651532240.240946:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3d:0x0] (18874368->19922943)  req@000000003426a1e6 x1731754469117888/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.240950:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003426a1e6 with x1731754469117888 ext(18874368->19922943)
00002000:00100000:1.0:1651532240.240951:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3d:0x0] (17825792->18874367)  req@00000000272c8c25 x1731754469117760/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00010000:0.0:1651532240.240951:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003426a1e6
00000100:00100000:0.0:1651532240.240958:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117568
00002000:00100000:0.0:1651532240.240962:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3e:0x0] (12582912->13631487)  req@000000002771ed62 x1731754469117568/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.240963:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000272c8c25 with x1731754469117760 ext(17825792->18874367)
00002000:00010000:1.0:1651532240.240965:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000272c8c25
00002000:00100000:0.0:1651532240.240965:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002771ed62 with x1731754469117568 ext(12582912->13631487)
00002000:00010000:0.0:1651532240.240966:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002771ed62
00000100:00100000:1.0:1651532240.240972:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117696
00000100:00100000:0.0:1651532240.240973:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117824
00002000:00100000:1.0:1651532240.240976:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3e:0x0] (13631488->14680063)  req@0000000090295d4b x1731754469117696/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.240976:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3e:0x0] (14680064->15728639)  req@00000000e2b43cbd x1731754469117824/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.240979:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000090295d4b with x1731754469117696 ext(13631488->14680063)
00002000:00100000:0.0:1651532240.240979:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e2b43cbd with x1731754469117824 ext(14680064->15728639)
00002000:00010000:0.0:1651532240.240980:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e2b43cbd
00002000:00010000:1.0:1651532240.240981:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000090295d4b
00000100:00100000:0.0:1651532240.240983:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469117952
00000100:00100000:1.0:1651532240.240990:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5805
00002000:00100000:0.0:1651532240.240991:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3e:0x0] (15728640->16777215)  req@000000000f81f6e0 x1731754469117952/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:1.0:1651532240.240992:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000268d6d1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438146:x1731754469117632:12345-10.240.43.64@tcp:3:diff.0
00002000:00100000:0.0:1651532240.240995:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000f81f6e0 with x1731754469117952 ext(15728640->16777215)
00002000:00010000:0.0:1651532240.240996:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000f81f6e0
00000100:00100000:0.0:1651532240.240999:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5806
00000100:00100000:0.0:1651532240.241001:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003426a1e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438146:x1731754469117888:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.241074:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5807
00000100:00100000:1.0:1651532240.241076:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000272c8c25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+151:438146:x1731754469117760:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.241079:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5808
00000100:00100000:0.0:1651532240.241081:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002771ed62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+151:438146:x1731754469117568:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.241127:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5809
00000100:00100000:1.0:1651532240.241129:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2b43cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438146:x1731754469117824:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.241138:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5810
00000100:00100000:0.0:1651532240.241140:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090295d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438146:x1731754469117696:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.241188:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5811
00000100:00100000:1.0:1651532240.241190:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f81f6e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+155:438146:x1731754469117952:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.242129:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000268d6d1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+155:438146:x1731754469117632:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1134us (1284us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.242136:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5805
00002000:00100000:1.0:1651532240.242141:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3d:0x0] (16777216->17825791)  req@00000000268d6d1f x1731754469117632/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.242146:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000268d6d1f with x1731754469117632 ext(16777216->17825791)
00002000:00010000:1.0:1651532240.242149:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000268d6d1f
00000100:00100000:1.0:1651532240.242860:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003426a1e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438146:x1731754469117888:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1857us (1980us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.242866:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5806
00002000:00100000:1.0:1651532240.242870:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3d:0x0] (18874368->19922943)  req@000000003426a1e6 x1731754469117888/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.242875:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003426a1e6 with x1731754469117888 ext(18874368->19922943)
00002000:00010000:1.0:1651532240.242877:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003426a1e6
00000100:00100000:1.0:1651532240.243150:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000272c8c25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+151:438146:x1731754469117760:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2072us (2278us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.243156:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5807
00002000:00100000:1.0:1651532240.243160:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3d:0x0] (17825792->18874367)  req@00000000272c8c25 x1731754469117760/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.243165:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000272c8c25 with x1731754469117760 ext(17825792->18874367)
00002000:00010000:1.0:1651532240.243179:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000272c8c25
00000100:00100000:1.0:1651532240.244178:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2b43cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438146:x1731754469117824:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3046us (3259us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.244190:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5809
00002000:00100000:1.0:1651532240.244195:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3e:0x0] (14680064->15728639)  req@00000000e2b43cbd x1731754469117824/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.244200:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e2b43cbd with x1731754469117824 ext(14680064->15728639)
00002000:00010000:1.0:1651532240.244203:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e2b43cbd
00000100:00100000:1.0:1651532240.244287:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002771ed62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438146:x1731754469117568:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3204us (3397us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.244312:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5808
00002000:00100000:1.0:1651532240.244316:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (12582912->13631487)  req@000000002771ed62 x1731754469117568/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.244330:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002771ed62 with x1731754469117568 ext(12582912->13631487)
00002000:00010000:1.0:1651532240.244332:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002771ed62
00000100:00100000:0.0:1651532240.244861:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090295d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438146:x1731754469117696:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3719us (3952us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.244866:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5810
00002000:00100000:0.0:1651532240.244869:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (13631488->14680063)  req@0000000090295d4b x1731754469117696/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.244874:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000090295d4b with x1731754469117696 ext(13631488->14680063)
00002000:00010000:0.0:1651532240.244876:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000090295d4b
00000100:00100000:1.0:1651532240.245081:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f81f6e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438146:x1731754469117952:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3889us (4152us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.245085:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5811
00002000:00100000:1.0:1651532240.245088:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3e:0x0] (15728640->16777215)  req@000000000f81f6e0 x1731754469117952/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.245092:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000f81f6e0 with x1731754469117952 ext(15728640->16777215)
00002000:00010000:1.0:1651532240.245093:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000f81f6e0
00000100:00100000:0.0:1651532240.246908:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.246921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.246930:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118144
00000100:00100000:1.0:1651532240.246933:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118208
00002000:00100000:1.0:1651532240.246945:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3e:0x0] (16777216->17825791)  req@00000000de96486d x1731754469118208/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.246945:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (19922944->20971519)  req@00000000d59952d8 x1731754469118144/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.246949:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000de96486d with x1731754469118208 ext(16777216->17825791)
00002000:00100000:0.0:1651532240.246949:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d59952d8 with x1731754469118144 ext(19922944->20971519)
00002000:00010000:1.0:1651532240.246950:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000de96486d
00002000:00010000:0.0:1651532240.246951:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d59952d8
00000100:00100000:1.0:1651532240.246958:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5812
00000100:00100000:1.0:1651532240.246960:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de96486d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+144:438146:x1731754469118208:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.246964:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5813
00000100:00100000:0.0:1651532240.246966:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d59952d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+144:438146:x1731754469118144:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.247992:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de96486d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438146:x1731754469118208:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1029us (1068us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.247998:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5812
00002000:00100000:0.0:1651532240.248004:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3e:0x0] (16777216->17825791)  req@00000000de96486d x1731754469118208/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.248010:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000de96486d with x1731754469118208 ext(16777216->17825791)
00002000:00010000:0.0:1651532240.248012:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000de96486d
00000100:00100000:0.0:1651532240.248616:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d59952d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438146:x1731754469118144:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1648us (1707us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.248620:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5813
00002000:00100000:0.0:1651532240.248623:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (19922944->20971519)  req@00000000d59952d8 x1731754469118144/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.248627:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d59952d8 with x1731754469118144 ext(19922944->20971519)
00002000:00010000:0.0:1651532240.248629:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000d59952d8
00000100:00100000:0.0:1651532240.250224:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.250236:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118400
00002000:00100000:0.0:1651532240.250250:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (17825792->18874367)  req@000000000e1a13cf x1731754469118400/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.250255:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000e1a13cf with x1731754469118400 ext(17825792->18874367)
00002000:00010000:0.0:1651532240.250256:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000e1a13cf
00000100:00100000:0.0:1651532240.250263:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5814
00000100:00100000:0.0:1651532240.250265:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e1a13cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438147:x1731754469118400:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.251281:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e1a13cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438147:x1731754469118400:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1014us (1056us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.251286:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5814
00002000:00100000:0.0:1651532240.251290:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (17825792->18874367)  req@000000000e1a13cf x1731754469118400/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.251308:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000e1a13cf with x1731754469118400 ext(17825792->18874367)
00002000:00010000:0.0:1651532240.251310:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000e1a13cf
00000100:00100000:0.0:1651532240.256327:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.256375:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.256386:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.256413:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118592
00000100:00100000:0.0:1651532240.256415:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.256425:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.256433:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.256442:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:1.0:1651532240.256449:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3d:0x0] (20971520->22020095)  req@00000000f56f40ee x1731754469118592/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:0.0:1651532240.256450:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:1.0:1651532240.256458:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f56f40ee with x1731754469118592 ext(20971520->22020095)
00002000:00010000:1.0:1651532240.256461:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f56f40ee
00000100:00100000:0.0:1651532240.256461:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.256472:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118720
00000100:00100000:0.0:1651532240.256473:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118848
00002000:00100000:1.0:1651532240.256476:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3d:0x0] (22020096->23068671)  req@00000000cda51318 x1731754469118720/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.256480:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cda51318 with x1731754469118720 ext(22020096->23068671)
00002000:00010000:1.0:1651532240.256481:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000cda51318
00002000:00100000:0.0:1651532240.256482:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3d:0x0] (23068672->24117247)  req@00000000819fb618 x1731754469118848/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:1.0:1651532240.256489:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118976
00002000:00100000:1.0:1651532240.256493:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3d:0x0] (24117248->25165823)  req@00000000bb68707a x1731754469118976/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.256493:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000819fb618 with x1731754469118848 ext(23068672->24117247)
00002000:00010000:0.0:1651532240.256495:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000819fb618
00002000:00100000:1.0:1651532240.256496:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bb68707a with x1731754469118976 ext(24117248->25165823)
00002000:00010000:1.0:1651532240.256498:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bb68707a
00000100:00100000:1.0:1651532240.256503:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118656
00000100:00100000:0.0:1651532240.256506:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118528
00002000:00100000:1.0:1651532240.256507:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3e:0x0] (19922944->20971519)  req@0000000028acbb6e x1731754469118656/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.256510:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028acbb6e with x1731754469118656 ext(19922944->20971519)
00002000:00100000:0.0:1651532240.256510:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3e:0x0] (18874368->19922943)  req@00000000a24c542c x1731754469118528/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00010000:1.0:1651532240.256511:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000028acbb6e
00000100:00100000:1.0:1651532240.256513:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118784
00002000:00100000:0.0:1651532240.256514:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a24c542c with x1731754469118528 ext(18874368->19922943)
00002000:00010000:0.0:1651532240.256515:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a24c542c
00002000:00100000:1.0:1651532240.256517:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3e:0x0] (20971520->22020095)  req@000000001042ba7f x1731754469118784/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:0.0:1651532240.256517:0:323282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469118912
00002000:00100000:1.0:1651532240.256520:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001042ba7f with x1731754469118784 ext(20971520->22020095)
00002000:00010000:1.0:1651532240.256520:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001042ba7f
00002000:00100000:0.0:1651532240.256520:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3e:0x0] (22020096->23068671)  req@000000008ba7f352 x1731754469118912/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:1.0:1651532240.256522:0:330054:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119040
00002000:00100000:0.0:1651532240.256523:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008ba7f352 with x1731754469118912 ext(22020096->23068671)
00002000:00100000:1.0:1651532240.256525:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3e:0x0] (23068672->24117247)  req@00000000c45ee848 x1731754469119040/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.256528:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c45ee848 with x1731754469119040 ext(23068672->24117247)
00002000:00010000:1.0:1651532240.256529:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c45ee848
00000100:00100000:1.0:1651532240.256532:0:330054:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5815
00002000:00010000:0.0:1651532240.256532:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008ba7f352
00000100:00100000:1.0:1651532240.256534:0:330054:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f56f40ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+151:438147:x1731754469118592:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.256536:0:323282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5816
00000100:00100000:0.0:1651532240.256538:0:323282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cda51318 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+151:438147:x1731754469118720:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.256609:0:330057:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5817
00000100:00100000:0.0:1651532240.256611:0:330057:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000819fb618 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438147:x1731754469118848:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.256614:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5818
00000100:00100000:1.0:1651532240.256616:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb68707a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438147:x1731754469118976:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.256665:0:330280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5819
00000100:00100000:0.0:1651532240.256667:0:330280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028acbb6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+155:438147:x1731754469118656:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.256671:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5820
00000100:00100000:1.0:1651532240.256673:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a24c542c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+155:438147:x1731754469118528:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.256721:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5821
00000100:00100000:0.0:1651532240.256722:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001042ba7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+157:438147:x1731754469118784:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.256724:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5822
00000100:00100000:1.0:1651532240.256726:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c45ee848 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+157:438147:x1731754469119040:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.256774:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5823
00000100:00100000:0.0:1651532240.256776:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ba7f352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+159:438147:x1731754469118912:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.257859:0:323282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cda51318 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+159:438147:x1731754469118720:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1320us (1485us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.257864:0:323282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5816
00002000:00100000:0.0:1651532240.257867:0:323282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x100000000:0x34d3d:0x0] (22020096->23068671)  req@00000000cda51318 x1731754469118720/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.257870:0:323282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cda51318 with x1731754469118720 ext(22020096->23068671)
00002000:00010000:0.0:1651532240.257872:0:323282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000cda51318
00000100:00100000:0.0:1651532240.258875:0:330054:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f56f40ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+157:438147:x1731754469118592:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2338us (2548us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.258881:0:330054:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5815
00002000:00100000:0.0:1651532240.258885:0:330054:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x100000000:0x34d3d:0x0] (20971520->22020095)  req@00000000f56f40ee x1731754469118592/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.258892:0:330054:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f56f40ee with x1731754469118592 ext(20971520->22020095)
00002000:00010000:0.0:1651532240.258894:0:330054:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f56f40ee
00000100:00100000:0.0:1651532240.259092:0:330057:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000819fb618 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+155:438147:x1731754469118848:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2480us (2705us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.259096:0:330057:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5817
00002000:00100000:0.0:1651532240.259098:0:330057:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x34d3d:0x0] (23068672->24117247)  req@00000000819fb618 x1731754469118848/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.259103:0:330057:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000819fb618 with x1731754469118848 ext(23068672->24117247)
00002000:00010000:0.0:1651532240.259105:0:330057:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000819fb618
00000100:00100000:0.0:1651532240.260433:0:330280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028acbb6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438147:x1731754469118656:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3764us (3998us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.260440:0:330280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5819
00002000:00100000:0.0:1651532240.260444:0:330280:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x100000000:0x34d3e:0x0] (19922944->20971519)  req@0000000028acbb6e x1731754469118656/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.260469:0:330280:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028acbb6e with x1731754469118656 ext(19922944->20971519)
00002000:00010000:0.0:1651532240.260470:0:330280:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000028acbb6e
00000100:00100000:0.0:1651532240.260533:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb68707a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+151:438147:x1731754469118976:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3915us (4117us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.260538:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5818
00002000:00100000:0.0:1651532240.260541:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3d:0x0] (24117248->25165823)  req@00000000bb68707a x1731754469118976/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.260547:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bb68707a with x1731754469118976 ext(24117248->25165823)
00002000:00010000:0.0:1651532240.260549:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000bb68707a
00000100:00100000:0.0:1651532240.261735:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001042ba7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438147:x1731754469118784:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5011us (5292us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.261740:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5821
00002000:00100000:0.0:1651532240.261744:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3e:0x0] (20971520->22020095)  req@000000001042ba7f x1731754469118784/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.261749:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001042ba7f with x1731754469118784 ext(20971520->22020095)
00002000:00010000:0.0:1651532240.261752:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001042ba7f
00000100:00100000:0.0:1651532240.261857:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a24c542c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438147:x1731754469118528:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5182us (5431us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.261879:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5820
00002000:00100000:0.0:1651532240.261883:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3e:0x0] (18874368->19922943)  req@00000000a24c542c x1731754469118528/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.261886:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a24c542c with x1731754469118528 ext(18874368->19922943)
00002000:00010000:0.0:1651532240.261888:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a24c542c
00000100:00100000:1.0:1651532240.262886:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c45ee848 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438147:x1731754469119040:12345-10.240.43.64@tcp:3:diff.0 Request processed in 6157us (6423us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.262893:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5822
00002000:00100000:1.0:1651532240.262897:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3e:0x0] (23068672->24117247)  req@00000000c45ee848 x1731754469119040/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.262902:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c45ee848 with x1731754469119040 ext(23068672->24117247)
00002000:00010000:1.0:1651532240.262904:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000c45ee848
00000100:00100000:0.0:1651532240.262992:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ba7f352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438147:x1731754469118912:12345-10.240.43.64@tcp:3:diff.0 Request processed in 6214us (6540us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.262996:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5823
00002000:00100000:0.0:1651532240.262999:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (22020096->23068671)  req@000000008ba7f352 x1731754469118912/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.263003:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008ba7f352 with x1731754469118912 ext(22020096->23068671)
00002000:00010000:0.0:1651532240.263004:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000008ba7f352
00000100:00100000:1.0:1651532240.267621:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.267651:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119232
00002000:00100000:0.0:1651532240.267674:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (24117248->25165823)  req@0000000082601bfc x1731754469119232/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.267682:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000082601bfc with x1731754469119232 ext(24117248->25165823)
00002000:00010000:0.0:1651532240.267685:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000082601bfc
00000100:00100000:0.0:1651532240.267699:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5824
00000100:00100000:0.0:1651532240.267701:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082601bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438146:x1731754469119232:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.268841:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082601bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438146:x1731754469119232:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1139us (1223us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651532240.268846:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5824
00002000:00100000:0.0:1651532240.268849:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (24117248->25165823)  req@0000000082601bfc x1731754469119232/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:0.0:1651532240.268853:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000082601bfc with x1731754469119232 ext(24117248->25165823)
00002000:00010000:0.0:1651532240.268855:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000082601bfc
00000100:00100000:1.0:1651532240.275459:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.275486:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.275490:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119424
00000100:00100000:1.0:1651532240.275495:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.275504:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.275513:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:0.0:1651532240.275515:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (25165824->26214399)  req@000000001fea5073 x1731754469119424/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:1.0:1651532240.275522:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:0.0:1651532240.275524:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001fea5073 with x1731754469119424 ext(25165824->26214399)
00002000:00010000:0.0:1651532240.275530:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001fea5073
00000100:00100000:1.0:1651532240.275531:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532240.275544:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119552
00000100:00100000:1.0:1651532240.275546:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:0.0:1651532240.275548:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (26214400->27262975)  req@000000001dd6c273 x1731754469119552/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:1.0:1651532240.275556:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:0.0:1651532240.275557:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001dd6c273 with x1731754469119552 ext(26214400->27262975)
00002000:00010000:0.0:1651532240.275558:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001dd6c273
00000100:00100000:0.0:1651532240.275566:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119680
00002000:00100000:0.0:1651532240.275569:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (27262976->28311551)  req@00000000b5756f57 x1731754469119680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:1.0:1651532240.275573:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119808
00002000:00100000:0.0:1651532240.275573:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b5756f57 with x1731754469119680 ext(27262976->28311551)
00002000:00010000:0.0:1651532240.275574:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b5756f57
00000100:00100000:0.0:1651532240.275580:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119360
00002000:00100000:0.0:1651532240.275583:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (25165824->26214399)  req@00000000e87ef33a x1731754469119360/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532240.275586:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e87ef33a with x1731754469119360 ext(25165824->26214399)
00002000:00010000:0.0:1651532240.275588:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e87ef33a
00002000:00100000:1.0:1651532240.275590:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3e:0x0] (28311552->29360127)  req@0000000082ac84dd x1731754469119808/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:0.0:1651532240.275593:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119488
00002000:00100000:0.0:1651532240.275596:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (26214400->27262975)  req@0000000048c6a7cf x1731754469119488/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.275599:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000082ac84dd with x1731754469119808 ext(28311552->29360127)
00002000:00100000:0.0:1651532240.275599:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000048c6a7cf with x1731754469119488 ext(26214400->27262975)
00002000:00010000:0.0:1651532240.275600:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000048c6a7cf
00002000:00010000:1.0:1651532240.275601:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000082ac84dd
00000100:00100000:0.0:1651532240.275602:0:323284:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119616
00002000:00100000:0.0:1651532240.275605:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3d:0x0] (27262976->28311551)  req@000000000600b6c2 x1731754469119616/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:1.0:1651532240.275606:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119744
00002000:00100000:0.0:1651532240.275608:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000600b6c2 with x1731754469119616 ext(27262976->28311551)
00002000:00010000:0.0:1651532240.275609:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000600b6c2
00002000:00100000:1.0:1651532240.275610:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3d:0x0] (28311552->29360127)  req@000000004e46b8d5 x1731754469119744/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:0.0:1651532240.275612:0:323284:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5825
00000100:00100000:0.0:1651532240.275614:0:323284:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001fea5073 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+150:438149:x1731754469119424:12345-10.240.43.64@tcp:3:diff.0
00002000:00100000:1.0:1651532240.275617:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004e46b8d5 with x1731754469119744 ext(28311552->29360127)
00002000:00010000:1.0:1651532240.275619:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004e46b8d5
00000100:00100000:1.0:1651532240.275621:0:323281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469119872
00002000:00100000:1.0:1651532240.275624:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3d:0x0] (29360128->30408703)  req@000000009d655133 x1731754469119872/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.275626:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009d655133 with x1731754469119872 ext(29360128->30408703)
00002000:00010000:1.0:1651532240.275627:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009d655133
00000100:00100000:1.0:1651532240.275630:0:323281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5826
00000100:00100000:1.0:1651532240.275632:0:323281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001dd6c273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+151:438149:x1731754469119552:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.275687:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5827
00000100:00100000:0.0:1651532240.275689:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5756f57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438149:x1731754469119680:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.275694:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5828
00000100:00100000:1.0:1651532240.275696:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e87ef33a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438149:x1731754469119360:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.275744:0:330281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5829
00000100:00100000:0.0:1651532240.275745:0:330281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000048c6a7cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+155:438149:x1731754469119488:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.275752:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5830
00000100:00100000:1.0:1651532240.275753:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082ac84dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+155:438149:x1731754469119808:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.275817:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5831
00000100:00100000:1.0:1651532240.275819:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000600b6c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+157:438149:x1731754469119616:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532240.275826:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5832
00000100:00100000:0.0:1651532240.275828:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e46b8d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+157:438149:x1731754469119744:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.275876:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5833
00000100:00100000:1.0:1651532240.275877:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d655133 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+159:438149:x1731754469119872:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.276991:0:323284:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001fea5073 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+159:438149:x1731754469119424:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1375us (1532us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.276998:0:323284:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5825
00002000:00100000:1.0:1651532240.277002:0:323284:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x100000000:0x34d3e:0x0] (25165824->26214399)  req@000000001fea5073 x1731754469119424/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.277020:0:323284:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001fea5073 with x1731754469119424 ext(25165824->26214399)
00002000:00010000:1.0:1651532240.277023:0:323284:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001fea5073
00000100:00100000:1.0:1651532240.277499:0:323281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001dd6c273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+157:438149:x1731754469119552:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1865us (2012us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.277502:0:323281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5826
00002000:00100000:1.0:1651532240.277505:0:323281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x100000000:0x34d3e:0x0] (26214400->27262975)  req@000000001dd6c273 x1731754469119552/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.277508:0:323281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001dd6c273 with x1731754469119552 ext(26214400->27262975)
00002000:00010000:1.0:1651532240.277510:0:323281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001dd6c273
00000100:00100000:1.0:1651532240.278296:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e87ef33a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+155:438149:x1731754469119360:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2597us (2781us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.278310:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5828
00002000:00100000:1.0:1651532240.278314:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3d:0x0] (25165824->26214399)  req@00000000e87ef33a x1731754469119360/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.278320:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e87ef33a with x1731754469119360 ext(25165824->26214399)
00002000:00010000:1.0:1651532240.278329:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000e87ef33a
00000100:00100000:1.0:1651532240.278446:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5756f57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438149:x1731754469119680:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2747us (2942us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.278452:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5827
00002000:00100000:1.0:1651532240.278455:0:330058:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x100000000:0x34d3e:0x0] (27262976->28311551)  req@00000000b5756f57 x1731754469119680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.278470:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b5756f57 with x1731754469119680 ext(27262976->28311551)
00002000:00010000:1.0:1651532240.278472:0:330058:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000b5756f57
00000100:00100000:1.0:1651532240.279707:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.279747:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.279833:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469120064
00002000:00100000:1.0:1651532240.279853:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3d:0x0] (31457280->32505855)  req@0000000047b5ebfa x1731754469120064/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.279870:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000047b5ebfa with x1731754469120064 ext(31457280->32505855)
00002000:00010000:1.0:1651532240.279873:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000047b5ebfa
00000100:00100000:1.0:1651532240.279895:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469120000
00002000:00100000:1.0:1651532240.279913:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3d:0x0] (30408704->31457279)  req@00000000312f10a3 x1731754469120000/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.279918:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000312f10a3 with x1731754469120000 ext(30408704->31457279)
00002000:00010000:1.0:1651532240.279920:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000312f10a3
00000100:00100000:1.0:1651532240.279942:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5834
00000100:00100000:1.0:1651532240.279954:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047b5ebfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+154:438149:x1731754469120064:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.280145:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082ac84dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+154:438149:x1731754469119808:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4390us (4639us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.280149:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5830
00002000:00100000:1.0:1651532240.280151:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3e:0x0] (28311552->29360127)  req@0000000082ac84dd x1731754469119808/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.280155:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000082ac84dd with x1731754469119808 ext(28311552->29360127)
00002000:00010000:1.0:1651532240.280156:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000082ac84dd
00000100:00100000:1.0:1651532240.280163:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5835
00000100:00100000:1.0:1651532240.280166:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000312f10a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438149:x1731754469120000:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.280317:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000600b6c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+153:438149:x1731754469119616:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4496us (4785us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.280323:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5831
00002000:00100000:1.0:1651532240.280326:0:330278:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x34d3d:0x0] (27262976->28311551)  req@000000000600b6c2 x1731754469119616/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.280339:0:330278:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000600b6c2 with x1731754469119616 ext(27262976->28311551)
00002000:00010000:1.0:1651532240.280341:0:330278:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000000600b6c2
00000100:00100000:1.0:1651532240.280444:0:330281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000048c6a7cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:0c703c47-a140-4387-a181-4e0a15e9b24e+151:438149:x1731754469119488:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4697us (4920us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.280450:0:330281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5829
00002000:00100000:1.0:1651532240.280464:0:330281:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x100000000:0x34d3d:0x0] (26214400->27262975)  req@0000000048c6a7cf x1731754469119488/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.280478:0:330281:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000048c6a7cf with x1731754469119488 ext(26214400->27262975)
00002000:00010000:1.0:1651532240.280481:0:330281:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000048c6a7cf
00000100:00100000:1.0:1651532240.280894:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e46b8d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438149:x1731754469119744:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5064us (5346us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.280899:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5832
00002000:00100000:1.0:1651532240.280903:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3d:0x0] (28311552->29360127)  req@000000004e46b8d5 x1731754469119744/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.280916:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004e46b8d5 with x1731754469119744 ext(28311552->29360127)
00002000:00010000:1.0:1651532240.280919:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000004e46b8d5
00000100:00100000:1.0:1651532240.281244:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d655133 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438149:x1731754469119872:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5365us (5687us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.281250:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5833
00002000:00100000:1.0:1651532240.281253:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3d:0x0] (29360128->30408703)  req@000000009d655133 x1731754469119872/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.281260:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009d655133 with x1731754469119872 ext(29360128->30408703)
00002000:00010000:1.0:1651532240.281270:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000009d655133
00000100:00100000:1.0:1651532240.281651:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047b5ebfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438149:x1731754469120064:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1697us (1944us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.281654:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5834
00002000:00100000:1.0:1651532240.281657:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3d:0x0] (31457280->32505855)  req@0000000047b5ebfa x1731754469120064/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.281660:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000047b5ebfa with x1731754469120064 ext(31457280->32505855)
00002000:00010000:1.0:1651532240.281661:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000047b5ebfa
00000100:00100000:1.0:1651532240.281946:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000312f10a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438149:x1731754469120000:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1779us (2209us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.281949:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5835
00002000:00100000:1.0:1651532240.281951:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3d:0x0] (30408704->31457279)  req@00000000312f10a3 x1731754469120000/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.281955:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000312f10a3 with x1731754469120000 ext(30408704->31457279)
00002000:00010000:1.0:1651532240.281956:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000312f10a3
00000100:00100000:1.0:1651532240.282642:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.282651:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469120128
00002000:00100000:1.0:1651532240.282660:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3d:0x0] (32505856->33554431)  req@00000000a9599a64 x1731754469120128/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.282664:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a9599a64 with x1731754469120128 ext(32505856->33554431)
00002000:00010000:1.0:1651532240.282665:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a9599a64
00000100:00100000:1.0:1651532240.282671:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5836
00000100:00100000:1.0:1651532240.282673:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9599a64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438149:x1731754469120128:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.290666:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.290679:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.290686:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.290709:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469120256
00002000:00100000:1.0:1651532240.290730:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3e:0x0] (29360128->30408703)  req@000000002d96294b x1731754469120256/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.290736:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002d96294b with x1731754469120256 ext(29360128->30408703)
00002000:00010000:1.0:1651532240.290738:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002d96294b
00000100:00100000:1.0:1651532240.290746:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469120384
00002000:00100000:1.0:1651532240.290750:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3e:0x0] (31457280->32505855)  req@000000003f0741d7 x1731754469120384/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.290753:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003f0741d7 with x1731754469120384 ext(31457280->32505855)
00002000:00010000:1.0:1651532240.290754:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003f0741d7
00000100:00100000:1.0:1651532240.290757:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469120320
00002000:00100000:1.0:1651532240.290760:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3e:0x0] (30408704->31457279)  req@000000001d9eb5b1 x1731754469120320/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.290763:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d9eb5b1 with x1731754469120320 ext(30408704->31457279)
00002000:00010000:1.0:1651532240.290764:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001d9eb5b1
00000100:00100000:1.0:1651532240.290769:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5837
00000100:00100000:1.0:1651532240.290771:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d96294b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438148:x1731754469120256:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.290876:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5838
00000100:00100000:1.0:1651532240.290878:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003f0741d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+148:438148:x1731754469120384:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.290938:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5839
00000100:00100000:1.0:1651532240.290941:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d9eb5b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438148:x1731754469120320:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.291078:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9599a64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+149:438149:x1731754469120128:12345-10.240.43.64@tcp:3:diff.0 Request processed in 8403us (8435us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.291084:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5836
00002000:00100000:1.0:1651532240.291088:0:330282:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x100000000:0x34d3d:0x0] (32505856->33554431)  req@00000000a9599a64 x1731754469120128/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.291093:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a9599a64 with x1731754469120128 ext(32505856->33554431)
00002000:00010000:1.0:1651532240.291096:0:330282:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000a9599a64
00000100:00100000:1.0:1651532240.291915:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d96294b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+147:438148:x1731754469120256:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1142us (1251us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.291931:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5837
00002000:00100000:1.0:1651532240.291934:0:330055:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x100000000:0x34d3e:0x0] (29360128->30408703)  req@000000002d96294b x1731754469120256/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.291938:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002d96294b with x1731754469120256 ext(29360128->30408703)
00002000:00010000:1.0:1651532240.291940:0:330055:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002d96294b
00000100:00100000:1.0:1651532240.292478:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003f0741d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+145:438148:x1731754469120384:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1599us (1798us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.292482:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5838
00002000:00100000:1.0:1651532240.292484:0:330279:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x100000000:0x34d3e:0x0] (31457280->32505855)  req@000000003f0741d7 x1731754469120384/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.292488:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003f0741d7 with x1731754469120384 ext(31457280->32505855)
00002000:00010000:1.0:1651532240.292489:0:330279:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003f0741d7
00000100:00100000:1.0:1651532240.292667:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d9eb5b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438148:x1731754469120320:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1725us (1981us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.292671:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5839
00002000:00100000:1.0:1651532240.292674:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (30408704->31457279)  req@000000001d9eb5b1 x1731754469120320/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.292677:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d9eb5b1 with x1731754469120320 ext(30408704->31457279)
00002000:00010000:1.0:1651532240.292678:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000001d9eb5b1
00000100:00100000:1.0:1651532240.295946:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532240.295961:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469120576
00002000:00100000:1.0:1651532240.295978:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (32505856->33554431)  req@000000002cfa3eee x1731754469120576/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651532283 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532240.295983:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002cfa3eee with x1731754469120576 ext(32505856->33554431)
00002000:00010000:1.0:1651532240.295984:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002cfa3eee
00000100:00100000:1.0:1651532240.295993:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5840
00000100:00100000:1.0:1651532240.295995:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002cfa3eee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438148:x1731754469120576:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532240.296906:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002cfa3eee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+143:438148:x1731754469120576:12345-10.240.43.64@tcp:3:diff.0 Request processed in 909us (961us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532240.296910:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5840
00002000:00100000:1.0:1651532240.296913:0:330059:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x100000000:0x34d3e:0x0] (32505856->33554431)  req@000000002cfa3eee x1731754469120576/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651532283 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'diff.0'
00002000:00100000:1.0:1651532240.296917:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002cfa3eee with x1731754469120576 ext(32505856->33554431)
00002000:00010000:1.0:1651532240.296918:0:330059:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002cfa3eee
00000400:00000080:1.0:1651532241.668829:0:332136:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651532241.668831:0:332136:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398k: test enospc on first stripe ========= 22:57:21 (1651532241)
00000100:00100000:1.0:1651532242.304212:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532242.304226:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532242.304234:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532242.304253:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238272
00000100:00100000:0.0:1651532242.304260:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238400
00000100:00100000:1.0:1651532242.304276:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238336
00000100:00100000:1.0:1651532242.304281:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6843
00000100:00100000:1.0:1651532242.304283:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d402ce83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951238272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00000100:00100000:0.0:1651532242.304285:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6844
00000100:00100000:0.0:1651532242.304287:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6a92180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951238400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:1.0:1651532242.304299:0:323273:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216378 count 1
00002000:00080000:0.0:1651532242.304299:0:328039:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216380 count 1
00010000:00010000:1.0:1651532242.304313:0:323273:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 3/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.304313:0:328039:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 3/0,1 mode: --/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.304323:0:323273:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417759 lrc: 2/0,0 mode: PR/PR res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda7 expref: 142 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532242.304323:0:328039:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4177c9 lrc: 2/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe17 expref: 142 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.304327:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.304328:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.304328:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532242.304328:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532242.304329:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 4/0,1 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.304329:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 4/0,1 mode: --/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.304343:0:323273:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417759 lrc: 3/0,0 mode: PR/PR res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda7 expref: 142 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532242.304343:0:328039:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4177c9 lrc: 3/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe17 expref: 142 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.304348:0:323273:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417759 lrc: 4/0,0 mode: PR/PR res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda7 expref: 142 pid: 323275 timeout: 15991 lvb_type: 1
00010000:00010000:0.0:1651532242.304348:0:328039:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4177c9 lrc: 4/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe17 expref: 142 pid: 323275 timeout: 15991 lvb_type: 0
00000100:00100000:1.0:1651532242.304355:0:323273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046db6994 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966865664:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532242.304355:0:328039:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9874732 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966865600:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532242.304384:0:323273:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b60669ec going to sleep for 6 seconds
00000100:00100000:0.0:1651532242.304389:0:328039:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb291445 going to sleep for 6 seconds
00000100:00100000:1.0:1651532242.304987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532242.304998:0:330056:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469121344
00000100:00100000:1.0:1651532242.305000:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532242.305008:0:330056:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4177c9 lrc: 5/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe17 expref: 143 pid: 323275 timeout: 15991 lvb_type: 0
00000100:00100000:1.0:1651532242.305010:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469121280
00000100:00100000:0.0:1651532242.305021:0:330056:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 315
00010000:00010000:1.0:1651532242.305023:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417759 lrc: 5/0,0 mode: PR/PR res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda7 expref: 144 pid: 323275 timeout: 15991 lvb_type: 1
00000100:00100000:0.0:1651532242.305024:0:330056:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021045a35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+144:438148:x1731754469121344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651532242.305028:0:330056:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532242.305030:0:330056:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4177c9 lrc: 5/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe17 expref: 144 pid: 323275 timeout: 15991 lvb_type: 0
00000100:00100000:1.0:1651532242.305033:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 316
00000100:00100000:1.0:1651532242.305035:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000209a795f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+144:438148:x1731754469121280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651532242.305035:0:330056:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4177c9 lrc: 4/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe17 expref: 144 pid: 323275 timeout: 15991 lvb_type: 0
00010000:00010000:1.0:1651532242.305039:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532242.305041:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417759 lrc: 5/0,0 mode: PR/PR res: [0x34d3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda7 expref: 144 pid: 323275 timeout: 15991 lvb_type: 1
00010000:00010000:1.0:1651532242.305045:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417759 lrc: 4/0,0 mode: PR/PR res: [0x34d3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda7 expref: 144 pid: 323275 timeout: 15991 lvb_type: 1
00010000:00010000:0.0:1651532242.305045:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.305045:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.305047:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 3/0,1 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305050:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 4/0,1 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305052:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.305052:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.305053:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305056:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 4/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305057:0:330056:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532242.305062:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532242.305073:0:330056:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021045a35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+144:438148:x1731754469121344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (86us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532242.305077:0:330056:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 315
00000100:00100000:1.0:1651532242.305078:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000209a795f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+144:438148:x1731754469121280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (78us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532242.305082:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 316
00010000:00010000:0.0:1651532242.305097:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f4177c9 lrc: 0/0,0 mode: --/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe17 expref: 142 pid: 323275 timeout: 15991 lvb_type: 0
00000100:00100000:0.0:1651532242.305102:0:328039:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9874732 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966865600:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532242.305119:0:328039:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 3/0,1 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305125:0:328039:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 3/0,1 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305127:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417759 lrc: 0/0,0 mode: --/PR res: [0x34d3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda7 expref: 141 pid: 323275 timeout: 15991 lvb_type: 1
00010000:00010000:0.0:1651532242.305130:0:328039:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 3/0,1 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.305135:0:323273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046db6994 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966865664:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532242.305136:0:328039:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 3/0,1 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305139:0:323273:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305141:0:328039:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 2/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305143:0:323273:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305145:0:323273:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305149:0:323273:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 3/0,1 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305151:0:323273:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305250:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 2/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305254:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532242.305256:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 2/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305260:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 3/0,0 mode: PW/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305265:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 1/0,0 mode: --/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305273:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b88 lrc: 0/0,0 mode: --/PW res: [0x34d3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305279:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305282:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532242.305282:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 2/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305285:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 3/0,0 mode: PW/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305289:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 1/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305292:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417b81 lrc: 0/0,0 mode: --/PW res: [0x34d3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532242.361532:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6a92180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745951238400:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57243us (57305us total) trans 158913794617 rc 0/0
00000100:00100000:0.0:1651532242.361536:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6844
00000100:00100000:0.0:1651532242.361542:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6845
00000100:00100000:0.0:1651532242.361544:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd3200ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745951238336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:0.0:1651532242.361550:0:328039:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216379 count 1
00010000:00010000:0.0:1651532242.361555:0:328039:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 3/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.361561:0:328039:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4177d0 lrc: 2/0,0 mode: PR/PR res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe1e expref: 140 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532242.361564:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.361565:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.361566:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 4/0,1 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.361573:0:328039:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4177d0 lrc: 3/0,0 mode: PR/PR res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe1e expref: 140 pid: 328039 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532242.361577:0:328039:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4177d0 lrc: 4/0,0 mode: PR/PR res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe1e expref: 140 pid: 328039 timeout: 15992 lvb_type: 1
00000100:00100000:0.0:1651532242.361582:0:328039:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9874732 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966865728:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532242.361596:0:328039:0:(client.c:2492:ptlrpc_set_wait()) set 000000003bfe041a going to sleep for 6 seconds
00000100:00100000:0.0:1651532242.361697:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d402ce83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951238272:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 57411us (57488us total) trans 158913794616 rc 0/0
00000100:00100000:0.0:1651532242.361723:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6843
00000100:00100000:0.0:1651532242.361983:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532242.362007:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469121472
00010000:00010000:1.0:1651532242.362021:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4177d0 lrc: 5/0,0 mode: PR/PR res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe1e expref: 141 pid: 328039 timeout: 15992 lvb_type: 1
00000100:00100000:1.0:1651532242.362032:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 317
00000100:00100000:1.0:1651532242.362034:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db8553a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+141:438147:x1731754469121472:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651532242.362038:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532242.362039:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4177d0 lrc: 5/0,0 mode: PR/PR res: [0x34d3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe1e expref: 141 pid: 328039 timeout: 15992 lvb_type: 1
00010000:00010000:1.0:1651532242.362047:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4177d0 lrc: 4/0,0 mode: PR/PR res: [0x34d3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe1e expref: 141 pid: 328039 timeout: 15992 lvb_type: 1
00010000:00010000:1.0:1651532242.362068:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.362069:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.362070:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.362074:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 4/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.362079:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532242.362081:0:328039:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f4177d0 lrc: 0/0,0 mode: --/PR res: [0x34d3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe1e expref: 141 pid: 328039 timeout: 15992 lvb_type: 1
00000100:00100000:0.0:1651532242.362086:0:328039:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9874732 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:328039:1731745966865728:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532242.362091:0:328039:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.362095:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db8553a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+140:438147:x1731754469121472:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 60us (113us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532242.362098:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 317
00010000:00010000:0.0:1651532242.362103:0:328039:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.362108:0:328039:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.362112:0:328039:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 3/0,1 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.362121:0:328039:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.362183:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.362188:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e1e35d6a already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532242.362189:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 2/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.362192:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 3/0,0 mode: PW/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.362198:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 1/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.362203:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e35d6a/0xa29a79078f417b8f lrc: 0/0,0 mode: --/PW res: [0x34d3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532242.364749:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd3200ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745951238336:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3203us (60514us total) trans 158913794618 rc 0/0
00000100:00100000:0.0:1651532242.364753:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6845
00000100:00100000:1.0:1651532242.400061:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532242.400075:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532242.400081:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532242.400090:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532242.400093:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238464
00000100:00100000:1.0:1651532242.400099:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238592
00000100:00100000:0.0:1651532242.400100:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238528
00000100:00100000:0.0:1651532242.400103:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238656
00000100:00100000:0.0:1651532242.400107:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6846
00000100:00100000:1.0:1651532242.400109:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6847
00000100:00100000:0.0:1651532242.400109:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6661ab3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745951238464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00000100:00100000:1.0:1651532242.400111:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001077059e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745951238528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:0.0:1651532242.400115:0:323273:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216381 count 1
00002000:00080000:1.0:1651532242.400118:0:323276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216382 count 1
00010000:00010000:0.0:1651532242.400121:0:323273:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 3/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.400123:0:323276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 3/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.400127:0:323273:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4179b3 lrc: 2/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feaa expref: 139 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532242.400129:0:323276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4179ba lrc: 2/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feb1 expref: 139 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532242.400132:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.400133:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.400133:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.400134:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 4/0,1 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.400134:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.400135:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 4/0,1 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.400142:0:323276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4179ba lrc: 3/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feb1 expref: 139 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532242.400143:0:323273:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4179b3 lrc: 3/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feaa expref: 139 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532242.400146:0:323276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4179ba lrc: 4/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feb1 expref: 139 pid: 323276 timeout: 15992 lvb_type: 1
00010000:00010000:0.0:1651532242.400147:0:323273:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4179b3 lrc: 4/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feaa expref: 139 pid: 323275 timeout: 15992 lvb_type: 1
00000100:00100000:0.0:1651532242.400151:0:323273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9874732 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966865856:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532242.400154:0:323276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9929b63 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:323276:1731745966865792:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532242.400165:0:323276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000293eb400 going to sleep for 6 seconds
00000100:00100000:0.0:1651532242.400165:0:323273:0:(client.c:2492:ptlrpc_set_wait()) set 000000007aba71a1 going to sleep for 6 seconds
00000100:00100000:1.0:1651532242.400491:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532242.400498:0:323263:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469121536
00010000:00010000:1.0:1651532242.400504:0:323263:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4179b3 lrc: 5/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feaa expref: 140 pid: 323275 timeout: 15992 lvb_type: 1
00000100:00100000:1.0:1651532242.400521:0:323263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 318
00000100:00100000:1.0:1651532242.400523:0:323263:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058447f4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+140:438149:x1731754469121536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651532242.400527:0:323263:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532242.400528:0:323263:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4179b3 lrc: 5/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feaa expref: 140 pid: 323275 timeout: 15992 lvb_type: 1
00010000:00010000:1.0:1651532242.400532:0:323263:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4179b3 lrc: 4/0,0 mode: PR/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feaa expref: 140 pid: 323275 timeout: 15992 lvb_type: 1
00000100:00100000:0.0:1651532242.400532:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532242.400544:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.400545:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.400546:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.400549:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 4/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.400549:0:323273:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f4179b3 lrc: 0/0,0 mode: --/PR res: [0x34d3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feaa expref: 140 pid: 323275 timeout: 15992 lvb_type: 1
00000100:00100000:0.0:1651532242.400554:0:323273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9874732 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966865856:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532242.400555:0:323263:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532242.400559:0:323273:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.400562:0:323273:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.400565:0:323263:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058447f4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+139:438149:x1731754469121536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (75us total) trans 0 rc 0/0
00010000:00010000:0.0:1651532242.400565:0:323273:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.400568:0:323263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 318
00010000:00010000:0.0:1651532242.400568:0:323273:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 3/0,1 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.400571:0:323273:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.400573:0:323263:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469121600
00010000:00010000:1.0:1651532242.400576:0:323263:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4179ba lrc: 5/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feb1 expref: 139 pid: 323276 timeout: 15992 lvb_type: 1
00000100:00100000:1.0:1651532242.400588:0:323263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 319
00000100:00100000:1.0:1651532242.400589:0:323263:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2eff3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+139:438147:x1731754469121600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651532242.400593:0:323263:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532242.400594:0:323263:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4179ba lrc: 5/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feb1 expref: 139 pid: 323276 timeout: 15992 lvb_type: 1
00010000:00010000:1.0:1651532242.400597:0:323263:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4179ba lrc: 4/0,0 mode: PR/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feb1 expref: 139 pid: 323276 timeout: 15992 lvb_type: 1
00010000:00010000:1.0:1651532242.400602:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.400603:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.400603:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.400606:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 4/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.400611:0:323263:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532242.400616:0:323263:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2eff3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+139:438147:x1731754469121600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 27us (85us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532242.400619:0:323263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 319
00010000:00010000:1.0:1651532242.400630:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f4179ba lrc: 0/0,0 mode: --/PR res: [0x34d3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44feb1 expref: 138 pid: 323276 timeout: 15992 lvb_type: 1
00000100:00100000:1.0:1651532242.400634:0:323276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9929b63 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:323276:1731745966865792:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532242.400638:0:323276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.400642:0:323276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.400644:0:323276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.400647:0:323276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 3/0,1 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.400650:0:323276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532242.403465:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6661ab3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745951238464:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3355us (3404us total) trans 158913794619 rc 0/0
00000100:00100000:0.0:1651532242.403469:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6846
00000100:00100000:0.0:1651532242.403475:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6848
00000100:00100000:0.0:1651532242.403476:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000864e5e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745951238592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:0.0:1651532242.403482:0:323273:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216383 count 1
00010000:00010000:0.0:1651532242.403487:0:323273:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 3/0,1 mode: --/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.403493:0:323273:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4179a5 lrc: 2/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe9c expref: 137 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.403496:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532242.403497:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532242.403498:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 4/0,1 mode: --/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.403505:0:323273:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4179a5 lrc: 3/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe9c expref: 137 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.403512:0:323273:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4179a5 lrc: 4/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe9c expref: 137 pid: 323275 timeout: 15992 lvb_type: 0
00000100:00100000:0.0:1651532242.403517:0:323273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9874732 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966865920:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532242.403525:0:323273:0:(client.c:2492:ptlrpc_set_wait()) set 000000003bfe041a going to sleep for 6 seconds
00010000:00010000:0.0:1651532242.403531:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.403535:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a925ecb already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532242.403536:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 2/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.403539:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 3/0,0 mode: PW/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.403540:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001077059e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745951238528:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3427us (3457us total) trans 158913794620 rc 0/0
00000100:00100000:1.0:1651532242.403544:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6847
00010000:00010000:0.0:1651532242.403544:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 1/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.403546:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417b96 lrc: 0/0,0 mode: --/PW res: [0x34d3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.403550:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6849
00000100:00100000:1.0:1651532242.403551:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006238b3d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745951238656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00010000:00010000:0.0:1651532242.403551:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.403553:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532242.403555:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 2/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00002000:00080000:1.0:1651532242.403557:0:323276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216384 count 1
00010000:00010000:0.0:1651532242.403558:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 3/0,0 mode: PW/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.403561:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 1/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.403562:0:323276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 3/0,1 mode: --/PW res: [0x34d40:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.403564:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417b9d lrc: 0/0,0 mode: --/PW res: [0x34d3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.403568:0:323276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4179ac lrc: 2/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fea3 expref: 137 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.403571:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532242.403572:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532242.403573:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 4/0,1 mode: --/PW res: [0x34d40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.403580:0:323276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4179ac lrc: 3/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fea3 expref: 137 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.403584:0:323276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4179ac lrc: 4/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fea3 expref: 137 pid: 328039 timeout: 15992 lvb_type: 0
00000100:00100000:1.0:1651532242.403588:0:323276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9929b63 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:323276:1731745966865984:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532242.403597:0:323276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000293eb400 going to sleep for 6 seconds
00000100:00100000:1.0:1651532242.403956:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532242.403956:0:323273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9874732 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966865920:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532242.403961:0:323273:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 3/0,1 mode: --/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.403977:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532242.403986:0:330056:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469121728
00000100:00100000:1.0:1651532242.403987:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469121664
00010000:00010000:0.0:1651532242.403992:0:330056:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4179ac lrc: 5/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fea3 expref: 139 pid: 328039 timeout: 15992 lvb_type: 0
00010000:00010000:1.0:1651532242.403993:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4179a5 lrc: 4/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe9c expref: 139 pid: 323275 timeout: 15992 lvb_type: 0
00000100:00100000:0.0:1651532242.404004:0:330056:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 320
00000100:00100000:0.0:1651532242.404006:0:330056:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f4d5dda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+139:438149:x1731754469121728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651532242.404009:0:330056:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651532242.404010:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 321
00010000:00010000:0.0:1651532242.404011:0:330056:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4179ac lrc: 5/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fea3 expref: 139 pid: 328039 timeout: 15992 lvb_type: 0
00000100:00100000:1.0:1651532242.404012:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a53775d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+139:438149:x1731754469121664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651532242.404014:0:330056:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4179ac lrc: 4/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fea3 expref: 139 pid: 328039 timeout: 15992 lvb_type: 0
00010000:00010000:1.0:1651532242.404016:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532242.404018:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4179a5 lrc: 4/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe9c expref: 139 pid: 323275 timeout: 15992 lvb_type: 0
00010000:00010000:0.0:1651532242.404021:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.404022:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4179a5 lrc: 3/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe9c expref: 139 pid: 323275 timeout: 15992 lvb_type: 0
00010000:00010000:0.0:1651532242.404022:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.404023:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 3/0,1 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.404026:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 4/0,1 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.404028:0:323261:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7f071c/0xa29a79078f4179a5 lrc: 0/0,0 mode: --/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe9c expref: 139 pid: 323275 timeout: 15992 lvb_type: 0
00010000:00010000:0.0:1651532242.404031:0:330056:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532242.404032:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.404033:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.404034:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 3/0,1 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.404037:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 4/0,1 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532242.404042:0:330056:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f4d5dda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+138:438149:x1731754469121728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (86us total) trans 0 rc 0/0
00010000:00010000:1.0:1651532242.404047:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532242.404051:0:330056:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 320
00000100:00100000:1.0:1651532242.404055:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a53775d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+137:438149:x1731754469121664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (79us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532242.404058:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 321
00010000:00010000:1.0:1651532242.404071:0:323276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000601104c8/0xa29a79078f4179ac lrc: 0/0,0 mode: --/PW res: [0x34d40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fea3 expref: 136 pid: 328039 timeout: 15992 lvb_type: 0
00000100:00100000:1.0:1651532242.404075:0:323276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9929b63 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:323276:1731745966865984:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532242.404079:0:323276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 3/0,1 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.404085:0:323276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 3/0,1 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.404090:0:323273:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 3/0,1 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.404096:0:323273:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 3/0,1 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.404097:0:323276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 3/0,1 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.404101:0:323276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 3/0,1 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.404101:0:323273:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 3/0,1 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.404104:0:323276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 2/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.404106:0:323273:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 2/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.407156:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006238b3d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745951238656:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3603us (7064us total) trans 158913794621 rc 0/0
00000100:00100000:1.0:1651532242.407161:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6849
00000100:00100000:0.0:1651532242.407166:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000864e5e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745951238592:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 3688us (7090us total) trans 158913794622 rc 0/0
00010000:00010000:1.0:1651532242.407168:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 2/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532242.407171:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6848
00010000:00010000:1.0:1651532242.407172:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532242.407174:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 2/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.407177:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 3/0,0 mode: PW/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.407180:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 2/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.407182:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 1/0,0 mode: --/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.407184:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532242.407185:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bab lrc: 0/0,0 mode: --/PW res: [0x34d40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.407186:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 2/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.407189:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 3/0,0 mode: PW/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.407194:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 1/0,0 mode: --/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.407197:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417ba4 lrc: 0/0,0 mode: --/PW res: [0x34d3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532243.168166:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532243.168196:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238720
00000100:00100000:1.0:1651532243.168222:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 84
00000100:00100000:1.0:1651532243.168224:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db8553a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745951238720:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532243.168240:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 423448256 pending 68681728 free 81180790784 avail 77010079744
00000100:00100000:1.0:1651532243.168263:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db8553a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745951238720:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 39us (100us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532243.168267:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 84
00000100:00100000:0.0:1651532243.644884:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1651532243.644894:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9929b63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966866048:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532243.645176:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9929b63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966866048:10.240.43.61@tcp:400:kworker/u4:2.0
00000001:00080000:1.0:1651532245.359913:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794622 is committed
00000001:00080000:1.0:1651532245.359922:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794615 is committed
00000100:00100000:0.0:1651532248.288188:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532248.288219:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238912
00000100:00100000:1.0:1651532248.288247:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 85
00000100:00100000:1.0:1651532248.288250:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2eff3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951238912:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532248.288268:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:1.0:1651532248.288295:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2eff3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951238912:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 45us (111us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532248.288298:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 85
00000100:00100000:1.0:1651532250.813034:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1651532250.813047:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f066994 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966866112:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532250.813443:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f066994 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966866112:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532253.408220:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532253.408248:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951239040
00000100:00100000:1.0:1651532253.408276:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 86
00000100:00100000:1.0:1651532253.408279:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9874732 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951239040:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532253.408297:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:1.0:1651532253.408323:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9874732 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951239040:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 43us (106us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532253.408326:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 86
00000100:00100000:0.0:1651532257.473286:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532257.473322:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469122432
00000100:00100000:1.0:1651532257.473351:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 87
00000100:00100000:1.0:1651532257.473353:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007250c610 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687013:x1731754469122432:12345-10.240.43.64@tcp:13:lctl.0
00002000:00000024:1.0:1651532257.473371:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:1.0:1651532257.473403:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007250c610 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687013:x1731754469122432:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 50us (120us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532257.473407:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 87
00000400:00000080:0.0:1651532257.783859:0:332190:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532257.783861:0:332190:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_398k 150507472 > 600000 skipping out-of-space test on OST0
00000400:00000080:1.0:1651532258.139105:0:332244:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651532258.139107:0:332244:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398l: test enospc on intermediate stripe/RPC ========================================================== 22:57:37 (1651532257)
00000100:00100000:0.0:1651532258.528194:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532258.528224:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951239360
00000100:00100000:1.0:1651532258.528250:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 88
00000100:00100000:1.0:1651532258.528253:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005115fe58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951239360:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532258.528268:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:1.0:1651532258.528296:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005115fe58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951239360:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 42us (105us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532258.528299:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 88
00000100:00100000:0.0:1651532262.122176:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.122191:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469124288
00000100:00100000:0.0:1651532262.122219:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6850
00000100:00100000:0.0:1651532262.122221:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a54cd2ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687479:x1731754469124288:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532262.122230:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532262.122250:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bb2 lrc: 2/0,0 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff21 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532262.122264:0:323273:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532262.122274:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.122275:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.122279:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bb2 lrc: 3/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff21 expref: 7 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.122287:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bb2 lrc: 3/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff21 expref: 7 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.122292:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000413f87ac, rc 0)
00000100:00100000:0.0:1651532262.122317:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a54cd2ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:687479:x1731754469124288:12345-10.240.43.64@tcp:101:dd.0 Request processed in 95us (143us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532262.122320:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6850
00000100:00100000:0.0:1651532262.122901:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.122911:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469124416
00000100:00100000:0.0:1651532262.122930:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6851
00000100:00100000:0.0:1651532262.122932:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:687479:x1731754469124416:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532262.122937:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532262.122943:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417bb9 lrc: 2/0,0 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff2f expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532262.122954:0:323273:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532262.122959:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.122960:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.122962:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417bb9 lrc: 3/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff2f expref: 8 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.122967:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417bb9 lrc: 3/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff2f expref: 8 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.122971:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a925ecb, rc 0)
00000100:00100000:0.0:1651532262.122988:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a9bc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:687479:x1731754469124416:12345-10.240.43.64@tcp:101:dd.0 Request processed in 55us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532262.122991:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6851
00000100:00100000:0.0:1651532262.123235:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.123252:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532262.123262:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469124544
00000100:00100000:0.0:1651532262.123265:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469124672
00002000:00010000:1.0:1651532262.123283:0:330059:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216387/0 (0->18446744073709551615)
00002000:00010000:0.0:1651532262.123283:0:330279:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216388/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532262.123284:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003e89e453 with x1731754469124672 ext(0->18446744073709551615)
00002000:00100000:1.0:1651532262.123285:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ed5f7c3c with x1731754469124544 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532262.123288:0:330059:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ed5f7c3c.
00002000:00010000:0.0:1651532262.123288:0:330279:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003e89e453.
00000100:00100000:0.0:1651532262.123298:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5841
00000100:00100000:0.0:1651532262.123300:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e89e453 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469124672:12345-10.240.43.64@tcp:10:dd.0
00000100:00100000:1.0:1651532262.123306:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5842
00000100:00100000:1.0:1651532262.123308:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ed5f7c3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469124544:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532262.123367:0:330059:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d43:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532262.123369:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d43:0x0] updating lvb mtime from disk: 0 -> 1651532262
00002000:00010000:0.0:1651532262.123369:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d44:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532262.123370:0:330059:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d43:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532262.123371:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d43:0x0] updating lvb ctime from disk: 0 -> 1651532262
00002000:00010000:0.0:1651532262.123371:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d44:0x0] updating lvb mtime from disk: 0 -> 1651532262
00002000:00010000:1.0:1651532262.123372:0:330059:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d43:0x0] updating lvb blocks from disk: 0 -> 0
00002000:00010000:0.0:1651532262.123372:0:330279:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d44:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532262.123373:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d44:0x0] updating lvb ctime from disk: 0 -> 1651532262
00002000:00010000:0.0:1651532262.123374:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d44:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532262.123385:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ed5f7c3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469124544:12345-10.240.43.64@tcp:10:dd.0 Request processed in 77us (150us total) trans 158913794623 rc 0/0
00000100:00100000:0.0:1651532262.123385:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e89e453 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469124672:12345-10.240.43.64@tcp:10:dd.0 Request processed in 85us (134us total) trans 158913794624 rc 0/0
00000100:00100000:1.0:1651532262.123389:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5842
00002000:00010000:1.0:1651532262.123390:0:330059:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216387/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532262.123391:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ed5f7c3c with x1731754469124544 ext(0->18446744073709551615)
00000100:00100000:0.0:1651532262.123391:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5841
00002000:00010000:0.0:1651532262.123392:0:330279:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216388/0 (0->18446744073709551615)
00002000:00010000:1.0:1651532262.123393:0:330059:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ed5f7c3c.
00002000:00100000:0.0:1651532262.123393:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003e89e453 with x1731754469124672 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532262.123395:0:330279:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000003e89e453.
00000100:00100000:0.0:1651532262.160048:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532262.160073:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469125056
00000100:00100000:1.0:1651532262.160089:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5843
00000100:00100000:1.0:1651532262.160091:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002285757d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469125056:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532262.160103:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 3/0,1 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.160111:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bb2 lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff21 expref: 10 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.160115:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532262.160116:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532262.160117:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 4/0,1 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.160131:0:330055:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bb2 lrc: 3/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff21 expref: 10 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.160137:0:330055:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bb2 lrc: 4/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff21 expref: 10 pid: 323273 timeout: 16011 lvb_type: 0
00000100:00100000:1.0:1651532262.160143:0:330055:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f066994 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:330055:1731745966866176:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532262.160164:0:330055:0:(client.c:2492:ptlrpc_set_wait()) set 00000000293eb400 going to sleep for 6 seconds
00000100:00100000:0.0:1651532262.161147:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.161160:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.161168:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469125376
00000100:00100000:1.0:1651532262.161170:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469125440
00000100:00100000:0.0:1651532262.161185:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5844
00000100:00100000:0.0:1651532262.161187:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eba21ffe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469125376:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532262.161192:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5845
00000100:00100000:1.0:1651532262.161194:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004328ce8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469125440:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532262.161196:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 3/0,1 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.161201:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 3/0,1 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.161206:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532262.161207:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532262.161207:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 3/0,1 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.161211:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 3/0,1 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161228:0:330279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417bb9 lrc: 2/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff2f expref: 12 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161233:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532262.161234:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532262.161234:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 4/0,1 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161244:0:330279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417bb9 lrc: 3/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff2f expref: 12 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161248:0:330279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417bb9 lrc: 4/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff2f expref: 12 pid: 323273 timeout: 16011 lvb_type: 0
00000100:00100000:0.0:1651532262.161254:0:330279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:330279:1731745966866240:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532262.161264:0:330055:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f066994 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:330055:1731745966866176:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532262.161269:0:330279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007aba71a1 going to sleep for 6 seconds
00010000:00010000:1.0:1651532262.161270:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 3/0,1 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532262.161649:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532262.161658:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.161660:0:330279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:330279:1731745966866240:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532262.161665:0:323263:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469125824
00010000:00010000:0.0:1651532262.161665:0:330279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 3/0,1 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.161673:0:323263:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417bb9 lrc: 4/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff2f expref: 13 pid: 323273 timeout: 16011 lvb_type: 0
00000100:00100000:0.0:1651532262.161680:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469125760
00000100:00100000:1.0:1651532262.161683:0:323263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 322
00000100:00100000:1.0:1651532262.161685:0:323263:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f066994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469125824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651532262.161686:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bb2 lrc: 4/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff21 expref: 14 pid: 323273 timeout: 16011 lvb_type: 0
00010000:00010000:1.0:1651532262.161689:0:323263:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532262.161695:0:323263:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417bb9 lrc: 4/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff2f expref: 14 pid: 323273 timeout: 16011 lvb_type: 0
00000100:00100000:0.0:1651532262.161695:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 323
00000100:00100000:0.0:1651532262.161697:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3fc6fa1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469125760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651532262.161700:0:323263:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417bb9 lrc: 3/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff2f expref: 14 pid: 323273 timeout: 16011 lvb_type: 0
00010000:00010000:0.0:1651532262.161701:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532262.161706:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bb2 lrc: 4/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff21 expref: 14 pid: 323273 timeout: 16011 lvb_type: 0
00010000:00010000:1.0:1651532262.161708:0:323263:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a925ecb/0xa29a79078f417bb9 lrc: 0/0,0 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff2f expref: 14 pid: 323273 timeout: 16011 lvb_type: 0
00010000:00010000:0.0:1651532262.161710:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bb2 lrc: 3/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff21 expref: 14 pid: 323273 timeout: 16011 lvb_type: 0
00010000:00010000:1.0:1651532262.161713:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.161713:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.161714:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161717:0:323259:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bb2 lrc: 0/0,0 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff21 expref: 13 pid: 323273 timeout: 16011 lvb_type: 0
00010000:00010000:1.0:1651532262.161718:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 4/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161721:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.161721:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.161722:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161726:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 4/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161729:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.161732:0:323263:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532262.161736:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.161737:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161740:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 4/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532262.161744:0:323263:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f066994 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469125824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (96us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532262.161748:0:323263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 322
00010000:00010000:0.0:1651532262.161755:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532262.161764:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.161764:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3fc6fa1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469125760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (106us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532262.161767:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 323
00010000:00010000:1.0:1651532262.161768:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161801:0:330279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.161819:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.161991:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.161995:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532262.595673:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794625 is committed
00002000:00010000:0.0:1651532262.595752:0:330282:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d43:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:0.0:1651532262.595754:0:330282:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d43:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:0.0:1651532262.595760:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.595767:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.595820:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004328ce8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469125440:12345-10.240.43.64@tcp:4:dd.0 Request processed in 434623us (434658us total) trans 158913794625 rc 0/0
00000100:00100000:0.0:1651532262.595826:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5845
00010000:00010000:0.0:1651532262.595841:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.595844:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532262.595846:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.595850:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 3/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.595860:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 1/0,0 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.595863:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417bce lrc: 0/0,0 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532262.647275:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794627 is committed
00010000:00010000:0.0:1651532262.647322:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.647326:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.647351:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002285757d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469125056:12345-10.240.43.64@tcp:4:dd.0 Request processed in 487258us (487304us total) trans 158913794627 rc 0/0
00000100:00100000:0.0:1651532262.647356:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5843
00010000:00010000:0.0:1651532262.647364:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.647368:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532262.647369:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.647372:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 3/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.647376:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 1/0,0 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.647379:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417bc0 lrc: 0/0,0 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532262.647460:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d44:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:1.0:1651532262.647463:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d44:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:1.0:1651532262.647467:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.647471:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 2/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532262.647494:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eba21ffe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754469125376:12345-10.240.43.64@tcp:4:dd.0 Request processed in 486305us (486346us total) trans 158913794626 rc 0/0
00000100:00100000:1.0:1651532262.647498:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5844
00010000:00010000:1.0:1651532262.647507:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 2/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.647510:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532262.647512:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 2/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.647515:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 3/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.647520:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 1/0,0 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.647523:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417bc7 lrc: 0/0,0 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532262.685145:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532262.685156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532262.685171:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469126272
00000100:00100000:0.0:1651532262.685178:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469126208
00000100:00100000:0.0:1651532262.685194:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5846
00000100:00100000:0.0:1651532262.685196:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008a5af404 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469126208:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532262.685198:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5847
00000100:00100000:1.0:1651532262.685200:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004283155e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469126272:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532262.685211:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d43:0x0] initial LVB size: 2097152, mtime: 0x627061e6, atime: 0x0, ctime: 0x627061e6, blocks: 0x1000
00002000:00010000:1.0:1651532262.685212:0:330279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d44:0x0] initial LVB size: 2097152, mtime: 0x627061e6, atime: 0x0, ctime: 0x627061e6, blocks: 0x1000
00010000:00010000:0.0:1651532262.685213:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bd5 lrc: 3/0,1 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.685214:0:330279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417bdc lrc: 3/0,1 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.685219:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.685219:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.685220:0:330279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.685220:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.685222:0:330279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417bdc lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.685222:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bd5 lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.685227:0:330279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417bdc lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.685229:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bd5 lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532263.035394:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794628 is committed
00002000:00010000:0.0:1651532263.035488:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d43:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:0.0:1651532263.035491:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d43:0x0] updating lvb blocks from disk: 4096 -> 8192
00010000:00010000:0.0:1651532263.035499:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bd5 lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035506:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bd5 lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532263.035551:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008a5af404 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469126208:12345-10.240.43.64@tcp:4:dd.0 Request processed in 350353us (350393us total) trans 158913794628 rc 0/0
00000100:00100000:0.0:1651532263.035557:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5846
00010000:00010000:0.0:1651532263.035572:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bd5 lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035576:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532263.035577:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bd5 lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035581:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bd5 lrc: 3/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035591:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bd5 lrc: 1/0,0 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035597:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bd5 lrc: 0/0,0 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532263.077874:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794629 is committed
00002000:00010000:1.0:1651532263.077911:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d44:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:1.0:1651532263.077913:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d44:0x0] updating lvb blocks from disk: 4096 -> 8192
00010000:00010000:1.0:1651532263.077917:0:330279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417bdc lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.077922:0:330279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417bdc lrc: 2/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.077947:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417bdc lrc: 2/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532263.077951:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004283155e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754469126272:12345-10.240.43.64@tcp:4:dd.0 Request processed in 392750us (392807us total) trans 158913794629 rc 0/0
00010000:00010000:0.0:1651532263.077955:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00000100:00100000:1.0:1651532263.077956:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5847
00010000:00010000:0.0:1651532263.077957:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417bdc lrc: 2/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.077960:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417bdc lrc: 3/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.077965:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417bdc lrc: 1/0,0 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.077968:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417bdc lrc: 0/0,0 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330279 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532263.089382:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.089395:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469126528
00000100:00100000:1.0:1651532263.089422:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 89
00000100:00100000:1.0:1651532263.089424:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff088905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687483:x1731754469126528:12345-10.240.43.64@tcp:13:lctl.0
00002000:00000024:1.0:1651532263.089435:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77001494528
00000100:00100000:1.0:1651532263.089451:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff088905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687483:x1731754469126528:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 26us (70us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532263.089454:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 89
00000400:00000080:0.0:1651532263.387935:0:332298:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532263.387937:0:332298:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_398l 150489656 > 600000 skipping out-of-space test on OST0
00000100:00100000:1.0:1651532263.416156:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.416169:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.416181:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469126784
00000100:00100000:1.0:1651532263.416199:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469126912
00000100:00100000:1.0:1651532263.416212:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6852
00000100:00100000:1.0:1651532263.416214:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c42cfeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469126784:12345-10.240.43.64@tcp:101:rm.0
00010000:00010000:1.0:1651532263.416224:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651532263.416228:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6853
00000100:00100000:0.0:1651532263.416232:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9929b63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469126912:12345-10.240.43.64@tcp:101:rm.0
00010000:00010000:1.0:1651532263.416235:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417be3 lrc: 2/0,0 mode: --/PR res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff44 expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.416238:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532263.416246:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bea lrc: 2/0,0 mode: --/PR res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff52 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532263.416247:0:323273:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d43:0x0] initial LVB size: 4194304, mtime: 0x627061e6, atime: 0x0, ctime: 0x627061e6, blocks: 0x2000
00010000:00010000:1.0:1651532263.416256:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.416257:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00002000:00010000:0.0:1651532263.416257:0:323275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d44:0x0] initial LVB size: 4194304, mtime: 0x627061e6, atime: 0x0, ctime: 0x627061e6, blocks: 0x2000
00010000:00010000:1.0:1651532263.416261:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417be3 lrc: 3/0,0 mode: PR/PR res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff44 expref: 9 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532263.416263:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532263.416264:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532263.416266:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bea lrc: 3/0,0 mode: PR/PR res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff52 expref: 9 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532263.416270:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417be3 lrc: 3/0,0 mode: PR/PR res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff44 expref: 9 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532263.416272:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bea lrc: 3/0,0 mode: PR/PR res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff52 expref: 9 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532263.416275:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fa9833a2, rc 0)
00010000:00010000:0.0:1651532263.416276:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000413f87ac, rc 0)
00000100:00100000:1.0:1651532263.416297:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c42cfeff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469126784:12345-10.240.43.64@tcp:101:rm.0 Request processed in 82us (145us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532263.416297:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9929b63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469126912:12345-10.240.43.64@tcp:101:rm.0 Request processed in 65us (128us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532263.416300:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6852
00000100:00100000:0.0:1651532263.416302:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6853
00000100:00100000:1.0:1651532263.648335:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532263.648353:0:323278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951239680
00000100:00100000:1.0:1651532263.648377:0:323278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 90
00000100:00100000:1.0:1651532263.648380:0:323278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000209a795f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951239680:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:1.0:1651532263.648399:0:323278:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81172402176 avail 77001691136
00000100:00100000:1.0:1651532263.648439:0:323278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000209a795f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951239680:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 58us (107us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532263.648443:0:323278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 90
00000400:00000080:0.0:1651532263.748474:0:332352:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532263.748477:0:332352:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398m: test RPC failures with parallel dio ========================================================== 22:57:43 (1651532263)
00000100:00100000:1.0:1651532263.969973:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.969991:0:328039:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128064
00000100:00100000:1.0:1651532263.970011:0:328039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6854
00000100:00100000:1.0:1651532263.970014:0:328039:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000058447f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:687797:x1731754469128064:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532263.970024:0:328039:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532263.970035:0:328039:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417bf1 lrc: 2/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff7c expref: -99 pid: 328039 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532263.970047:0:328039:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532263.970056:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.970057:0:328039:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.970061:0:328039:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417bf1 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff7c expref: 9 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.970068:0:328039:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417bf1 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff7c expref: 9 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.970074:0:328039:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000012a81dbf, rc 0)
00000100:00100000:1.0:1651532263.970096:0:328039:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000058447f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:687797:x1731754469128064:12345-10.240.43.64@tcp:101:dd.0 Request processed in 81us (125us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532263.970099:0:328039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6854
00000100:00100000:1.0:1651532263.970836:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.970846:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128192
00000100:00100000:1.0:1651532263.970854:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6855
00000100:00100000:1.0:1651532263.970856:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021045a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:687797:x1731754469128192:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532263.970861:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532263.970875:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417bf8 lrc: 2/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff8a expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532263.970882:0:323276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532263.970886:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.970887:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.970889:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417bf8 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff8a expref: 10 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.970893:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417bf8 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff8a expref: 10 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.970897:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042a9b21c, rc 0)
00000100:00100000:1.0:1651532263.970909:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021045a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:687797:x1731754469128192:12345-10.240.43.64@tcp:101:dd.0 Request processed in 52us (73us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532263.970912:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6855
00000100:00100000:1.0:1651532263.971469:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.971483:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.971498:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128320
00000100:00100000:0.0:1651532263.971505:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128448
00002000:00010000:1.0:1651532263.971507:0:330279:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216391/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532263.971508:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000046db6994 with x1731754469128320 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532263.971512:0:330279:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000046db6994.
00002000:00010000:0.0:1651532263.971516:0:330055:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216392/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532263.971517:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000579bf8b5 with x1731754469128448 ext(0->18446744073709551615)
00000100:00100000:1.0:1651532263.971519:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5848
00000100:00100000:1.0:1651532263.971521:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046db6994 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469128320:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:0.0:1651532263.971521:0:330055:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000579bf8b5.
00000100:00100000:0.0:1651532263.971530:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5849
00000100:00100000:0.0:1651532263.971532:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000579bf8b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469128448:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532263.971585:0:330279:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532263.971587:0:330279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb mtime from disk: 0 -> 1651532263
00002000:00010000:1.0:1651532263.971588:0:330279:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532263.971588:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532263.971589:0:330279:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb ctime from disk: 0 -> 1651532263
00002000:00010000:1.0:1651532263.971589:0:330279:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 0 -> 0
00002000:00010000:0.0:1651532263.971589:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb mtime from disk: 0 -> 1651532263
00002000:00010000:0.0:1651532263.971590:0:330055:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532263.971591:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb ctime from disk: 0 -> 1651532263
00002000:00010000:0.0:1651532263.971593:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532263.971601:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046db6994 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469128320:12345-10.240.43.64@tcp:10:dd.0 Request processed in 80us (132us total) trans 158913794631 rc 0/0
00000100:00100000:1.0:1651532263.971604:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5848
00002000:00010000:1.0:1651532263.971606:0:330279:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216391/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532263.971606:0:330279:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000046db6994 with x1731754469128320 ext(0->18446744073709551615)
00000100:00100000:0.0:1651532263.971606:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000579bf8b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469128448:12345-10.240.43.64@tcp:10:dd.0 Request processed in 73us (123us total) trans 158913794630 rc 0/0
00002000:00010000:1.0:1651532263.971608:0:330279:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000046db6994.
00000100:00100000:0.0:1651532263.971610:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5849
00002000:00010000:0.0:1651532263.971611:0:330055:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216392/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532263.971612:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000579bf8b5 with x1731754469128448 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532263.971614:0:330055:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000579bf8b5.
00000100:00100000:1.0:1651532264.007933:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532264.007957:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128640
00000100:00100000:0.0:1651532264.007972:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5850
00000100:00100000:0.0:1651532264.007974:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004ae461d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469128640:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532264.007978:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532264.012737:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532264.012767:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532264.012779:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129088
00000100:00100000:1.0:1651532264.012812:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129024
00000100:00100000:1.0:1651532264.012821:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5851
00000100:00100000:1.0:1651532264.012824:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c9cd6ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469129088:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:1.0:1651532264.012828:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532264.012850:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c9cd6ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469129088:12345-10.240.43.64@tcp:4:dd.0 Request processed in 26us (115us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532264.012853:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5851
00000100:00100000:1.0:1651532264.012859:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5852
00000100:00100000:1.0:1651532264.012861:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000072c48a87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469129024:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:1.0:1651532264.012863:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532264.012869:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000072c48a87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469129024:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8us (102us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532264.012872:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5852
00000100:00100000:0.0:1651532264.013770:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004ae461d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469128640:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5794us (5837us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532264.013774:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5850
00000100:00100000:1.0:1651532265.024937:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532265.024952:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532265.024961:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532265.024962:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129408
00000100:00100000:1.0:1651532265.024968:0:330279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129344
00000100:00100000:0.0:1651532265.024978:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129472
00000100:00100000:0.0:1651532265.024987:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5853
00000100:00100000:0.0:1651532265.024989:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000943caad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469129408:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532265.024993:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532265.024995:0:330279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5854
00000100:00100000:1.0:1651532265.024997:0:330279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cc09f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469129472:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532265.025001:0:330279:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:0.0:1651532265.025006:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000943caad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469129408:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 16us (70us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532265.025009:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5853
00000100:00100000:1.0:1651532265.025012:0:330279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cc09f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469129472:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 14us (51us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532265.025014:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5855
00000100:00100000:1.0:1651532265.025016:0:330279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5854
00000100:00100000:0.0:1651532265.025016:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a60d0ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469129344:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532265.025018:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:0.0:1651532265.025025:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a60d0ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469129344:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 9us (73us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532265.025027:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5855
00000100:00100000:1.0:1651532267.072909:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532267.072924:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532267.072932:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532267.072935:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129536
00000100:00100000:1.0:1651532267.072940:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129664
00000100:00100000:0.0:1651532267.072950:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129600
00000100:00100000:0.0:1651532267.072959:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5856
00000100:00100000:0.0:1651532267.072961:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0834f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469129536:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532267.072964:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532267.072965:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5857
00000100:00100000:1.0:1651532267.072968:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006091ef5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469129600:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532267.072971:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532267.072983:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006091ef5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469129600:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 15us (51us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532267.072987:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5857
00000100:00100000:1.0:1651532267.072991:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5858
00000100:00100000:1.0:1651532267.072993:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000addbcc4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469129664:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532267.072995:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532267.073001:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000addbcc4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469129664:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 8us (77us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532267.073004:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5858
00000100:00100000:0.0:1651532267.075065:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0834f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469129536:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 2103us (2156us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532267.075069:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5856
00000100:00100000:1.0:1651532268.768149:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532268.768173:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951239872
00000100:00100000:0.0:1651532268.768189:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 91
00000100:00100000:0.0:1651532268.768192:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007580b5a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951239872:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532268.768203:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81172402176 avail 77001691136
00000100:00100000:0.0:1651532268.768220:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007580b5a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951239872:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 28us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532268.768223:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 91
00000100:00100000:1.0:1651532268.857532:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532268.857540:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532268.857548:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240064
00000100:00100000:1.0:1651532268.857563:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240192
00000100:00100000:1.0:1651532268.857568:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6856
00000100:00100000:1.0:1651532268.857571:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a76824a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951240064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00000100:00100000:0.0:1651532268.857578:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6857
00002000:00080000:1.0:1651532268.857579:0:323276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216387 count 1
00000100:00100000:0.0:1651532268.857581:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083e42e86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951240192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0
00002000:00080000:0.0:1651532268.857588:0:323275:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:216388 count 1
00010000:00010000:1.0:1651532268.857591:0:323276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 3/0,1 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.857596:0:323275:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 3/0,1 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.857601:0:323276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417be3 lrc: 2/0,0 mode: PR/PR res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff44 expref: 11 pid: 323273 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532268.857603:0:323275:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bea lrc: 2/0,0 mode: PR/PR res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff52 expref: 11 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532268.857606:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532268.857607:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532268.857608:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 4/0,1 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.857610:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532268.857611:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532268.857612:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 4/0,1 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.857621:0:323275:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bea lrc: 3/0,0 mode: PR/PR res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff52 expref: 11 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532268.857626:0:323275:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bea lrc: 4/0,0 mode: PR/PR res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff52 expref: 11 pid: 323275 timeout: 16018 lvb_type: 1
00010000:00010000:1.0:1651532268.857630:0:323276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417be3 lrc: 3/0,0 mode: PR/PR res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff44 expref: 11 pid: 323273 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651532268.857632:0:323275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:323275:1731745966866304:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532268.857635:0:323276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417be3 lrc: 4/0,0 mode: PR/PR res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff44 expref: 11 pid: 323273 timeout: 16018 lvb_type: 1
00000100:00100000:1.0:1651532268.857640:0:323276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3cfedfa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:323276:1731745966866368:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532268.857651:0:323275:0:(client.c:2492:ptlrpc_set_wait()) set 000000007aba71a1 going to sleep for 6 seconds
00000100:00100000:1.0:1651532268.857652:0:323276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000000529983 going to sleep for 6 seconds
00000100:00100000:1.0:1651532268.858087:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532268.858097:0:323275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:323275:1731745966866304:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532268.858098:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532268.858108:0:323275:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 3/0,1 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532268.858110:0:323276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3cfedfa pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:323276:1731745966866368:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532268.858115:0:323276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 3/0,1 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532268.858118:0:330056:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130048
00010000:00010000:0.0:1651532268.858125:0:330056:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417be3 lrc: 4/0,0 mode: PR/PR res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff44 expref: 12 pid: 323273 timeout: 16018 lvb_type: 1
00000100:00100000:1.0:1651532268.858129:0:323259:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129920
00010000:00010000:1.0:1651532268.858141:0:323259:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bea lrc: 4/0,0 mode: PR/PR res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff52 expref: 13 pid: 323275 timeout: 16018 lvb_type: 1
00000100:00100000:0.0:1651532268.858150:0:330056:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 324
00000100:00100000:0.0:1651532268.858152:0:330056:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099391ae3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469130048:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00000100:00100000:1.0:1651532268.858155:0:323259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 325
00010000:00010000:0.0:1651532268.858156:0:330056:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651532268.858157:0:323259:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057c4f872 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469129920:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651532268.858158:0:330056:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417be3 lrc: 4/0,0 mode: PR/PR res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff44 expref: 13 pid: 323273 timeout: 16018 lvb_type: 1
00010000:00010000:1.0:1651532268.858160:0:323259:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532268.858162:0:323259:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bea lrc: 4/0,0 mode: PR/PR res: [0x34d44:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff52 expref: 13 pid: 323275 timeout: 16018 lvb_type: 1
00010000:00010000:0.0:1651532268.858163:0:330056:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417be3 lrc: 3/0,0 mode: PR/PR res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff44 expref: 13 pid: 323273 timeout: 16018 lvb_type: 1
00010000:00010000:1.0:1651532268.858166:0:323259:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bea lrc: 3/0,0 mode: PR/PR res: [0x34d44:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff52 expref: 13 pid: 323275 timeout: 16018 lvb_type: 1
00010000:00010000:0.0:1651532268.858172:0:330056:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417be3 lrc: 0/0,0 mode: --/PR res: [0x34d43:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff44 expref: 13 pid: 323273 timeout: 16018 lvb_type: 1
00010000:00010000:1.0:1651532268.858173:0:323259:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417bea lrc: 0/0,0 mode: --/PR res: [0x34d44:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff52 expref: 13 pid: 323275 timeout: 16018 lvb_type: 1
00010000:00010000:1.0:1651532268.858177:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532268.858177:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532268.858177:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532268.858178:0:323259:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532268.858179:0:323259:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858179:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858182:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 4/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858185:0:323259:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 4/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858192:0:330056:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532268.858200:0:323259:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532268.858208:0:330056:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099391ae3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469130048:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 55us (121us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532268.858209:0:323259:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057c4f872 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469129920:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 51us (111us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532268.858211:0:330056:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 324
00000100:00100000:1.0:1651532268.858212:0:323259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 325
00010000:00010000:0.0:1651532268.858218:0:323275:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858222:0:323276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858222:0:323275:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858226:0:323276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858226:0:323275:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 3/0,1 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858229:0:323276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 3/0,1 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858232:0:323276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858232:0:323275:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 2/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532268.858769:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083e42e86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745951240192:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1187us (1227us total) trans 158913794633 rc 0/0
00000100:00100000:0.0:1651532268.858773:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6857
00000100:00100000:1.0:1651532268.858775:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a76824a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951240064:12345-10.240.43.61@tcp:6:osp-syn-0-0.0 Request processed in 1203us (1243us total) trans 158913794632 rc 0/0
00000100:00100000:1.0:1651532268.858779:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6856
00010000:00010000:0.0:1651532268.858782:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858785:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532268.858787:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 2/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858787:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 2/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858790:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532268.858791:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 3/0,0 mode: PW/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858792:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 2/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858795:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 3/0,0 mode: PW/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858796:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 1/0,0 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858799:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417bff lrc: 0/0,0 mode: --/PW res: [0x34d43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858801:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 1/0,0 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858819:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417c06 lrc: 0/0,0 mode: --/PW res: [0x34d44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532269.244890:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1651532269.244896:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966866432:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532269.245171:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966866432:10.240.43.61@tcp:400:kworker/u4:0.0
00000001:00080000:1.0:1651532269.286280:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794633 is committed
00000001:00080000:1.0:1651532269.286284:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794631 is committed
00000100:00100000:1.0:1651532270.144902:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532270.144922:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129792
00000100:00100000:1.0:1651532270.144925:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532270.144934:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532270.144943:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129856
00000100:00100000:1.0:1651532270.144953:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129728
00000100:00100000:0.0:1651532270.144953:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5859
00000100:00100000:0.0:1651532270.144955:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b5468c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469129792:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532270.144958:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532270.144966:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5860
00000100:00100000:1.0:1651532270.144968:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060a5edbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469129856:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000100:00100000:0.0:1651532270.144971:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b5468c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469129792:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 16us (70us total) trans 0 rc -5/-5
00000020:02000000:1.0:1651532270.144972:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:0.0:1651532270.144975:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5859
00000100:00100000:0.0:1651532270.144979:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5861
00000100:00100000:0.0:1651532270.144981:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ef885cde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469129728:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000100:00100000:1.0:1651532270.144982:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060a5edbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469129856:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 13us (57us total) trans 0 rc -5/-5
00000020:02000000:0.0:1651532270.144983:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532270.144985:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5860
00000100:00100000:0.0:1651532270.144989:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ef885cde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469129728:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 8us (55us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532270.144992:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5861
00000100:00100000:1.0:1651532272.864110:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532272.864119:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240256
00000100:00100000:1.0:1651532272.864135:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6
00000100:00100000:1.0:1651532272.864137:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c377c70a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951240256:12345-10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532272.864152:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c377c70a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951240256:12345-10.240.43.61@tcp:400:kworker/u4:2.0 Request processed in 14us (43us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532272.864155:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6
00000100:00100000:1.0:1651532273.888119:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532273.888142:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240384
00000100:00100000:0.0:1651532273.888157:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 92
00000100:00100000:0.0:1651532273.888159:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e39a6b03 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951240384:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532273.888167:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:0.0:1651532273.888180:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e39a6b03 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951240384:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 20us (62us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532273.888183:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 92
00000100:00100000:1.0:1651532274.176919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532274.176932:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532274.176940:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532274.176941:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130176
00000100:00100000:1.0:1651532274.176947:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130304
00000100:00100000:0.0:1651532274.176955:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130240
00000100:00100000:0.0:1651532274.176965:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5862
00000100:00100000:0.0:1651532274.176967:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097c1cfe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130176:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532274.176970:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532274.176972:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5863
00000100:00100000:1.0:1651532274.176974:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b2a78c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130240:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532274.176977:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532274.176992:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b2a78c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130240:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 18us (51us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532274.176995:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5863
00000100:00100000:1.0:1651532274.177000:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5864
00000100:00100000:1.0:1651532274.177002:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae0e011b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469130304:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532274.177004:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532274.177010:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae0e011b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469130304:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 7us (77us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532274.177012:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5864
00000100:00100000:0.0:1651532274.179090:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097c1cfe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469130176:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 2122us (2172us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532274.179094:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5862
00000100:00100000:0.0:1651532276.412859:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4117a37c-db10-4766-b60a-8aa6e5558d6b:39028:1731745966866496:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532276.413102:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4117a37c-db10-4766-b60a-8aa6e5558d6b:39028:1731745966866496:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651532277.440921:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532277.440931:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130624
00000100:00100000:1.0:1651532277.440947:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 7
00000100:00100000:1.0:1651532277.440949:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b06021fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469130624:12345-10.240.43.64@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651532277.440967:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b06021fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469130624:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 17us (47us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532277.440970:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 7
00000100:00100000:1.0:1651532279.008139:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532279.008164:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240576
00000100:00100000:0.0:1651532279.008181:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 93
00000100:00100000:0.0:1651532279.008183:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c980086 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951240576:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532279.008192:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:0.0:1651532279.008207:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c980086 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951240576:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532279.008210:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 93
00000100:00100000:1.0:1651532279.488920:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532279.488934:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532279.488942:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532279.488946:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130496
00000100:00100000:1.0:1651532279.488950:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130560
00000100:00100000:0.0:1651532279.488962:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130432
00000100:00100000:0.0:1651532279.488972:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5865
00000100:00100000:0.0:1651532279.488974:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004baadc77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130496:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000100:00100000:1.0:1651532279.488975:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5866
00000100:00100000:1.0:1651532279.488977:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051a06de6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130560:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532279.488978:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000020:02000000:1.0:1651532279.488981:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532279.488991:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051a06de6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130560:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 14us (58us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532279.488991:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004baadc77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130496:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 17us (73us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532279.488995:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5865
00000100:00100000:1.0:1651532279.488997:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5866
00000100:00100000:0.0:1651532279.489000:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5867
00000100:00100000:0.0:1651532279.489001:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3cfedfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469130432:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532279.489005:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:0.0:1651532279.489011:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3cfedfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469130432:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 9us (69us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532279.489014:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5867
00000100:00100000:1.0:1651532284.128151:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532284.128177:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240896
00000100:00100000:0.0:1651532284.128197:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 94
00000100:00100000:0.0:1651532284.128199:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007120ffbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951240896:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532284.128211:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:0.0:1651532284.128233:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007120ffbe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951240896:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 33us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532284.128237:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 94
00000100:00100000:1.0:1651532285.632926:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532285.632952:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532285.632953:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130688
00000100:00100000:1.0:1651532285.632962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532285.632971:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130816
00000100:00100000:1.0:1651532285.632976:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130752
00000100:00100000:0.0:1651532285.632981:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5868
00000100:00100000:0.0:1651532285.632983:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1bc100b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130688:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532285.632987:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532285.632995:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5869
00000100:00100000:1.0:1651532285.632997:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000caa66376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130816:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532285.633001:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532285.633015:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000caa66376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130816:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 17us (63us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532285.633018:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5869
00000100:00100000:1.0:1651532285.633023:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5870
00000100:00100000:1.0:1651532285.633025:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a25935f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469130752:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532285.633027:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532285.633033:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a25935f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469130752:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 8us (71us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532285.633035:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5870
00000100:00100000:0.0:1651532285.635131:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1bc100b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469130688:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 2147us (2206us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532285.635135:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5868
00000100:00100000:1.0:1651532289.248117:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532289.248145:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240960
00000100:00100000:0.0:1651532289.248166:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 95
00000100:00100000:0.0:1651532289.248169:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2d1465d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951240960:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532289.248183:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:0.0:1651532289.248204:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2d1465d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951240960:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 34us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532289.248209:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 95
00000100:00100000:1.0:1651532292.800955:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532292.800971:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532292.800980:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532292.800981:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131008
00000100:00100000:1.0:1651532292.800988:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131072
00000100:00100000:0.0:1651532292.800999:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130944
00000100:00100000:0.0:1651532292.801009:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5871
00000100:00100000:0.0:1651532292.801011:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdedbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131008:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532292.801016:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532292.801017:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5872
00000100:00100000:1.0:1651532292.801020:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b7a2946 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130944:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532292.801024:0:330058:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:0.0:1651532292.801031:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdedbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131008:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 19us (78us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532292.801035:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b7a2946 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469130944:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 15us (55us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532292.801035:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5871
00000100:00100000:1.0:1651532292.801038:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5872
00000100:00100000:0.0:1651532292.801040:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5873
00000100:00100000:0.0:1651532292.801042:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009687e29d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469131072:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532292.801044:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:0.0:1651532292.801051:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009687e29d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469131072:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 8us (80us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532292.801053:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5873
00000100:00100000:0.0:1651532293.820850:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1651532293.820859:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966866560:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532293.821122:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966866560:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651532294.368123:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532294.368149:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241088
00000100:00100000:0.0:1651532294.368173:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 96
00000100:00100000:0.0:1651532294.368175:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6090b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241088:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532294.368183:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:0.0:1651532294.368199:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6090b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241088:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (77us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532294.368202:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 96
00000100:00100000:1.0:1651532299.488245:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532299.488270:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241216
00000100:00100000:0.0:1651532299.488286:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 97
00000100:00100000:0.0:1651532299.488288:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c3281ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241216:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532299.488297:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:0.0:1651532299.488314:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c3281ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241216:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 25us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532299.488318:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 97
00000100:00100000:1.0:1651532300.992903:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532300.992919:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532300.992927:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532300.992932:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131136
00000100:00100000:1.0:1651532300.992935:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131264
00000100:00100000:0.0:1651532300.992949:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131200
00000100:00100000:0.0:1651532300.992956:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5874
00000100:00100000:0.0:1651532300.992958:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075bc2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131136:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000100:00100000:1.0:1651532300.992959:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5875
00000100:00100000:1.0:1651532300.992961:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000817a6d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131264:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532300.992962:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000020:02000000:1.0:1651532300.992965:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:0.0:1651532300.992978:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075bc2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131136:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 19us (76us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532300.992982:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5874
00000100:00100000:1.0:1651532300.992983:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000817a6d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131264:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 21us (64us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532300.992987:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5876
00000100:00100000:0.0:1651532300.992988:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000025cf06eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469131200:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532300.992991:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:0.0:1651532300.992997:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000025cf06eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469131200:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 8us (70us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532300.992998:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5875
00000100:00100000:0.0:1651532300.993000:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5876
00000100:00100000:0.0:1651532302.012868:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4117a37c-db10-4766-b60a-8aa6e5558d6b:39028:1731745966866624:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532302.013126:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4117a37c-db10-4766-b60a-8aa6e5558d6b:39028:1731745966866624:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651532304.608158:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532304.608183:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241472
00000100:00100000:0.0:1651532304.608198:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 98
00000100:00100000:0.0:1651532304.608200:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029a61ec3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241472:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532304.608208:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:0.0:1651532304.608222:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029a61ec3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241472:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 22us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532304.608226:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 98
00000100:00100000:1.0:1651532309.728165:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532309.728190:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241664
00000100:00100000:0.0:1651532309.728206:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 99
00000100:00100000:0.0:1651532309.728208:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b4465a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241664:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532309.728217:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:0.0:1651532309.728233:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b4465a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241664:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 25us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532309.728236:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 99
00000100:00100000:1.0:1651532310.208963:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532310.208978:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532310.208986:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532310.208991:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131520
00000100:00100000:1.0:1651532310.208994:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131456
00000100:00100000:0.0:1651532310.209009:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5877
00000100:00100000:0.0:1651532310.209017:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002aca8eef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469131520:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000100:00100000:1.0:1651532310.209018:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131584
00000020:02000000:0.0:1651532310.209022:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532310.209031:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5878
00000100:00100000:1.0:1651532310.209034:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be43f13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131456:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532310.209039:0:330058:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532310.209054:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be43f13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131456:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 19us (76us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532310.209059:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5878
00000100:00100000:1.0:1651532310.209067:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5879
00000100:00100000:1.0:1651532310.209070:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bdd0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469131584:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532310.209073:0:330058:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532310.209081:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bdd0726 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469131584:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 11us (95us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532310.209084:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5879
00000100:00100000:0.0:1651532310.211361:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002aca8eef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469131520:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 2343us (2399us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532310.211365:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5877
00000100:00100000:1.0:1651532314.848122:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532314.848145:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241728
00000100:00100000:0.0:1651532314.848161:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 100
00000100:00100000:0.0:1651532314.848164:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fad251f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241728:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532314.848173:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:0.0:1651532314.848188:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fad251f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241728:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 24us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532314.848191:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 100
00000100:00100000:0.0:1651532319.420859:0:39028:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1651532319.420867:0:39028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966866688:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532319.421132:0:39028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8e2ea52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:39028:1731745966866688:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651532319.968171:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532319.968197:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241920
00000100:00100000:0.0:1651532319.968211:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 101
00000100:00100000:0.0:1651532319.968213:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002841ddcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241920:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532319.968221:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 354766528 pending 0 free 81180790784 avail 77010079744
00000100:00100000:0.0:1651532319.968234:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002841ddcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241920:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 21us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532319.968237:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 101
00000100:00100000:1.0:1651532320.448920:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.448935:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.448944:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532320.448945:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131712
00000100:00100000:1.0:1651532320.448952:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131840
00000100:00100000:0.0:1651532320.448962:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131776
00000100:00100000:0.0:1651532320.448972:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5880
00000100:00100000:0.0:1651532320.448974:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051a17589 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131712:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532320.448978:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:1.0:1651532320.448979:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5881
00000100:00100000:1.0:1651532320.448981:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b9eaeb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131776:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:1.0:1651532320.448985:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:0.0:1651532320.448992:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051a17589 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131712:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 18us (74us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532320.448996:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b9eaeb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469131776:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 14us (52us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532320.448996:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5880
00000100:00100000:1.0:1651532320.448999:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5881
00000100:00100000:0.0:1651532320.449001:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5882
00000100:00100000:0.0:1651532320.449003:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ebed73a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469131840:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0
00000020:02000000:0.0:1651532320.449006:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00000100:00100000:0.0:1651532320.449012:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ebed73a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469131840:12345-10.240.43.64@tcp:4:ptlrpcd_01_01.0 Request processed in 8us (77us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532320.449015:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5882
00000100:00100000:1.0:1651532320.650202:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.650219:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.650233:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469132608
00002000:00010000:1.0:1651532320.650251:0:330282:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216391/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532320.650253:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ba1611c9 with x1731754469132608 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532320.650260:0:330282:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ba1611c9.
00000100:00100000:1.0:1651532320.650269:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469132736
00002000:00010000:1.0:1651532320.650271:0:330282:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216392/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532320.650273:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007653f059 with x1731754469132736 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532320.650274:0:330282:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000007653f059.
00000100:00100000:1.0:1651532320.650280:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5883
00000100:00100000:1.0:1651532320.650283:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1611c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469132608:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532320.650345:0:330282:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532320.650347:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb mtime from disk: 1651532263 -> 1651532320
00002000:00010000:1.0:1651532320.650348:0:330282:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532320.650349:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb ctime from disk: 1651532263 -> 1651532320
00002000:00010000:1.0:1651532320.650350:0:330282:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532320.650373:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1611c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469132608:12345-10.240.43.64@tcp:10:dd.0 Request processed in 89us (173us total) trans 158913794634 rc 0/0
00000100:00100000:1.0:1651532320.650378:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5883
00002000:00010000:1.0:1651532320.650380:0:330282:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216391/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532320.650381:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ba1611c9 with x1731754469132608 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532320.650382:0:330282:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000ba1611c9.
00000100:00100000:1.0:1651532320.650388:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5884
00000100:00100000:1.0:1651532320.650390:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007653f059 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469132736:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532320.650411:0:330282:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532320.650412:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb mtime from disk: 1651532263 -> 1651532320
00002000:00010000:1.0:1651532320.650413:0:330282:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532320.650413:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb ctime from disk: 1651532263 -> 1651532320
00002000:00010000:1.0:1651532320.650414:0:330282:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532320.650421:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007653f059 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469132736:12345-10.240.43.64@tcp:10:dd.0 Request processed in 31us (202us total) trans 158913794635 rc 0/0
00000100:00100000:1.0:1651532320.650424:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5884
00002000:00010000:1.0:1651532320.650425:0:330282:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216392/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532320.650426:0:330282:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007653f059 with x1731754469132736 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532320.650428:0:330282:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000007653f059.
00000100:00100000:1.0:1651532320.688107:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.688128:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.688138:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469132992
00000100:00100000:1.0:1651532320.688155:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469133056
00000100:00100000:1.0:1651532320.688162:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5885
00000100:00100000:1.0:1651532320.688164:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000faaf3d99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469132992:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532320.688178:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688188:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417bf1 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff7c expref: 11 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688192:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532320.688193:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532320.688194:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 4/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688208:0:330058:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417bf1 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff7c expref: 11 pid: 328039 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688214:0:330058:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417bf1 lrc: 4/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff7c expref: 11 pid: 328039 timeout: 16070 lvb_type: 0
00000100:00100000:1.0:1651532320.688220:0:330058:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f85bb724 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:330058:1731745966866752:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532320.688241:0:330058:0:(client.c:2492:ptlrpc_set_wait()) set 00000000072ec890 going to sleep for 6 seconds
00000100:00100000:1.0:1651532320.688248:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5886
00000100:00100000:1.0:1651532320.688250:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7215249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469133056:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532320.688257:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688261:0:330278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417bf8 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff8a expref: 11 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688264:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532320.688265:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532320.688266:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 4/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688279:0:330278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417bf8 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff8a expref: 11 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688283:0:330278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417bf8 lrc: 4/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff8a expref: 11 pid: 323276 timeout: 16070 lvb_type: 0
00000100:00100000:1.0:1651532320.688287:0:330278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000049d48527 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0000_UUID:330278:1731745966866816:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532320.688294:0:330278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000000529983 going to sleep for 6 seconds
00000100:00100000:1.0:1651532320.688860:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.688869:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469133824
00000100:00100000:1.0:1651532320.688880:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5887
00000100:00100000:1.0:1651532320.688882:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022fb3cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469133824:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532320.688889:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688893:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532320.688894:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532320.688895:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688899:0:330282:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532320.689092:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.689107:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.689115:0:323261:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469133888
00000100:00100000:0.0:1651532320.689118:0:323263:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469133952
00010000:00010000:1.0:1651532320.689132:0:323261:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417bf1 lrc: 5/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff7c expref: 14 pid: 328039 timeout: 16070 lvb_type: 0
00010000:00010000:0.0:1651532320.689134:0:323263:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417bf8 lrc: 5/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff8a expref: 14 pid: 323276 timeout: 16070 lvb_type: 0
00000100:00100000:1.0:1651532320.689143:0:323261:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 326
00000100:00100000:1.0:1651532320.689145:0:323261:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000102a9960 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469133888:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00000100:00100000:0.0:1651532320.689147:0:323263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 327
00010000:00010000:1.0:1651532320.689149:0:323261:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1651532320.689150:0:323263:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1c21a88 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469133952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651532320.689154:0:323263:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532320.689156:0:323261:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417bf1 lrc: 5/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff7c expref: 14 pid: 328039 timeout: 16070 lvb_type: 0
00010000:00010000:1.0:1651532320.689160:0:323261:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417bf1 lrc: 4/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff7c expref: 14 pid: 328039 timeout: 16070 lvb_type: 0
00010000:00010000:0.0:1651532320.689160:0:323263:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417bf8 lrc: 5/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff8a expref: 14 pid: 323276 timeout: 16070 lvb_type: 0
00010000:00010000:0.0:1651532320.689165:0:323263:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417bf8 lrc: 4/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff8a expref: 14 pid: 323276 timeout: 16070 lvb_type: 0
00010000:00010000:1.0:1651532320.689170:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532320.689171:0:323261:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532320.689172:0:323261:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.689172:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.689173:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.689174:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.689175:0:323261:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 4/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.689178:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 4/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.689181:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532320.689182:0:323261:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532320.689182:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.689183:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.689186:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 4/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532320.689192:0:323261:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000102a9960 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469133888:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 47us (101us total) trans 0 rc 0/0
00010000:00010000:0.0:1651532320.689196:0:323263:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532320.689202:0:323261:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 326
00000100:00100000:0.0:1651532320.689208:0:323263:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1c21a88 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469133952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (101us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532320.689212:0:323263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 327
00010000:00010000:1.0:1651532320.689219:0:330278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417bf8 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff8a expref: 12 pid: 323276 timeout: 16070 lvb_type: 0
00000100:00100000:1.0:1651532320.689224:0:330278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000049d48527 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0000_UUID:330278:1731745966866816:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532320.689229:0:330278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.689232:0:330278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.689235:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.689252:0:330058:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a81dbf/0xa29a79078f417bf1 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff7c expref: 11 pid: 328039 timeout: 16070 lvb_type: 0
00000100:00100000:0.0:1651532320.689257:0:330058:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f85bb724 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:330058:1731745966866752:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532320.689262:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.689265:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.689268:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.689475:0:330282:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.689479:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.057229:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794636 is committed
00002000:00010000:0.0:1651532321.057310:0:330278:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:0.0:1651532321.057313:0:330278:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:0.0:1651532321.057320:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.057326:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.057382:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7215249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469133056:12345-10.240.43.64@tcp:4:dd.0 Request processed in 369129us (369252us total) trans 158913794636 rc 0/0
00000100:00100000:0.0:1651532321.057388:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5886
00010000:00010000:0.0:1651532321.057402:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.057406:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa9833a2 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532321.057408:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.057411:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.057420:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.057424:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9833a2/0xa29a79078f417c14 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.094903:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794638 is committed
00010000:00010000:0.0:1651532321.094954:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094959:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.094982:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022fb3cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469133824:12345-10.240.43.64@tcp:4:dd.0 Request processed in 406099us (406122us total) trans 158913794638 rc 0/0
00000100:00100000:0.0:1651532321.094988:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5887
00010000:00010000:0.0:1651532321.094996:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094999:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006121da6f already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532321.095001:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.095004:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.095008:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.095011:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006121da6f/0xa29a79078f417c1b lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532321.095085:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:1.0:1651532321.095087:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:1.0:1651532321.095091:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.095096:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.095120:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000faaf3d99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754469132992:12345-10.240.43.64@tcp:4:dd.0 Request processed in 406955us (407015us total) trans 158913794637 rc 0/0
00000100:00100000:1.0:1651532321.095125:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5885
00010000:00010000:1.0:1651532321.095135:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.095139:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532321.095140:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.095143:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.095149:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.095151:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c0d lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.131004:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.131022:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469134144
00000100:00100000:1.0:1651532321.131057:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5888
00000100:00100000:1.0:1651532321.131059:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049d48527 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469134144:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532321.131076:0:330058:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 2097152, mtime: 0x62706220, atime: 0x0, ctime: 0x62706220, blocks: 0x1000
00010000:00010000:1.0:1651532321.131079:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c22 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.131084:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.131085:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.131087:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c22 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.131095:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c22 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.132432:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.132453:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469134400
00000100:00100000:0.0:1651532321.132481:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5889
00000100:00100000:0.0:1651532321.132495:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a3e2cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469134400:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532321.132519:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00010000:0.0:1651532321.132529:0:330282:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 2097152, mtime: 0x62706220, atime: 0x0, ctime: 0x62706220, blocks: 0x1000
00010000:00010000:0.0:1651532321.132532:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c29 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.132537:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.132538:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.132539:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c29 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.132555:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c29 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.132676:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469134464
00000100:00100000:1.0:1651532321.132690:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5890
00000100:00100000:1.0:1651532321.132692:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c116b93f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469134464:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532321.132700:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417c30 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.132705:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.132705:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.132706:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417c30 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.132710:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417c30 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.353461:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794641 is committed
00002000:00010000:1.0:1651532321.353510:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:1.0:1651532321.353512:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb mtime from disk: 1651532320 -> 1651532321
00002000:00010000:1.0:1651532321.353513:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb ctime from disk: 1651532320 -> 1651532321
00002000:00010000:1.0:1651532321.353514:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 4096 -> 8192
00002000:00010000:0.0:1651532321.353517:0:330282:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 2097152 -> 4194304
00010000:00010000:1.0:1651532321.353520:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417c30 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532321.353520:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb mtime from disk: 1651532320 -> 1651532321
00002000:00010000:0.0:1651532321.353521:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb ctime from disk: 1651532320 -> 1651532321
00002000:00010000:0.0:1651532321.353522:0:330282:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 4096 -> 8192
00010000:00010000:0.0:1651532321.353526:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c29 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353530:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417c30 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353531:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c29 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.353573:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c116b93f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469134464:12345-10.240.43.64@tcp:4:dd.0 Request processed in 220878us (221052us total) trans 158913794640 rc 0/0
00000100:00100000:0.0:1651532321.353573:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a3e2cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469134400:12345-10.240.43.64@tcp:4:dd.0 Request processed in 221076us (221140us total) trans 158913794641 rc 0/0
00000100:00100000:1.0:1651532321.353578:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5890
00000100:00100000:0.0:1651532321.353581:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5889
00010000:00010000:0.0:1651532321.353595:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417c30 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353599:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042a9b21c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532321.353600:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417c30 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353604:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417c30 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353617:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417c30 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353620:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042a9b21c/0xa29a79078f417c30 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353622:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c22 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353624:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c29 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353626:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c22 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353627:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532321.353628:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c29 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353631:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c29 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353634:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c29 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353637:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c29 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.353640:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049d48527 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469134144:12345-10.240.43.64@tcp:4:dd.0 Request processed in 222580us (222638us total) trans 158913794639 rc 0/0
00010000:00010000:0.0:1651532321.353641:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c22 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.353643:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5888
00010000:00010000:0.0:1651532321.353644:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fa60b9cc already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532321.353645:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c22 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353648:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c22 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353651:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c22 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353654:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60b9cc/0xa29a79078f417c22 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.389925:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.389951:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469134848
00000100:00100000:1.0:1651532321.389973:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5891
00000100:00100000:1.0:1651532321.389976:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c8e2ea52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469134848:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532321.389991:0:330058:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 4194304, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x2000
00010000:00010000:1.0:1651532321.389994:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417c37 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.389999:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.390000:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.390003:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417c37 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.390011:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417c37 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.391380:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.391389:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.391406:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469135296
00000100:00100000:1.0:1651532321.391421:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469135232
00000100:00100000:1.0:1651532321.391432:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5892
00000100:00100000:1.0:1651532321.391435:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d8c99a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469135296:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532321.391453:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c3e lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.391458:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.391459:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.391459:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c3e lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.391463:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c3e lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.391620:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5893
00000100:00100000:0.0:1651532321.391622:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f6ca81c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469135232:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532321.391637:0:330278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 4194304, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x2000
00010000:00010000:0.0:1651532321.391639:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c45 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.391644:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.391645:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.391646:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c45 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.391650:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c45 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.613056:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794644 is committed
00002000:00010000:1.0:1651532321.613100:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 4194304 -> 6291456
00002000:00010000:1.0:1651532321.613102:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 8192 -> 12288
00010000:00010000:1.0:1651532321.613108:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c3e lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532321.613110:0:330278:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 4194304 -> 6291456
00002000:00010000:0.0:1651532321.613112:0:330278:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 8192 -> 12288
00010000:00010000:1.0:1651532321.613114:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c3e lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613116:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c45 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613121:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c45 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.613150:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d8c99a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469135296:12345-10.240.43.64@tcp:4:dd.0 Request processed in 221712us (221769us total) trans 158913794643 rc 0/0
00000100:00100000:0.0:1651532321.613150:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f6ca81c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469135232:12345-10.240.43.64@tcp:4:dd.0 Request processed in 221526us (221759us total) trans 158913794644 rc 0/0
00000100:00100000:0.0:1651532321.613155:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5893
00000100:00100000:1.0:1651532321.613159:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5892
00010000:00010000:1.0:1651532321.613170:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c3e lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613170:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c45 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613174:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532321.613174:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532321.613176:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c3e lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613176:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c45 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613179:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c3e lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613179:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c45 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613188:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c3e lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613188:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c45 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613191:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c3e lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613191:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c45 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613224:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417c37 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613227:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417c37 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613245:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417c37 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613253:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054c6cc1e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532321.613254:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417c37 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.613255:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c8e2ea52 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469134848:12345-10.240.43.64@tcp:4:dd.0 Request processed in 223279us (223331us total) trans 158913794642 rc 0/0
00010000:00010000:0.0:1651532321.613258:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417c37 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.613261:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5891
00010000:00010000:0.0:1651532321.613263:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417c37 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613265:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6cc1e/0xa29a79078f417c37 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.650050:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.650065:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.650076:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469135552
00000100:00100000:1.0:1651532321.650099:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469135616
00000100:00100000:1.0:1651532321.650106:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5894
00000100:00100000:1.0:1651532321.650109:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033a0a20a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469135552:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532321.650113:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5895
00000100:00100000:0.0:1651532321.650116:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079f174de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469135616:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532321.650123:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 6291456, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x3000
00010000:00010000:1.0:1651532321.650125:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c4c lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532321.650127:0:330278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 6291456, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x3000
00010000:00010000:0.0:1651532321.650129:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c53 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.650130:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.650131:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.650134:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c4c lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.650134:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.650134:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.650135:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c53 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.650139:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c4c lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.650139:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c53 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.651093:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.651104:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.651113:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469136064
00000100:00100000:1.0:1651532321.651124:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469136128
00000100:00100000:1.0:1651532321.651131:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5896
00000100:00100000:1.0:1651532321.651133:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bd0b9c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469136064:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532321.651155:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c5a lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.651160:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.651161:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.651162:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c5a lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.651169:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c5a lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.651366:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5897
00000100:00100000:1.0:1651532321.651368:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000976c2f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469136128:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532321.651376:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417c61 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.651380:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.651381:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.651382:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417c61 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.651385:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417c61 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.936817:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794648 is committed
00002000:00010000:1.0:1651532321.936857:0:330059:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 6291456 -> 8388608
00002000:00010000:1.0:1651532321.936859:0:330059:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 12288 -> 16384
00010000:00010000:1.0:1651532321.936864:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417c61 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.936870:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417c61 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936883:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c53 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936889:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c53 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.936907:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000976c2f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469136128:12345-10.240.43.64@tcp:4:dd.0 Request processed in 285537us (285802us total) trans 158913794648 rc 0/0
00000100:00100000:1.0:1651532321.936915:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5897
00000100:00100000:0.0:1651532321.936917:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079f174de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469135616:12345-10.240.43.64@tcp:4:dd.0 Request processed in 286800us (286850us total) trans 158913794646 rc 0/0
00000100:00100000:0.0:1651532321.936921:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5895
00010000:00010000:0.0:1651532321.936931:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417c61 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936935:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000187bb4a8 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532321.936936:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417c61 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936940:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417c61 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936949:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417c61 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936952:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187bb4a8/0xa29a79078f417c61 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532321.936953:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 6291456 -> 8388608
00002000:00010000:1.0:1651532321.936954:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 12288 -> 16384
00010000:00010000:0.0:1651532321.936956:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c53 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.936957:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c4c lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936958:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532321.936959:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c53 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.936960:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c4c lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936962:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c53 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936966:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c53 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936968:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c53 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936973:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c4c lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.936974:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033a0a20a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469135552:12345-10.240.43.64@tcp:4:dd.0 Request processed in 286864us (286925us total) trans 158913794645 rc 0/0
00010000:00010000:0.0:1651532321.936975:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a000b3c already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532321.936976:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c4c lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.936977:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5894
00010000:00010000:0.0:1651532321.936979:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c4c lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936982:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c4c lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.936985:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a000b3c/0xa29a79078f417c4c lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.936999:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c5a lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.937003:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c5a lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.937014:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bd0b9c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469136064:12345-10.240.43.64@tcp:4:dd.0 Request processed in 285880us (285922us total) trans 158913794647 rc 0/0
00000100:00100000:1.0:1651532321.937017:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5896
00010000:00010000:1.0:1651532321.937022:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c5a lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.937025:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532321.937027:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c5a lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.937030:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c5a lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.937061:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c5a lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.937065:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c5a lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.986105:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.986116:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.986125:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469136576
00000100:00100000:1.0:1651532321.986149:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469136640
00000100:00100000:1.0:1651532321.986155:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5898
00000100:00100000:1.0:1651532321.986158:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008606a51b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469136576:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532321.986163:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5899
00000100:00100000:0.0:1651532321.986166:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e92dd067 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469136640:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532321.986172:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 8388608, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x4000
00010000:00010000:1.0:1651532321.986174:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c68 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532321.986178:0:330278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 8388608, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x4000
00010000:00010000:1.0:1651532321.986180:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.986181:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.986181:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c6f lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.986183:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c68 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.986185:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.986186:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.986187:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c6f lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.986188:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c68 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.986191:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c6f lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532322.216113:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794650 is committed
00002000:00010000:1.0:1651532322.216173:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 8388608 -> 10485760
00002000:00010000:0.0:1651532322.216173:0:330278:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 8388608 -> 10485760
00002000:00010000:1.0:1651532322.216175:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 16384 -> 20480
00002000:00010000:0.0:1651532322.216176:0:330278:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 16384 -> 20480
00010000:00010000:1.0:1651532322.216183:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c68 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216183:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c6f lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.216189:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c68 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216189:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c6f lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.216230:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008606a51b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469136576:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230069us (230123us total) trans 158913794649 rc 0/0
00000100:00100000:0.0:1651532322.216230:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e92dd067 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469136640:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230061us (230112us total) trans 158913794650 rc 0/0
00000100:00100000:1.0:1651532322.216235:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5898
00000100:00100000:0.0:1651532322.216237:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5899
00010000:00010000:0.0:1651532322.216250:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c68 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216254:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000afe85794 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532322.216256:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c68 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216260:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c68 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216270:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c68 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216273:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afe85794/0xa29a79078f417c68 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216278:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c6f lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216281:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532322.216282:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c6f lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216285:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c6f lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216289:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c6f lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216291:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c6f lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.253027:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532322.253042:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532322.253052:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469137152
00000100:00100000:0.0:1651532322.253052:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469137088
00000100:00100000:1.0:1651532322.253073:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5900
00000100:00100000:1.0:1651532322.253081:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c384dac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469137152:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532322.253081:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5901
00000100:00100000:0.0:1651532322.253083:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a453e9c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469137088:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532322.253096:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 10485760, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x5000
00002000:00010000:0.0:1651532322.253096:0:330278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 10485760, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x5000
00010000:00010000:1.0:1651532322.253098:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c7d lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.253098:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c76 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.253104:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.253104:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.253105:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.253105:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.253107:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c7d lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.253107:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c76 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.253112:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c7d lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.253112:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c76 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.254312:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532322.254326:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532322.254341:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469137728
00000100:00100000:0.0:1651532322.254352:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469137664
00000100:00100000:0.0:1651532322.254359:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5902
00000100:00100000:0.0:1651532322.254361:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4bc26d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469137728:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532322.254369:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417c84 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.254374:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.254375:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.254376:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417c84 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.254391:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417c84 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.254425:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5903
00000100:00100000:1.0:1651532322.254427:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e8844fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469137664:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532322.254436:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417c8b lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.254455:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.254455:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.254456:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417c8b lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.254469:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417c8b lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532322.561998:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794654 is committed
00002000:00010000:1.0:1651532322.562040:0:330059:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 10485760 -> 12582912
00002000:00010000:1.0:1651532322.562042:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb mtime from disk: 1651532321 -> 1651532322
00002000:00010000:1.0:1651532322.562043:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb ctime from disk: 1651532321 -> 1651532322
00002000:00010000:1.0:1651532322.562044:0:330059:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 20480 -> 24576
00002000:00010000:0.0:1651532322.562045:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 10485760 -> 12582912
00002000:00010000:0.0:1651532322.562048:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb mtime from disk: 1651532321 -> 1651532322
00002000:00010000:0.0:1651532322.562049:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb ctime from disk: 1651532321 -> 1651532322
00010000:00010000:1.0:1651532322.562050:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417c8b lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532322.562050:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 20480 -> 24576
00010000:00010000:0.0:1651532322.562053:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417c84 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562056:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417c8b lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.562058:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417c84 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.562101:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e8844fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469137664:12345-10.240.43.64@tcp:4:dd.0 Request processed in 307671us (307772us total) trans 158913794653 rc 0/0
00000100:00100000:0.0:1651532322.562104:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4bc26d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469137728:12345-10.240.43.64@tcp:4:dd.0 Request processed in 307741us (307791us total) trans 158913794654 rc 0/0
00000100:00100000:1.0:1651532322.562109:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5903
00000100:00100000:0.0:1651532322.562111:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5902
00010000:00010000:1.0:1651532322.562126:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417c8b lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562130:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532322.562131:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417c8b lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562135:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417c8b lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562145:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417c8b lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562148:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417c8b lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.562151:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c7d lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562152:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417c84 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.562155:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c7d lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562159:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532322.562160:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417c84 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562163:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417c84 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562167:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417c84 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562170:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417c84 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.562170:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c384dac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469137152:12345-10.240.43.64@tcp:4:dd.0 Request processed in 309089us (309128us total) trans 158913794651 rc 0/0
00010000:00010000:1.0:1651532322.562173:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c7d lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.562173:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5900
00010000:00010000:1.0:1651532322.562175:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532322.562176:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c7d lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562179:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c7d lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562182:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c7d lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.562184:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c7d lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.562206:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c76 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.562210:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c76 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.562222:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a453e9c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469137088:12345-10.240.43.64@tcp:4:dd.0 Request processed in 309139us (309196us total) trans 158913794652 rc 0/0
00000100:00100000:0.0:1651532322.562225:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5901
00010000:00010000:0.0:1651532322.562231:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c76 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.562234:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532322.562235:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c76 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.562238:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c76 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.562244:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c76 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.562247:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c76 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.639091:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532322.639104:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532322.639115:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469137984
00000100:00100000:0.0:1651532322.639138:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469138048
00000100:00100000:0.0:1651532322.639145:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5904
00000100:00100000:0.0:1651532322.639148:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1589f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469137984:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532322.639153:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5905
00000100:00100000:1.0:1651532322.639156:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6777fde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469138048:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532322.639165:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 12582912, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x6000
00002000:00010000:1.0:1651532322.639167:0:330059:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 12582912, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x6000
00010000:00010000:0.0:1651532322.639167:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c92 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.639169:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c99 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.639173:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.639174:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.639176:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.639176:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c92 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.639177:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.639178:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c99 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.639181:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c92 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.639182:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c99 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532322.869354:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794656 is committed
00002000:00010000:0.0:1651532322.869412:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 12582912 -> 14680064
00002000:00010000:0.0:1651532322.869415:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 24576 -> 28672
00002000:00010000:1.0:1651532322.869422:0:330059:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 12582912 -> 14680064
00010000:00010000:0.0:1651532322.869422:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c92 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532322.869423:0:330059:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 24576 -> 28672
00010000:00010000:1.0:1651532322.869427:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c99 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869428:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c92 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.869432:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c99 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.869484:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6777fde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469138048:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230326us (230378us total) trans 158913794655 rc 0/0
00000100:00100000:0.0:1651532322.869484:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1589f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469137984:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230334us (230393us total) trans 158913794656 rc 0/0
00000100:00100000:1.0:1651532322.869490:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5905
00000100:00100000:0.0:1651532322.869492:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5904
00010000:00010000:1.0:1651532322.869504:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c92 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869504:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c99 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.869508:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532322.869508:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fea6e5f already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532322.869510:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c92 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869510:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c99 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869514:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c99 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.869516:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c92 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.869523:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c92 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869523:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c99 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.869526:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417c92 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869526:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fea6e5f/0xa29a79078f417c99 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.905987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532322.905998:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469138496
00000100:00100000:1.0:1651532322.906024:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5906
00000100:00100000:1.0:1651532322.906026:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c056c75b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469138496:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532322.906041:0:330059:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 14680064, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x7000
00010000:00010000:1.0:1651532322.906044:0:330059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417ca0 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.906049:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.906050:0:330059:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.906052:0:330059:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417ca0 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.906057:0:330059:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417ca0 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.907535:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532322.907563:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469138752
00000100:00100000:0.0:1651532322.907588:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5907
00000100:00100000:0.0:1651532322.907590:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4682a5a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469138752:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532322.907602:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 14680064, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x7000
00010000:00010000:0.0:1651532322.907604:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417ca7 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.907609:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.907610:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.907611:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417ca7 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.907615:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417ca7 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.907646:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532322.907881:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469138816
00000100:00100000:1.0:1651532322.907898:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5908
00000100:00100000:1.0:1651532322.907900:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075edc75d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469138816:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532322.907909:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cae lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.907914:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.907915:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.907916:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cae lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.907920:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cae lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532323.142789:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794659 is committed
00002000:00010000:1.0:1651532323.142855:0:330059:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 14680064 -> 16777216
00002000:00010000:0.0:1651532323.142855:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 14680064 -> 16777216
00002000:00010000:1.0:1651532323.142857:0:330059:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 28672 -> 32768
00002000:00010000:0.0:1651532323.142858:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 28672 -> 32768
00010000:00010000:1.0:1651532323.142863:0:330059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417ca0 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142863:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417ca7 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142869:0:330059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417ca0 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142869:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417ca7 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532323.142910:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4682a5a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469138752:12345-10.240.43.64@tcp:4:dd.0 Request processed in 235317us (235373us total) trans 158913794658 rc 0/0
00000100:00100000:1.0:1651532323.142913:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c056c75b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469138496:12345-10.240.43.64@tcp:4:dd.0 Request processed in 236885us (236926us total) trans 158913794657 rc 0/0
00000100:00100000:0.0:1651532323.142915:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5907
00000100:00100000:1.0:1651532323.142917:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5906
00010000:00010000:1.0:1651532323.142930:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417ca0 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142930:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417ca7 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142934:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532323.142935:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417ca7 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142937:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532323.142938:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417ca0 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142939:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417ca7 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142941:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417ca0 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142948:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417ca0 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142948:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417ca7 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142951:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417ca0 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330059 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142951:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417ca7 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142973:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cae lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142977:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cae lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532323.142991:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075edc75d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469138816:12345-10.240.43.64@tcp:4:dd.0 Request processed in 235090us (235346us total) trans 158913794659 rc 0/0
00000100:00100000:1.0:1651532323.142994:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5908
00010000:00010000:1.0:1651532323.143000:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cae lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.143027:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027a45845 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532323.143033:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cae lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.143037:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cae lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.143042:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cae lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.143044:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cae lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532323.335199:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532323.335214:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532323.335232:0:323276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469139584
00000100:00100000:0.0:1651532323.335252:0:323275:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469139712
00000100:00100000:1.0:1651532323.335262:0:323276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6858
00000100:00100000:1.0:1651532323.335264:0:323276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000102a9960 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469139584:12345-10.240.43.64@tcp:101:dd.0
00000100:00100000:0.0:1651532323.335275:0:323275:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6859
00000100:00100000:0.0:1651532323.335277:0:323275:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000038f5cf9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469139712:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532323.335280:0:323276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532323.335282:0:323275:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532323.335292:0:323276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cbc lrc: 2/0,0 mode: --/PR res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ffbb expref: -99 pid: 323276 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.335292:0:323275:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cb5 lrc: 2/0,0 mode: --/PR res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ffc9 expref: -99 pid: 323275 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532323.335303:0:323276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 16777216, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x8000
00002000:00010000:0.0:1651532323.335303:0:323275:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 16777216, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x8000
00010000:00010000:1.0:1651532323.335312:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532323.335312:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532323.335313:0:323276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532323.335313:0:323275:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532323.335317:0:323276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cbc lrc: 3/0,0 mode: PR/PR res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffbb expref: 9 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532323.335317:0:323275:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cb5 lrc: 3/0,0 mode: PR/PR res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc9 expref: 9 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532323.335324:0:323275:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cb5 lrc: 3/0,0 mode: PR/PR res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc9 expref: 9 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532323.335325:0:323276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cbc lrc: 3/0,0 mode: PR/PR res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffbb expref: 9 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532323.335330:0:323275:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036ef374e, rc 0)
00010000:00010000:1.0:1651532323.335332:0:323276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027a45845, rc 0)
00000100:00100000:1.0:1651532323.335356:0:323276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000102a9960 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469139584:12345-10.240.43.64@tcp:101:dd.0 Request processed in 91us (160us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532323.335360:0:323276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6858
00000100:00100000:0.0:1651532323.335361:0:323275:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000038f5cf9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469139712:12345-10.240.43.64@tcp:101:dd.0 Request processed in 83us (146us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532323.335365:0:323275:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6859
00000100:00100000:1.0:1651532323.339028:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532323.339040:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532323.339056:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469139968
00000100:00100000:0.0:1651532323.339061:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140032
00000100:00100000:1.0:1651532323.339075:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5909
00000100:00100000:1.0:1651532323.339077:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1c5bb37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469139968:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:0.0:1651532323.339078:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5910
00000100:00100000:0.0:1651532323.339080:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022a5d10d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140032:12345-10.240.43.64@tcp:3:dd.0
00000020:02000000:1.0:1651532323.339083:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000020:02000000:0.0:1651532323.339085:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:1.0:1651532323.339099:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1c5bb37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469139968:12345-10.240.43.64@tcp:3:dd.0 Request processed in 22us (73us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532323.339103:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5909
00000100:00100000:0.0:1651532323.339105:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022a5d10d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140032:12345-10.240.43.64@tcp:3:dd.0 Request processed in 24us (65us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532323.339109:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5910
00000100:00100000:1.0:1651532324.352877:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532324.352889:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532324.352902:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140416
00000100:00100000:0.0:1651532324.352907:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140352
00000100:00100000:1.0:1651532324.352917:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5911
00000100:00100000:1.0:1651532324.352919:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088506543 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140416:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000100:00100000:0.0:1651532324.352929:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5912
00000020:02000000:1.0:1651532324.352931:0:330058:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:0.0:1651532324.352931:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031971791 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140352:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000020:02000000:0.0:1651532324.352936:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:1.0:1651532324.352947:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088506543 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140416:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 27us (71us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532324.352951:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5911
00000100:00100000:0.0:1651532324.352954:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031971791 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469140352:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 23us (65us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532324.352958:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5912
00000100:00100000:1.0:1651532325.088172:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532325.088197:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241984
00000100:00100000:0.0:1651532325.088212:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 102
00000100:00100000:0.0:1651532325.088214:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cde87c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241984:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532325.088225:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532325.088245:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cde87c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241984:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 30us (74us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532325.088248:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 102
00000100:00100000:1.0:1651532326.400888:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532326.400903:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532326.400912:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140544
00000100:00100000:0.0:1651532326.400912:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140480
00000100:00100000:1.0:1651532326.400932:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5913
00000100:00100000:1.0:1651532326.400934:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cf9fa32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140544:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000100:00100000:0.0:1651532326.400936:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5914
00000100:00100000:0.0:1651532326.400938:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdabe54f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140480:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000020:02000000:1.0:1651532326.400940:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000020:02000000:0.0:1651532326.400943:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:1.0:1651532326.400952:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cf9fa32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140544:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 17us (66us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532326.400954:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdabe54f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140480:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 16us (51us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532326.400955:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5913
00000100:00100000:0.0:1651532326.400957:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5914
00000100:00100000:1.0:1651532326.588878:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1651532326.588887:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048d9c348 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966866880:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532326.589121:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048d9c348 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966866880:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532329.408873:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532329.408883:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532329.408890:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140672
00000100:00100000:1.0:1651532329.408908:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140608
00000100:00100000:1.0:1651532329.408915:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5915
00000100:00100000:1.0:1651532329.408917:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000048d9c348 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140672:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000020:02000000:1.0:1651532329.408923:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:0.0:1651532329.408924:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5916
00000100:00100000:0.0:1651532329.408927:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0aa0144 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140608:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000100:00100000:1.0:1651532329.408934:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000048d9c348 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140672:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 16us (63us total) trans 0 rc -5/-5
00000020:02000000:0.0:1651532329.408934:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:1.0:1651532329.408937:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5915
00000100:00100000:0.0:1651532329.408945:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0aa0144 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469140608:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 18us (62us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532329.408948:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5916
00000100:00100000:1.0:1651532330.208121:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532330.208146:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242304
00000100:00100000:0.0:1651532330.208160:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 103
00000100:00100000:0.0:1651532330.208163:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f98cc2d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242304:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532330.208171:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532330.208187:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f98cc2d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242304:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 24us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532330.208191:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 103
00000100:00100000:1.0:1651532333.440868:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532333.440883:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532333.440891:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140736
00000100:00100000:0.0:1651532333.440891:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140800
00000100:00100000:1.0:1651532333.440910:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5917
00000100:00100000:1.0:1651532333.440913:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000485dc0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140736:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000100:00100000:0.0:1651532333.440914:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5918
00000100:00100000:0.0:1651532333.440916:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b287abd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140800:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000020:02000000:1.0:1651532333.440918:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000020:02000000:0.0:1651532333.440921:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:1.0:1651532333.440929:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000485dc0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140736:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 16us (46us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532333.440932:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b287abd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140800:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 16us (65us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532333.440933:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5917
00000100:00100000:0.0:1651532333.440936:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5918
00000100:00100000:1.0:1651532335.328145:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532335.328167:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242432
00000100:00100000:0.0:1651532335.328182:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 104
00000100:00100000:0.0:1651532335.328185:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc18c644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951242432:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532335.328193:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532335.328208:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc18c644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951242432:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532335.328211:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 104
00000100:00100000:1.0:1651532338.496905:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532338.496920:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532338.496929:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140864
00000100:00100000:0.0:1651532338.496929:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140928
00000100:00100000:1.0:1651532338.496949:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5919
00000100:00100000:1.0:1651532338.496951:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084726455 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140864:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000100:00100000:0.0:1651532338.496953:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5920
00000100:00100000:0.0:1651532338.496955:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c66dc916 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140928:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000020:02000000:1.0:1651532338.496957:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000020:02000000:0.0:1651532338.496960:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:1.0:1651532338.496968:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084726455 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140864:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 16us (48us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532338.496971:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c66dc916 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140928:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 16us (68us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532338.496972:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5919
00000100:00100000:0.0:1651532338.496976:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5920
00000100:00100000:1.0:1651532340.448141:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532340.448165:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242560
00000100:00100000:0.0:1651532340.448179:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 105
00000100:00100000:0.0:1651532340.448181:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043cda8c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242560:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532340.448189:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532340.448204:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043cda8c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242560:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 22us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532340.448207:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 105
00000100:00100000:1.0:1651532344.512859:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532344.512873:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532344.512880:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141184
00000100:00100000:1.0:1651532344.512882:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141120
00000100:00100000:0.0:1651532344.512900:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5921
00000100:00100000:0.0:1651532344.512902:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001742bb64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141184:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000100:00100000:1.0:1651532344.512904:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5922
00000100:00100000:1.0:1651532344.512907:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000466c7e35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141120:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000020:02000000:0.0:1651532344.512907:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000020:02000000:1.0:1651532344.512912:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:1.0:1651532344.512923:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000466c7e35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141120:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 16us (50us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532344.512927:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5922
00000100:00100000:0.0:1651532344.515041:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001742bb64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469141184:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 2137us (2182us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532344.515045:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5921
00000100:00100000:1.0:1651532345.020874:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8b8746c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966866944:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532345.021154:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8b8746c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966866944:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532345.568153:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532345.568179:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242624
00000100:00100000:0.0:1651532345.568194:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 106
00000100:00100000:0.0:1651532345.568196:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8b8746c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242624:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532345.568205:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532345.568220:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8b8746c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242624:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532345.568223:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 106
00000100:00100000:1.0:1651532350.688128:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532350.688152:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242880
00000100:00100000:0.0:1651532350.688168:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 107
00000100:00100000:0.0:1651532350.688171:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e53c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242880:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532350.688179:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532350.688193:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e53c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242880:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 22us (66us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532350.688196:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 107
00000100:00100000:1.0:1651532351.552910:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532351.552925:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532351.552934:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141312
00000100:00100000:0.0:1651532351.552935:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141248
00000100:00100000:1.0:1651532351.552955:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5923
00000100:00100000:1.0:1651532351.552958:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e9fbb787 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141312:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000100:00100000:0.0:1651532351.552959:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5924
00000100:00100000:0.0:1651532351.552961:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022b783d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141248:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000020:02000000:1.0:1651532351.552963:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000020:02000000:0.0:1651532351.552966:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:1.0:1651532351.552978:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e9fbb787 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141312:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 20us (69us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532351.552981:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5923
00000100:00100000:0.0:1651532351.552983:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022b783d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141248:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 22us (58us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532351.552987:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5924
00000100:00100000:1.0:1651532352.188868:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1651532352.188874:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ac87df7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966867008:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532352.189151:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ac87df7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966867008:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532355.808148:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532355.808173:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243072
00000100:00100000:0.0:1651532355.808188:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 108
00000100:00100000:0.0:1651532355.808191:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ac87df7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243072:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532355.808199:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532355.808212:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ac87df7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243072:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 21us (66us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532355.808215:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 108
00000100:00100000:1.0:1651532359.872900:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532359.872915:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532359.872924:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141440
00000100:00100000:0.0:1651532359.872925:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141504
00000100:00100000:1.0:1651532359.872945:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5925
00000100:00100000:1.0:1651532359.872947:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bd657137 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141440:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000100:00100000:0.0:1651532359.872949:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5926
00000100:00100000:0.0:1651532359.872951:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000855da1de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141504:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000020:02000000:1.0:1651532359.872953:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000020:02000000:0.0:1651532359.872957:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:1.0:1651532359.872968:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bd657137 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141440:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 20us (70us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532359.872974:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5925
00000100:00100000:0.0:1651532359.872975:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000855da1de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141504:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 23us (60us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532359.872980:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5926
00000100:00100000:1.0:1651532360.928112:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532360.928136:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243136
00000100:00100000:0.0:1651532360.928150:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 109
00000100:00100000:0.0:1651532360.928152:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b481ef1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243136:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532360.928161:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532360.928176:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b481ef1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243136:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 23us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532360.928179:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 109
00000100:00100000:1.0:1651532366.048112:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532366.048134:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243328
00000100:00100000:0.0:1651532366.048149:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 110
00000100:00100000:0.0:1651532366.048151:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017088a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243328:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532366.048159:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532366.048174:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017088a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243328:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 22us (63us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532366.048177:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 110
00000100:00100000:1.0:1651532369.088897:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532369.088922:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532369.088922:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141568
00000100:00100000:1.0:1651532369.088932:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141632
00000100:00100000:0.0:1651532369.088939:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5927
00000100:00100000:0.0:1651532369.088941:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0bc1f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141568:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000020:02000000:0.0:1651532369.088946:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:1.0:1651532369.088950:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5928
00000100:00100000:1.0:1651532369.088953:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7c4e69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141632:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000100:00100000:0.0:1651532369.088961:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0bc1f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141568:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 19us (65us total) trans 0 rc -5/-5
00000020:02000000:1.0:1651532369.088963:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:0.0:1651532369.088964:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5927
00000100:00100000:1.0:1651532369.088974:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7c4e69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469141632:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 20us (52us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532369.088977:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5928
00000100:00100000:1.0:1651532370.620865:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dbc99d0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966867072:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532370.621152:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dbc99d0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:39027:1731745966867072:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532371.168127:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532371.168152:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243456
00000100:00100000:0.0:1651532371.168167:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 111
00000100:00100000:0.0:1651532371.168169:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbc99d0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243456:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532371.168177:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532371.168190:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbc99d0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243456:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 21us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532371.168193:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 111
00000100:00100000:1.0:1651532376.288118:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532376.288141:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243648
00000100:00100000:0.0:1651532376.288156:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 112
00000100:00100000:0.0:1651532376.288158:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6830ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243648:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532376.288165:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355061440 pending 0 free 81147236352 avail 76976525312
00000100:00100000:0.0:1651532376.288179:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6830ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243648:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 21us (63us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532376.288182:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 112
00000100:00100000:1.0:1651532376.764855:0:39027:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1651532376.764861:0:39027:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d156f222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966867136:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532376.765138:0:39027:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d156f222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4117a37c-db10-4766-b60a-8aa6e5558d6b:39027:1731745966867136:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532379.328954:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.328964:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.328978:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141824
00000100:00100000:0.0:1651532379.328987:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141888
00000100:00100000:1.0:1651532379.328994:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5929
00000100:00100000:1.0:1651532379.328997:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d156f222 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141824:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000020:02000000:1.0:1651532379.329003:0:330059:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:0.0:1651532379.329007:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5930
00000100:00100000:0.0:1651532379.329009:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f539cb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141888:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0
00000100:00100000:1.0:1651532379.329016:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d156f222 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469141824:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 19us (64us total) trans 0 rc -5/-5
00000100:00100000:1.0:1651532379.329020:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5929
00000020:02000000:0.0:1651532379.329020:0:330058:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20f, val=0***
00000100:00100000:0.0:1651532379.329031:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f539cb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469141888:12345-10.240.43.64@tcp:3:ptlrpcd_01_00.0 Request processed in 21us (66us total) trans 0 rc -5/-5
00000100:00100000:0.0:1651532379.329034:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5930
00000100:00100000:1.0:1651532379.528058:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.529706:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469142784
00000100:00100000:0.0:1651532379.529729:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6860
00000100:00100000:0.0:1651532379.529732:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000754afd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:687639:x1731754469142784:12345-10.240.43.64@tcp:101:bash.0
00010000:00010000:0.0:1651532379.529741:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532379.529752:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 2/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ffec expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.529772:0:323273:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cbc lrc: 2/0,0 mode: PR/PR res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffbb expref: 9 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532379.529776:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.529777:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.529779:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 4/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 9 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.529793:0:323273:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cbc lrc: 3/0,0 mode: PR/PR res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffbb expref: 9 pid: 323276 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532379.529798:0:323273:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cbc lrc: 4/0,0 mode: PR/PR res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffbb expref: 9 pid: 323276 timeout: 16129 lvb_type: 1
00000100:00100000:0.0:1651532379.529819:0:323273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f85bb724 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966867200:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532379.529848:0:323273:0:(client.c:2492:ptlrpc_set_wait()) set 000000007aba71a1 going to sleep for 6 seconds
00000100:00100000:0.0:1651532379.532449:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.532466:0:323273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f85bb724 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966867200:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532379.532485:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 3/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 9 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.532493:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000e522113, rc 0)
00000100:00100000:0.0:1651532379.532507:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000754afd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:687639:x1731754469142784:12345-10.240.43.64@tcp:101:bash.0 Request processed in 2774us (4451us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532379.532511:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6860
00000100:00100000:0.0:1651532379.532522:0:330056:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469142848
00010000:00010000:0.0:1651532379.532529:0:330056:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cbc lrc: 4/0,0 mode: PR/PR res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffbb expref: 9 pid: 323276 timeout: 16129 lvb_type: 1
00000100:00100000:0.0:1651532379.532538:0:330056:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 328
00000100:00100000:0.0:1651532379.532540:0:330056:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a53775d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469142848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651532379.532544:0:330056:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532379.532546:0:330056:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cbc lrc: 4/0,0 mode: PR/PR res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffbb expref: 9 pid: 323276 timeout: 16129 lvb_type: 1
00010000:00010000:0.0:1651532379.532550:0:330056:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cbc lrc: 3/0,0 mode: PR/PR res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffbb expref: 9 pid: 323276 timeout: 16129 lvb_type: 1
00010000:00010000:0.0:1651532379.532567:0:330056:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a45845/0xa29a79078f417cbc lrc: 0/0,0 mode: --/PR res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffbb expref: 9 pid: 323276 timeout: 16129 lvb_type: 1
00010000:00010000:0.0:1651532379.532572:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.532573:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.532574:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 8 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.532578:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 8 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.532588:0:330056:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 8 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532379.532592:0:330056:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f066994 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:330056:1731745966867264:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651532379.532602:0:330056:0:(client.c:2492:ptlrpc_set_wait()) set 000000007aba71a1 going to sleep for 6 seconds
00000100:00100000:0.0:1651532379.532857:0:330056:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f066994 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:330056:1731745966867264:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651532379.532863:0:330056:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532379.532872:0:330056:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a53775d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469142848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 331us (424us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532379.532876:0:330056:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 328
00000100:00100000:0.0:1651532379.533865:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.533873:0:323273:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143040
00000100:00100000:0.0:1651532379.533882:0:323273:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6861
00000100:00100000:0.0:1651532379.533884:0:323273:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f066994 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:687639:x1731754469143040:12345-10.240.43.64@tcp:101:bash.0
00010000:00010000:0.0:1651532379.533888:0:323273:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532379.533893:0:323273:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 2/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fffa expref: -99 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.533901:0:323273:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cb5 lrc: 2/0,0 mode: PR/PR res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc9 expref: 9 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532379.533905:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.533905:0:323273:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.533906:0:323273:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 4/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 9 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.533914:0:323273:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cb5 lrc: 3/0,0 mode: PR/PR res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc9 expref: 9 pid: 323275 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532379.533918:0:323273:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cb5 lrc: 4/0,0 mode: PR/PR res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc9 expref: 9 pid: 323275 timeout: 16129 lvb_type: 1
00000100:00100000:0.0:1651532379.533925:0:323273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b3fc6fa1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966867328:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532379.533937:0:323273:0:(client.c:2492:ptlrpc_set_wait()) set 000000007aba71a1 going to sleep for 6 seconds
00000100:00100000:0.0:1651532379.534104:0:323273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b3fc6fa1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:323273:1731745966867328:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532379.534110:0:323273:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 3/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 9 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.534115:0:323273:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ffdbbad6, rc 0)
00000100:00100000:0.0:1651532379.534125:0:323273:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f066994 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:687639:x1731754469143040:12345-10.240.43.64@tcp:101:bash.0 Request processed in 240us (260us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532379.534128:0:323273:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6861
00000100:00100000:0.0:1651532379.534177:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.534185:0:330056:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143104
00010000:00010000:0.0:1651532379.534190:0:330056:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cb5 lrc: 4/0,0 mode: PR/PR res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc9 expref: 9 pid: 323275 timeout: 16129 lvb_type: 1
00000100:00100000:0.0:1651532379.534198:0:330056:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 329
00000100:00100000:0.0:1651532379.534200:0:330056:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3fc6fa1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469143104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651532379.534203:0:330056:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532379.534204:0:330056:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cb5 lrc: 4/0,0 mode: PR/PR res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc9 expref: 9 pid: 323275 timeout: 16129 lvb_type: 1
00010000:00010000:0.0:1651532379.534208:0:330056:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cb5 lrc: 3/0,0 mode: PR/PR res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc9 expref: 9 pid: 323275 timeout: 16129 lvb_type: 1
00010000:00010000:0.0:1651532379.534217:0:330056:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cb5 lrc: 0/0,0 mode: --/PR res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc9 expref: 9 pid: 323275 timeout: 16129 lvb_type: 1
00010000:00010000:0.0:1651532379.534221:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.534222:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.534223:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 8 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.534226:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 8 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.534234:0:330056:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 8 pid: 323273 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532379.534238:0:330056:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f85bb724 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:330056:1731745966867392:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651532379.534249:0:330056:0:(client.c:2492:ptlrpc_set_wait()) set 000000007aba71a1 going to sleep for 6 seconds
00000100:00100000:0.0:1651532379.534437:0:330056:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f85bb724 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:330056:1731745966867392:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651532379.534441:0:330056:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532379.534450:0:330056:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3fc6fa1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469143104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 249us (273us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532379.534453:0:330056:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 329
00000100:00100000:0.0:1651532379.535249:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.535258:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.535273:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143296
00000100:00100000:1.0:1651532379.535280:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143424
00002000:00010000:0.0:1651532379.535281:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216391/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532379.535283:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f85bb724 with x1731754469143296 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532379.535287:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f85bb724.
00002000:00010000:1.0:1651532379.535290:0:330055:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216392/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532379.535291:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000099391ae3 with x1731754469143424 ext(0->18446744073709551615)
00000100:00100000:0.0:1651532379.535295:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5931
00000100:00100000:0.0:1651532379.535297:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f85bb724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469143296:12345-10.240.43.64@tcp:10:bash.0
00002000:00010000:1.0:1651532379.535302:0:330055:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000099391ae3.
00000100:00100000:1.0:1651532379.535310:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5932
00000100:00100000:1.0:1651532379.535312:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099391ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469143424:12345-10.240.43.64@tcp:10:bash.0
00002000:00010000:1.0:1651532379.536896:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 16777216 -> 0
00002000:00010000:0.0:1651532379.536896:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 16777216 -> 0
00002000:00010000:1.0:1651532379.536898:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb mtime from disk: 1651532322 -> 1651532379
00002000:00010000:0.0:1651532379.536898:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb mtime from disk: 1651532322 -> 1651532379
00002000:00010000:1.0:1651532379.536899:0:330055:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532379.536899:0:330058:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532379.536900:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb ctime from disk: 1651532322 -> 1651532379
00002000:00010000:0.0:1651532379.536900:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb ctime from disk: 1651532322 -> 1651532379
00002000:00010000:1.0:1651532379.536901:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 32768 -> 0
00002000:00010000:0.0:1651532379.536901:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 32768 -> 0
00000100:00100000:1.0:1651532379.536915:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099391ae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469143424:12345-10.240.43.64@tcp:10:bash.0 Request processed in 1602us (1656us total) trans 158913794661 rc 0/0
00000100:00100000:0.0:1651532379.536915:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f85bb724 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469143296:12345-10.240.43.64@tcp:10:bash.0 Request processed in 1616us (1666us total) trans 158913794660 rc 0/0
00000100:00100000:0.0:1651532379.536918:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5931
00000100:00100000:1.0:1651532379.536920:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5932
00002000:00010000:0.0:1651532379.536920:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216391/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532379.536921:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f85bb724 with x1731754469143296 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532379.536922:0:330055:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216392/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532379.536923:0:330055:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000099391ae3 with x1731754469143424 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532379.536923:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f85bb724.
00002000:00010000:1.0:1651532379.536925:0:330055:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 0000000099391ae3.
00000100:00100000:1.0:1651532379.727393:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.727406:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.727424:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143680
00002000:00010000:1.0:1651532379.727441:0:330059:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216391/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532379.727443:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002facea99 with x1731754469143680 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532379.727451:0:330059:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002facea99.
00000100:00100000:1.0:1651532379.727460:0:330059:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143808
00002000:00010000:1.0:1651532379.727463:0:330059:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216392/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532379.727464:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f57bc3d5 with x1731754469143808 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532379.727467:0:330059:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f57bc3d5.
00000100:00100000:1.0:1651532379.727485:0:330059:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5933
00000100:00100000:1.0:1651532379.727488:0:330059:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002facea99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469143680:12345-10.240.43.64@tcp:10:dd.0
00000100:00100000:0.0:1651532379.727530:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5934
00000100:00100000:0.0:1651532379.727534:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f57bc3d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469143808:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532379.727548:0:330059:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532379.727549:0:330059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb mtime from disk: 1651532379 -> 1651532379
00002000:00010000:1.0:1651532379.727551:0:330059:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532379.727551:0:330059:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb ctime from disk: 1651532379 -> 1651532379
00002000:00010000:1.0:1651532379.727552:0:330059:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532379.727578:0:330059:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002facea99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469143680:12345-10.240.43.64@tcp:10:dd.0 Request processed in 89us (187us total) trans 158913794662 rc 0/0
00000100:00100000:1.0:1651532379.727582:0:330059:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5933
00002000:00010000:1.0:1651532379.727583:0:330059:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216391/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532379.727584:0:330059:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002facea99 with x1731754469143680 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532379.727584:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532379.727585:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb mtime from disk: 1651532379 -> 1651532379
00002000:00010000:1.0:1651532379.727586:0:330059:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 000000002facea99.
00002000:00010000:0.0:1651532379.727586:0:330058:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532379.727587:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb ctime from disk: 1651532379 -> 1651532379
00002000:00010000:0.0:1651532379.727588:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651532379.727602:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f57bc3d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469143808:12345-10.240.43.64@tcp:10:dd.0 Request processed in 68us (196us total) trans 158913794663 rc 0/0
00000100:00100000:0.0:1651532379.727606:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5934
00002000:00010000:0.0:1651532379.727608:0:330058:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 216392/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532379.727609:0:330058:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f57bc3d5 with x1731754469143808 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532379.727611:0:330058:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req 00000000f57bc3d5.
00000100:00100000:1.0:1651532379.765005:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.765030:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469144064
00000100:00100000:0.0:1651532379.765052:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5935
00000100:00100000:0.0:1651532379.765055:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec5f35ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469144064:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532379.765060:0:330058:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00010000:00010000:0.0:1651532379.765070:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765110:0:330058:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 12 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765115:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532379.765116:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532379.765117:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 4/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765131:0:330058:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 12 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765137:0:330058:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 4/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 12 pid: 323273 timeout: 16129 lvb_type: 0
00000100:00100000:0.0:1651532379.765144:0:330058:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057c4f872 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:330058:1731745966867456:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532379.765146:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.765155:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469144128
00000100:00100000:0.0:1651532379.765167:0:330058:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b8c8ad9f going to sleep for 6 seconds
00000100:00100000:1.0:1651532379.765175:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5936
00000100:00100000:1.0:1651532379.765177:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000016271823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754469144128:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:1.0:1651532379.765181:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00010000:00010000:1.0:1651532379.765188:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765196:0:330055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 13 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765199:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532379.765200:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532379.765201:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 4/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765209:0:330055:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 13 pid: 323273 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765213:0:330055:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 4/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 13 pid: 323273 timeout: 16129 lvb_type: 0
00000100:00100000:1.0:1651532379.765218:0:330055:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000806f35ae pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:330055:1731745966867520:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532379.765230:0:330055:0:(client.c:2492:ptlrpc_set_wait()) set 00000000689a3564 going to sleep for 6 seconds
00000100:00100000:1.0:1651532379.765678:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.765690:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.765691:0:330058:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057c4f872 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:330058:1731745966867456:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532379.765703:0:330055:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000806f35ae pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:330055:1731745966867520:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532379.765705:0:330058:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765709:0:330055:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532379.765715:0:330056:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469144576
00000100:00100000:1.0:1651532379.765721:0:323263:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469144640
00010000:00010000:0.0:1651532379.765721:0:330056:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 4/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 14 pid: 323273 timeout: 16129 lvb_type: 0
00010000:00010000:1.0:1651532379.765727:0:323263:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 4/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 15 pid: 323273 timeout: 16129 lvb_type: 0
00000100:00100000:0.0:1651532379.765735:0:330056:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 330
00000100:00100000:0.0:1651532379.765737:0:330056:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bbacd93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469144576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651532379.765742:0:330056:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532379.765747:0:330056:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 4/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 15 pid: 323273 timeout: 16129 lvb_type: 0
00010000:00010000:0.0:1651532379.765751:0:330056:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 15 pid: 323273 timeout: 16129 lvb_type: 0
00000100:00100000:1.0:1651532379.765756:0:323263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 331
00000100:00100000:1.0:1651532379.765758:0:323263:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8a7d49d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469144640:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651532379.765760:0:330056:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417cc3 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffec expref: 15 pid: 323273 timeout: 16129 lvb_type: 0
00010000:00010000:1.0:1651532379.765762:0:323263:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532379.765765:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.765765:0:330056:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.765766:0:323263:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 4/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 14 pid: 323273 timeout: 16129 lvb_type: 0
00010000:00010000:0.0:1651532379.765766:0:330056:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765770:0:330056:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 4/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765771:0:323263:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 14 pid: 323273 timeout: 16129 lvb_type: 0
00010000:00010000:1.0:1651532379.765778:0:323263:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417cca lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fffa expref: 14 pid: 323273 timeout: 16129 lvb_type: 0
00010000:00010000:0.0:1651532379.765778:0:330056:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532379.765781:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.765782:0:323263:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.765783:0:323263:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765786:0:323263:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 4/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532379.765792:0:330056:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bbacd93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469144576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (115us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532379.765795:0:330056:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 330
00010000:00010000:1.0:1651532379.765799:0:323263:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532379.765816:0:330058:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765820:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532379.765821:0:323263:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8a7d49d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469144640:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 63us (131us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532379.765825:0:323263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 331
00010000:00010000:1.0:1651532379.765836:0:330055:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765842:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532380.104211:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794664 is committed
00002000:00010000:0.0:1651532380.104304:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:0.0:1651532380.104307:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:0.0:1651532380.104314:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.104320:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.104347:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.104353:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532380.104355:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.104365:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec5f35ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469144064:12345-10.240.43.64@tcp:4:dd.0 Request processed in 339307us (339358us total) trans 158913794664 rc 0/0
00000100:00100000:0.0:1651532380.104370:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5935
00010000:00010000:1.0:1651532380.104381:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.104391:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.104394:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417cd1 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532380.145134:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794665 is committed
00002000:00010000:1.0:1651532380.145179:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:1.0:1651532380.145180:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:1.0:1651532380.145184:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145188:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532380.145221:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000016271823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469144128:12345-10.240.43.64@tcp:4:dd.0 Request processed in 380042us (380074us total) trans 158913794665 rc 0/0
00000100:00100000:1.0:1651532380.145225:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5936
00010000:00010000:1.0:1651532380.145235:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145239:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532380.145240:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145243:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145250:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145255:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cd8 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.181987:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532380.182014:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469144960
00000100:00100000:1.0:1651532380.182041:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5937
00000100:00100000:1.0:1651532380.182044:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057c4f872 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469144960:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:1.0:1651532380.182050:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:1.0:1651532380.182064:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 2097152, mtime: 0x6270625b, atime: 0x0, ctime: 0x6270625b, blocks: 0x1000
00010000:00010000:1.0:1651532380.182068:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cdf lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.182080:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.182081:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.182083:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cdf lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.182088:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cdf lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.182119:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532380.182128:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469145024
00000100:00100000:0.0:1651532380.182142:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5938
00000100:00100000:0.0:1651532380.182144:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a77b0a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469145024:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532380.182148:0:330058:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:0.0:1651532380.182157:0:330058:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 2097152, mtime: 0x6270625b, atime: 0x0, ctime: 0x6270625b, blocks: 0x1000
00010000:00010000:0.0:1651532380.182160:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417ce6 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.182166:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.182166:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.182167:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417ce6 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.182172:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417ce6 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532380.520195:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794666 is committed
00002000:00010000:0.0:1651532380.520303:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:0.0:1651532380.520306:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb mtime from disk: 1651532379 -> 1651532380
00002000:00010000:0.0:1651532380.520307:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb ctime from disk: 1651532379 -> 1651532380
00002000:00010000:0.0:1651532380.520308:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 4096 -> 8192
00010000:00010000:0.0:1651532380.520315:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cdf lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.520322:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cdf lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.520362:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057c4f872 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469144960:12345-10.240.43.64@tcp:4:dd.0 Request processed in 338316us (338375us total) trans 158913794666 rc 0/0
00000100:00100000:0.0:1651532380.520367:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5937
00010000:00010000:1.0:1651532380.520370:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cdf lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520377:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532380.520379:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cdf lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520383:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cdf lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520394:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cdf lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520397:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cdf lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532380.559399:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794667 is committed
00002000:00010000:0.0:1651532380.559451:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:0.0:1651532380.559453:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb mtime from disk: 1651532379 -> 1651532380
00002000:00010000:0.0:1651532380.559454:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb ctime from disk: 1651532379 -> 1651532380
00002000:00010000:0.0:1651532380.559455:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 4096 -> 8192
00010000:00010000:0.0:1651532380.559459:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417ce6 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.559464:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417ce6 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.559495:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417ce6 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.559497:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a77b0a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469145024:12345-10.240.43.64@tcp:4:dd.0 Request processed in 377352us (377378us total) trans 158913794667 rc 0/0
00000100:00100000:0.0:1651532380.559501:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5938
00010000:00010000:1.0:1651532380.559502:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532380.559504:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417ce6 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.559506:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417ce6 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.559512:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417ce6 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.559515:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417ce6 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.595962:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532380.595973:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469145472
00000100:00100000:0.0:1651532380.595993:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5939
00000100:00100000:0.0:1651532380.595996:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08b9601 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469145472:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532380.596001:0:330058:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:0.0:1651532380.596014:0:330058:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 4194304, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x2000
00010000:00010000:0.0:1651532380.596016:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417ced lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.596022:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.596023:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.596025:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417ced lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.596031:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417ced lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.596356:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532380.596382:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469145536
00000100:00100000:1.0:1651532380.596417:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5940
00000100:00100000:1.0:1651532380.596420:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000590ca8ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469145536:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:1.0:1651532380.596423:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:1.0:1651532380.596433:0:330278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 4194304, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x2000
00010000:00010000:1.0:1651532380.596436:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cf4 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.596440:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.596441:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.596442:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cf4 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.596446:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cf4 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532380.869050:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794668 is committed
00002000:00010000:0.0:1651532380.869131:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 4194304 -> 6291456
00002000:00010000:0.0:1651532380.869134:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 8192 -> 12288
00010000:00010000:0.0:1651532380.869141:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417ced lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.869148:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417ced lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.869191:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417ced lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.869193:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08b9601 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469145472:12345-10.240.43.64@tcp:4:dd.0 Request processed in 273195us (273230us total) trans 158913794668 rc 0/0
00010000:00010000:1.0:1651532380.869198:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532380.869198:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5939
00010000:00010000:1.0:1651532380.869199:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417ced lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.869204:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417ced lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.869214:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417ced lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.869217:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417ced lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532380.904306:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794669 is committed
00002000:00010000:1.0:1651532380.904340:0:330278:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 4194304 -> 6291456
00002000:00010000:1.0:1651532380.904341:0:330278:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 8192 -> 12288
00010000:00010000:1.0:1651532380.904345:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cf4 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.904349:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cf4 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532380.904377:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000590ca8ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469145536:12345-10.240.43.64@tcp:4:dd.0 Request processed in 307956us (308021us total) trans 158913794669 rc 0/0
00000100:00100000:1.0:1651532380.904382:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5940
00010000:00010000:1.0:1651532380.904391:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cf4 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.904394:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532380.904395:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cf4 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.904398:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cf4 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.904404:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cf4 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.904407:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cf4 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.940924:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532380.940951:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469145984
00000100:00100000:1.0:1651532380.940977:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5941
00000100:00100000:1.0:1651532380.940980:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005911588d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469145984:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:1.0:1651532380.940985:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:1.0:1651532380.940997:0:330278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 6291456, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x3000
00010000:00010000:1.0:1651532380.941000:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cfb lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.941006:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.941007:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.941010:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cfb lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.941018:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cfb lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.941054:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532380.941062:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469146048
00000100:00100000:0.0:1651532380.941075:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5942
00000100:00100000:0.0:1651532380.941077:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000921d0471 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469146048:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532380.941081:0:330058:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:0.0:1651532380.941091:0:330058:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 6291456, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x3000
00010000:00010000:0.0:1651532380.941093:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417d02 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.941098:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.941099:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.941100:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417d02 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.941104:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417d02 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532381.260933:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794670 is committed
00002000:00010000:0.0:1651532381.261028:0:330278:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 6291456 -> 8388608
00002000:00010000:0.0:1651532381.261031:0:330278:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 12288 -> 16384
00010000:00010000:0.0:1651532381.261038:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cfb lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.261044:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cfb lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.261079:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cfb lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.261085:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532381.261087:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cfb lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.261088:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005911588d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469145984:12345-10.240.43.64@tcp:4:dd.0 Request processed in 320106us (320164us total) trans 158913794670 rc 0/0
00010000:00010000:1.0:1651532381.261092:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cfb lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.261094:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5941
00010000:00010000:1.0:1651532381.261101:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cfb lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.261104:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417cfb lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532381.295713:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794671 is committed
00002000:00010000:0.0:1651532381.295766:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 6291456 -> 8388608
00002000:00010000:0.0:1651532381.295768:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 12288 -> 16384
00010000:00010000:0.0:1651532381.295772:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417d02 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.295776:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417d02 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.295801:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417d02 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.295815:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001aae7bfe already unused, calling callback (00000000109466a4)
00000100:00100000:0.0:1651532381.295815:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000921d0471 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469146048:12345-10.240.43.64@tcp:4:dd.0 Request processed in 354724us (354749us total) trans 158913794671 rc 0/0
00010000:00010000:1.0:1651532381.295816:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417d02 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.295819:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5942
00010000:00010000:1.0:1651532381.295820:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417d02 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.295826:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417d02 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.295829:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aae7bfe/0xa29a79078f417d02 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.331971:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.331982:0:330058:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469146496
00000100:00100000:0.0:1651532381.332027:0:330058:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5943
00000100:00100000:0.0:1651532381.332030:0:330058:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e61bd8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469146496:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532381.332036:0:330058:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:0.0:1651532381.332049:0:330058:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 8388608, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x4000
00010000:00010000:0.0:1651532381.332051:0:330058:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417d09 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.332057:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.332058:0:330058:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.332060:0:330058:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417d09 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.332065:0:330058:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417d09 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.332238:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.332264:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469146560
00000100:00100000:0.0:1651532381.332279:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5944
00000100:00100000:0.0:1651532381.332281:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008db748c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469146560:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532381.332284:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:0.0:1651532381.332291:0:330278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 8388608, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x4000
00010000:00010000:0.0:1651532381.332293:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417d10 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.332297:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.332298:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.332299:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417d10 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.332302:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417d10 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.332766:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.332894:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.332917:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469147008
00000100:00100000:0.0:1651532381.332930:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469147072
00000100:00100000:0.0:1651532381.332938:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5945
00000100:00100000:0.0:1651532381.332940:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa5e63e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469147008:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532381.332944:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00010000:00010000:0.0:1651532381.332951:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417d17 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.332956:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.332957:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.332958:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417d17 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.332963:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417d17 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.333153:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5946
00000100:00100000:0.0:1651532381.333155:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f304aa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469147072:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532381.333158:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00010000:00010000:0.0:1651532381.333164:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417d1e lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.333168:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.333169:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.333170:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417d1e lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.333173:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417d1e lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.408219:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532381.408233:0:327822:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243776
00000100:00100000:0.0:1651532381.408255:0:327822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 113
00000100:00100000:0.0:1651532381.408258:0:327822:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a7f2c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243776:12345-10.240.43.61@tcp:13:osp-pre-0-0.0
00002000:00000024:0.0:1651532381.408271:0:327822:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 363351744 pending 4292608 free 81159819264 avail 76989108224
00000100:00100000:0.0:1651532381.408294:0:327822:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a7f2c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243776:12345-10.240.43.61@tcp:13:osp-pre-0-0.0 Request processed in 35us (78us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532381.408298:0:327822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 113
00000001:00080000:1.0:1651532381.606820:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794672 is committed
00002000:00010000:0.0:1651532381.606893:0:330058:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 8388608 -> 10485760
00002000:00010000:0.0:1651532381.606895:0:330058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb mtime from disk: 1651532380 -> 1651532381
00002000:00010000:0.0:1651532381.606896:0:330058:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb ctime from disk: 1651532380 -> 1651532381
00002000:00010000:0.0:1651532381.606897:0:330058:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 16384 -> 20480
00010000:00010000:0.0:1651532381.606903:0:330058:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417d09 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.606908:0:330058:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417d09 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606940:0:323265:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417d09 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.606942:0:330058:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e61bd8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754469146496:12345-10.240.43.64@tcp:4:dd.0 Request processed in 274911us (274972us total) trans 158913794672 rc 0/0
00000100:00100000:0.0:1651532381.606947:0:330058:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5943
00010000:00010000:1.0:1651532381.606961:0:323265:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e522113 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532381.606963:0:323265:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417d09 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606968:0:323265:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417d09 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606978:0:323265:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417d09 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606981:0:323265:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e522113/0xa29a79078f417d09 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330058 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532381.649224:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794675 is committed
00002000:00010000:0.0:1651532381.649273:0:330282:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 8388608 -> 10485760
00002000:00010000:0.0:1651532381.649274:0:330282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb mtime from disk: 1651532380 -> 1651532381
00002000:00010000:0.0:1651532381.649275:0:330282:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb ctime from disk: 1651532380 -> 1651532381
00002000:00010000:0.0:1651532381.649276:0:330282:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 16384 -> 20480
00010000:00010000:0.0:1651532381.649280:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417d1e lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.649284:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417d1e lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.649311:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f304aa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469147072:12345-10.240.43.64@tcp:4:dd.0 Request processed in 316154us (316416us total) trans 158913794675 rc 0/0
00010000:00010000:1.0:1651532381.649312:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417d1e lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.649314:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5946
00010000:00010000:1.0:1651532381.649316:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032e8427e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532381.649317:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417d1e lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649321:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417d1e lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649326:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417d1e lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649329:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032e8427e/0xa29a79078f417d1e lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.649343:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417d17 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.649347:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417d17 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.649363:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa5e63e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469147008:12345-10.240.43.64@tcp:4:dd.0 Request processed in 316423us (316598us total) trans 158913794674 rc 0/0
00000100:00100000:0.0:1651532381.649366:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5945
00010000:00010000:1.0:1651532381.649386:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417d17 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.649394:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417d10 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.649397:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417d10 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649401:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ffdbbad6 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532381.649402:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417d17 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649410:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417d17 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649415:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417d17 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649421:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffdbbad6/0xa29a79078f417d17 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649426:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417d10 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649428:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036ef374e already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532381.649429:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417d10 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649432:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417d10 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.649435:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417d10 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.649435:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008db748c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469146560:12345-10.240.43.64@tcp:4:dd.0 Request processed in 317153us (317197us total) trans 158913794673 rc 0/0
00010000:00010000:1.0:1651532381.649438:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036ef374e/0xa29a79078f417d10 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.649439:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5944
00000100:00100000:1.0:1651532381.685977:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.686002:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469147520
00000100:00100000:0.0:1651532381.686022:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5947
00000100:00100000:0.0:1651532381.686025:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000806f35ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469147520:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532381.686030:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:0.0:1651532381.686067:0:330278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 10485760, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x5000
00010000:00010000:0.0:1651532381.686070:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417d25 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.686075:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.686077:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.686079:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417d25 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.686084:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417d25 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.686420:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.686428:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469147584
00000100:00100000:0.0:1651532381.686438:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5948
00000100:00100000:0.0:1651532381.686440:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035583231 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469147584:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532381.686443:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:0.0:1651532381.686449:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 10485760, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x5000
00010000:00010000:0.0:1651532381.686452:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417d2c lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.686456:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.686456:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.686457:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417d2c lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.686464:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417d2c lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532381.916941:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794677 is committed
00002000:00010000:0.0:1651532381.917006:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 10485760 -> 12582912
00002000:00010000:0.0:1651532381.917009:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 20480 -> 24576
00010000:00010000:0.0:1651532381.917015:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417d2c lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.917022:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417d2c lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917051:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417d2c lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917057:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b80df6d8 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532381.917059:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417d2c lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.917068:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035583231 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469147584:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230625us (230646us total) trans 158913794677 rc 0/0
00010000:00010000:1.0:1651532381.917072:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417d2c lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.917073:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5948
00010000:00010000:1.0:1651532381.917082:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417d2c lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917085:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b80df6d8/0xa29a79078f417d2c lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532381.917122:0:330278:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 10485760 -> 12582912
00002000:00010000:0.0:1651532381.917124:0:330278:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 20480 -> 24576
00010000:00010000:0.0:1651532381.917130:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417d25 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.917134:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417d25 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917146:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417d25 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917150:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002ac5e3f4 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532381.917152:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417d25 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917155:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417d25 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.917157:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000806f35ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469147520:12345-10.240.43.64@tcp:4:dd.0 Request processed in 231131us (231181us total) trans 158913794676 rc 0/0
00010000:00010000:1.0:1651532381.917159:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417d25 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.917160:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5947
00010000:00010000:1.0:1651532381.917162:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac5e3f4/0xa29a79078f417d25 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532381.953996:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.954044:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469148032
00000100:00100000:0.0:1651532381.954067:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5949
00000100:00100000:0.0:1651532381.954070:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d5f0d2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469148032:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532381.954075:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:0.0:1651532381.954088:0:330278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 12582912, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x6000
00010000:00010000:0.0:1651532381.954090:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d33 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.954095:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.954096:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.954099:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d33 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.954104:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d33 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.954427:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.954434:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469148096
00000100:00100000:0.0:1651532381.954451:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5950
00000100:00100000:0.0:1651532381.954453:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020c5b4ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469148096:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532381.954456:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:0.0:1651532381.954463:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 12582912, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x6000
00010000:00010000:0.0:1651532381.954465:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417d3a lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.954469:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.954481:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.954482:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417d3a lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.954490:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417d3a lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.955221:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532381.955266:0:330282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469148736
00000100:00100000:1.0:1651532381.955291:0:330282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5951
00000100:00100000:1.0:1651532381.955294:0:330282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008addf01b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469148736:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:1.0:1651532381.955298:0:330282:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00010000:00010000:1.0:1651532381.955306:0:330282:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d41 lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.955312:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.955312:0:330282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.955314:0:330282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d41 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.955319:0:330282:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d41 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532382.263819:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794680 is committed
00002000:00010000:0.0:1651532382.263869:0:330282:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 12582912 -> 14680064
00002000:00010000:0.0:1651532382.263871:0:330282:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 24576 -> 28672
00010000:00010000:0.0:1651532382.263877:0:330282:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d41 lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.263883:0:330282:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d41 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.263911:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d41 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.263918:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532382.263919:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d41 lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.263924:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d41 lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532382.263925:0:330282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008addf01b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469148736:12345-10.240.43.64@tcp:4:dd.0 Request processed in 308629us (308703us total) trans 158913794680 rc 0/0
00000100:00100000:0.0:1651532382.263931:0:330282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5951
00010000:00010000:1.0:1651532382.263934:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d41 lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.263936:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d41 lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330282 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.263960:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417d3a lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.263964:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417d3a lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532382.263982:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020c5b4ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469148096:12345-10.240.43.64@tcp:4:dd.0 Request processed in 309528us (309556us total) trans 158913794679 rc 0/0
00000100:00100000:0.0:1651532382.263985:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5950
00002000:00010000:1.0:1651532382.264001:0:330278:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 12582912 -> 14680064
00002000:00010000:1.0:1651532382.264003:0:330278:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 24576 -> 28672
00010000:00010000:1.0:1651532382.264006:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d33 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.264010:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d33 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.264028:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417d3a lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.264035:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9816573 already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532382.264036:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417d3a lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.264040:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417d3a lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532382.264043:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d5f0d2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469148032:12345-10.240.43.64@tcp:4:dd.0 Request processed in 309972us (310047us total) trans 158913794678 rc 0/0
00010000:00010000:0.0:1651532382.264046:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417d3a lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532382.264047:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5949
00010000:00010000:0.0:1651532382.264049:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9816573/0xa29a79078f417d3a lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.264054:0:328040:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d33 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.264056:0:328040:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:0.0:1651532382.264057:0:328040:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d33 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.264060:0:328040:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d33 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.264063:0:328040:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d33 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.264066:0:328040:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d33 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532382.325972:0:39022:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532382.326002:0:330278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469148928
00000100:00100000:1.0:1651532382.326028:0:330278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5952
00000100:00100000:1.0:1651532382.326031:0:330278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cae7a2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469148928:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:1.0:1651532382.326036:0:330278:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:1.0:1651532382.326048:0:330278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d47:0x0] initial LVB size: 14680064, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x7000
00010000:00010000:1.0:1651532382.326050:0:330278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d48 lrc: 3/0,1 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.326056:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532382.326057:0:330278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532382.326059:0:330278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d48 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.326064:0:330278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d48 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532382.326430:0:39021:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532382.326466:0:330055:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469148992
00000100:00100000:0.0:1651532382.326494:0:330055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5953
00000100:00100000:0.0:1651532382.326496:0:330055:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fa7bfceb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469148992:12345-10.240.43.64@tcp:4:dd.0
00000020:02000000:0.0:1651532382.326500:0:330055:0:(libcfs_fail.h:96:cfs_fail_check_set()) *** cfs_fail_loc=20e, val=0***
00002000:00010000:0.0:1651532382.326508:0:330055:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x34d48:0x0] initial LVB size: 14680064, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x7000
00010000:00010000:0.0:1651532382.326511:0:330055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d4f lrc: 3/0,1 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.326515:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532382.326516:0:330055:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532382.326517:0:330055:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d4f lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.326522:0:330055:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d4f lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532382.557070:0:323241:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0000: transno 158913794682 is committed
00002000:00010000:1.0:1651532382.557134:0:330278:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb size from disk: 14680064 -> 16777216
00002000:00010000:0.0:1651532382.557134:0:330055:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb size from disk: 14680064 -> 16777216
00002000:00010000:1.0:1651532382.557136:0:330278:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb mtime from disk: 1651532381 -> 1651532382
00002000:00010000:0.0:1651532382.557136:0:330055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb mtime from disk: 1651532381 -> 1651532382
00002000:00010000:1.0:1651532382.557137:0:330278:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb ctime from disk: 1651532381 -> 1651532382
00002000:00010000:0.0:1651532382.557137:0:330055:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb ctime from disk: 1651532381 -> 1651532382
00002000:00010000:1.0:1651532382.557138:0:330278:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d47:0x0] updating lvb blocks from disk: 28672 -> 32768
00002000:00010000:0.0:1651532382.557138:0:330055:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x34d48:0x0] updating lvb blocks from disk: 28672 -> 32768
00010000:00010000:1.0:1651532382.557145:0:330278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d48 lrc: 3/0,1 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.557145:0:330055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d4f lrc: 3/0,1 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557151:0:330278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d48 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.557151:0:330055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d4f lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532382.557197:0:330278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cae7a2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469148928:12345-10.240.43.64@tcp:4:dd.0 Request processed in 231163us (231223us total) trans 158913794681 rc 0/0
00000100:00100000:0.0:1651532382.557200:0:330055:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fa7bfceb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469148992:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230702us (230770us total) trans 158913794682 rc 0/0
00000100:00100000:1.0:1651532382.557202:0:330278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5952
00000100:00100000:0.0:1651532382.557205:0:330055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5953
00010000:00010000:1.0:1651532382.557217:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d48 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557221:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6be4665 already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532382.557223:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d48 lrc: 2/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557227:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d48 lrc: 3/0,0 mode: PW/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557237:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d48 lrc: 1/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557240:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6be4665/0xa29a79078f417d48 lrc: 0/0,0 mode: --/PW res: [0x34d47:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330278 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557246:0:323267:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d4f lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557248:0:323267:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000413f87ac already unused, calling callback (00000000109466a4)
00010000:00010000:1.0:1651532382.557249:0:323267:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d4f lrc: 2/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557261:0:323267:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d4f lrc: 3/0,0 mode: PW/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557265:0:323267:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d4f lrc: 1/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557268:0:323267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000413f87ac/0xa29a79078f417d4f lrc: 0/0,0 mode: --/PW res: [0x34d48:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 330055 timeout: 0 lvb_type: 0
00000400:00000080:1.0:1651532382.860649:0:332676:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651532382.860651:0:332676:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_398m: @@@@@@ FAIL: parallel dio write with failure on first stripe succeeded
Debug log: 140656 lines, 140656 kept, 0 dropped, 0 bad.